Check out the articles on reverse geocoding on this site, they will tell you what can and cannot be done (within reason). Doing what you are considering sounds pretty hard to do with acceptable performance.