Uber actually does this today if you have the app. You tell it where you want to go, it shows you where the nearest car is and you say "pick me up!" (big green button) and you're done.

What isn't yet done is that when you run the Maps app on the phone and you look for some place nearby, it 'up-sells' you an option to do what the Uber app currently does.