I'm surprised that you think the smelling analogy is valid. There is nothing really at stake with letting the aroma from my kitchen waft onto the street aside from maybe what's in the meal I've prepared.
Personal information is a different matter. It's perfectly reasonable to take issue with Google for taking people's data without their knowledge about it.
Personal information becomes public when it's not properly secured and then broadcasted out into the world... even if the user doesn't understand it's happening.
I agree that it's not a perfect analogy, but it is quite a bit closer than being robbed, as the the OP suggested.