I don't really care? We also use Location Sharing so Google already knows my family members' locations. And if you ever use Google Maps they know your location too.
For that matter, they also know my credit card number, and supply the internet connection to my house.
There's no chance I'm hiding from Google, so might as well have the cool doorbell.
As a Nest doorbell owner (came with the house), I think it's completely neutral and will never realistically have any import to anyone. I did turn off the facial recognition on mine, but if it could not be turned off, I would still not bother replacing the thing.