Do the napkin math on how many of the residents (don't forget children and old people) in your neighborhood bike year round vs. the number who use a car daily. Being on a bike seeing the few other people who bike in the rain is a form of availability bias.
Putting on a pair of snow pants over my jeans and a waterproof shell over my jacket takes... 1 minute? and protects me from basically all our weather.