Hot air balloons frequently fly over Rancho Santa Fe nearby, as well. Local ordinances are such that most if not all of them are doing so illegally, if I recall correctly, but that still doesn't mean shooting them down would be legal.
Private property owners generally only have airspace rights in so far as "enjoyment". That, is they can shoot fireworks, have balloons, loft their own drones, etc.
Unless a pilot of an aircaft (including balloons, etc) is somehow being intentionally disruptive (e.g., hovering their helicopter over an ex-girlfriend's birthday party), they have a higher obligation to safe flight. And if that means overflying Coral Reef Ranch, Gwendolyn Sontheim Meyer's show ponies are just going to have to deal with it.
