Right, by European standards even if you live in a detached house with a backyard, any location is probably going to be too close, as you probably don't want to be bothered when you eat outside or have people over for a barbecue.
Obviously if you live on a farm, it might be different, especially if you have fruit trees, which should keep them busy.
Around here, they usually set up, high in a tree. You often can’t see the nest, until fall.
Yellowjackets, on the other hand, dig holes; often quite near houses. They are also quite aggressive. You can easily disturb their nests.
Also, I don’t think hornet stings are as venomous as yellowjacket stings (they probably don’t need to be). Being swarmed by yellowjackets really sucks.
Obviously if you live on a farm, it might be different, especially if you have fruit trees, which should keep them busy.