Just the primary/hub/main site. Mobile clients do not.

If this is a problem with a home connection then you'd want to use a relay. A small 1C CPU box at some cloud provider.

Make that the "hub" that everything connects to and then you don't have to worry about the residential connection changing IPs