I guess same thing happens as when someone wants to leave Google ecosystem behind.

You give people the new phone number. It's really not that hard (and I'm writing this as an expat using multiple phone numbers :) ).