What would be the cost for you to self host and serve locally on a network? It's potentially more cost effective to aggregate resources to host "on prem" vs the ongoing SaaS costs.
Yes. I have seen examples of servers for developing countries that host local copies of Wikipedia and other open data sets, as well as an aggressive caching proxy for low bandwidth internet uplinks. Same idea, but local serving of LLM inference.
