I don't know anything about Google's architecture but I would guess that the average Gemini request per search query is < 1, surely there's a lot of caching that can be done and a lot of money to be saved by doing so.