Major footnote here that I'm wayyyy out of my wheelhouse on this stuff, so there may be reasons that this doesn't work. I invite correction if that's the case so we can all learn some stuff :)
I'd say that there is always a better option. Can someone point to a case where a gravity battery would definitely be better than all the alternatives?
Pumped hydro is a form of gravity battery. It doesn't have great energy density, but it has fantastic power density and responsiveness. That's where its strength lies. We have also probably already built most of the ones that could possibly be built.
There are 86 large pumped storage sites in the world. It does work, but you need the right geography.
You need two good reservoir sites at considerably different levels close to one another. That's somewhat hard to find.
Major footnote here that I'm wayyyy out of my wheelhouse on this stuff, so there may be reasons that this doesn't work. I invite correction if that's the case so we can all learn some stuff :)