That works when there are only a few thousand satellites, or when you have a very low FOV, but once you have 100k+ satellites or you are doing a sky survey that becomes unfeasible.

This interview goes really in depth on these issues. https://www.youtube.com/watch?v=-0w0dM_e9a8