> [...] you could end up without X11 and no way to easily run a browser or google about the problem you had.

You don't need X11 to run a browser. But you are right that it's pretty inconvenient without.