Yes, but not everything. Everything mentioned in the list of GP, yes. However something like GCM or Google Play, no. That's why you decide when you're flashing say LineageOS whether you want GApps yes or no.

I'd also like to note that disabling them does save up space. Not sure its all completely removed though. From memory, it reverts to an old version which was bundled with that Android version. On old phones, such space can be vital. Especially if you don't have microSD or pref not to use it.