I believe GSConnect uses MPRIS for this type of video control, so with an extension like https://github.com/sakithb/media-controls you should also be able to control playback without having to grab your phone.