If I send a slow, waddling mobster to go break your kneecaps, are you affected when I give the order or two weeks later when Guido knocks on your door?
Only if gravity moves at the same speed as light, right? It sounds like we've been observing energy emissions (light) rather than directly observing it's gravitational impact on us.