Which is essentially also why you get more diffraction limited as you stop down the aperture -- a larger and larger fraction of the light that gets through passes near the edges (and gets diffracted) rather than the central area.