The problem is millennials having fewer children, not wealthy people having fewer children.

Millennials are historically notable for having both fewer children and less wealth than prior generations at the same age.