Really small kids get balance bikes these days, that come without pedals then at about age 3 or 4 you can go to a bike with pedals and no stabilisers are needed.

At least that's how it is in London for the last few years, while my kid was learning.