I don't know where you got that idea from, but I took an online test for English (which is my native language) vocabulary, and found that I knew about 30000 words. And I wouldn't consider myself to be that unusual.