Go, but don't pick a super specialized school. The valuable aspects of college aren't so much in what you learn in the classroom, but in what you learn about life. It is 4 years where you can pretty much dick around and find out what interests you. In my opinion, the social experience is what really makes it. You get to spend those years around a diverse group of people in your own age range who are probably just as lost and confused as you are. This is great for both friendships and more intimate relationships (it really is never as easy as in college).

You can also build awesome things while in college. If you're fairly bright, course work shouldn't consume all of your time. It's all about balance between class, building things on your own, and your social life.

Also, another thing to consider is that if you skip college, you will likely be spending a lot of time with people 6-10 years your senior. This can be both fun, but also quite a drag. This is especially evident when they go out to bars and you have to stay behind (or hope to god that your "alternative" id works).

My university has a drinking song that includes the line "We all came to college, but we didn't come for knowledge, so let's raise hell while we're here." In a lot of ways, this sums up the true value proposition for "wasting" 4 years of your life in the pursuit of finding out who you actually are.