For me A Deepness in the Sky is his best, and one of the most memorable novels I've read.

The Peace War is a fascinating exploration of "what if this one thing was possible?" and all its terrible consequences, but Deepness grabbed me much more as a story.