I don't think comfort would be much of an issue given a slow adjustment period, but structurally it would be ludicrous. You'd be unable to open or close doors. Your walls would have to be built a hundred times stronger than the walls of a normal house. Any breach in the pressure envelope would be a miniature version of Aloha Airlines 243.

This is, by the way, why hard drives have filtered air holes rather than being completely sealed.