If conservatives worried about budget deficits, they would make them smaller. As it happens, budget deficits go up under conservative governments more then under democratic ones.

It just so happen that tax breaks and military cost much more money then what they pretend save.