There is a pretty strong bias in the statement "2 + 2 = 4" because math doesn't care about the encoding used to describe a sum. For example, in an alternative society the expression could be written with flipped number symbols, right to left or in a vertical layout. Axioms are also a form of bias.
Axioms would only be a form of bias if they were taken at random. It's not biased to take the axiom that repeatedly holds true in empiric testing, over others that do not.