Whole grains do have anti nutrients, e.g. phytic acid, which can inhibit uptake of some nutrients, but whether that's a problem or not depends heavily on the rest of your diet.