I didn't buy it until I figured out the (very convoluted and possible) way to build on it while ag. Because rezoning is a long, expensive process that can trivially be blocked by a single neighbor that doesn't want to rezone with me. I wanted the parcel because it was in what I considered a desirable location for a reasonable price. In my region, finding property is getting very difficult - and unless you want to go super far away from civilization, you don't have so many options.
You are lucky that you can even abuse it that much. My home country seems a bit stricter. My grandparents split their farm between my uncle, aunt and mother, with the later two only inheriting a house. When my mother tried to pass it on to my brother someone noted that it handn't been part of a farm or used to house farmworkers for years and should be torn down. The plot it stood on had to be converted to residential to deal with that surprise.