Don't want to be a buzz-kill, but I think there's an issue that's being danced around. It seems the main theme here is, "how can I break the law and not get caught?" That's exactly how a criminal thinks.
I live in an agricultural zoning, but it's almost kind of of a suburban setting. In other words, most of the agricultural activity is more like 'playing' at farming but not full-blown farming or livestock. So I've seen numerous instances where folks have pushed the envelope and have always got flagged for it. My next-door neighbor decided to put in a small pig sty. Of course, it was on a location as far away from his own house it could be (I wonder why), but right up against the fence of his neighbor in the back. Yep, it stank. Screw the neighbor, right? Well, the county got called, and they decided to cite him for every violation they could find on his property. They threw the book at him. He ended up buying a real agricultural 10-acre property in an adjacent town where it was realistically feasible in the eyes of any reasonable person to have the kind of operation he wanted. He left a few cows on the pasture just so he could continue to collect his tax discount (more cheater mentality), and rented out the house.
I think the thing that needs to be considered is why are the specific zone restrictions in place there to begin with? I know in my area, looking at the neighborhood makes it very plain why our zoning restrictions are in place. I suspect if one looked around at the OP's neighborhood, it would be quite apparent why his restrictions exist. The neighbors bought their properties with the understanding of the restrictions, and have every right to expect those restrictions to be maintained and enforced. And no, if someone reports a violation, they're not the bad guy--that's like the criminal blaming the cops for being busted and the judge for sentencing them instead of accepting the responsibility for their own actions. The neighbor isn't the bad guy--the violator is. What a novel idea.
So IMO, the overarching criteria here should not be what you can get away with, but in doing the right thing for everyone concerned. The law probably has not changed since the property was bought, so there's no surprise being sprung on anyone. Obey the law and stop thinking about how to cheat.