Not sure what local laws are, but generally, yes, from what Ive learned, once they are asked on your property, things can go down hill, if they start looking around at other stuff, and asking questions. Im sure others will chime in.
I spent 10 years, as part of my job, dealing with local inspectors, and they can be just as power hungry and corrupt as any politician. They can also be a super pain in the ***, or a real asset (not too often I might add..).
I was witness to a Mayor, a City Manger, the Fire Chief and the Head inspector all of the same city, screaming at each other in my store (that I was building for a client). It was a power struggle, the head inspector was trying to pull rank over the Fire Chief on a fire prevention code. It was a "event" in the making, months or years before I ever laid foot in that town, the show down just happened to happen right in front of me.
Ive also had to go to the state inspector in a conflict with a local electrical inspector, because he wanted it "his way" even though we built it to code and the stamped print. I lost and had to re do it.
Ive alos been "shaken down" buy a building department in the state or Oregon. Inspector gave me a verbal "OK" to occupy, and then fined me $750 when we occupied it because I didnt buy a $75 temp occupancy permit. He didnt mention I needed to do that. It was dishonest and intentional.
Re-habbing the farm and being zoned AG, Ive needed no permits, due to the fact that Im the owner doing all the work. But I do need a permit for a fence and a cattle gate, which I will not apply for until Im completely done with everything, because I dont want to give them any reason to see anything at anytime for any reason. Call me paranoid, and Ive got good reason to be.