Seems like the prudent thing to do is to not leave the pump capable of running unless you're out there. I have at one time or another left mine plugged-in and on/energized, and when it leaks-down, it starts. My wife is quick to remind me that it's on, and I get-up and shut it down. (2-car attached garage which is my workshop)
I had a different issue recently, the Campbell-Hausfeld 240V 11 CFM/135 psi 60 gal. upright charged the tank, but when it cut-on to refill the tank, after a bit, the belt started chattering badly. I had replaced the belt awhile ago, and I rarely use the compressor unless I want to sandblast; I use a Porter Cable pancake compressor for airing tires, and air tools like wrenches. Anyway, I asked my friend who owns a new compressor sales and repair shop (30+ years) about it, and he said that if the belt is good, make-sure the belt is tensioned to be taut, w/little free-play in the middle, and the pulleys aligned.
I checked the tension and it looks like it loosened up since I had replaced the belt and had run it a bit. I re-tensioned the belt after checking to see it wasn't worn or glazed, and that seems to have fixed the problem. That's good, as I was counting my pennies about the possibility of replacing it with something of more CFM so I can do longer duty cycles of sandblasting of motorcycle parts. I have a HFT benchtop and a floor model blasting cabinet, it's just me, so I only use 1 at a time.