Whenever I attach an enclosure to a pole, I replace any standard hardware (bolts, nuts, etc.) that can be removed with regular hand tools with security-style fasteners.
Will that stop someone who's determined to cause serious damage? Absolutely not. But it does prevent tampering by kids...