To get down to it... UTP CAT5/6/7/whatever, there really isn't a direct electrical connection between ethernet devices. The first component in an ethernet adapter / switch the cable touches is a 1:1 transformer. This is also what allows power over ethernet to work. You can bias the physical wire however you want, but the 1:1 transformer will only pass the differential between TX+/- and RX+/- through to the comm chip.
I wouldn't worry about ground differential between building if your not using shielded cable. Due to lack of planning, I have a ethernet line paralleling a 120V line in about 50 feet of conduit out to my shed to run a raspberry pi and a instance of pi-aware (for flightaware and ADSB tracking). Never had a problem with that ethernet line or voltage issues killing that little Rpi.
I would go with fiber if I could, but long cables already terminated are not *that* cheap as compared to a spool of underground/outdoor rated cat6. The raw fiber cables (6 / 12 strand) spools are cheap enough, and the termination seems rather easy (with the right tools), but fiber termination kits are still prohibitively expensive for the home gamer.