Finally something I have experience with.
I agree Geo works and can be cheap enough if you are capable and don't need a contractor or permits etc. I guess it all depends on your situation: shop size, available water or excavation equipment.
I am on the West Coast, I rebuilt a house and installed radiant floors it was setup to take a standard boiler or ?? in the garage. When the time came I opted for a Geosource HP. It heated the house all year, we had no electric plenum heaters, but we had a couple decorative gas fire places. We heated a pool in the shoulder seasons as required. The unit also preheated the electric domestic hot water tank, to the point that it would not turn on in active heating season. AC was not deemed a reqd so no cooling coils were installed.
I spent about ~14K in 2004 for the 5T W2W unit and the in-ground field. A contractor installed the pump and field. I believe a boiler\install was about 5-6K at the time.
The install has never required any service work.
I sold and moved on.
In my current shop, 1400sq with 4 bays, 3 bays 10ft ceilings, 1 bay16ft ceiling. It has an old 30ft surface well beside it, which I use as a source of 45deg water. I pump from the old well and dump on the back side of the building where eaves water runs, the gravel base lets some of the water find its way back to the well. Its all about 300yds from a major river so it doesn't seem like the water table changes much, and the ground water tmp varies maybe 2deg.
I bought 7-8 pullout Daikin H20 source heatpumps from a bank reno, 4 year old units $100/T +$50 for each depending on the size. (new heating contractor refused to use old equip) I have a single circ. pump(200W) to feed filtered water to the 2ea 2T ceiling W2A units and I use a wifi staged thermostat to remotely adjust the T when I want to go to work in comfort. It will cool or heat as required, provided the bay doors are closed. I have maybe $1000 installed in that shop. The only thing I dislike is the fan noise, I should get some soft ducting to dampen the noise or install the boxes above the ceiling but Id rather not expose them to freezing rafter temps. I dont really notice the electric cost as I run welders, lathes, mill, compressor etc.