In my area I am encouraged to talk to local building inspectors for advice.
They actually advertise this on the local radio station.
They stress they would rather stop by and offer free advice and have a safe community.
Would be very helpful to know what is required for your location.
Location makes a huge difference on building requirement because of weather.
Frost line, wind, rain, soil conditions ... your local inspector or building codes would be very helpful for this.
Telling us where you live would help with answers from here.
4' deep poles sounds wrong .... 6" slab is not enough to support a bearing column for a 2nd story, and over kill where not needed. Building living quarters in a pole barn ... sketchy.
I know all of this has been done before and worked.
I live in a very dry/warm climate, West TX. Because of oil industry, there is a abundance of used 3" metal pipe. Everybody uses it for building structures, carports, sheds, pole barns etc.
My house has a carport and probably 30+ years old. At ground level I have one post 50% rotted out. I have to replace it. It is a carport and I can do that.
Metal or wood post in a dry climate will rot out.
Building a pole building, 6" slab, 2nd story, living quarters etc... you wont be able to replace the poles ... your building eventually will need to be torn down.
A proper foundation and it could last forever with maintenance.