I would not consider omitting the insulation. Your basement will be comfortable if you insulate it, and won't be as comfortable if you don't. Insulating the outside will make condensation on the inside less likely, and will reduce the likelihood of mold.
What is the year-round average temperature where you are building? That is roughly the temperature your ground will be at, down under the basement floor. If the year-round average temperature is room temperature, you don't have much need for insulation. If you live in a temperate zone, you do need insulation.
Money in the bank can run out. Oil in the tank can run out. Insulation can never run out. Insulate.
Put hard foam board under your footings, under your slab and around your basement walls. Ordinary 10 PSI Dow Styrofoam foam can handle 1,440 pounds per square foot, so don't let your contractor BS you out of putting it under your footer.
Here in Fairbanks, AK, the year round average temperature is about 34F. I used 4" to 10" of blueboard insulation under and around my basement, and I probably should have used more. Your two inches will probably be plenty across most of the Lower 48. Outside of the Florida Keys or Hawaii, no insulation will be a mistake.
Edited to add:
I just went back and read the other replies. There are a lot of comments from people who have no understanding of the topic. How can you tell they don't know what they are talking about? They tell you not to put foam on the outside.