You could cast an insulated mono slab (frost protected shallow foundation) and not deal with rocks, and be stacking ICF blocks the next day. Spray a coat of recycled latex paint on the block to stop UV.
Yes, this sound easier than it actually is but, it is easy enough to work with since you are...