Good point on the void it would be difficult to seal, and insulate, although I don't see it being too much different from a pole barn.
Also it would be wider than the wall itself, which poses some other slight problems.
But I don't understand what you mean by building on the concrete, I need...