Nomad,
I don't have much good advice but don't make it any smaller than the 6'x6' you suggested. If you build with 2x4 walls thats 7" less space each direction. Once you get a mower on one side and a couple bikes on the other side, all you have is an isle to get in and out.
I have a garden...