Yes, I agree 100%.
Setbacks are as follows, all from property line which is app. 14' from the curb.
From the bottom of the pic ( South ) 20'
From the right side of the pic ( East ) 10'
From the top of the pic ( North ) 5'
Here is the layout I am thinking will work with the setbacks I have to...