I just read thru most of this thread, so I'll answer one of your earlier questions; 'am I asking for trouble?'. Yes, you are.
It appears you are trying to skirt the zoning process by playing Mickey the Dunce. Setback requirements can ****, but they're a fact of life and they're put in place...