Thanks for the replies guys. I am a aware that I can't put anything combustible in the closet, or at least tell the inspector I don't "intend" to put anything combustible in the closet :D.
I would like to avoid building a closet altogether, but the location of the panel makes it difficult to do...