I think that attaching the four uprights at the corners to the joists above would be fine. Not trying to hang any weight from the joists, but keeping the whole unit from racking, twisting, or tipping over.
If you can do that, I don't think it needs to be attached to the wall. Wouldn't hurt...