I just went through this in a 2 car garage. I put fiberglass insulation in the walls. Its fast, cheap, and easy to do. Just wear gloves and long sleeves. I finished the walls with 5/8" plywood and screwed it to the studs. If I have to remove a piece, I can just unscrew it and pull it off.