I love my Proslat slat wall. Not exactly cheap though.
Also, Home Depot sells these 4x8 plastic wall panels for around $25 each. They're around 1/16 inches thick. I used them in my laundry room rather than finishing the drywall. Its fast, relatively cheap, and more durable and water...