You can.....but you also need to check your local code....
If you use the gray PVC...make sure you run a ground wire in the conduit....and try to avoid using Romex....(don't ask why....we don't need another 'Epic' thread on the subject)
If it's considered exposed to physical damage, it's supposed to be sch.80. I've never used it around a shop wall, but I'd bet my inspector would like to see sch. 80. I usually only use pvc for the underground runs to a shop, then stub through the concrete floor with rigid. I use emt around the walls.
I believe both sch 40 and 80 are permitted by the NEC for exposed applications. But if the OP wants to reroute the raceway later, why not use Emt..? The Emt provides a much faster installation and demo since it's all connected with set screws. The PVC is glued and to me would take longer to install. You also gotta mess with that nasty smelling solvent. The PVC would have to be cut up with the demo and you'll waste a lot of material.