The thing with handy boxes is they have no room, most of the time when they are installed they are over filled. I might use one on a rare occasion on a side of the furnace for the service disconnect switch, but most of the time I will even use a 4x4 for that. Here is what I mean by over filling. Say you have a conduit coming into and out of a handy box that is 2 1/8 inch deep. According to the NEC, that box is a 14.5 ci. You can have 6 # 12's of 7 # 14's. The receptacle counts as 2, the grounds count as 1, and say you have a black and white entering and leaving the box which is spliced for that receptacle, that's 4. So that all adds up to 7. If you are running # 12, you would be over filled. # 14 would be ok, but you probably want to run a 20 amp circuit. And if you are putting wire nuts in there, that just adds to the problem. Although the NEC does not deduct for wire nuts. The boxes are just to small.
As far as EMT vs PVC. EMT just looks better. But you need a bender and a little know how, its not hard once you know the math. Lots of videos on YouTube. PVC has its place outside and underground and wet locations. Plus the threads on those PVC box connectors are long and stick in the box farther, that just adds to the handy box problem
These are just my own opinions. Do it the way you feel is the best for you.