Not sure of the size punch you are using but I drill out a small block of a wood 2x2 (1.5"x1.5") the same diameter of the punch and slip it over and stick a rubber o-ring on there so it doesn't slide through. I can then hold the block of wood well below the top of the punch in case of errant swings. Doesn't help if your aim is really off!