This was happing to me too. What I did was unscrew the tip of the rivet gun and ran the broken shaft through the jaws and squeeze the handle it broke the rivet below the base of the rivet head where it was supose to. You then have to reinsert the the tip to release the shaft from the gun.
I...