I think the holes on the sides of the swivel jaw were used at the factory for setup or locational purposes when machining the swivel jaw. I have read other posts making the same assumption on the Prentiss swivel jaws. Mine were empty, but other posts talk of the holes being filled with lead.
There is a good chance you will be able to hammer the pin out from below. It may require more than gentle taps. This vise pin came out easily. On my Reed 406, I ended up putting pressure on the bottom of the pin with an improvised screw jack and then hammering on the top side of the swivel jaw to get the swivel pin out.
I did replace the washer and the original square headed bolt for the swivel base. The washer was broken into pieces and the original bolt was in poor shape. I faced the head of a grade 5 bolt until the head was below the edge of the swivel base.
The base repair took over 4 hours of machining time and 1 hour of CAD work. This repair would most likely be too expensive if you do not have access to the proper machinery. Most shop rates are $75/hr and up.
After the ear was repaired, the base had a slight rock when placed on a surface plate. I think the base was not flat from the factory and the ear probably broke off when the vise was tightened down to a solid surface. The surface on the top of the swivel base was good, so we flipped it over and used a surface grinder to clean up the mounting side of the swivel base.