I believe there are 2 versions of that battery. NMH and Li
NMH will show you voltage...but die when there is a load.
Li....if it's done....it's done...there will be no voltage.
I took apart one of my 18v Li batteries....it had standard 18650 cells in it. Their typical voltage is around 3.5 Vdc. So the 18v pack has 5 cells in it. The BMB (battery management board) regulates the current into and out of the pack. When the voltage gets too low, it shuts completely down.
You do NOT want the voltage to drop below 2v. If that happens, the cell is DONE. Nothing you can do to revive it.
Hence....it sounds like you have one of the older NMH packs. Toss it...get one of the newer ones. More capacity...and longer life.
I have 4 of the 4AH packs and 2 of the 2AH packs. I run the dog **** out of them. My mower uses the same batteries. In fact, all of my cordless lawn tools are Ryobi...and use the same batteries.