In use rail gets work hardened.
This might be the issue.
That rail section doesn’t look like used rail, and used rail tends to have had dozens of steel rail wheels along with the tons of train cars and engines riding on those wheels, passing over the rail dozens of times or more a day for years.
After all that time, the steel rail top surface has been flexed and beaten enough that the steel gets an ultra fine molecular structure and becomes much harder.
New rail won’t have this advantage.
If you just need a block of hard steel to use as an anvil, jewelry tool suppliers usually have bench blocks that aren’t that expensive, especially fir the cheaper “import versions”
Alternately, if the piece if anvil you have gets flattened and polished, it should be fine for wacking most soct jewelry mets, as long as it doesn’t get errant hammer hits.
Back when copper and bronze were the metals used for knives etc., hard stone blocks were used as the anvil surface.