Yes, removing the old, improperly installed insulation is the right move, as it's likely trapping moisture in your subfloor and preventing your dehumidifier from effectively drying out the area. You should also get those knee walls insulated, as they're another direct path for humid air to enter...