How big are the gaps and what’s the decking material? Assuming it’s OSB, the panels are gonna need a bit of expansion room, I probably wouldn’t fill them.
That said I think you’re on the right track with putting down some underlayment panels - here’s what Armstrong flooring requires for...