I'd just leave it alone, maybe put a foam filler strip like for the windows and doors in there and lay it over. I'm not an expert on concrete, but it seems like it's there so the concrete can expand and contract, hence filling it would make it obsolete. Carpet and pad does do wonders to fill up...