I am painstakingly removing it with a combination of razor blades, picks, scrapers and screwdrivers. I will get it clean if I have to shower in my kids bathroom for another week -lol.
I was going to start a new thread but I’ll ask here -
Can I just grout this area ? Or does it require silicone ? I’d rather not do this again

.
Once you get the silicone down to a nearly invisible layer, you can apply a silicone remover paste, let it soak in and scrub if off with a brush (toothbrush or better yet, a slightly more aggressive nylon brush) for a residue-free surface. Lots of options on the market:
Kleen Strip Caulk Remover
Dap Caulk-Be-Gone
Goo Gone Caulk Remover
Permatex RTV Silicone Dissolver
etc.
edit: Applying the paste to a thick layer of silicone CAN cause it to lose it's bond and just fall off in chunks, if you're lucky. But it takes a good deal of soaking time and just-right conditions. By pre-scraping down to a minimum layer, you guarantee the remnants will slough off easily.
PCustoms has it. Changes of plane flex too much for grouts, and even epoxy grouts don't stretch significantly (plus epoxy and polyester grouts are DIFFICULT to work with). Silicone isn't the longest lasting adhesive. It tends to lose it's bond (starting at the "toes") within about 10 years. Life-Caulk (polysulfide) has better adhesion and similar stretch, and lasts a lot longer, if you shop in marine stores and want the longest lasting option. It does have a pretty good selection for color matching, but only comes in gloss finishes.
I've had good luck with sanded caulk that matches my grout in color and texture. When dry, you really can't distinguish where the grout meets the caulk, but when wet, my caulk color seems to lighten more than the grout. I get my polymer modified (sealing not required) grout and matching caulk at Old Country Ceramic Tile in Westbury.