I would say it depends on the subsoil and how much groundwater can collect there due to existing grading/stormwater runoff. I have clay which is rock hard when dry, and like mashed potatoes when wet. Once sealed under the slab & 42" continuous footing around, after several dry weeks, I like to believe its pretty much dry from then-on.
If the ability for the soil to hold mositure and get mushy exists, its a prime opportunity for the gravel base to get smashed into the subsoil. Which would be the reason to pull out the geotex fabric.
My opinion is that its best-practice, but you can still do a good job without it. I would avoid gravel with the fines in it and go for the 3/4" washed stone instead. The superfine dust can setup fast, then fall out of the compacted state over time.