YES!! Do it.
I have 2 basic automotive toolboxes. I have a couple sets of SAE sockets and a set of wrenches that float between them for lawn mower maintenance, which is vehicle maintenance to me. That's it. Our vehicles are nearly all metric now.
I have SAE tools in Kennedy boxes scattered around. These are MUCH smaller sets. I find I don't need the quality or diversity in inch sizes. In my machine shop, I have a single 28" drawer that holds all the sockets, extensions, ratchets and screwdrivers I need. I have a shallow drawer (Kennedy) for wrenches laying flat and another for pliers.
For carpentry, I occasionally need mechanical tools and these are nearly always SAE. What's left of my craftsman stuff is scattered around in hand boxes (need to consolidate).
Point is, the use for SAE isn't what it used to be. The big red toolboxes, typically serving vehicles, now (for me) no longer need to hold SAE sizes, just metric. That gives me more room for the tools I actually need to work on cars.
Said this before, but maybe worth repeating. Like a dinner buffet, I start on the right hand side, pick up a ratchet, then selection extension, then keep moving left, pick up a socket and keep walking. If I had SAE mixed in, I'd need to open 2 drawers to get the socket I need. That SAE would have to buy its way into this drawer.
That one red holder far left is 3/8" SAE hex sockets. The red mechanics time savers magnetic holder (vertical, mid picture) is SAE 3/8" Allens, as is the black holder adjacent to it (1/4" drive). Someday, I'll swap all the holders so the colors match the units.