If you use something like a Hansen tray or a socket magnetic rack or keep them in the case like how Grey pneumatic comes.
A little of all three in my home garage.
The first thing I grab is a full-ish VIM rail of 3/8" impact swivels along with 1/2" shallow impact sockets. These live on my cart/tray/stool depending on the job, along with my other commonly used tools. The 1/2 impact wrench usually sits with the quick-flip tire service impacts so I don't need deeps to get wheels off.
I then have a full drawer for metric sockets - way too many to be sure. The ones that will fit live on the Kobalt trays, while some of the axle sockets (some 3/4" drive too) live beside the 1/2 trays. I also have a chrome 3/4 drive metric set that lives in its case and occasionally gets introduced to an impact wrench

.
SAE stuff is mostly split (and neglected) between two smaller drawers on Kobalt trays. I also have a 3/4 SAE impact set that lives in its case (the stuff that needs it doesn't usually fit in the garage

).
I guess it comes down to how much stuff you've got and how you use it. I really like having everything in one drawer where possible, because it lets me see and assess all my options.
Just the other day I needed to get at a 26mm transmission fluid strainer on a Kubota. I didn't have a thin enough socket to fit (in either metric or 1", which ended up fitting after knocking the paint off). If it was a smaller, metric-only size it would have been a quick glance because everything is in the one drawer, but instead I had to dig out several 3/4 drive cases to check them out while also looking back and forth through several drawers to see what would work best. In the end sockets didn't work at all and an old 1" offset box wrench (with the 15/16 end already broken off) plus a 24" cheater pipe solved my problem.
I guess my point is that the simple rail works well, but once that fails all-in-one-drawer is usually the easiest way for me to find the right tool for the job. Once that fails you better hope you kept those broken old wrenches to save your ***!