I never really had a rule for it but that is almost exactly what I do and it seems to work quite well. There are exceptions however and you will need overlap with all drive sizes.
I mainly use metric so I have 1/4: 4-14 mm, 3/8: 7-19mm and 1/2: 10-27 with other ones like 30,36.
The reason is...