I use security bits quite often, since I do IT and A/V work.
Klein sells a magnetic screwdriver with a set of 1/4" x 1" security bits, and a set of regular bits is also available, but not with a driver for some reason. I can say the bits are good quality, and the driver is one of my favorites. The handle is comfortable and the magnet is very strong. Part Numbers: 32510 for the Driver/security bit set, and 32526 for the regular bits. This will cover most of your needs, but Pentalobe and Pozi-drive bits are noticeably absent, likely because these sets are aimed at electricians.
Again, ifixit is highly recommended. The 112-piece Manta set include a bunch of 1/4" and 4mm bits, and drivers for each size. This company was started by electronics technicians, and the bit selection is based on real-world needs. If I had to start my tool collection over, this would be at the top of the list.
There are a lot of identical 100+ or 200+ bit sets in blow mold cases from various brands. Most of these are rather poor quality, have a lot of duplicates, or missing sizes. They are cheap for a reason. I can't say for certain that there is one complete bit set that will cover everything. More than likely, you will have to get more than one set.
There are downsides to regular insert bits...mainly the length. They are often too short to reach recessed screws, so you still need to get standalone screwdrivers - at least in the most common sizes. Wiha and Wera are the best there is when it comes to precision screwdrivers.