Any decent multimeter should be able to handle voltage across the ohm setting. The freebe HF meters, no but most anything else yes. You won't get a good reading but it won't damage the meter.
If in doubt always, always use voltage scale. Continuity/ohms/resistance testing you never check if there's power. Even disconnecting the battery is not 100% since there may be a charged capacitor somewhere.
Fuses check on lowest (Rx1) scale. Higher scale readings on anything like if you're checking resistor plug wire resistance you don't want fingers touching probes since skin has resistance and gives false reading.
The older analog and some even newer digital meters on Rx1 scale can produce enough current to actually blow a good fuse under test...but that's typically fuses less than 1/4A (250mA) or so.
The beauty of a test light is this...when using any test equipment test IT first! A test light put across battery, be sure it lights. The light itself is a good thing if it's incandescent because it draws current, not much but 1/4 to 1/2 amp. So...it's possible (and I speak from experience) to have a fuse that's not open...but high resistance. A test light loads circuit a little, it's fast and visual. So light one side fuse... It's bright, other side it's same brightness, fuse is good (99+%). Bright one side, dim the other...bad fuse.
Typically automotive I doubt you'd see a less than 1 amp fuse.
Oh...always ohms scale on any meter you should zero it. Short leads together, reading should be zero ohms. If you can adjust it. If no adjustment, on Rx1 short leads and it reads say 0.5 ohms...not to worry...that's the resistance of the leads.
You measure a wire or fuse and it's 0.8 ohms, subtract the 0.5 lead resistance and you know it's 0.3 ohms (fuse, wire, etc. under test).
Hope this is helpful information.
Sent from my SM-S320VL using Tapatalk