Reversing the batteries can cause damage to electronics, and may encourage leaking. It's bet to remove them, or in the case of flashlights, you may be able to unscrew the tail-cap enough to prevent contact.
All alkaline batteries will leak, but Duracell and Rayovac are more prone to leakage than Energizer. I've seen Rayovacs leaking while still on the store shelves.
It's rare for NiMH to leak, same with Energizer Lithium batteries. Those are generally better options than alkaline. Good NiMH batteries can hold a charge for a good while, and are generally safe to use. Energizer Lithiums are not rechargeable, but are great for high drain device, and devices that sit for long periods of time without being used.
For things like remote controls, and clocks, use Carbon Zinc batteries. They are great for low drain devices and last a long time, and are less prone leak. Plus they are cheap. You can often find them at dollar stores.