First, you will NEVER have truly ZERO volts difference. More than 50(?) mV and I would be concerned.
Second, some meters are notorious for reading "ghost voltages". What you want is a meter with a low impedance/low-Z setting. You can make you own by placing a resistor of about 3k ohms across the leads.
