Ok, I took the dimmer out again, with all three wires separated (black, red, grey) I turned the power back on. Tested the wires, black: hot, red: not hot, grey: not hot. Fliped the switch across the room, Black: not hot, Red: hot, Grey: not hot.
None of the wires in this switch are constant...