I'll check the check valve. I suppose if that's the culprit, I'd never find it with soap/water.
I have not ruled out gauges, pressure regulator, etc as I'm not entirely sure how to test them other than to soak them with soapy water (which I have done, but I'm not sure if that's sufficient).