Yes.
It supposed to be grounded right where the pipe enters the house. Attach it to the ground wire going to the ground rod, not in the breaker box.
Reason why: It's metal. If it were to get energized, you could die by touching it. Another reason would be for lightning portection.
Use one of these: