It was never designed to be a filter - just to keep the bugs out. I've never seen one that dirty - do you have like multiple powered roof vents or is this just a Texas thing?
Yeah, keep them clean. Depending on your construction, clogged soffit vents or improperly installed insulation blocking air flow up through the ridge vent can cause elevated attic temperatures and premature failure of roof shingles.