I used to work for a mining company. Our products had silica in them of varying amounts, up to pure silica. The effects are cumulative as you say. However it never hurts to wear a dust mask or respirator. If you develop silicosis, you basically smother to death.