if the contacts are loose, dirty, corroded, or heavily oxidized the spark will be more significant to the point where it can erode metal on the contacts which then causes a bigger spark, which causes more erosion, etc. If your receptacle is loose (its too easy to pull the plug out) replace it.
best to not plug in things that are already on if it can be avoided.