It's hard to tell from your pic. If it has the consistency of sand, it's something pushing spoil up out from the seams from underneath as they dig, like ants or termites. If it's like sawdust, it's "frazz" from something chewing on the wood. You name it, carpenter ants, carpenter bees, who knows. Most likely not termites.
Tommy