You really don't know until you test it, though. I've pulled samples I thought would undoubtedly come back hot (black vinyl sheet backing, black tar adhesive, chunks of 1970's 9x9 tile) that were clean.
That said, at some point asbestos was in just about everything you can find in a building...