You will want to get as much of the residue off as most mortars dont stick to the glue.I have used Methyl Hydrate for this but the fumes are terrible.I have also used a citrus solution that works well it just takes longer.How bad is the residue?If it is just the residue from the peel and stick...