Yep, unless your sticky coating is still sticky. Then the coating will bond like crazy to the tape. Yes, the dust will come off, so will the coating. Following your advice may very well destroy the drivers.
The only method that I've had luck with is picking the loose pieces of dust with...