All the sources I have checked say it was the mercury vapour inhaled during the felting process. Lead was certainly an issue for painters and has different symptoms to mercury exposure.
Another mercury related factoid, one of the first photographic processes, the daguerreotype, used vaporised...