Pioneer in the Tuning Fork #4 elaborated quite a bit on turntable W/F measurement. They said conventional W/F testing was good to about .05% with a test record. With a specially made lacquer test record that could go down to .02%. Then they came up with an optical measurement system to measure down to much smaller variations.
Yes, but this still has the problems i've described, mainly the use of weighting, and of only 1 frequency as the signal.
On the Pioneer Exclusive... an interesting story that shows how manufacturers intentionally change weighting figures for their own benefit:
The Pioneer Exclusive P3 was specified at 78dB weighted rumble, and the new one (P3a) to an unheard of, unbelievable, unheard-of 95dB! What did they change on the turntable? NOTHING. What happened was described as this:
Sometime in the very early 80s, the EIAJ (Electronics Industry Association of Japan) changed their DIN B measurement methodology
to, according to the marketers, 'better measure what the ear hears'. They changed something to account for the shape of the human ear.
Left largely unannounced, they 'flattened' the weighted curve, and added another filter, which had the effect of raising S/N ratios by 'about 20dB' depending on the piece of equipment being measured."
I asked him whether they measured anything when tables came in to get repaired. He said that in fact they measure all tables according to that newer "DIN B (EIAJ, A-network) standard because that is the machine they have now.
When I asked how much better the P3a measures vs the P3, he said, "They come out the same : non-statistically-significant sample difference".
Source:
http://www.thevintageknob.org/pioneer-Exclusive_P3.html
So it was still called "DIN B weighting" but, in fact, it wasn't the real DIN B weighting... By the way, saying "DIN B (EIAJ, A-network)" is like saying "red color (50% blue, 50% yellow)".
This is a rumble example, but the bottom line is: when comparing flutter figures, we have to at the very least take note of the weighting used, and if that if there were no hidden tricks...