Where do we draw the line?
Thanks for posting that interesting article. The question is, what to make of it? Did it, as the author claimed, hoist those who demand scientific tests on their own petard? Was the test so deeply flawed that it proved nothing? I encourage you to read the article and come to your own conclusions.
How did this test relate to me or to others here? I highly doubt I'll ever shell out $10,000 for one stereo IC and two 15 foot speaker cables. I'll never own a system where that expense for cables is in line with the rest of the system. If I had a system that might be considered low to mid audiophile, say total system outlay in the $5k to $10k range, I think I'd be far more likely to hear an improvement by taking that $10k and applying it to a speaker and/or amp upgrade.
Can I take those results and interpolate them to less expensive cables, something in the range of the "cheap" QED's they threw into the test? Could I assume, say that the QED's would stand head and shoulders above Monoprice cables or that I could hear differences in the QED's and other cables similarly priced? Personally, I wouldn't use that test to make any assumptions.
I did find a couple of things interesting. One judge scored the "cheap" QED cables first in one test and last in the other. There are two possible explanations. The first is the cables had "synergy" with one system and not the other. The second is that it shows randomness in the response of the judges and that two tests aren't enough. It also shows that there might have been some environmental factors, such as the lunch and the pint or two of bitter they consumed between tests. For me a far more conclusive but impractical test would be to have the same three repeat the test on the same equipment using the same songs over an extended period. If they scored the cables in the same order 45 out of 50 trials, then we could say with some assurance that there is an audible difference between them.
its not some peer reviewed study. Aren't you at least glad they made some effort?
I agree. It's especially bad when you pat yourself on the back and think you've done science.Pretending to do science and using methodology that would not make it in a high school science fair is worse than not trying.
Actuall it's worse than making no effort.
Pretending to do science and using methodology that would not make it in a high school science fair is worse than not trying.
Regardless of their complaining, a proper experiment might take a week or more to run, and longer than that to design and get the design past review.
You would first need to establish that the listeners can, beyond doubt, hear any difference between cables. For that you need a lot of trials, run double blind. enough to generate some convincing statistics.
This isn't a new concept. Experimental psychologists have known about experimental design problems for over a century.
The first round doesn't require any qualitative judgments. Just whether two test runs are the same or different.
Skipping stuff like this and claiming significance with a handful of data points is just junk.
Not to mention, they simply dismissed the implications of outlying data, when that is the most important finding. You can't do that unless you have massive amounts of data.
Why do you need them done? Is it just so you can point fingers at others and call them deluded?
I'm so beyond over you guys that it boggles the mind. You treat what you think are scientific experiments from jokes like the Audio Critic as if it were the word of some deity and anything that disagrees with your preconceived notions of what is 'true' suddenly is worse than the subjectivity you so despise.
Its a &^%^%$ hobby about listening to music and you treat it likes its brain surgery. I read some of these threads and the arguments I get into and think I seriously need to reevaluate the direction my life is going- as in, I need to get one.
What took you so long?
You know, it's summer. You could be sitting at the harbor watching people go by, or riding a bike, or having lunch at a nice out door cafe downtown, rather than endlessly arguing with people who will never change their minds.
Just sayin....
I find it really odd that a hobby that is totally dependent on the products of science and engineering would have so many people opposed to the kinds of research that made audio products possible.
What possible rationale is there for opposing competent research?
This from a person who has admitted to not having been in a hi fi store in years.