Originally Posted By: Dr.House
Double-blind is a catchy term but most people don't understand the strictness you have to adhere to properly conduct a true, controlled double-blind study. Controlled audio listening test are much more difficult and costly to setup and have many other variables that can introduce bias from both the experimenter and listening panel that almost make it a impossible to adhere to the double-blind standard (compared to the food example).

A true, double-blind listening test IMO you would need all these things.

Expertise: 3rd party (multiple) expert(s) in the field choosing the individual speakers and setting up the listening test and another 3rd party that is an expert in statistics and basic computer statistical analysis like linear regression/ANOVA that can take the data and perform and interpret the significance of the data.

Speaker Shuffler and acoustically transparent curtain:
Adhering to the double-blind standard would be that you control any bias big or small and that would mean having all speakers being played in the exact same position in the room through a speaker shuffler and having the speakers not visible to the listeners.

Large random sample (100+) of people that we nothing about except having their hearing checked to get on the panel. They use their own source material, one at a time in the listening room, taking all the time they want.

The process would be expensive, time consuming and STILL be subject to plenty of error. That said, a controlled single blind test using random listening panels is more than appropriate for testing audio equipment. We are not talking about saving lives here.


Dr. House you are a voice of reason on his forum. Excellent points.

I read the Axiom M3 vs B&W blog here on this site and found it quite disturbing that an Axiom employee (Alan) whom is extremely familiar with the sound participated in an Axiom run speaker comparison and guess what.... he picked the Axiom speakers. Big surprise! Sadly the blog doesn't list the bias that Alan is a trained Axiom listener and knows the sound of his own speakers sighted or blind. Also the blog refers to it as a Double Blind Test when according to your post it clearly is not.

I guess this is how you can declare Axiom speakers in a blind test cannot be beaten and only tied. What a way to never lose a blind test!

But as you said, we aren't saving lives here....

Last edited by JBall; 02/12/11 06:11 PM.