I love Marshall & Co., but in my view, none of their results are conclusive or "reach statistical significance" because their sample size is always too small.
I'm sorry, I spent like 5 minutes trying to get this point across without sounding like a smug ******, I know that I have failed at that, so I just kindly ask you to believe me I'm not trying to be an ass **:
That statement is in and of itself entirely wrong and expresses a deep misconception of hypothesis testing and statistical significance.
"Statistical significance" at a certain confidence level (say 95%) always means the same thing, regardless of sample size: There is a less than 5% chance to observe the data at hand under the assumption of the null-hypothesis. This so-called frequentist approach has its very own set of problems (again, the marvelous Randall Munroe kind of nails it
https://xkcd.com/1132/). But it is,
by its very nature, independent of sample size.
Take the experiment we just discussed: 12 out of 26 people made the right guess, which is 46%. Assuming the null hypothesis - that the beers were indeed absolutely indistinguishable - everyone has only a 33% chance to guess the right cup. If we had a sample size of 100 people and 46 out of them would have picked the right cup, this would
absolutely be statistically significant. The low sample size is reflected in the high percentage of correct guesses that we need in order to reach statistical significance.
Now, as I said in the - doubtlessly charming - foreword to this explanation, I do not mean to call you out for "being wrong in the internet" (
https://xkcd.com/386/) or anything of the kind, but I feel like I'm repeating these things more often than I'd like to and I just want to get the point across as clearly as possible, hence the unforgivingly technical tone. I'm actually thinking of putting together a thread with some basic info about this stuff for future reference when somebody tries to turn "we cannot refute the null hypothesis" into "we therefore prove the null hypothesis" (
https://xkcd.com/843/), but I know that'll just bury me even deeper in the rabbit hole of educated *********gery.
I'm sorry, I did not mean to hijack this thread. Please forward all personal insults directly to me, so other people can enjoy their sulphury beer in peace.
Oh, by the way: had quite a bit of sulphur during fermentation of my last three brews using W34/70, in spite of plenty of yeast, yeast nutrient, protein rest, what have you. Turned out great in the end nontheless, so nothing to fret about. Raising the temperature is also unneccessary, it will clean up just fine at low temperatures within just a few days.
** (but I was born that way)