Patrick Honner published this interesting post about skew dice today:
This part caught my attention:
I asked participants to propose tests for fairness, and then had them perform a test I had decided on ahead of time: roll the die 100 times and report the number of sixes. Before they began, I asked participants to consider how many sixes they would expect, and what numbers of observed sixes might suggest to them that the die was unfair.
The reason it caught my attention is that I went through a similar exercise when we insured Pepsi’s game show “Play for a Billion” back in 2003 and 2004.
The game involved 1,000 contestants selecting a 6-digit number from 000000 to 999999. Each contestant had one guess. Following their guesses, we selected a six digit number by rolling 6 10-sided dice. If any contestant had the number we rolled, a prize of $1,000,000,000 would have been awarded.
It goes without saying that we wanted to be sure that the dice were fair! If they were not fair, the contestants would have had a better shot of guessing the numbers that the dice would roll. Here’s a rough description (that did not make the final cut for the show) of my thought process in selecting the dice – I rolled them 15,000 times:
We were not the only ones to have concerns about the dice, though. Both Pepsi, the TV network, and the show’s auditors wanted to be sure that the dice were fair. So, all the dice that would potentially be used on the show had to pass an additional set of statistical tests designed by the auditors. It took about 5 hours of testing the day before the show to select the 50 dice that would be used on the show (out of about 2,000 dice that I brought). Here’s a short clip showing how we picked the number on the show.
So, a funny coincidence for sure, but figuring out of a set of dice is fair isn’t just a theoretical statistics exercise – in 2003 it was a real exercise I went through for $1,000,000,000 contest!