I vividly remember my stats professor, back when I took my undergrad degree. He had a nearly unintelligible Croatian accent, barely spoke above a whisper, and liked to write on the overhead with squiggly scribbles as he spoke/whispered. In short, I could hardly understand him, hear him, or read what he was writing, but he instilled in me that statistics are among the most misused metrics out there.
I’ll explain why. It’s easy to say that “a majority of people believe in aliens.” Or that “the average weight of hamsters in Slovenia is 200 grams.” Or “90% of survey respondents agreed that a Provincial Task Force on Walking While Texting” is a good idea. What do these numbers really mean? What constitutes a “majority?” How many hamsters were weighed in Slovenia? Did the researchers take into accounts things like breed, age and sex of the hamsters? Of this “90%” did the researchers consider things like: how many people did you ask? What was the survey return rate? Are the responses liked to other influencing factors? It’s just to easy to use words like “average” or “majority” and not give the context of sample size. It makes a pretty big difference if you asked 10 people in a survey versus 1000. How would you know if those 10 people were representative of the general population?
[Read More]