So all 150 million fans saw that survey.
In my statics class in college it was said a sample size of 1000 would have a 3% margin of error. And thatās speaking about the entire country. So, yes. A was being liberal by saying 5%.
I deal with relative accuracy on a weekly basis at workā¦ it only works if the sampling is correctly representedā¦ people think that the math equation is the only part of that, but it only works when what you are sampling has generally similar representationā¦
Misunderstanding that concept is the first step to bad data.
Stratification in a test market requires either general representative sampling or correction for bias.
Its not just the number of responses that gives you that, its the number of representative data setsā¦
So in this case, you wouldnāt want 478 people from one city or 239 from 2ā¦ you would probably want 15 from the 32 nfl citiesā¦ but then the results arenāt 480 people, its 15 data sets.
A portion of what I do is directly built from the same mathematical theories that drive statistical polling, only instead of just doing half assed math and throwing it out into the public, I have to follow rigid scientific methods as regulated by the governmentā¦
So when I have to verify how accurate a sampling system is, I often cannot simply test a single point over and over or test sporadically in areasā¦ I have to scientifically determine the level of potential stratification, then use a series of logical steps to come up with a representative sample plan.
In some cases, the difference in a test source is going to be statistically negligible and representative sampling could just be one sample point.. but in other cases it could be something much higherā¦
But lets say I sample 48 pointsā¦ thatās mathematically considered 1 data set for relative accuracy purposesā¦ so if i do that 12 times.. that is 576 samples, but each set of 48 is averaged together then counted as 1 when we calculate standard deviation and confidence coefficients.. we donāt use 576 as the number to set the T value, we would use 12ā¦.
A lot of people canāt grasp this conceptā¦ even some professional pollstersā¦ its a personal pet peeve of mine..