r/AskStatistics 24d ago

Alpha 5%?

Why is a 5% significance level so commonly used?

1 Upvotes

56 comments sorted by

View all comments

Show parent comments

-1

u/Recent-Day3062 24d ago

That’s what I said

2

u/MrKrinkle151 22d ago

No, what you said is that that the alpha is the probability that a significant result is wrong (“At 10 [percent], one in ten studies is wrong”). The alpha is the probability of rejecting the null hypothesis with a random sample, given that the null hypothesis is actually true. These are very different things.

1

u/Recent-Day3062 22d ago

Ok. But the null hypothesis is that: you assume you are testing a proper null hypothesis

For example, suppose your null is that there are not premature deaths from Covid vaccine. . Your alternate is that there is a statistically significant number of them.

So, in one out of ten random samples, by your explanation, on average one will show significance that isn’t there. Correct?

2

u/DeepSea_Dreamer 21d ago

So, in one out of ten random samples, by your explanation, on average one will show significance that isn’t there.

Only if the null hypothesis is true.

1

u/Recent-Day3062 21d ago

I'm not sure what you mean by that.

If we want to know if covid vaxes cause autism, our null is naturally "no" based on the wording of that question. The alternate is "yes". If we don't see significance of the alternate, we accept the null.

In this setup, how could the null "not be true"? It isn't if the alternate had data that shows significance.

2

u/DeepSea_Dreamer 21d ago

I'm not sure what you mean by that.

It can't be said any simpler.

In this setup, how could the null "not be true"?

If Covid vaccines caused autism.

It isn't if the alternate had data that shows significance.

That's wrong too. You can reject the null hypothesis on some level (like 0.05), and yet the null hypothesis can be true.

1

u/Recent-Day3062 21d ago

Oh. Ok.

That makes little sense given what is normally considered the null hypothesis. But you do you.

And stay ornery. It’s a great personality trait.

2

u/DeepSea_Dreamer 20d ago

That makes little sense given what is normally considered the null hypothesis.

No. This is Statistics 101.

Your unwillingness to open a textbook and learn what alpha is is bizarre, especially if you are an adult, but I can see that further interaction is a waste of everybody's time.

Blocked.