<p><a href="https://stats.stackexchange.com/questions/113602/test-if-two-binomial-distributions-are-statistically-different-from-each-other">This answer</a> should provide a reasonable discussion of how to compare the two results for statistical significance.</p>

<p>We have n1 = n2 = n3 = 158. We have p1 = 128/158, p2 = 67/158, and p3 = 64/168. Just run the hypothesis test on each pair to see if there is a significant shift.</p>

<p>However, there is a bigger issue here. This question should have been answered before you started collecting data. The first thing you should be doing is coming up with your theory to test. Then you design your experiment. And only then should you be collecting the data, unless your goal is just to collect large amounts of data for future theory testing, which does not seem to be the case here (<a href="https://www.reddit.com/r/AcademicProposals/wiki/practices" rel="nofollow noreferrer">Best Research Practices</a>).</p>

CC BY-SA 3.0
2018-02-10T16:26:20.920Z
2018-02-10T16:26:20.920Z
Daniel Goldman
<p>I have run a study on a group of 158 individuals to see if a teaching intervention can change their perceptions of scientists.</p>

<p>Before the intervention, all the children in the study were asked to choose 6 words to describe a scientist. This data collection was repeated at the end of a 5-week intervention, and then again 3 months after the intervention was complete.</p>

<p>I have begun processing the data and have categorised all the words that the children have used. When I look at the data for the cohort I can see that there has been a change in the types of words used to describe scientists (Pre 128 children used one stereotypical word, post this dropped to 67 and 64 in follow-up). </p>

<p>What statistical tests should I use to demonstrate the significance of these changes? All the data is tracked so I have individual data on the change of language use for each participant, I also have data for the group.</p>

CC BY-SA 3.0
2018-02-10T18:45:04.167Z
You do have a control group, don't you?
faustus
CC BY-SA 3.0
2018-02-18T15:21:10.383Z
I'm voting to close this question as off-topic because this question belongs on https://stats.stackexchange.com
Chris Rogers
<statistics>
Calculating statistical significance in behaviour change
llewmihs
# Calculating statistical significance in behaviour change

(Asked by: username_0 on 2018-02-10)

I have run a study on a group of 158 individuals to see if a teaching intervention can change their perceptions of scientists.

Before the intervention, all the children in the study were asked to choose 6 words to describe a scientist. This data collection was repeated at the end of a 5-week intervention, and then again 3 months after the intervention was complete.

I have begun processing the data and have categorised all the words that the children have used. When I look at the data for the cohort I can see that there has been a change in the types of words used to describe scientists (Pre 128 children used one stereotypical word, post this dropped to 67 and 64 in follow-up).

What statistical tests should I use to demonstrate the significance of these changes? All the data is tracked so I have individual data on the change of language use for each participant, I also have data for the group.

**Tags:** statistics

> **Comments:**
> **username_1**: You do have a control group, don't you?  
> **username_2**: I'm voting to close this question as off-topic because this question belongs on https://stats.stackexchange.com  

---

## 1 answers

### Answer by username_3 on 2018-02-10. Score: 1

[This answer](https://stats.stackexchange.com/questions/113602/test-if-two-binomial-distributions-are-statistically-different-from-each-other) should provide a reasonable discussion of how to compare the two results for statistical significance.

We have n1 = n2 = n3 = 158. We have p1 = 128/158, p2 = 67/158, and p3 = 64/168. Just run the hypothesis test on each pair to see if there is a significant shift.

However, there is a bigger issue here. This question should have been answered before you started collecting data. The first thing you should be doing is coming up with your theory to test. Then you design your experiment. And only then should you be collecting the data, unless your goal is just to collect large amounts of data for future theory testing, which does not seem to be the case here ([Best Research Practices](https://www.reddit.com/r/AcademicProposals/wiki/practices)).


---

