If your child has learning and attention issues, you might be exploring various treatments and therapies. Promoters of treatments want to convince consumers that their product works. They often cite scientific studies to back up their claims. But how do you know if you can trust the research behind the treatment you’re considering?
You don’t have to be a researcher to know what makes a research study valid—or not. Once you know what questions to ask and what to look for, you can decide for yourself if those research results are legitimate.
Consider the Source
When a product is being developed, its creators may do research to test how effective it is. But good research doesn’t stop there.
Once a treatment is on the market, it may be tested by researchers who have nothing to gain (or lose) from the results of the study. This is called independent, third-party research. It can provide valuable, unbiased research results.
Researchers publish their findings in professional journals. They encourage other researchers to replicate (or repeat) their studies using the same method and conditions. Before a research study can be published in most professional journals, it must be reviewed by other experts (peers) who conduct similar research. Think of this peer review as quality control.
The More the Merrier
The more often a research study is repeated, the more reliable the total results are. And in general, the bigger the sample size (the number of participants in a study), the more reliable the results are.
In some cases, however, a small, well-designed study can produce useful information. An example is if the product being tested is designed for a small group of people, such as people who have two rare health conditions.
Different Research Techniques
There are several different research techniques. Here are some of the most common.
Many studies include two groups: an experimental group of people (who get the treatment) and a control or placebo group (who do not get the treatment). This makes it possible to compare results of those who get the treatment and those who don’t.
In some studies, researchers don’t know if they’re giving participants the treatment being tested or a placebo. Likewise, participants don’t know if they’re getting a placebo or the treatment. This is called a “double-blind” study. This approach keeps researchers and participants from reporting the results they expect or hope for.
Quantitative research is strictly about data, numbers and facts. Qualitative research allows for some individual opinion and subjective reports about how a treatment affects research subjects.
What to Watch Out For
Product promoters can be misleading in the way they cite research. Some make false claims about their product. They may gloss over the details of the research behind the product. Or they sprinkle research-related jargon throughout their advertising to make their product sound legitimate.
Understanding how research works can help you see through the smoke and mirrors. But it can take time to learn to assess how valid a research study is. You may need to read between the lines to dig out the facts. With practice, you’ll learn to spot valid research—and to spot the imposters.