Observational study
This article may require copy editing for spelling, grammar, style, cohesion, or tone. (November 2026) |
An observational study is a type of research design in which outcomes are measured to identify patterns or associations without attempts by the investigator to manipulate variables or conditions.[1]
Observational studies are commonly used in fields such as medicine, epidemiology, psychology, sociology,[2] and statistics.
Observational studies are one of two types of clinical study design, which can be either experimental or observational.[3] In an experimental study, particularly a randomized controlled trial (RTC), test subjects are randomly assigned to either a treatment group (who receive the intervention or treatment being studied, i.e. the independent variable) or a control group (who do not), and the researcher compares the outcomes of the two groups. By contrast, in an observational study, the researcher does not determine the assignment of subjects, and there may not be a control group; if there is a control group, assignment of the independent variable is not under the control of the researcher.[1]
Although such studies can be rigorously designed, due of the lack of a random assignment mechanism, observational studies naturally present difficulties for inferential analysis, are susceptible to confounding and bias, and produce a lower quality of evidence than RTCs.[1]
An observational study might be performed if an RCT is unethical, impractical, or outside the control of the investigator. Observational studies are often pragmatic, being designed to show real-world effectiveness without attempting to understand underlying mechanisms. Indeed, regardless of its quality, an observational study cannot, on its own, establish causality.[4][1]
Motivations
[edit]The independent variable may be beyond the control of the investigator for a variety of reasons, for instance:
- Conducting an RCT may violate ethical standards. For instance, in a hypothetical trial seeking to prove that smoking cigarettes causes lung cancer, it would be unethical to randomly assign a group of participants to smoke.[5] (However, observational studies are not automatically free of ethical considerations, and, depending on the study design, may still put participants at risk of harm; for instance they may involve an invasive or high-risk means of collecting data from participants.)[6]
- The researcher may lack control over the situation. Suppose a scientist wants to study the public health effects of a community-wide ban on smoking in public indoor areas. In a controlled experiment, the investigator would randomly pick a set of communities to be in the treatment group. However, it is typically up to each community and/or its legislature to enact a smoking ban. The investigator can be expected to lack the political power to cause precisely those communities in the randomly selected treatment group to pass a smoking ban. In an observational study, the investigator would typically start with a treatment group consisting of those communities where a smoking ban is already in effect.[citation needed]
- A randomized experiment may be impractical. Suppose a researcher wants to study the suspected link between a certain medication and a very rare group of symptoms arising as a side effect. Setting aside any ethical considerations, a randomized experiment may not be practical due to rare outcomes. There may not be a subject pool large enough for the symptoms to be observed in at least one treated subject. An observational study would typically start with a group of symptomatic subjects and work backwards to find those who were given the medication and later developed the symptoms. So the treated group is identified based on symptoms, instead of by random assignment.[citation needed]
- Many randomized controlled trials are not broadly representative of real-world patients and this may not reflect real-world conditions. Patients who are eligible for inclusion in a randomized controlled trial are usually younger, more likely to be male, healthier and more likely to be treated according to recommendations from guidelines.[7] If and when the intervention is later added to routine-care, a large portion of the patients who will receive it may be old with many concomitant diseases and drug-therapies.
Types
[edit]- Case-control study: study originally developed in epidemiology, in which two groups with different outcomes are compared on the basis of some supposed causal attribute.
- Cross-sectional study: involves data collection from a population, or a representative subset, data collected at a single point in time.
- Longitudinal study: correlational research study that involves repeated observations of the same variables over long periods of time. Cohort study and Panel study are particular forms of longitudinal study.
- Target trial emulation: an observational study that tries to emulate a randomized controlled trial.[8][9]
Degree of usefulness and reliability
[edit]"Although observational studies cannot prove cause-and-effect relationships about safety or effectiveness" of a practice, they can:[10]
- provide information on 'real world' use and practice;
- detect signals about the benefits and risks of...[the] use [of practices] in the general population;
- help formulate hypotheses to be tested in subsequent experiments;
- provide part of the community-level data needed to design more informative pragmatic clinical trials; and
- inform clinical practice."[10]
Bias and compensating methods
[edit]This section needs more citations. (August 2021) |
In all of those cases, if a randomized experiment cannot be carried out, the alternative line of investigation suffers from the problem that the decision of which subjects receive the treatment is not entirely random and thus is a potential source of bias. A major challenge in conducting observational studies is to draw inferences that are acceptably free from influences by overt biases, as well as to assess the influence of potential hidden biases. The following are a non-exhaustive set of problems especially common in observational studies.
Matching techniques bias
[edit]In lieu of experimental control, multivariate statistical techniques allow the approximation of experimental control with statistical control by using matching methods. Matching methods account for the influences of observed factors that might influence a cause-and-effect relationship. In healthcare and the social sciences, investigators may use matching to compare units that nonrandomly received the treatment and control. One common approach is to use propensity score matching in order to reduce confounding,[11] although this has recently come under criticism for exacerbating the very problems it seeks to solve.[12]
Multiple comparison bias
[edit]Multiple comparison bias can occur when several hypotheses are tested at the same time. As the number of recorded factors increases, the likelihood increases that at least one of the recorded factors will be highly correlated with the data output simply by chance.[13]
Omitted variable bias
[edit]An observer of an uncontrolled experiment (or process) records potential factors and the data output: the goal is to determine the effects of the factors. Sometimes the recorded factors may not be directly causing the differences in the output. There may be more important factors which were not recorded but are, in fact, causal. Also, recorded or unrecorded factors may be correlated which may yield incorrect conclusions.[14]
Selection bias
[edit]Another difficulty with observational studies is that researchers may themselves be biased in their observational skills. This would allow for researchers to (either consciously or unconsciously) seek out the information they're looking for while conducting their research. For example, researchers may exaggerate the effect of one variable, or downplay the effect of another: researchers may even select in subjects that fit their conclusions. This selection bias can happen at any stage of the research process. This introduces bias into the data where certain variables are systematically incorrectly measured.[15]
Quality
[edit]A 2014 (updated in 2024) Cochrane review concluded that observational studies produce results similar to those conducted as randomized controlled trials.[16] The review reported little evidence for significant effect differences between observational studies and randomized controlled trials, regardless of design.[16] Differences need to be evaluated by looking at population, comparator, heterogeneity, and outcomes.[16]
See also
[edit]References
[edit]- 1 2 3 4 Hess, Dean R. (November 2023). "Observational Studies". Respiratory Care. 68 (11): 1585–1597. doi:10.4187/respcare.11170. ISSN 1943-3654. PMC 10589119. PMID 37339891.
- ↑ Chauhan, Laksheeta; Bunkar, Ramesh; Verma; Mounika, B (2024-11-20). "Observational Research: A Qualitative Research Method". Exploring Narratives: A Guide to Qualitative Research Methods. pp. 55–66. ISBN 978-81-979457-0-0. Retrieved 2026-11-01.
- ↑ Kim, Seonwoo (March 2024). "Overview of clinical study designs". Clinical and Experimental Emergency Medicine. 11 (1): 33–42. doi:10.15441/ceem.23.036. ISSN 2383-4625. PMC 11009715. PMID 37280050.
- ↑ "Health Journalism Glossary: Observational study". Association of Health Care Journalists. Retrieved 2026-11-01.
- ↑ Mariani, Alessandro Wasum; Pêgo-Fernandes, Paulo Manuel (2014). "Observational studies: why are they so important?". Sao Paulo Medical Journal = Revista Paulista De Medicina. 132 (1): 1–2. doi:10.1590/1516-3180.2014.1321784. ISSN 1806-9460. PMC 10889453. PMID 24474072.
- ↑ "10. Ethical features of studies | National Ethics Advisory Committee". neac.health.govt.nz. Retrieved 2026-11-01.
- ↑ Kennedy-Martin T, Curtis S, Faries D, Robinson S, Johnston J (November 2015). "A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results". Trials. 16 (1) 495. doi:10.1186/s13063-015-1023-4. PMC 4632358. PMID 26530985.
- ↑ Hernán, Miguel A.; Dahabreh, Issa J.; Dickerman, Barbra A.; Swanson, Sonja A. (2025). "The Target Trial Framework for Causal Inference From Observational Data: Why and When Is It Helpful?". Annals of Internal Medicine. 178 (3): 402–407. doi:10.7326/ANNALS-24-01871. ISSN 1539-3704. PMC 11936718. PMID 39961105.
- ↑ Cashin, Aidan G.; Hansford, Harrison J.; Hernán, Miguel A.; Swanson, Sonja A.; Lee, Hopin; Jones, Matthew D.; Dahabreh, Issa J.; Dickerman, Barbra A.; Egger, Matthias; Garcia-Albeniz, Xabier; Golub, Robert M.; Islam, Nazrul; Lodi, Sara; Moreno-Betancur, Margarita; Pearson, Sallie-Anne; Schneeweiss, Sebastian; Sharp, Melissa K.; Sterne, Jonathan A. C.; Stuart, Elizabeth A.; McAuley, James H. (2025-09-03). "Transparent Reporting of Observational Studies Emulating a Target Trial-The TARGET Statement". JAMA. 334 (12): 1084–1093. doi:10.1001/jama.2025.13350. ISSN 1538-3598. PMID 40899949.
- 1 2 "Although observational studies cannot provide definitive evidence of safety, efficacy, or effectiveness, they can: 1) provide information on "real world" use and practice; 2) detect signals about the benefits and risks of complementary therapies use in the general population; 3) help formulate hypotheses to be tested in subsequent experiments; 4) provide part of the community-level data needed to design more informative pragmatic clinical trials; and 5) inform clinical practice." "Observational Studies and Secondary Data Analyses To Assess Outcomes in Complementary and Integrative Health Care." Richard Nahin, Ph.D., M.P.H., Senior Advisor for Scientific Coordination and Outreach, National Center for Complementary and Integrative Health, June 25, 2012
- ↑ Rosenbaum, Paul R. 2009. Design of Observational Studies. New York: Springer.
- ↑ King, Gary; Nielsen, Richard (2019-05-07). "Why Propensity Scores Should Not Be Used for Matching". Political Analysis. 27 (4): 435–454. doi:10.1017/pan.2019.11. hdl:1721.1/128459. ISSN 1047-1987. S2CID 53585283. | link to the full article (from the author's homepage
- ↑ Benjamini, Yoav (2010). "Simultaneous and selective inference: Current successes and future challenges". Biometrical Journal. 52 (6): 708–721. doi:10.1002/bimj.200900299. PMID 21154895. S2CID 8806192.
- ↑ "Introductory Econometrics Chapter 18: Omitted Variable Bias". www3.wabash.edu. Retrieved 2022-07-16.
- ↑ Hammer, Gaël P; du Prel, Jean-Baptist; Blettner, Maria (2009-10-01). "Avoiding Bias in Observational Studies". Deutsches Ärzteblatt International. 106 (41): 664–668. doi:10.3238/arztebl.2009.0664. ISSN 1866-0452. PMC 2780010. PMID 19946431.
- 1 2 3 Toews, Ingrid; Anglemyer, Andrew; Nyirenda, John Lz; Alsaid, Dima; Balduzzi, Sara; Grummich, Kathrin; Schwingshackl, Lukas; Bero, Lisa (2024-01-04). "Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials: a meta-epidemiological study". The Cochrane Database of Systematic Reviews. 1 (1): MR000034. doi:10.1002/14651858.MR000034.pub3. ISSN 1469-493X. PMC 10765475. PMID 38174786.
Further reading
[edit]- Rosenbaum PR (2002). Observational Studies (2nd ed.). New York: Springer-Verlag. ISBN 0387989676.
- "NIST/SEMATECH Handbook on Engineering Statistics" at NIST