RCTs vs real world evidence: what the Lancet cannabis meta-analysis misses
#72
Notable Clinical Interest
Emerging findings or policy developments worth monitoring closely.
Clinicians need to understand that randomized controlled trials on cannabinoids involve small sample sizes and may not capture safety and efficacy outcomes in diverse patient populations seen in clinical practice. Real-world evidence can reveal adverse effects, drug interactions, and treatment patterns that RCTs miss, allowing clinicians to better counsel patients about what to expect from cannabis-based treatments. This gap between trial data and clinical reality is critical for informed decision-making when patients ask about cannabis for symptom management.
This commentary critiques a recent Lancet meta-analysis of cannabis research by highlighting a significant methodological gap: the combined sample size of all randomized controlled trials examining cannabinoids is substantially smaller than single real-world evidence studies, yet RCTs remain the basis for clinical guideline development. The author argues that reliance exclusively on RCT data may underestimate both the efficacy and adverse effects of cannabis observed in actual clinical practice, where patient populations are more diverse and treatment conditions less controlled than trial settings. Real-world evidence studies capture effectiveness across varied patient demographics, comorbidities, and concurrent medications that RCTs typically exclude, potentially revealing patterns relevant to routine clinical care. While RCTs provide rigorous efficacy data, their limited sample sizes and narrow inclusion criteria may not fully represent how cannabis performs in heterogeneous patient populations encountered in clinical practice. Clinicians should consider both RCT-derived efficacy data and real-world effectiveness evidence when counseling patients and making prescribing decisions, recognizing that neither study type alone provides a complete picture of cannabis therapeutic utility and safety profile.
“The tension between RCT rigor and real-world generalizability is genuinely important here, but we have to be careful not to use that tension as license to abandon our evidentiary standards. Real-world data can help us understand how treatments perform outside controlled settings, yet it cannot replace the causal clarity that randomized trials provide, and we still need both types of evidence working together before we shift clinical practice.”
💊 The tension between randomized controlled trials and real-world evidence in cannabis research highlights a critical gap in our understanding of cannabinoid efficacy and safety in routine clinical practice. While RCTs provide rigorous internal validity through controlled conditions and standardized dosing, their relatively small sample sizes and highly selected patient populations may not capture the heterogeneity of outcomes seen in actual patient care, where comorbidities, drug interactions, variable product potency, and adherence patterns substantially differ from trial settings. Real-world data offer valuable external validity and statistical power but are susceptible to confounding, selection bias, and unmeasured variables that can obscure causal relationships between cannabis use and clinical outcomes. Rather than viewing these evidence streams as competitive, clinicians should recognize that both contribute necessary but incomplete information: RCT data establish proof of concept and help identify potential harms, while real-world evidence reveals how those effects actually manifest across diverse patient populations.
💬 Join the Conversation
Have a question about how this applies to your situation?
Ask Dr. Caplan →
Want to discuss this topic with other patients and caregivers?
Join the forum discussion →
Have thoughts on this? Share it:

