Back to top Open menu arrow
Download Reprints
Sections
METHODS RESULTS DISCUSSION CONCLUSIONS Clinical Points
The Journal of Clinical Psychiatry The Journal of Clinical Psychiatry

The Journal of
Clinical Psychiatry
Access icon

Meta-Analysis Focus on Suicide February 15, 2022

Ineligibility for and Refusal to Participate in Randomized Controlled Trials That Have Studied Impact on Suicide-Related Outcomes in the United States: A Meta-Analysis

Ryoko Susukida, PhD; Masoumeh Amin-Esmaeili, MD, MPH; Taylor C. Ryan, MS; Hadi Kharrazi, MD, PhD; Renee F. Wilson, MS; Rashelle J. Musci, PhD; Allen Zhang, BS; Lawrence Wissow, MD, MPH; Karen A. Robinson, PhD; Holly C. Wilcox, PhD

J Clin Psychiatry 2022;83(2):20r13798

ABSTRACT

Objective: Ineligibility for and refusal to participate in randomized controlled trials (RCTs) can potentially lead to unrepresentative study samples and limited generalizability of findings. We examined the rates of exclusion and refusal in RCTs that have studied impact on suicide-related outcomes in the US.

Data Sources: PubMed, the Cochrane Library, the Campbell Collaboration Library of Systematic Reviews, CINAHL, PsycINFO, and Education Resources Information Center were searched from January 1990 to May 2020 using the terms (suicide prevention) AND (clinical trial).

Study Selection: Of 8,403 studies retrieved, 36 RCTs assessing effectiveness on suicide-related outcomes in youth (≤ 25 years old) conducted in the US were included.

Data Extraction: Study-level data were extracted by 2 independent investigators for a random-effects meta-analysis and meta-regression.

Results: The study participants (N = 13,264) had a mean (SD) age of 14.87 (1.58) years and were 50% male, 23% African American, and 24% Hispanic. The exclusion rate was 36.4%, while the refusal rate was 25.5%. The exclusion rate was significantly higher in the studies excluding individuals not exceeding specified cutoff points of suicide screening tools (51.2%; adjusted linear coefficient [β] = 1.30, standard error [SE] = 0.15; P = .041) and individuals not meeting the age or school grade criterion (45.9%; β = 1.37, SE = 0.13; P = .005).

Conclusions: The rates of exclusion and refusal in youth prevention interventions studying impact on suicide-related outcomes were not as high compared to the rates found in other mental and behavioral interventions. While there was strong racial/ethnic group representation in RCTs examining youth suicide–related outcomes, suicide severity and age limited eligibility.

Continue Reading...

Did you know members enjoy unlimited free PDF downloads as part of their subscription? Subscribe today for instant access to this article and our entire library in your preferred format. Alternatively, you can purchase the PDF of this article individually.

Subscribe Now

Already a member? Login

Purchase PDF for $40

Members enjoy free PDF downloads on all articles. Join today

  1. Curtin SC. State Suicide Rates Among Adolescents and Young Adults Aged 10–24: United States, 2000–2018. Hyattsville, MD: National Center for Health Statistics; 2020.
  2. Youth Risk Behavior Survey Data (YRBSS). 2019. cdc.gov/yrbs. Accessed October 9, 2020.
  3. Calear AL, Christensen H, Freeman A, et al. A systematic review of psychosocial suicide prevention interventions for youth. Eur Child Adolesc Psychiatry. 2016;25(5):467–482. PubMed CrossRef
  4. Katz C, Bolton SL, Katz LY, et al; Swampy Cree Suicide Prevention Team. A systematic review of school-based suicide prevention programs. Depress Anxiety. 2013;30(10):1030–1045. PubMed CrossRef
  5. Robinson J, Bailey E, Witt K, et al. What works in youth suicide prevention? a systematic review and meta-analysis. EClinicalMedicine. 2018;4-5:52–91. PubMed CrossRef
  6.  Melberg HO, Humphreys K. Ineligibility and refusal to participate in randomised trials of treatments for drug dependence. Drug Alcohol Rev. 2010;29(2):193–201. PubMed CrossRef
  7. Zimmerman M, Clark HL, Multach MD, et al. Have treatment studies of depression become even less generalizable? a review of the inclusion and exclusion criteria used in placebo-controlled antidepressant efficacy trials published during the past 20 years. Mayo Clin Proc. 2015;90(9):1180–1186. PubMed CrossRef
  8. Ronconi JM, Shiner B, Watts BV. Inclusion and exclusion criteria in randomized controlled trials of psychotherapy for PTSD. J Psychiatr Pract. 2014;20(1):25–37. PubMed CrossRef
  9. Moberg CA, Humphreys K. Exclusion criteria in treatment research on alcohol, tobacco and illicit drug use disorders: a review and critical analysis. Drug Alcohol Rev. 2017;36(3):378–388. PubMed CrossRef
  10. Susukida R, Crum RM, Ebnesajjad C, et al. Generalizability of findings from randomized controlled trials: application to the National Institute of Drug Abuse Clinical Trials Network. Addiction. 2017;112(7):1210–1219. PubMed CrossRef
  11. Susukida R, Crum RM, Stuart EA, et al. Assessing sample representativeness in randomized controlled trials: application to the National Institute of Drug Abuse Clinical Trials Network. Addiction. 2016;111(7):1226–1234. PubMed CrossRef
  12. Hoertel N, Le Strat Y, Blanco C, et al. Generalizability of clinical trial results for generalized anxiety disorder to community samples. Depress Anxiety. 2012;29(7):614–620. PubMed CrossRef
  13. Blanco C, Hoertel N, Franco S, et al. Generalizability of clinical trial results for adolescent major depressive disorder. Pediatrics. 2017;140(6):e20161701. PubMed CrossRef
  14. Blanco C, Wall MM, Lindquist MA, et al. Generalizability of neuroimaging studies in 5 common psychiatric disorders based on the National Epidemiologic Survey on Alcohol and Related Conditions (NESARC). J Clin Psychiatry. 2016;77(12):e1618–e1625. PubMed CrossRef
  15. Hoertel N, Le Strat Y, Lavaud P, et al. Generalizability of clinical trial results for bipolar disorder to community samples: findings from the National Epidemiologic Survey on Alcohol and Related Conditions. J Clin Psychiatry. 2013;74(3):265–270. PubMed CrossRef
  16. Covell NH, Frisman LK, Essock SM. Rates of refusal to participate in research studies among men and women. Psychiatr Serv. 2003;54(11):1541–1544. PubMed CrossRef
  17. Woodall A, Morgan C, Sloan C, et al. Barriers to participation in mental health research: are there specific gender, ethnicity and age related barriers? BMC Psychiatry. 2010;10(1):103. PubMed CrossRef
  18. Hom MA, Podlogar MC, Stanley IH, et al. Ethical issues and practical challenges in suicide research. Crisis. 2017;38(2):107–114. PubMed CrossRef
  19. Pearson JL, Stanley B, King CA, et al. Intervention research with persons at high risk for suicidality: safety and ethical considerations. J Clin Psychiatry. 2001;62(suppl 25):17–26. PubMed
  20. King CA, Kramer AC. Intervention research with youths at elevated risk for suicide: meeting the ethical and regulatory challenges of informed consent and assent. Suicide Life Threat Behav. 2008;38(5):486–497. PubMed CrossRef
  21. DeCou CR, Schumann ME. On the iatrogenic risk of assessing suicidality: a meta-analysis. Suicide Life Threat Behav. 2018;48(5):531–543. PubMed CrossRef
  22. O’Mara RM, Hill RM, Cunningham RM, et al. Adolescent and parent attitudes toward screening for suicide risk and mental health problems in the pediatric emergency department. Pediatr Emerg Care. 2012;28(7):626–632. PubMed CrossRef
  23. Wilcox HC, Kharrazi H, Wilson RF, et al. Data linkage strategies to advance youth suicide prevention: a systematic review for a National Institutes of Health Pathways to Prevention Workshop. Ann Intern Med. 2016;165(11):779–785. PubMed CrossRef
  24. Begg C, Cho M, Eastwood S, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996;276(8):637–639. PubMed CrossRef
  25. Plint AC, Moher D, Morrison A, et al. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? a systematic review. Med J Aust. 2006;185(5):263–267. PubMed CrossRef  
  26. United States Census Bureau. 2019 National and state population estimates. USCB website. https://www.census.gov/newsroom/press-kits/2019/national-state-estimates.html. Published 2019. Accessed September 24, 2020.
  27. Substance Abuse and Mental Health Services Administration. Key substance use and mental health indicators in the United States: Results from the 2018 National Survey on Drug Use and Health (HHS Publication No. PEP19-5068, NSDUH Series H-54). Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration; 2019.
  28. Aseltine RH Jr, James A, Schilling EA, et al. Evaluating the SOS suicide prevention program: a replication and extension. BMC Public Health. 2007;7(1):161. PubMed CrossRef
  29. Schilling EA, Lawless M, Buchanan L, et al. “Signs of suicide” shows promise as a middle school suicide prevention program. Suicide Life Threat Behav. 2014;44(6):653–667. PubMed CrossRef
  30. Schilling EA, Aseltine RH Jr, James A. The SOS suicide prevention program: Further evidence of efficacy and effectiveness. Prev Sci. 2016;17(2):157–166. PubMed CrossRef
  31. Wilcox HC, Kellam SG, Brown CH, et al. The impact of two universal randomized first- and second-grade classroom interventions on young adult suicide ideation and attempts. Drug Alcohol Depend. 2008;95(suppl 1):S60–S73. PubMed CrossRef
  32. Connell AM, McKillop HN, Dishion TJ. Long-term effects of the family check-up in early adolescence on risk of suicide in early adulthood. Suicide Life Threat Behav. 2016;46(suppl 1):S15–S22. PubMed CrossRef
  33. Brent D, Emslie G, Clarke G, et al. Switching to another SSRI or to venlafaxine with or without cognitive behavioral therapy for adolescents with SSRI-resistant depression: the TORDIA randomized controlled trial. JAMA. 2008;299(8):901–913. PubMed CrossRef
  34. Brown KJ, Block AJ, RMC Research Corporation. Evaluation of Project Chrysalis: a school-based intervention to reduce negative consequences of abuse. J Early Adolesc. 2001;21(3):325–353. CrossRef
  35. Brown LA, Belli G, Suzuki N, et al. Reduction in suicidal ideation from prolonged exposure therapy for adolescents. J Clin Child Adolesc Psychol. 2020;49(5):651–659. PubMed CrossRef
  36. Eggert LL, Thompson EA, Randell BP, et al. Preliminary effects of brief school-based prevention approaches for reducing youth suicide–risk behaviors, depression, and drug involvement. J Child Adolesc Psychiatr Nurs. 2002;15(2):48–64. PubMed CrossRef
  37. Esposito-Smythers C, Hadley W, Curby TW, et al. Randomized pilot trial of a cognitive-behavioral alcohol, self-harm, and HIV prevention program for teens in mental health treatment. Behav Res Ther. 2017;89:49–56. PubMed CrossRef
  38. Hill RM, Pettit JW. Pilot randomized controlled trial of LEAP: a selective preventive intervention to reduce adolescents’ perceived burdensomeness. J Clin Child Adolesc Psychol. 2019;48(sup 1):S45–S56. PubMed CrossRef
  39. Kaminer Y, Burleson JA, Goldston DB, et al. Suicidal ideation among adolescents with alcohol use disorders during treatment and aftercare. Am J Addict. 2006;15(suppl 1):43–49. PubMed CrossRef
  40. Keeton CP, Caporino NE, Kendall PC, et al. Mood and suicidality outcomes 3–11 years following pediatric anxiety disorder treatment. Depress Anxiety. 2019;36(10):930–940. PubMed CrossRef
  41. Kerr DC, DeGarmo DS, Leve LD, et al. Juvenile justice girls’ depressive symptoms and suicidal ideation 9 years after multidimensional treatment foster care. J Consult Clin Psychol. 2014;82(4):684–693. PubMed CrossRef
  42. King CA, Hill RM, Wynne HA, et al. Adolescent suicide risk screening: the effect of communication about type of follow-up on adolescents’ screening responses. J Clin Child Adolesc Psychol. 2012;41(4):508–515. PubMed CrossRef
  43. King CA, Gipson PY, Horwitz AG, et al. Teen options for change: an intervention for young emergency patients who screen positive for suicide risk. Psychiatr Serv. 2015;66(1):97–100. PubMed CrossRef
  44. March J, Silva S, Petrycki S, et al; Treatment for Adolescents With Depression Study (TADS) Team. Fluoxetine, cognitive-behavioral therapy, and their combination for adolescents with depression: Treatment for Adolescents With Depression Study (TADS) randomized controlled trial. JAMA. 2004;292(7):807–820. PubMed CrossRef
  45. Vidot DC, Huang S, Poma S, et al. Familias Unidas’ crossover effects on suicidal behaviors among Hispanic adolescents: results from an effectiveness trial. Suicide Life Threat Behav. 2016;46(suppl 1):S8–S14. PubMed CrossRef
  46. Weinstein SM, Cruz RA, Isaia AR, et al. Child- and family-focused cognitive behavioral therapy for pediatric bipolar disorder: Applications for suicide prevention. Suicide Life Threat Behav. 2018;48(6):797–811. PubMed CrossRef
  47. Sandler I, Tein JY, Wolchik S, et al. The effects of the family bereavement program to reduce suicide ideation and/or attempts of parentally bereaved children six and fifteen years later. Suicide Life Threat Behav. 2016;46(suppl 1):S32–S38. PubMed CrossRef
  48. Spirito A, Wolff JC, Seaboyer LM, et al. Concurrent treatment for adolescent and parent depressed mood and suicidality: feasibility, acceptability, and preliminary findings. J Child Adolesc Psychopharmacol. 2015;25(2):131–139. PubMed CrossRef
  49. Slesnick N, Zhang J, Feng X, et al. Cognitive therapy for suicide prevention: a randomized pilot with suicidal youth experiencing homelessness. Cognit Ther Res. 2020;44(2):402–411. CrossRef
  50. Grupp-Phelan J, Stevens J, Boyd S, et al. Effect of a motivational interviewing-based intervention on initiation of mental health treatment and mental health after an emergency department visit among suicidal adolescents: a randomized clinical trial. JAMA Netw Open. 2019;2(12):e1917941. PubMed CrossRef
  51. Asarnow JR, Baraff LJ, Berk M, et al. An emergency department intervention for linking pediatric suicidal patients to follow-up mental health treatment. Psychiatr Serv. 2011;62(11):1303–1309. PubMed CrossRef
  52. Asarnow JR, Hughes JL, Babeva KN, et al. Cognitive-behavioral family treatment for suicide attempt prevention: a randomized controlled trial. J Am Acad Child Adolesc Psychiatry. 2017;56(6):506–514. PubMed CrossRef
  53. Bernal G, Rivera-Medina CL, Cumba-Avilés E, et al. Can cognitive-behavioral therapy be optimized with parent psychoeducation? a randomized effectiveness trial of adolescents with major depression in Puerto Rico. Fam Process. 2019;58(4):832–854. PubMed CrossRef
  54. Diamond GS, Wintersteen MB, Brown GK, et al. Attachment-based family therapy for adolescents with suicidal ideation: a randomized controlled trial. J Am Acad Child Adolesc Psychiatry. 2010;49(2):122–131. PubMed
  55. Diamond GS, Kobak RR, Krauthamer Ewing ES, et al. A randomized controlled trial: attachment-based family and nondirective supportive treatments for youth who are suicidal. J Am Acad Child Adolesc Psychiatry. 2019;58(7):721–731. PubMed CrossRef
  56. Hooven C, Walsh E, Pike KC, et al. Promoting CARE: including parents in youth suicide prevention. Fam Community Health. 2012;35(3):225–235. PubMed CrossRef
  57. Huey SJ Jr, Henggeler SW, Rowland MD, et al. Multisystemic therapy effects on attempted suicide by youths presenting psychiatric emergencies. J Am Acad Child Adolesc Psychiatry. 2004;43(2):183–190. PubMed CrossRef
  58. Kennard BD, Goldstein T, Foxwell AA, et al. As Safe as Possible (ASAP): a brief app-supported inpatient intervention to prevent postdischarge suicidal behavior in hospitalized, suicidal adolescents. Am J Psychiatry. 2018;175(9):864–872. PubMed CrossRef
  59. King CA, Kramer A, Preuss L, et al. Youth-Nominated Support Team for Suicidal Adolescents (Version 1): a randomized controlled trial. J Consult Clin Psychol. 2006;74(1):199–206. PubMed CrossRef
  60. King CA, Klaus N, Kramer A, et al. The Youth-Nominated Support Team-Version II for suicidal adolescents: a randomized controlled intervention trial. J Consult Clin Psychol. 2009;77(5):880–893. PubMed CrossRef
  61. Rudd MD, Rajab MH, Orman DT, et al. Effectiveness of an outpatient intervention targeting suicidal young adults: preliminary results. J Consult Clin Psychol. 1996;64(1):179–190. PubMed CrossRef
  62. Thompson EA, Eggert LL, Randell BP, et al. Evaluation of indicated suicide risk prevention approaches for potential high school dropouts. Am J Public Health. 2001;91(5):742–752. PubMed CrossRef
  63. Yen S, Ranney ML, Krek M, et al. Skills to enhance positivity in suicidal adolescents: results from a pilot randomized clinical trial. J Posit Psychol. 2020;15(3):348–361. PubMed CrossRef
  64. Thompson EA, Eggert LL, Herting JR. Mediating effects of an indicated prevention program for reducing youth depression and suicide risk behaviors. Suicide Life Threat Behav. 2000;30(3):252–271. PubMed
  65. Wharff EA, Ginnis KB, Ross AM, et al. Family-based crisis intervention with suicidal adolescents: a randomized clinical trial. Pediatr Emerg Care. 2019;35(3):170–175. PubMed CrossRef
  66. Yen S, Spirito A, Weinstock LM, et al. Coping long term with active suicide in adolescents: results from a pilot randomized controlled trial. Clin Child Psychol Psychiatry. 2019;24(4):847–859. PubMed CrossRef
  67. Esposito-Smythers C, Wolff JC, Liu RT, et al. Family-focused cognitive behavioral treatment for depressed adolescents in suicidal crisis with co-occurring risk factors: a randomized trial. J Child Psychol Psychiatry. 2019;60(10):1133–1141. PubMed CrossRef
  68. McCauley E, Berk MS, Asarnow JR, et al. Efficacy of dialectical behavior therapy for adolescents at high risk for suicide: a randomized clinical trial. JAMA Psychiatry. 2018;75(8):777–785. PubMed CrossRef
  69. Humphreys K, Williams LM. What can treatment research offer general practice? Lancet Psychiatry. 2018;5(4):295–297. PubMed CrossRef
  70. Stuart EA, Bradshaw CP, Leaf PJ. Assessing the generalizability of randomized trial results to target populations. Prev Sci. 2015;16(3):475–485. PubMed CrossRef
  71. The Congressional Black Caucus Emergency Taskforce on Black Youth Suicide and Mental Health. Ring the Alarm: The Crisis of Black Youth Suicide in America. The Congressional Black Caucus. December, 17, 2019.
  72. Ackerman B, Schmid I, Rudolph KE, et al. Implementing statistical methods for generalizing randomized trial findings to a target population. Addict Behav. 2019;94:124–132. PubMed CrossRef
Purchase PDF for $40

Members enjoy free PDF downloads on all articles. Join today

Save Save

Share Share

Cite Cite

Vol 85 • 2024 • Number 3

Read the Current Issue

Editorial

Focus on Women’s Mental Health: Twenty Years and Counting

Original Research

Esmethadone in Patients With Major Depressive Disorder and Inadequate Response to Standard Antidepressants

Commentary

Can Our Collective Experiences As Clinicians Improve Mental Health Care?

Original Research

Prescription Opioid Use Disorder in US Adults Reporting Prescription Opioid Use

Original Research

Symptomatic Disorders Comorbid with Borderline Personality Disorder Over Time

Original Research

Aripiprazole Lauroxil Initiation Regimens
View current Issue

Celebrating
85 Years

Read the Journal of Clinical Psychiatry

Subscribe to read
more articles

Subscribe