Failure Rate and "Professional Subjects" in Clinical Trials of Major Depressive Disorder
To the Editor: We commend Khin et al1 on a thorough and comprehensive article detailing the declining treatment effect and high failure rate in major depressive disorder (MDD) trials. We wish to highlight an area that we believe is a major factor in the increasing failure rate of studies: the choice of subjects. Specifically, we believe that failure rates are rising due to the increase in "professional subjects," who go from site to site, learning inclusion and exclusion criteria and collecting stipends. Professional subjects are assisted in this by several Web sites.2-4
The changing nature of our subjects as an explanation for the declining treatment effect in central nervous system (CNS) studies has received only minimal attention.5
Factors that may facilitate the effect of professional subjects are many: investigators are loath to "blame the patient" or admit they cannot always detect professional subjects. Pharmaceutical companies and contract research organizations are under time pressures to enroll studies, do not appropriately compensate for prescreening, and have not shared their internal data on duplicate subjects.
In speaking with individual sponsors (who wish to remain anonymous), we were told that the number of duplicate subjects within a protocol is often > 5% of screened subjects. If this statistic were tracked between sponsors, this number would certainly be higher.
The following brief examples may help to highlight the issue.
Example 1. Subject A had just completed visit 8 in a treatment-resistant MDD study. The site was notified by the sponsor that his initials and date of birth were a match to identifiers captured on visit 1 lab reports at 2 other sites participating in the same protocol.
Example 2. A clinical research coordinator who had worked until 6 months ago at a site specializing in early drug development told her new principal investigator that the depressed subject B reading consent for an MDD study in Room 2 had been in at least 1 inpatient schizophrenia study of an investigational antipsychotic at her previous site less than a year ago.
Example 3. A psychiatrist and his spouse work together as investigator and rater at a site doing a repetitive transcranial magnetic resonance imaging (rTMS) study. The rater works separately at a second CNS site about a mile away. She arrived at the second site in the afternoon to find subject C, whom she had just rated that morning at the rTMS site, in the waiting room filling out paperwork. "I didn’ t know you’ d be here too," the subject laughed.
Example 4. Subject D was enrolled in a placebo-controlled study of recurrent MDD. Her total Montgomery-Asberg Depression Rating Scale score was 31 at baseline, but improved to a score of 2 at the end of the study. When the blind was broken, it was revealed that subject D was on placebo. Later, it was discovered that she had previously participated in an anxiety study using a slightly different name and had denied any history of depression.
Raising entrance criteria, while better for the overall outcome of many trials, may allow professional subjects who can report high levels of pathology to have a greater proportional negative effect on study outcome.1
Subject dishonesty in clinical trials, while not new, seems to be on the rise. We contend that this may be due to social changes that have made cheating more acceptable, the downturn in the economy, stipends for study participation, and the rise of the Internet.6
Investigators and sponsors could greatly benefit from knowing when a subject last participated in a study and for what indication. In addition, frequent pharmacokinetic samples would help characterize noncompliant subjects.
Investigators have not worsened over time, suddenly diagnosing and rating poorly; with training, they have become better than ever. It is time to acknowledge that our subject pool has changed—to the detriment of CNS drug development.
References
1. Khin NA, Chen Y-F, Yang Y, et al. Exploratory analyses of efficacy data from major depressive disorder trials submitted to the US Food and Drug Administration in support of new drug applications. J Clin Psychiatry. 2011;72(4):464-472. PubMed doi:10.4088/JCP.10m06191
2. Guinea Pig, Guinea Pig Web site. http://www.gpgp.net. Accessed June 2011.
3. Just Another Lab Rat Web site. http://www.jalr.org/. Accessed June 2011.
4. How to Participate in More Than One Clinical Study. eHow.com Website. http://www.ehow.com/how_7337674_participate-one-clinical-trial.html. Accessed June 2011.
5. Kemp AS, Schooler NR, Kalali AH, et al. What is causing the reduced drug-placebo difference in recent schizophrenia clinical trials and what can be done about it? Schizophr Bull. 2010;36(3):504-509. PubMed doi:10.1093/schbul/sbn110
6. Simmons MS, Nides MA, Rand CS, et al. Unpredictability of deception in compliance with physician-prescribed bronchodilator inhaler use in a clinical trial. Chest. 2000;118(2):290-295. PubMed doi:10.1378/chest.118.2.290
Author affiliations: California Neuroscience Research Medical Group, Inc, Sherman Oaks, California (Dr T. M. Shiovitz, Ms Zarrow, and Mr A. M. Shiovitz); and David Geffen School of Medicine, University of California, Los Angeles (Dr Bystritsky). Potential conflicts of interest: Dr. T. M. Shiovitz has created a company, CTS database, LLC, whose intent is to provide investigators and sponsors with data about subjects’ prior study participation. Funding/support: None reported.
doi:10.4088/JCP.11lr07229
© Copyright 2011 Physicians Postgraduate Press, Inc.
