Risk-Taking Propensity as a Predictor of Induction Onto Naltrexone Treatment for Opioid Dependence
ABSTRACT
Objective: Heroin addiction is a chronic relapsing disorder that has devastating social, medical, and economic consequences. Naltrexone is an antagonist that blocks opioid effects and could be an effective medication for the treatment of opioid dependence. However, its clinical utility has been limited partly because of poor adherence and acceptability. Given the importance of compliance to naltrexone treatment for opioid dependence, the goal of the current study was to examine predictors involved in successful induction onto naltrexone treatment.
Method: Parametric and nonparametric statistical tests were performed on data from a sample of 64 individuals entering treatment who met DSM-IV criteria for opioid dependence. The relationship between naltrexone induction (ie, inducted vs not inducted onto naltrexone) and risk-taking propensity, as indexed by riskiness on the Balloon Analogue Risk Task (BART), was examined. Participants were recruited from local detoxification programs, inpatient drug treatment, and other Baltimore programs that provided services to opioid-dependent adults (eg, Baltimore Needle Exchange Program) during the period from August 2007 to September 2008.
Results: Positive association was shown between risk-taking propensity and odds of naltrexone induction. Specifically, each 5-point increase in the total BART score was associated with a 25% decrease in odds of naltrexone induction (OR = 0.76; 95% CI, 0.58-0.99; P = .041). This association remained statistically significant, even after adjusting for potential confounds, including injection drug use and cocaine positive urine results (P = .05). After adjusting for the covariates, each 5-point increase in BART score was associated with 28% decrease in the odds of achieving the maintenance dose (adjusted OR = 0.73; 95% CI, 0.54-0.99; P = .046).
Conclusions: Risk-taking propensity was predictive of induction onto naltrexone treatment, above and beyond injection drug use and cocaine-positive urine samples.
J Clin Psychiatry 2012;73(8):e1056-e1061
© Copyright 2012 Physicians Postgraduate Press, Inc.
Submitted: October 30, 2009; accepted April 6, 2012 (doi:10.4088/JCP.09m05807).
Corresponding author: Will M. Aklin, PhD, National Institute on Drug Abuse, Behavioral and Integrative Treatment Branch, 6001 Executive Blvd, Rm. 3150, MSC 9593, Bethesda, MD 20892-9551 ([email protected]).
Heroin addiction is a chronic relapsing disorder that has devastating social, medical, and economic consequences.1 Naltrexone is an opioid that blocks opioid effects and could be an effective medication for the treatment of opioid dependence.2 However, its clinical utility has been limited partly because of poor adherence and acceptability.3 Perhaps the most difficult obstacle to improving the clinical utility and adherence of naltrexone treatment is initiating naltrexone treatment.4 Several steps and considerations must be taken in order to properly initiate opioid-dependent patients onto naltrexone. Physically dependent patients must first complete opioid detoxification, and remain abstinent before beginning naltrexone. If naltrexone is initiated too soon, there is an increased risk to precipitate the sudden onset of withdrawal symptoms among physically dependent patients. Studies have shown that fewer than 30% of opioid-dependent patients are successfully inducted onto naltrexone treatment.2
Research on naltrexone treatment for opioid-dependent patients aimed at identifying successful predictors of naltrexone outcomes is important, and several important investigations have focused on this issue. For example, lengthening the detoxification period, offering monetary incentives, providing patient education, and psychotherapy have been identified as predictors of positive naltrexone outcomes.5 Additionally, employment at the start of naltrexone treatment and length of naltrexone treatment are considered potent predictors of successful outcomes at 1-month follow-up.6 Although this work is useful for understanding the factors underlying treatment outcomes during and following treatment among successfully detoxified patients, few studies focus on predicting successful induction of naltrexone treatment through the detoxification period.6
With regard to the intersection of impulsivity and treatment outcome, risk-taking propensity may be one potential predictor underlying treatment dropout or adherence and may be related to successful induction onto naltrexone treatment. Traditionally, risk-taking propensity is conceptualized as one’s decision to engage in a particular behavior that balances the probability of unpredictable rewards and punishments.7,8 For example, while drug use produces reinforcing effects, there remain potential but generally unpredictable punishers that may include compulsive drug seeking, withdrawal, adverse health effects, and potential criminal penalties.
One strategy for assessing risk-taking propensity is the Balloon Analogue Risk Task (BART).9 This laboratory-based behavioral task models risk taking in the natural environment in which riskiness to a certain point leads to positive consequences, with further excessive risk taking leading to greater negative consequences that outweigh the positives (ie, changing reward-punishment schedules). Recent studies have shown the BART is linked to a range of risky behaviors in adolescents as well as community and clinical samples of drug use patients.7,10,11 However, no studies have examined performance on the BART and its relationship to treatment outcome. A detailed description of the task is provided in the Method section.
Given the importance of adherence and compliance to naltrexone treatment for opioid dependence, the goal of the current study was to examine the utility of the BART in predicting successful induction onto naltrexone treatment. Heightened levels of risk-taking propensity in this regard is particularly relevant to adherence and compliance, given one’s decision not to induce but instead continue to use heroin (eg, risks involved with continued use, injection use, and unsafe sexual practices). This study was conducted in 64 opioid-dependent adults who were offered induction onto oral naltrexone. All participants completed the BART at the start of the study and were not under the influence of any substances during completion of the task. The current study examined differences in risk-taking propensity between individuals who were "inducted" and were "not inducted" successfully onto oral naltrexone. We hypothesized that BART score would relate significantly to naltrexone induction outcome in that individuals with higher scores would be less likely to have been successfully inducted.
- Behavioral measures to assess risk-taking propensity have considerable promise for opiate-dependent patients who may be candidates for modified or individualized treatment with a focus on decision-making strategies, risk modulation, behavioral control, and treatment adherence.
- To improve the clinical utility and adherence of naltrexone treatment, assessing risk-taking propensity and impulsiveness is especially important during the early stages of treatment.
METHOD
Setting
The study was conducted with participants enrolled in a randomized clinical trial evaluating the extent to which contingent access to paid training in a therapeutic workplace would promote use of naltrexone (an antagonist that blocks the effects of opioids). The study was conducted at the Center for Learning and Health and the Behavioral Pharmacology Research Unit, treatment-research units located at the Johns Hopkins Bayview Medical Center in Baltimore, Maryland.
Recruitment, Screening, and Participant Selection
The Johns Hopkins Institutional Review Board approved this study. Participants were enrolled in this study from August 2007 to September 2008. To recruit participants, research staff members distributed fliers and letters to detoxification programs, recruited from inpatient drug treatment and other Baltimore programs that provided services to opioid-dependent adults (eg, Baltimore Needle Exchange Program), and local Baltimore neighborhoods. Specifically, adults addicted to heroin were encouraged to apply and enroll in a study that provided treatment, job-skills training, monetary vouchers, and medication for their drug problem. Interested individuals first completed an anonymous brief screening interview in which they were asked 8 questions designed to determine quickly if they might be eligible for the study. Brief screening interviews were conducted over the phone or in person at the detoxification program or Center for Learning and Health. Applicants were invited to participate in a full interview if they were 18 years or older, were opioid dependent, were unemployed, were not receiving methadone maintenance treatment, and lived within commuting distance of the therapeutic workplace.
The full-screen interview included urine and breath samples collected under observation that were tested for opioids, cocaine, and methadone; the Composite International Diagnostic Interview-Second Edition,12 a structured interview that provides an assessment of whether participants met DSM criteria for cocaine, opioid, and alcohol dependence; the Addiction Severity Index Lite,13 a structured clinical interview designed to assess psychosocial functioning in 7 areas commonly affected by drug use; the Risk Assessment Battery,14 a 29-item self-report questionnaire that assesses needle-use practices and sexual behaviors associated with human immunodeficiency virus (HIV) transmission (eg, shared injection equipment, been to shooting gallery, been to crack house, traded sex for money or drugs); the Vocational/Educational Assessment,15 a questionnaire designed to gather employment-related information (eg, employment attitudes and experience); the welfare-to-work edition of the Treatment Services Review,16 a structured clinical interview designed to assess information about treatment services that participants had received; information about physical limitations that would limit the participant’s ability to type; a personal contact information form; and the BART,9 a computerized task designed to assess risk-taking propensity. Because the primary variable of interest in the current study involved the behavioral measures of risk-taking propensity as assessed by the BART, the BART is described in detail in the Measure of Risk Propensity section.
Participants were eligible for this study if they were between the ages of 18 and 65 years, met DSM-IV criteria for opioid dependence, reported using heroin at least 21 of the last 30 days while living in the community, were unemployed, were not receiving methadone treatment, and lived within reasonable commuting distance of the therapeutic workplace (eg, all Baltimore City zip codes and several surrounding Baltimore County zip codes). Participants were not eligible for the clinical trial if they had active hallucinations, delusions, or thought disorder or posed a threat to harm themselves or others; they were pregnant or breastfeeding; their serum aminotransferase results were over 3 times normal; the need for opioids to treat an identified medical problem was anticipated; or a physical limitation that would prevent using a keyboard appropriately and acquiring typing skills was present. These criteria helped to maintain sample homogeneity, minimize the impact of potential confounding variables, and ensure patient safety and ability to provide informed consent.
There were 64 participants in the final model. Almost two-thirds of the sample was male. Most had a history of injection drug use and cocaine use. The mean age was around 44 years, and the mean education level was less than high school. The majority of participants were African American (89% African American; remaining participants were white American).
Measure of Risk Propensity
Risk-taking propensity was assessed by using the BART.9 The BART is a computerized task on which participants have the opportunity to win or lose potential earnings, where persistent responding increases gains but also increases the risk of loss in each trial. In the task, a computer screen displays 4 items: a small balloon accompanied by a balloon pump, a reset button labeled "Collect $$$," a "Total Earned" display, and a second display labeled "Last Balloon," which lists the money earned on the last balloon. With each pump, money (5 cents per pump) is accumulated in a temporary bank. When a balloon explodes, all money in the temporary bank is lost, and the next uninflated balloon appears on the screen. The participant can stop pumping the balloon at any time and click the "Collect $$$" button. If the participant clicks the "Collect $$$" button, the amount of money accumulated in the temporary bank is added to the amount in the "Total Earned" display. A new balloon appears after each balloon explosion or money collection until a total of 20 balloons (trials) are completed. Each balloon has the probability to pop between 1 and 128 pumps, with an average breakpoint of 64 pumps. Specific information regarding the balloon breakpoint determination was not provided to participants, who were simply informed that the balloon can break at any time from the first pump to the point at which the balloon has been pumped enough times to fill the screen. After the participants completed the task, they received the amount of money they accumulated in the "Total Earned" display in vouchers that were exchangeable for goods and services (see description of the voucher program in the Therapeutic Workplace section).
Detoxification and Naltrexone Induction
Opioid detoxifications and naltrexone inductions were conducted in community treatment programs at our residential research unit in the Behavioral Pharmacology Research Unit and/or through some combination of community programs and the Behavioral Pharmacology Research Unit. Participants who were recruited from 28-day community inpatient programs and who did not use opioids before beginning our study began naltrexone treatment immediately after discharge. Participants who enrolled without completing a lengthy detoxification in a community treatment (eg, those recruited from the community or those who completed a brief detoxification in the community) were given opioid detoxification services at the Behavioral Pharmacology Research Unit treatment program on an inpatient and/or outpatient basis. Finally, participants were invited to attend the Therapeutic Workplace (see Therapeutic Workplace section for description of procedures) or participate in Therapeutic Workplace procedures via remote computer terminal following the opioid detoxification period. The Therapeutic Workplace participation was used in these cases to motivate patients to stay in treatment and remain abstinent from opioids, both of which were necessary before naltrexone treatment initiation.
Naltrexone induction began after participants underwent opioid detoxification. The naltrexone dose increased until the patient tolerated 50 mg/d, at which point the dosing schedule changed to 100 mg on Mondays and Wednesdays, and 150 mg on Fridays (with some exceptions for holidays, missed days). The maintenance routine was continued until 3 consecutive doses were ingested, after which the induction period ended and oral naltrexone treatment was discontinued. Participants received oral naltrexone for a mean of 1.3 weeks (range, 1-2 weeks) at the workplace. Staff members who conducted BART sessions were not the same individuals facilitating naltrexone induction. The medical and nursing staff who supervised naltrexone induction were blind to BART results. Study participants were not under the influence of any substances during the performance of the BART and were completely detoxified.
Therapeutic Workplace
Based on the tenets of operant conditioning, the Therapeutic Workplace is a novel employment-based intervention that uses wages for work to reinforce clinically important behavior change. Drug abuse patients are hired and paid in a model workplace to promote clinically important behaviors, whereby wages are arranged contingent on both work and the emission of those behaviors. In the current study, the Therapeutic Workplace was used to promote naltrexone pharmacotherapy for the maintenance treatment of primary opioid abusers. Once inducted on naltrexone, participants were required to take scheduled doses of naltrexone to gain and maintain access to the workplace. After naltrexone ingestion, the participant was allowed to work and earn wages that day and on subsequent weekdays until the next scheduled naltrexone dose. While in the workplace, participants could work 4 hours every weekday on computerized typing and keypad training programs and earn $8/h in base pay and about $2/h for performance on the training programs. If an individual missed a naltrexone dose during this phase, the participant was not allowed to work that day and his/her base pay was reset to $1/h. Participants’ base pay increased $1/h for every consecutive day that they worked. All pay was provided in vouchers exchangeable for goods and services. See Silverman et al17 for a detailed description of the Therapeutic Workplace setting and procedures.
While attending the Therapeutic Workplace, participants had thrice weekly urine drug testing and breathalyzer testing. Other standard treatment services were offered to all study participants throughout the study, including drug abuse counseling, case management referrals, smoking cessation, and HIV risk-reduction counseling.
Data Analysis Plan
The analyses were designed to determine if risk propensity as measured on the BART predicted whether or not participants were successfully inducted onto oral naltrexone. The adjusted mean number of pumps on the BART task was used to measure risk propensity. This measure has been used in all BART studies as the primary index of risk-taking propensity and has been associated with impulsivity and risk behavior, including regular smoking, alcohol use, polysubstance use, unsafe sex, infrequent seat belt use, stealing, and gambling (Lejuez et al9). Participants were categorized as successfully inducted onto naltrexone if they received 3 consecutive maintenance doses of naltrexone (ie, 100 mg on Mondays and Wednesdays and 150 mg on Fridays). The analysis sought to determine whether performance on the BART predicted naltrexone induction after we adjusted for sex and other potential confounds.
In the first stage of the data analysis plan, exploratory analyses were conducted by using Pearson correlation coefficients to assess the nature of potential relationships between behavioral and self-reported risk behaviors, urinalysis samples, and induction onto naltrexone treatment. Next, to examine the extent to which scores across behavioral and self-reported measures of risk-taking propensity contributed to naltrexone induction (including relevant covariates), we conducted both unadjusted and adjusted logistic regression analyses. The regressions were adjusted for sex, cocaine-positive urinalysis samples, and injection drug use. Inclusion of both adjusted and unadjusted analyses was to display potential confounds. All P values were 2-tailed, and the statistical significance threshold was set at P < .05.
RESULTS
Preliminary Analyses
Of the original 67 participants included in the study, 3 participants were missing urine results. Because the number of participants with missing values was below 5% of the sample, we chose to drop these 3 cases as we proceeded with the analysis. Therefore, we conducted analyses on 64 participants. Table 1 shows demographic information stratified by naltrexone maintenance dose.
Pearson correlation coefficients were conducted to assess the nature of potential relationships between behavioral and self-reported risk behaviors, urinalysis results, and induction onto naltrexone treatment (Table 2). History of cocaine injection and history of heroin injection were strongly associated with each other (r = 0.513, P < .001). Total BART score was associated with induction onto naltrexone and cocaine-positive urine samples. Figure 1 shows the individual and mean BART scores for individuals successfully inducted onto naltrexone and for those who failed.
No other associations were observed between potential covariates.
BART as Predictor of Naltrexone Induction
To test the hypothesis that high BART scores (indicative of greater risk-taking propensity) would be associated with failure to achieve naltrexone induction, we conducted both adjusted and unadjusted logistic regression analyses, controlling for injection drug use and positive cocaine sample. On the basis of exploratory analysis using Lowess plotting of the BART score and induction onto naltrexone, we elected to fit a model with the BART score as a continuous variable in the subsequent logistic regression model. Table 3 shows the unadjusted odds ratios (ORs) and the adjusted odds ratios (AORs) for each covariate from the logistic regression analysis. The BART scores were divided by 5 to provide a more meaningful interpretation of the ORs. Consistent with our hypothesis, the results evidenced an inverse association between risk-taking propensity and odds of naltrexone induction. Specifically, each 5-point increase in the total BART score was associated with a 25% decrease in odds of naltrexone induction (OR = 0.76; 95% CI, 0.58-0.99; P = .041). This association remained significant even after adjusting for potential confounds, including injection drug use and cocaine-positive urine results (P = .05). After we adjusted for the covariates, each 5-point increase in BART score was associated with 28% decrease in the odds of achieving the maintenance dose (AOR = 0.73; 95% CI, 0.54-0.99; P = .046). No other variables were significantly associated with naltrexone induction. A Hosmer-Lemeshow test indicated the model adequately fit the data (χ28 = 3.50, P = .899). Figure 2 shows the proportion of individuals inducted onto naltrexone based on BART performance.
DISCUSSION
The relationship between risk-taking propensity and induction onto naltrexone treatment for opioid dependence was examined. In line with our hypotheses, risk-taking propensity, as indexed by participants’ BART responses, indicated a significant relationship to naltrexone induction groups (ie, inducted vs not inducted onto naltrexone). Specifically, there was evidence that the task predicted naltrexone induction above and beyond other theoretically relevant risk behaviors (injection drug use and biochemically confirmed cocaine urine samples).
Participants’ propensity to engage in risk taking was assessed through scores on the BART. The findings suggest that the most risk-prone participants were less likely to complete naltrexone induction. Risk-taking propensity might have predicted naltrexone induction given its role on one’s ability to become drug-free. Essentially, participants who were unsuccessfully inducted onto naltrexone may have been more influenced by their heightened level of riskiness and poor decision-making to terminate treatment. Because the success of naltrexone treatment depends largely on the patient’s adherence and compliance to a set regimen, it is plausible that the strong relationship between risk-taking propensity on the BART and naltrexone induction may have worked in concert to increase one’s vulnerability to terminate treatment prematurely. Considering the context of the larger literature on impulsivity and drug abuse treatment, novel measures with the ability to predict patients’ likelihood to succeed during the induction phase of treatment has the potential to improve retention, compliance, and long-term treatment outcomes. In particular, patients with increased levels of risk taking may be prime candidates for longer periods of detoxification and other supportive measures, whereas standard protocols of naltrexone induction may well be adequate for patients with lower levels of risk taking. With a better understanding of risk taking and impulsiveness tendencies among opioid-dependent patients, such findings may provide information on increasing the acceptability of naltrexone treatment.
These findings must be considered in light of the study’s limitations. One limitation of the current study regards the timing of when the BART was administered. For example, is it important to have participants detoxified before or after completing the BART? If participants are detoxified before completing the BART, they may have established an ability to tolerate the physical effects of withdrawal. Therefore, it is plausible that participants with heightened risk-taking propensity who did not persist through the process of detoxification before entering the study were missed. Additionally, would individuals with heightened levels of risk-taking propensity after successful detoxification be less inclined to have become drug-free (ie, inducted onto naltrexone)?
Another important point to consider is the fact that higher BART scores were associated with more voucher earnings for the patients, who, therefore, may be considered as more adaptive in responding to a laboratory measure predicting treatment induction. One interpretation issue that occurs with virtually all BART studies is that participants always have an average number of pumps that is lower than 64 (the point at which earnings are maximized).18 Therefore, in all studies in which BART pumps are related to risk behavior, it is also the case that higher earnings are related to risk behavior. Thus, one could conceptualize the current results as showing that more adaptive responding is related to less treatment induction. Although this interpretation certainly should be considered, it does not obviate the fact that the risk-averse strategy on the BART via fewer pumps was related to treatment induction. Future BART work must consider what the implications of this complex relationship are, but the complication of earnings does not change the relationship between level of risk taking and induction.
Another limitation involves the fact that the current study included a homogeneous sample of inner-city substance abusers from the Baltimore area. Accordingly, there needs to be some caution before making generalizations to other samples. While not necessarily generalizable to all samples of inner-city substance abusers, the current study provides valuable data on a group of substance abusers whose personality characteristics (risk proneness) might allow for the development of targeted treatment opportunities. Future studies should expand these methods to more diverse samples to examine the scope and generalizability of these findings to other substance-abusing groups. In addition to identifying the processes by which risk-taking propensity relates to successful naltrexone induction, it is important to examine what role, if any, risk taking plays in relapse following naltrexone treatment or treatment adherence following successful naltrexone induction.
This study is the first to show the relationship between risk-taking propensity and naltrexone induction in that individuals with higher risk-taking propensity may be difficult to successfully induct onto naltrexone treatment. This propensity is of great public health importance, given the clear relationship that initiating and remaining on treatment have with long-term abstinence. Clinically, these results suggest the potential value of targeting individuals with high levels of risk proneness to receive modified or specialized treatment modules emphasizing effective decision-making skills, risk modulation, behavioral control, and treatment adherence, which may be especially important during the early stages of treatment.
Drug names: methadone (Methadose, Dolophine, and others), naltrexone (Vivitrol, ReVia, and others).
Author affiliations: National Institute on Drug Abuse, Behavioral and Integrative Treatment Branch, Bethesda (Dr Aklin); Departments of Psychiatry and Behavioral Sciences (Drs Aklin, Umbricht, Bigelow, and Silverman) and Medicine (Drs Umbricht and Fingerhood), Johns Hopkins University School of Medicine, Baltimore; Department of Psychology, University of Maryland, College Park (Dr Lejuez), Maryland; and Rocky Mountain Poison and Drug Center, Denver Health and Hospital Authority and Department of Epidemiology, University of Colorado, Denver (Dr Severtson).
Potential conflicts of interest: None of the authors have personal affiliations or financial relationships with any commercial interest to disclose relative to this article.
Funding/support: This research was supported by funding by grants from the National Institute on Drug Abuse to Dr Silverman (R01DA019386; R01DA019497) and Dr Bigelow (T32DA07209).
Disclaimer: This research was conducted while Dr Aklin was affiliated with Johns Hopkins University. Dr Aklin is now at the National Institute on Drug Abuse. The views expressed in this article do not necessarily represent the views of the National Institute on Drug Abuse, the National Institutes of Health, the Department of Health and Human Services, or the US Government.
Acknowledgments: The authors thank Paul Nuzzo, MA (University of Kentucky), for helpful comments on earlier versions of this article; Haley Brown, BA; Megan Duffy, BA; and Jacqueline Hampton (Johns Hopkins University School of Medicine); and Amanda Rodriquez, BA (University of Maryland, Baltimore County), for assistance with data collection. None of the acknowledged individuals have conflicts of interest.
Previous presentation: Portions of this article were presented at the 71st Annual Meeting at The College on Problems of Drug Dependence; June 20-25, 2009; Reno/Sparks, Nevada.
REFERENCES
1. Rawson RA, McCann MJ, Shoptaw SJ, et al. Naltrexone for opioid dependence: evaluation of a manualized psychosocial protocol to enhance treatment response. Drug Alcohol Rev. 2001;20(1):67-78.
2. Tucker TK, Ritter A, Maher C, et al. A randomized control trial of group counseling in a naltrexone treatment program. J Subst Abuse Treat. 2004;27(4):277-288. doi:10.1016/j.jsat.2004.08.003 PubMed
3. Nunes EV, Rothenberg JL, Sullivan MA, et al. Behavioral therapy to augment oral naltrexone for opioid dependence: a ceiling on effectiveness? Am J Drug Alcohol Abuse. 2006;32(4):503-517. doi:10.1080/00952990600918973 PubMed
4. Preston KL, Silverman K, Umbricht A, et al. Improvement in naltrexone treatment compliance with contingency management. Drug Alcohol Depend. 1999;54(2):127-135. doi:10.1016/S0376-8716(98)00152-5 PubMed
5. Greenstein RA, Evans BD, McLellan AT, et al. Predictors of favorable outcome following naltrexone treatment. Drug Alcohol Depend. 1983;12(2):173-180. doi:10.1016/0376-8716(83)90042-X PubMed
6. Sullivan MA, Garawi F, Bisaga A, et al. Management of relapse in naltrexone maintenance for heroin dependence. Drug Alcohol Depend. 2007;91(2-3):289-292. doi:10.1016/j.drugalcdep.2007.06.013 PubMed
7. Aklin WM, Lejuez CW, Zvolensky MJ, et al. Evaluation of behavioral measures of risk taking propensity with inner city adolescents. Behav Res Ther. 2005;43(2):215-228. doi:10.1016/j.brat.2003.12.007 PubMed
8. Leigh BC. Peril, chance, adventure: concepts of risk, alcohol use and risky behavior in young adults. Addiction. 1999;94(3):371-383. doi:10.1046/j.1360-0443.1999.9433717.x PubMed
9. Lejuez CW, Read JP, Kahler CW, et al. Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART). J Exp Psychol Appl. 2002;8(2):75-84. doi:10.1037/1076-898X.8.2.75 PubMed
10. Lejuez CW, Simmons BL, Aklin WM, et al. Risk-taking propensity and risky sexual behavior of individuals in residential substance use treatment. Addict Behav. 2004;29(8):1643-1647. doi:10.1016/j.addbeh.2004.02.035 PubMed
11. Lejuez CW, Bornovalova MA, Daughters SB, et al. Differences in impulsivity and sexual risk behavior among inner-city crack/cocaine users and heroin users. Drug Alcohol Depend. 2005;77(2):169-175. doi:10.1016/j.drugalcdep.2004.08.013 PubMed
12. Kessler RC, Wittchen H-U, Abelson JM, et al. Methodological studies of the Composite International Diagnostic Interview (CIDI) in the US National Comorbidity Survey. Int J Methods Psychiatr Res. 1998;7(1):33-55.i:10.1002/mpr.33</jrn>
13. McLellan AT, Cacciola JS, Zanis D. The Addiction Severity Index-"Lite" (ASI-"Lite"). Philadelphia, PA: Center for the Studies of Addiction, University of Pennsylvania/Philadelphia VA Medical Center; 1997.
14. Navaline HA, Snider EC, Petro CJ, et al. Preparations for AIDS vaccine trials. An automated version of the Risk Assessment Battery (RAB): enhancing the assessment of risk behaviors. AIDS Res Hum Retroviruses. 1994;10(suppl 2):S281-S283. PubMed
15. Zanis DA, Coviello D, Alterman AI, et al. A community-based trial of vocational problem-solving to increase employment among methadone patients. J Subst Abuse Treat. 2001;21(1):19-26. doi:10.1016/S0740-5472(01)00177-5 PubMed
16. McLellan AT, Alterman AI, Cacciola J, et al. A new measure of substance abuse treatment: initial studies of the Treatment Services Review. J Nerv Ment Dis. 1992;180(2):101-110. doi:10.1097/00005053-199202000-00007 PubMed
17. Silverman K, Wong CJ, Needham M, et al. A randomized trial of employment-based reinforcement of cocaine abstinence in injection drug users. J Appl Behav Anal. 2007;40(3):387-410. doi:10.1901/jaba.2007.40-387 PubMed
18. Aklin WM, Tull MT, Kahler CW, et al. Risk-taking propensity changes throughout the course of residential substance abuse treatment. Pers Individ Dif. 2009;46(4):454-459. doi:10.1016/j.paid.2008.11.018 PubMed