This article is freely available to all

Article Abstract

Objective: This study examined whether exposure to the Internet could create a preference for colors associated with visited Web sites and explored the possible relationship with self-reported problematic Internet use and Internet deprivation.

Method: 100 adult participants were divided into 2 groups; one was deprived access to the Internet for 4 hours, and the other was not. After this period, they were asked to choose a color and complete a series of psychometric questionnaires concerning mood (Positive and Negative Affect Schedule), anxiety (Spielberger State-Trait Anxiety Inventory), and depression (Beck Depression Inventory). They were then given a 15-minute exposure to the Internet, and the Web sites they visited were recorded. They were then asked to again choose a color, complete the same psychometric questionnaires, and complete the Internet Addiction Test. The study was conducted between November 2013 and April 2014.

Results: For Internet-deprived, but not nondeprived, subjects, a reduction of mood and increased anxiety was noted in the higher problematic Internet users following Web cessation. There was also a shift toward choosing the color most prominent on the visited Web sites in these participants. No shift in mood, or toward choosing the dominant Web site color, was seen in the lower problem users.

Conclusions: These findings suggest that the Internet can serve as a negative reinforcer for behavior in higher problem users and that the reinforcement obtained from the alleviation of withdrawal symptoms becomes conditioned, with the color and appearance of the visited Web sites giving them a more positive value.

Evidence for an Internet Addiction Disorder:

Internet Exposure Reinforces Color Preference in Withdrawn Problem Users

Vertical divider

ABSTRACT

Objective: This study examined whether exposure to the Internet could create a preference for colors associated with visited Web sites and explored the possible relationship with self-reported problematic Internet use and Internet deprivation.

Method: 100 adult participants were divided into 2 groups; one was deprived access to the Internet for 4 hours, and the other was not. After this period, they were asked to choose a color and complete a series of psychometric questionnaires concerning mood (Positive and Negative Affect Schedule), anxiety (Spielberger State-Trait Anxiety Inventory), and depression (Beck Depression Inventory). They were then given a 15-minute exposure to the Internet, and the Web sites they visited were recorded. They were then asked to again choose a color, complete the same psychometric questionnaires, and complete the Internet Addiction Test. The study was conducted between November 2013 and April 2014.

Results: For Internet-deprived, but not nondeprived, subjects, a reduction of mood and increased anxiety was noted in the higher problematic Internet users following Web cessation. There was also a shift toward choosing the color most prominent on the visited Web sites in these participants. No shift in mood, or toward choosing the dominant Web site color, was seen in the lower problem users.

Conclusions: These findings suggest that the Internet can serve as a negative reinforcer for behavior in higher problem users and that the reinforcement obtained from the alleviation of withdrawal symptoms becomes conditioned, with the color and appearance of the visited Web sites giving them a more positive value.

J Clin Psychiatry 2016;77(2):269-274

dx.doi.org/10.4088/JCP.15m10073

aAbertawe Bro Morgannwg University Health Board, Swansea, United Kingdom

bUniversit×  degli Studi di Milano, Milan, Italy

cSwansea University, Swansea, United Kingdom

*Corresponding author: Phil Reed, DPhil, Department of Psychology, Swansea University, Singleton Park, Swansea, SA2 8PP, UK ([email protected]).

Problematic use of the Internet has been suggested to be a growing problem in many parts of the world,1,2 with between 2% and 20% of the population reporting some level of problematic Internet use.2-4 Such problematic Internet use is manifest by individuals spending long periods each day on the Internet at the expense of other important activities,5,6 resulting in disruptions to their social life,7,8 work and education,9 psychological state,10-12 and physical functioning.13-15 It has been suggested that such problematic use of the Internet might be regarded as an addiction akin to other behavioral addictions such as gambling3,16 and that further investigation into this phenomenon is needed.16

A number of reports have explored the degree to which “Internet withdrawal” effects can be seen in those who report high levels of problematic Internet use when they cease using the Internet.12,17 High problem Internet users experience negative mood swings on cessation of an Internet session,12 and a prolonged absence from the Internet leads to increased levels of anxiety in these individuals,17 suggesting that psychological Internet withdrawal effects may occur in high problem users. The current experiment explored the phenomenon of Internet addiction and withdrawal further by examining whether exposure to the Internet can establish preferences for aspects of the Web sites visited in those sessions, such as their color, as has been noted for many addictive substances.18-20 If Internet addiction follows the same pattern as other addictions,18 then when an individual suffering from an addiction is given access to the target of that addiction, aspects of the situation associated with the presence of that target become positively valued.

Experiments have established that rats will show a preference for the place associated with the administration of heroin or cocaine18 and that humans will show a preference for a color associated with a caffeine drink.19,21 However, these caffeine-conditioning effects are noted only if participants are in a state of caffeine withdrawal—that is, if they have been deprived access to caffeine for some time.19,20 This suggests that caffeine dependence and withdrawal are potent factors in the establishment of reinforcement by caffeine in humans; the positive feelings associated with the alleviation of the withdrawal symptoms condition to aspects of the situation/stimulus that produced alleviation of the withdrawal symptoms.19,20 The current experiment sought to use a procedure based on these caffeine-conditioning experiments to explore whether a period of Internet deprivation (withdrawal) would produce similar effects in terms of color preferences that might be established as a result of exposure to the Internet. Again, this would establish the similarity of the characteristics of problematic Internet and other addictions and investigate the strength of the concept of an Internet addiction.

To this end, following a period in which the participants were either denied access to or could access the Internet, they completed series of psychometric tests in order to establish their mood, and they were also asked to choose a color. Following a subsequent session on the Internet, they were asked to choose a color and complete the psychological tests again, as well as complete the Internet Addiction Test. If individuals reporting high problem use of the Internet display behaviors indicative of a behavioral addiction, then it might be expected that they would show a negative mood swing and increased anxiety following exposure to the Internet.12,17 It was also hypothesized that if Internet addiction were similar to other addictions, then individuals with high levels of self-reported Internet problems would show a shift in preference to the color most associated with the Web sites that they had visited during their exposure to the Internet. This would suggest that exposure to the Internet had produced a positive association with the characteristics of the Web sites visited. Again, if problematic Internet use is similar to a behavioral addiction, then any such effect should be most readily manifest in the Internet-deprived individuals.

clinical points
  • The nature of “Internet addiction disorder” is not well understood, and the current report attempted to assess whether those scoring high on a self-report measure of problematic Internet use displayed similar reactions to the object of their addiction to those with substance abuse problems.
  • The results demonstrated that the cues associated with Internet exposure may gain hedonic status in withdrawn heavy Internet users in a similar way as they do for substance abusers.
  • The findings suggest that individuals scoring highly on psychometric measures of problem Internet use should be considered similarly to those with other addiction problems.

METHOD

Participants

One hundred participants (61 females and 39 males) were recruited in a psychology department of a university in the United Kingdom. All participants were students and were volunteers—none received any form of compensation for their participation. The participants had a mean age of 22.47 years (± 2.98; range, 18-30), and none reported any history of psychiatric problems or addictions. The study was granted ethics permission from the Department of Psychology Ethics Board, Swansea University.

Typical Internet Use

Participants were asked about their average Internet use by asking them to estimate the number of hours per day that they had spent on the Internet over the last 2 months; this measure is commonly taken in studies of problematic Internet use.14,22 The mean number of hours per day of Internet use reported was 5.73 (± 3.73, range, 0.33-16): 31% reported spending between 0 and 3 hours per day online, 36% reported spending between 3 to 6 hours per day online, and 33% reported spending more than 6 hours per day online. For females, this was 5.19 hours (± 3.45; range, 0.33-16), and for males, this was 6.58 hours (± 3.93; range, 0.5-16). An independent group t test revealed that this difference was not statistically significant (t98 = 1.83, P > .08, d = 0.38).

The participants reported accessing the Internet a mean of 10.35 times per day (± 15.28; range, 1-100); 56% reported accessing the Internet up to 5 times per day, 34% reported accessing the Internet between 6 and 10 times per day, and 20% reported accessing the Internet more than 10 times per day. The Internet was accessed by females a mean of 11.71 times per day (± 17.73; range, 1-100) and by males, 10.41 times per day (± 9.83; range, 1-50); this difference was not statistically significant (t98 = 0.42, P > .60, d=0.10).

Materials

Internet Addiction Test. The Internet Addiction Test (IAT)23 is a 20-item scale covering the degree to which Internet use disrupts everyday life. The overall score ranges from 20 to 100. The factor structure of the IAT is currently debated,22,24 but a cutoff score of 40 or more for the total IAT score is taken as representing some level of problematic Internet usage.5,12,23 The internal reliability of the scale has been found to be between 0.905 and 0.932 (calculated as 0.91 for the current sample). The scale also has good concurrent validity with other measures of disruptive Internet use.22

Positive and Negative Affect Schedule. The Positive and Negative Affect Schedule (PANAS)25 is a 20-item questionnaire designed to measure participants’ positive and negative moods. The total scores can range from 10 to 50. The internal reliability of both the positive and negative scales is 0.9025 (calculated as 0.84 for the current sample). The scale also correlates well with other measures of mood such as the Hospital Anxiety and Depression Scales.26

Spielberger State-Trait Anxiety Inventory. The Spielberger State-Trait Anxiety Inventory (STAI)27 rates the affective, cognitive, and physiological manifestations of anxiety in terms of long-standing patterns (trait anxiety) and current anxiety (state), but only the latter was used for this study. The total score for each scale ranges from 20 to 80. The internal reliability of the scale is 0.9327 (calculated as 0.82 for the current sample). There is strong evidence regarding its validity.27

Beck Depression Inventory. The Beck Depression Inventory (BDI)28 is a 21-item questionnaire that assesses the clinical symptoms of depression through asking about feelings over the past week. The score ranges from 0 to 63. The internal reliability of the scale is 0.9328 (calculated as 0.90 for the current sample). Reviews have noted that the scale has excellent validity.29

Procedure

The participants initially experienced a 4-hour teaching session, unrelated to issues concerned with the Internet, which took place in the University. Half of the participants (n = 50) were explicitly told to switch off their mobile devices and to leave them at the door of the teaching room in which the session occurred. The Internet connection was disabled on the PCs in the room. The other participants experienced the same teaching session but were allowed to keep their mobile phones with them, and the PCs were not Internet disabled (they were not explicitly told that they could access their mobile phones, etc). The 4-hour length of the period was chosen for a number of reasons: it is similar to lengths of time that have been chosen for studies of substance abuse,20 but it also corresponded to the longest period of teaching that was already scheduled in the timetable (which was organizationally fortuitous and would not make the session seem out of the ordinary for the students).

All subsequent testing was completed individually in small experimental cubicles. Participants were told that this was an assessment of personality and color preferences. The participants were then asked to name the first color that came into their mind (which was recorded by the experimenter) and were asked to complete the BDI, STAI, and PANAS questionnaires.

After completing the psychometric tests, the participants were told that the questionnaires had to be scored and that the experimenter would return in a short time to complete the experiment. The participants were asked to wait in the experimental room and were told that they could access the Internet through the computer in the room. All participants accessed the Internet, and the content of the Web sites they visited was recorded. A short 15-minute Internet period was used in this study, as this has been found previously to be long enough to produce psychological changes in high problem users.12 Moreover, shorter periods of Internet use are more reflective of current methods of interacting with the Internet since the advent of mobile devices.17

After a 15-minute period of Internet exposure, the experimenter returned to the room, and the participants were asked to switch off the Internet and were told that the next part of the study comprised a further series of questionnaires. They were again asked to name the first color that came into their mind and were asked to complete the PANAS and STAI questionnaires again (in that order), as well as the IAT questionnaire, which was always completed last.

After the participants had left the room, the record of their Internet activity was recovered from the Internet browser history (the participants had not been informed that their browsing activities would be checked). The number of Web sites that were visited during the 15-minute period was recorded, along with their address. It was possible to recover these records for 83 participants—17 had deleted this record from the computer. The dominant color of the Web sites visited by each participant was assessed by 2 independent raters who were blind to the results of the psychometric tests from the participants. Each rater separately visited each of the Web sites recorded on the browser history for each participant. The raters noted the main colors displayed on those Web site pages (ie, those colors that occupied more that 25% of the Web page, so that it was theoretically possibly to have more than 1 prominent color per Web site). The dominant colors on each Web page were assessed by visual inspection. This was done for each Web page separately. The color most often noted across all the Web pages visited by the individual was then calculated. There was a 97% agreement between the raters regarding the dominant colors. Disagreements were settled by negotiation.

The study was conducted between November 2013 and April 2014.

RESULTS

The mean (± SD) number of Web sites visited by the participants during the 15-minute period was 2.66 (± 1.75; range, 1-8). The Internet-deprived group visited 2.91 (± 2.06; range, 1-8) Web sites during their Internet exposure, and the nondeprived group visited 2.43 (± 1.36; range, 1-8) Web sites (t98 = 1.25, P > .20, d = 0.29).

The mean IAT score for the sample was 35.57 (± 11.72; range, 11-72), and 27 participants scored higher than the IAT cutoff (ie, 40) for mild or worse problematic Internet use. The mean IAT score for females was 35.69 (± 12.35; range, 11-72; 26.2% scored above the cutoff), and the mean IAT score for males was 35.38 (± 10.82; range, 11-72; 28.2% scored above the cutoff). The difference between the genders in terms of their IAT scores was not statistically significant (t98 = 0.12, P > .90, d = 0.03). The mean IAT score for the Internet-deprived group was 35.50 (± 12.17; range, 11-72; 24% scored above the cutoff), and for the nondeprived group, the mean was 35.64 (±11.38; range, 11-72; 30% scored above the cutoff). The difference between these groups was not statistically significant (t98 = 0.06, P > .90, d = 0.01). The IAT score had significant correlations with depression (BDI; r98 = 0.208, P < .05), anxiety (STAI; r98 = 0.252, P < .01), hours spent on the Internet (r98 = 0.257, P < .05), and number of visits to the Internet per day (r98 = 0.388, P < .001).

The cohort was split into lower problem users (ie, those scoring below the IAT cut off of 40) and a higher problem user group (ie, those scoring 40 or above on the IAT). This split according to IAT score combined with the deprivation group allocation to create 4 groups: low problem users with no deprivation (n = 35; mean± SD IAT = 30.06 ± 7.78; range, 11-39); low problem users with deprivation (n = 38; mean IAT = 30.08 ± 4.93; range, 20-39); high problem users with no deprivation (n = 15; mean IAT = 48.67 ± 6.82; range, 40-61); and high problem users with deprivation (n = 12; mean IAT = 52.67 ± 12.44; range, 40-72).

Figure 1 shows the change in the psychological ratings (the score after the Internet minus the score before the Internet session) for the high and low problematic Internet user groups who had and had not been deprived of Internet access. Inspection of these data shows that, for the Internet-deprived groups, higher problem users demonstrated a decreased positive mood and increased levels of anxiety following Internet exposure compared to lower problem users. However, there was no effect in the Internet-nondeprived groups. Separate 2-factor between-subject analyses of variance with IAT group (lower versus higher) and deprivation group (deprived versus nondeprived) were conducted on each of the 3 psychological measures. For the change in positive mood, there was a significant main effect of IAT (F1,96 = 3.63, P < .05, partial η2 = 0.036), but not of deprivation (F1,96 = 2.10, P > .10, partial η2 = 0.021), and there was a significant interaction between the factors (F1,96 = 3.69, P < .05, partial η2 = 0.037). Simple effect analyses conducted for each deprivation group revealed a significant simple effect of IAT group for the Internet-deprived condition (F1,96 = 6.84, P < .01, partial η2 = 0.067), but not for the nondeprived condition (F < 1, partial η2 = 0.001). For the change in negative mood, there were no significant main effects or interactions (all P values > .20, all partial η2 values < 0.01). For the change in anxiety, there was a significant main effect of IAT (F1,96 = 6.06, P < .05, partial η2 = 0.064), but not of deprivation (F1,96 = 1.89, P > .10, partial η2 = 0.021), and there was a significant interaction between the factors (F1,96 = 3.84, P < .05, partial η2 = =0.038). Simple effect analyses conducted for each deprivation condition revealed a significant simple effect of IAT group for the deprived condition (F1,96 = 9.59, P < .01, partial η2 = 0.091), but not for the nondeprived condition (F < 1, partial η2 = 0.002).

Figure 1

Click figure to enlarge

Figure 2 shows the change in color selection as a result of the Internet session for the higher and lower problem user groups who had and had not been deprived of Internet access. A change to the predominant color of the Web sites (ie, this color was selected after but not before Internet exposure) was scored as a change toward the dominant Web page color experienced by that participant; no change in selection, or a random change unrelated to the Web site colors, was scored as no change; and a change away from the predominant Web site color (ie, this color was selected before but not after Internet exposure) was scored as a change away. Inspection of these data reveals that, for the Internet-deprived groups, there was a marked change toward the predominant Web page color for the higher problem users, but not for the lower problem users. There was little difference in color change noted between the higher and lower problem user groups for the Internet-nondeprived groups, with their color shifts tending to be random relative to the Web site colors.

Figure 2

Click figure to enlarge

These data were analyzed using a χ2 for 3 categorical variables (change in color preference, lower versus higher problem user groups, and Internet deprivation). This analysis showed that, while there was an overall significant effect of IAT level on the change in color choice (χ22 = 6.40, P < .05), the partial χ2 was significant only for the participants who had been Internet deprived (χ22 = 6.93, P < .01) and not for the participants who had not been Internet deprived (χ22 = 4.56, P > .10).

DISCUSSION

The current results demonstrated that a color preference could be conditioned by exposure to the Internet in higher but not lower problem users and that this effect was seen only when there was some degree of Internet deprivation prior to the test. This effect is further evidence about the nature of problematic Internet use as a potential addiction16 and also gives insight into the potential impact of Internet exposure on preference development in some individuals.

This finding regarding deprivation on the Internet-conditioning effect is consistent with the caffeine-conditioning literature.19,20 It suggests that the mechanism of action for this Internet-conditioning effect is the alleviation of negative symptoms of withdrawal generating a positive valence for the stimuli associated with that alleviation.20,30 The differences found between the lower and higher problem Internet user groups are likely to be due to withdrawal symptoms from the Internet among the higher problem user group, which are alleviated by reexposure to the Internet.12,17 The participants are conditioned to associate the alleviating effects of Internet exposure with the stimuli associated with the visited Web pages, resulting in an increase in positive valence for those stimuli.19,30 That this effect was not seen in the lower problem users, for whom the Internet exposure did not increase the valence of stimuli associated with the Web pages, suggests that in the absence of withdrawal effects in lower problem users there is no negative reinforcing effect of the Internet per se, providing further evidence that Internet can act as a negative reinforcer.

The current study replicated the psychological withdrawal effect on cessation of using the Internet.12,17 However, a novel aspect of the current data was that this psychological withdrawal effect was limited to those with high levels of self-reported problematic Internet use who had been deprived from the Internet for at least 4 hours, which is similar to previous studies of the effects of substance abuse.20 That only those who were Internet deprived showed this effect, and that only those who were Internet deprived showed the Internet-conditioning effect, suggests that alleviating this withdrawal state may well be critical in maintaining Internet use in some problematic Internet users, as it is in some caffeine users.19,30

The demonstration that color choice can be conditioned from Internet exposure, at least in the short term, might allow the use of further conditioning techniques to revalue the status of the Internet and alter the behavior of high problem users. It has been shown in many contexts that altering the hedonic status of a stimulus (eg, a color) associated with a second stimulus (eg, the Internet) can, without further conditioning, alter the status of that second stimulus (the Internet).31 The use of this procedure could act to reduce subsequent Internet use and help maintain longer periods of abstinence in problematic users. Of course, the potential use of this suggested procedure is speculative, and further work would be required to explore its potential.

It is worth noting that around a third of the current sample displayed a mild or worse form of Internet addiction. This value is similar to those found in previous studies from the same areas in the world.2-4,15 The fact that this problem appeared to be distributed similarly among males and females is also in line with contemporary reports that have shown a narrowing in the gender gap in terms of problematic Internet use.9 Levels of Internet addiction were also correlated with levels of depression and anxiety, as has been noted in several previous investigations.5,8

As with any study, there are some methodological limitations that should be acknowledged. The current study, although attempting to be ecologically valid, may not capture all of the aspects of everyday Internet use that might contribute to these effects. It is unknown how long the current preference conditioning lasts, which could be further examined in subsequent work. The level of deprivation was chosen on the basis of previous work, but this level might have an effect on the results and should be explored in some more detail. More precise methods of establishing dominant colors on the screen could be examined in future work.

In summary, the current data show that problematic Internet users who have been deprived access to the Internet for some hours will display psychological withdrawal effects after finishing an Internet cessation. This exposure is enough to generate an Internet-conditioning effect for stimuli associated with the visited Web pages, making stimuli associated with the Web pages more valued, which is an effect seen with some addictive substances. These findings add to the evidence that the concept of Internet addiction should be given serious consideration.

Submitted: April 22, 2015; accepted November 13, 2015.

Potential conflicts of interest: All authors certify that they have no potential conflicts of interest.

Funding/support: This study received no external funding.

REFERENCES

1. Dong G, Huang J, Du X. Enhanced reward sensitivity and decreased loss sensitivity in Internet addicts: an fMRI study during a guessing task. J Psychiatr Res. 2011;45(11):1525-1529. PubMed doi:10.1016/j.jpsychires.2011.06.017

2. Niemz K, Griffiths M, Banyard P. Prevalence of pathological Internet use among university students and correlations with self-esteem, the General Health Questionnaire (GHQ), and disinhibition. Cyberpsychol Behav. 2005;8(6):562-570. PubMed doi:10.1089/cpb.2005.8.562

3. Christakis DA. Internet addiction: a 21st century epidemic? BMC Med. 2010;8(1):61. PubMed doi:10.1186/1741-7015-8-61

4. Weinstein A, Lejoyeux M. Internet addiction or excessive internet use. Am J Drug Alcohol Abuse. 2010;36(5):277-283. PubMed doi:10.3109/00952990.2010.491880

5. Hardie E, Tee M-Y. Excessive internet use: the role of personality, loneliness and social support networks in internet addiction. Australian Journal of Emerging Technologies and Society. 2007;5:34-47.

6. Young KS. Caught in the Net. Chichester, UK: Wiley; 1998.

7. Caplan SE, High AC. Online social interaction, psychosocial well-being, and problematic internet use. In: Young KS, de Abreu CN, eds. Internet Addiction: A Handbook and Guide to Evaluation and Treatment. Hoboken, NJ: Wiley; 2011; 201: 35-53.

8. Ko CH, Liu TL, Wang PW, et al. The exacerbation of depression, hostility, and social anxiety in the course of Internet addiction among adolescents: a prospective study. Compr Psychiatry. 2014;55(6):1377-1384. PubMed doi:10.1016/j.comppsych.2014.05.003

9. Reed P, Raey E. Relationship between levels of problematic Internet usage and motivation to study in university students. High Educ. 2015;70(4):711-723. doi:10.1007/s10734-015-9862-1

10. Bernardi S, Pallanti S. Internet addiction: a descriptive clinical study focusing on comorbidities and dissociative symptoms. Compr Psychiatry. 2009;50(6):510-516. PubMed doi:10.1016/j.comppsych.2008.11.011

11. Ko CH, Yen JY, Yen CF, et al. The association between Internet addiction and psychiatric disorder: a review of the literature. Eur Psychiatry. 2012;27(1):1-8. PubMed doi:10.1016/j.eurpsy.2010.04.011

12. Romano M, Osborne LA, Truzoli R, et al. Differential psychological impact of internet exposure on Internet addicts. PLoS ONE. 2013;8(2):e55162. PubMed doi:10.1371/journal.pone.0055162

13. Jenaro C, Flores N, Gomez-Vela M, et al. Problematic internet and cell-phone use: psychological, behavioral, and health correlates. Addict Res Theory. 2007;15(3):309-320. doi:10.1080/16066350701350247

14. Kelley KJ, Gruber EM. Problematic Internet use and physical health. J Behav Addict. 2013;2(2):108-112. PubMed doi:10.1556/JBA.1.2012.016

15. Reed P, Vile R, Osborne LA, et al. Problematic internet usage and immune function. PLoS ONE. 2015;10(10):e0140692. doi:10.1371/journal.pone.0140692 PubMed

16. American Psychiatric Association. Diagnostic and Statistical Manual for Mental Disorders. Fifth Edition. Washington, DC: American Psychiatric Association; 2013.

17. Cheever NA, Rosen LD, Carrier LM, et al. Out of sight is not out of mind: the impact of restricting wireless mobile device use on anxiety levels among low, moderate and high users. Comput Human Behav. 2014;37:290-297. doi:10.1016/j.chb.2014.05.002

18. Bardo MT, Rowlett JK, Harris MJ. Conditioned place preference using opiate and stimulant drugs: a meta-analysis. Neurosci Biobehav Rev. 1995;19(1):39-51. PubMed doi:10.1016/0149-7634(94)00021-R

19. Dack C, Reed P. Caffeine reinforces flavor preference and behavior in moderate users but not in low caffeine users. Learn Motiv. 2009;40(1):35-45. doi:10.1016/j.lmot.2008.05.002

20. Yeomans MR, Spetch H, Rogers PJ. Conditioned flavour preference negatively reinforced by caffeine in human volunteers. Psychopharmacology (Berl). 1998;137(4):401-409. PubMed doi:10.1007/s002130050636

21. Rogers PJ, Richardson NJ, Elliman NA. Overnight caffeine abstinence and negative reinforcement of preference for caffeine-containing drinks. Psychopharmacology (Berl). 1995;120(4):457-462. PubMed doi:10.1007/BF02245818

22. Widyanto L, McMurran M. The psychometric properties of the internet addiction test. Cyberpsychol Behav. 2004;7(4):443-450. PubMed doi:10.1089/cpb.2004.7.443

23. Young KS. Internet Addiction Test (IAT) 2009. NetAddiction Web site. http://netaddiction.com/internet-addiction-test/. Accessed November 19, 2015.

24. Chang MK, Man Law SP. Factor structure for Young’s Internet Addiction Test: a confirmatory study. Comput Human Behav. 2008;24(6):2597-2619. doi:10.1016/j.chb.2008.03.001

25. Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988;54(6):1063-1070. PubMed doi:10.1037/0022-3514.54.6.1063

26. Crawford JR, Henry JD. The Positive and Negative Affect Schedule (PANAS): construct validity, measurement properties and normative data in a large non-clinical sample. Br J Clin Psychol. 2004;43(pt 3):245-265. PubMed doi:10.1348/0144665031752934

27. Spielberger CD. Manual for the State-Trait Anxiety Inventory STAI (Form Y). Palo Alto, CA: Consulting Psychologists Press; 1983.

28. Beck AT, Ward CH, Mendelson M, et al. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4(6):561-571. PubMed doi:10.1001/archpsyc.1961.01710120031004

29. Beck AT, Steer RA, Carbin MG. Psychometric properties of the Beck Depression Inventory: twenty-five years of evaluation. Clin Psychol Rev. 1988;8(1):77-100. doi:10.1016/0272-7358(88)90050-5

30. James JE. Does caffeine enhance or merely restore degraded psychomotor performance? Neuropsychobiology. 1994;30(2-3):124-125. PubMed doi:10.1159/000119151

31. Davey GC. UCS revaluation and conditioning models of acquired fears. Behav Res Ther. 1989;27(5):521-528. PubMed doi:10.1016/0005-7967(89)90086-7