- Study protocol
- Open Access
- Open Peer Review
Protocol for a collaborative meta-analysis of 5-HTTLPR, stress, and depression
© Culverhouse et al.; licensee BioMed Central Ltd. 2013
- Received: 4 October 2013
- Accepted: 14 October 2013
- Published: 12 November 2013
Debate is ongoing about what role, if any, variation in the serotonin transporter linked polymorphic region (5-HTTLPR) plays in depression. Some studies report an interaction between 5-HTTLPR variation and stressful life events affecting the risk for depression, others report a main effect of 5-HTTLPR variation on depression, while others find no evidence for either a main or interaction effect. Meta-analyses of multiple studies have also reached differing conclusions.
To improve understanding of the combined roles of 5-HTTLPR variation and stress in the development of depression, we are conducting a meta-analysis of multiple independent datasets. This coordinated approach utilizes new analyses performed with centrally-developed, standardized scripts. This publication documents the protocol for this collaborative, consortium-based meta-analysis of 5-HTTLPR variation, stress, and depression.
Study eligibility criteria: Our goal is to invite all datasets, published or unpublished, with 5-HTTLPR genotype and assessments of stress and depression for at least 300 subjects. This inclusive approach is to minimize potential impact from publication bias.
Data sources: This project currently includes investigators from 35 independent groups, providing data on at least N = 33,761 participants.
The analytic plan was determined prior to starting data analysis. Analyses of individual study datasets will be performed by the investigators who collected the data using centrally-developed standardized analysis scripts to ensure a consistent analytical approach across sites. The consortium as a group will review and interpret the meta-analysis results.
Variation in 5-HTTLPR is hypothesized to moderate the response to stress on depression. To test specific hypotheses about the role of 5-HTTLPR variation on depression, we will perform coordinated meta-analyses of de novo results obtained from all available data, using variables and analyses determined a priori. Primary analyses, based on the original 2003 report by Caspi and colleagues of a GxE interaction will be supplemented by secondary analyses to help interpret and clarify issues ranging from the mechanism of effect to heterogeneity among the contributing studies. Publication of this protocol serves to protect this project from biased reporting and to improve the ability of readers to interpret the results of this specific meta-analysis upon its completion.
- Childhood Maltreatment
- Stressful Life Event
- Stress Exposure
- Genetic Ancestry
- Symptom Count
Large-scale, collaborative meta-analysis has the potential to clarify complex scientific questions by increasing sample size, harmonizing variables, and conducting uniform analyses. In this paper, we describe the protocol for a collaborative, consortium-based meta-analysis to increase understanding of the role of 5-HTTLPR variation and stress in depression. The publication of this protocol serves several important purposes. First, we document our study protocols, design, and primary analysis decisions prior to conducting and publishing our study of 5-HTTLPR variation, stress, and depression, which will avoid biased reporting later. Second, publication of these details will improve the ability of other researchers to interpret the results of this specific meta-analysis upon its completion. Finally, publishing our detailed protocol may be helpful to future consortia by detailing key analysis strategies and as a standard for transparency and commitment to analytic plans set prior to meta-analysis.
Both genetic and environmental factors influence depression . As with other psychiatric illnesses, research on the etiology of depression has identified moderate heritability estimates of 40-50% [1–6], yet recent genome-wide association studies (GWAS) have so far been unable to identify robust and replicable loci associated with depression . It has been argued that some of this ‘missing heritability’ is a result of particular genes exerting an influence on risk for depression only under specific environmental conditions, or ‘gene-environment interactions (GxE) [8, 9]. One of the most high profile reports of GxE involves a common functional polymorphism (5-HTTLPR) in the promoter region of the serotonin transporter gene (5-HTT). This gene encodes an integral membrane protein that transports the neurotransmitter serotonin from synaptic spaces into presynaptic neurons, which terminates the action of serotonin. The repeat length polymorphism has been shown to affect the rate of serotonin uptake . Specifically, the short (S) allele of the 5-HTTLPR is associated with less transcriptional efficiency of the promoter compared to the long (L) allele . Additionally, a single nucleotide substitution (rs25531, A > G) within both alleles reduces transcription so that the LG allele becomes functionally equivalent to the S allele [12, 13]. Studies have suggested grouping LG with the S allele to increase efficiency in predicting variation in serotonin transporter expression , although not all agree on this point.
In 2003, Caspi and colleagues reported evidence of a G×E interaction between 5-HTTLPR variation and stressful life events on depression , with nearly 5000 citations to date. Carriers of either one or two copies of the S allele of the 5-HTTLPR were reported to be more likely to develop major depressive disorder, increased depressive symptoms, and suicidality in response to stressful life events and, separately, child maltreatment than individuals homozygous for the L allele. Furthermore, there was evidence of a dose–response relationship, with risk of depression highest amongst those with two copies of the S allele compared to individuals with only one copy in the presence of stress.
In the original report, no main effect of genotype was found. If the genotype exerts an effect only on those exposed to the stressor, i.e. a diathesis-stress model, the lack of main effect may be due to insufficient power . Alternatively, the genotypic effect may be one of differential environmental susceptibility , in which the L-carriers are indifferent to the environment, whereas the S allele confers environmental susceptibility, allowing S carriers to benefit more from positive experiences as well as being more sensitive to stress, resulting in no net genotype-depression association irrespective of sample size . Studying a large sample may distinguish these possibilities.
Since the original report of a GxE interaction, hundreds of studies have investigated the combined impact of 5-HTTLPR variation and stress on risk for depression, some of which reported replicating the original findings, while some did not. Meta-analyses, also, have come to quite different conclusions [16, 19–22] and various reasons for these differences have been proposed [21, 23–25].
Study design. One factor complicating interpretation is differences in study design. Sample sizes vary, with the majority modest or small. Underpowered studies, combined with potential publication bias, can lead to an increased risk of Type 1 errors . Sampling strategies vary from population-based methods [15, 27] to convenience sampling [28, 29]. Different ancestral populations have been included, with a preponderance of samples of European ancestry. The age range of subjects varies, and it has been suggested that GxE effects are most consistently replicated in young adult samples .
The studies contributing to our meta-analysis represent a range of study designs, so we will test whether differing study design contributes to the heterogeneity of results.
Timing of measurements. Brown and Harris  noted that studies that have failed to replicate the GxE between 5-HTTLPR variation and life events have measured the occurrence of stressful life events in the months immediately preceding the depressive outcomes . In contrast, most of the positive replications have been in keeping with the original study by Caspi and colleagues in measuring life events in the five years prior to the outcome. Retrospective recall of adversity over long periods of time may increase the risk of forgetting or discounting of events  or lead to a bias due to selective recall when those who are depressed self report [27, 31]. When only a lifetime diagnosis of depression is available, information about relative timing of stressors and depression is lost.
Longitudinal studies are largely able to avoid this bias, so our test of longitudinal vs. cross-sectional designs will also, in part, address the issue of timing of stress and depression.
Type of environmental stressor. Different stressors have been examined for interaction with 5-HTTLPR variation. The most common are broad measures of stressful life events [32, 33] and exposure to child maltreatment [34, 35]. The method of measurement (self report vs. interviewer), the type of stressors (e.g. chronic vs. acute) and the scale (binary exposed vs. not exposed, frequency as in the original study, or continuous variable) also vary. It has been suggested that the varied methodology in assessing stressful life events in GxE studies may in part explain the inconsistency of findings , and in a meta-analysis that differentiated between stressors (child maltreatment, specific stressors, and stressful life events), significant differences between types of stressors were found.
We will therefore perform heterogeneity analyses to account for different types of stressors and measurements of stressors. One such test will be to compare results from the studies that focused on specific stressors (e.g. pregnancy, heart attack, medical internship) to those from studies based on summary measures of diverse stressors (e.g. the LTE-Q).
Type of outcome. Some studies used a categorical measure of depression diagnosis (e.g. DSM-IV or the ICD-10) as an outcome, others used a symptom count as continuous outcome, and some used both. Such differences in outcome measures (e.g., continuous versus categorical) result in different assumptions and analytical approaches being used (see for a Discussion ).
The role of 5-HTTLPR variation and stress in the development of depression remains a topic of active debate, in part because of the challenges outlined above. Therefore, we are undertaking this collaborative meta-analysis using a standardized protocol to improve understanding of this important issue.
The primary objective of this study is to increase understanding of the role of 5-HTTLPR variation and stress in depression, where 5-HTTLPR variation is hypothesized as a moderator of the response to stress. To address the complexities of this topic, we will perform a coordinated meta-analysis of all data available from collaborators, using consistent de novo analyses and variables determined a priori.
In keeping with the original finding by Caspi and colleagues , we will test the following main hypothesis.
The risk of depression, evaluated either as a dichotomous diagnosis or as a continuous phenotype, is greater in carriers of the S allele versus those homozygous for the L allele in the presence of exposure to stress.
This main hypothesis will be examined in multiple settings to determine a range of conditions under which the effect might be found. Additional hypotheses (e.g. whether there is a main effect of 5-HTTLPR variation on depression) will be examined to improve our understanding of this complex topic.
Plans for analysis, definitions of stressors and outcomes, as laid out in this protocol, were determined a priori by our study leadership team in consultation with contributing study investigators, who provided input via conference calls and email. Individual study analyses will be performed by the investigators who collected the data, using standardized analysis scripts developed by the coordinating team at Washington University to implement a consistent analytical approach across sites. Results from these analyses will be sent to the coordinating team for meta-analysis. The consortium as a group will review and interpret the results. We have previously developed and successfully implemented this collaborative meta-analysis approach to investigate the genetics of addiction [37–39].
This coordinated meta-analysis approach has several advantages over traditional literature-based meta-analyses arising from the fact that a collaborative meta-analysis is based on de novo, consistent analyses of harmonized variables in the primary data. First, the consistent analytic approach and harmonized variables greatly ameliorate the effects of two of the chief causes of heterogeneity between individual studies. In particular, meta-analyzing results derived from differing analytic approaches, such as the use of different covariates, different phenotype definitions, and different analytical models, has a clear potential to bias literature-based meta-analyses . Second, the fact that the results are based on de novo analyses allows for the inclusion of previously unpublished data, both from researchers who have not published on the topic before and through updated individual data from research groups who have previously published. Third, coordinated de novo analyses of primary data allow a collaborative meta-analysis to conduct secondary analyses that can aid in the interpretation of the main results. Finally, the coordinated meta-analysis approach allows the examination of more homogeneous subsets of the primary data than is possible through literature review.
Groups participating in the 5-HTTLPR coordinated meta-analysis
Marcus Munafò, Ricardo Araya, Lucy Bowes
Nicholas Stefanis, Laura Mandelli, Costas N. Stefanis, Alex Hatzimanolis, Alessandro Serretti
Craig Olsson, Keriann Little
Alex Todorov, Vesselin Chorbov
David Fergusson, John Horwood
Chinese Academy of Medical Sciences
Bernhard T. Baune, Grant Sinnamon, Sarah Cohen-Woods
John Nurnberger, Jr.
Naomi Breslau, Laura Bierut
CTS-LTS and NYSFS
John Hewitt, Brett Haberstick
Peter McGuffin, Helen L. Fisher, Sarah Cohen-Woods, Anne Farmer
Paul Surtees, Nick Wainwright
Karen Ritchie, Isabelle Jaussent
Thalia Eley, Kathryn Lester
Genetic Study of Bipolar Disorder
Philippe Courtet, Alain Malafosse, Emilie Olié
Kerry Ressler, Bekh Bradley-Davino
Heart and Soul Study
Christian Otte, Mary Whooley
Intern Health Study
Manfred Laucht, Tobias Banaschewski, Daniel Brandeis
Margit Burmeister, Robert A Zucker, Sandra Villafuerte
Volker Arolt, Bernhard T. Baune
Münster Neuroimaging Study
Udo Dannlowski, Bernhard T. Baune
Brenda Penninx, Johannes Smit, Wouter Peyrot
Gabriella Juhasz, Bill Deakin, Gyorgy Bagdy, Judit Lazary
NTR (Adult NTR and Young NTR)
Christel Middeldorp, Dorret Boomsma
Simon Easteal, Kaarin J. Anstey
Jeanette Scheid, Claudia Holzman, Nicole Jones
Blanca Gutiérrez, Jorge Cervilla,
Nicholas G. Martin, William L. Coventry, Grant W. Montgomery, Naomi R. Wray
SALVe 2001 and SALVe 2006
Cecilia Åslund, Kent Nilsson
Dana Glei, Noreen Goldman, Maxine Weinstein
Hans Jörgen Grabe
Albertine Oldehinkel, Esther Nederhof, Johan Ormel
Laura Mandelli, Alessandro Serretti
Marco Sarchiapone, Laura Mandelli
George Patton, Craig Olsson, Christina O’Loughlin
Robert Culverhouse, Nancy Saccone, Laura Bierut, Amy Horton
Robert Culverhouse, Laura Bierut, Naomi Breslau, John Nurnberger Jr., Nancy Saccone
External Beta Testers
Lucy Bowes, Sarah Cohen-Woods, Helen Fisher, Brett Haberstick, Marcus Munafò
5-HTTLPR variant genotyped.
Measurement of exposure to stress (including stressful life events and/or maltreatment).
Measurement of depression (including symptom counts and/or diagnosis).
Study sample size of 300 or more.
Studies where the 5-HTTLPR variant was not directly genotyped.
Studies with a sample size of less than 300 participants.
Data management, analysis, and meta-analysis
Multiple existing, independent datasets will contribute de novo analysis results for meta-analysis, following coordinated meta-analysis protocols we have developed and implemented previously [37–39]. Extensive meetings between the leaders of the contributing studies have focused on effective ways to harmonize the available variables across the studies (see “Data Harmonization” below) to minimize heterogeneity across the resulting analyses. Following the common protocol, each contributing group will format their data for analysis by a common analysis script. Analyses will be performed by each individual data contributing site, using standardized scripts developed by the coordinating site at Washington University in consultation with the entire consortium. Beta-testing of these scripts will be performed both by the coordinating team and individual study teams. These scripts will ensure consistent analyses across sites. Results will be returned to the coordinating site for meta-analysis. The results of the meta-analyses will be interpreted by the consortium and a collaborative publication reporting the results will be produced.
The data contributing sites will be responsible for checking the quality of their formatted data (e.g., making sure that values for all variables are credible, confirming the sample size, and checking the number of missing observations for each variable) prior to analysis and in the results returned to the coordinating site. The coordinating site will review the results and work out any anomalies with the data providers, and perform meta-analyses.
Depression: Many different assessments and evaluations are available for study. Differences in measurement of depression may influence the association results, and as a result, a thorough review of the best measurement to be used in this study was undertaken.
The primary phenotype selected for analysis is a major depressive disorder defined by DSM-IV criteria. This phenotype is one used in the original  paper. Additional analyses will be completed using DSM-IV major depressive disorder symptom count, again as in keeping with the original study.
Across the majority of the current contributing datasets, a lifetime diagnosis of DSM-IV major depressive disorder was assessed. For studies where DSM-IV definition of major depressive disorder is not available, a proxy diagnosis will be used. We will track the assessment used and if a proxy diagnostic variable is used, we will examine potential biases introduced by assessment heterogeneity.
Stress: The studies vary widely on the types of assessments of stress and on the relative timing of the stressful event and the onset of depression. This study will examine two main stress assessments: a narrowly focused stressor, childhood maltreatment (most frequently used assessment among our participating groups: the Childhood Trauma Questionnaire (CTQ) ), and a broader defined stressor class, lifetime stressful events (most frequently used assessment: the List of Threatening Events (LTE) ). A second dimension we will investigate is timing of stress exposure relative to the assessment of depression. Some analyses will require that timing is known, while others will be broadened to include datasets where the timing is uncertain. A comprehensive list of the stress variables used in the analyses can be found in Additional file 2: Table S2.
We will test our hypotheses in two models, the first using data from a well-characterized, narrowly defined set of subjects selected to most closely resemble those used in the original study by  (young adults with no prior history of depression), and a more broadly defined group of subjects.
Data harmonization requires compromises, and some heterogeneity and biases will surely remain. We will address this issue and improve the interpretation of our primary analyses by testing for heterogeneity across a variety of factors and examining results within and across more homogeneous subsets.
A priori group comparisons for heterogeneity will include the following:
Longitudinal versus cross-sectional studies.
Different measures of depression (DSM-IV criteria and other measures).
Different stress exposure scales.
Interview versus questionnaire reports.
Self-report versus report by others.
Should heterogeneity be detected, we will report meta-analysis results from homogeneous subgroups as well as results based on all available data. Assessment of heterogeneity across groups of studies and meta-analyses of sub-groups of studies will be carried out by the coordinating team.
In our exploration of the relationship between 5-HTTLPR variation, stress, and depression, we will try to determine (1) settings in which an effect can be identified and (2) the extent to which an effect can be generalized.
In the original report by Caspi and colleagues , a depression outcome at age 26 was assessed using the Diagnostic Interview Schedule , yielding a diagnosis of a major depressive episode according to DSM-IV criteria, as well as a continuous measure of depressive symptoms. Stressful life events occurring over a five-year period were assessed retrospectively when study members were aged 26. Subjects with a diagnosis of depression prior to the five-year window were excluded. Stressful events were summed to create a five-level ordinal variable (no life events, one, two, three, and four or more events). Exposure to childhood maltreatment was also examined at three levels (no, probable, and likely maltreatment).
Analyses involved both a logistic regression (multiplicative) model where depression diagnosis was the outcome, and an ordinal least squares regression (additive) model of depressive symptoms. No main effect of genotype was found.
As stated above, our analyses will fall into two main groups of data: a well-characterized, narrowly defined set of subjects similar to those included in the original study, and a broadly defined group of subjects. Each of these groups will be investigated based on two stressor classes: narrow (childhood maltreatment – including physical and sexual abuse as well as physical neglect occurring before age 17) and broad (any lifetime stressful events (e.g. death of family member, job loss, assault, life threatening illness)). The first group of subjects will consist of adults aged 21 to 30, who did not have depression prior to a 5-year window before assessment, and for whom stress exposure is known to have occurred before any current depression. Other than childhood maltreatment, lifetime stressful events will only be considered if they occurred no more than 5 years prior to assessment. The second, broader group of subjects will have no age restriction. Examination of the broader group of subjects will include additional analyses which drop requirements related to the timing of the stressors.
Using these approaches, we intend to balance the competing factors affecting power: sample size and purity of assessments. Analyses of the first class of subjects are designed to most closely match the original report of . By examining the more severe stressor, childhood maltreatment, in a larger sample with no age restriction, our goal is to potentially increase our ability to see the influence of 5-HTTLPR variation if the effect is not limited young adulthood. Our broadest analysis, with stress broadly defined in the largest population, can be expected to maximize power if there is a general effect of 5-HTTLPR variation moderating the impact of stress exposure on depression. If we do not see the influence of 5-HTTLPR variation in this final set of analyses, but it was present in at least one of the previous analyses, we will be able to examine which factors reduce the effect of the association. An important benefit of this design is that we will also examine the degree to which results observed with narrower analyses generalize to the broader analyses, which provides the opportunity to clarify the importance of specific phenotype, stressor, and age requirements.
Under this protocol, data from a particular study may be appropriate for inclusion in one or more of these analysis categories.
The primary model of interest, a focused analysis of 5-HTTLPR variation, consists of two arms (arms A and B) and most closely follows the original report. The analysis scripts will also include pre-specified secondary analyses aimed to aid additional understanding of the primary analysis results and to explore secondary hypotheses.
Primary analysis 1: analysis of the impact of 5-HTTLPR variation in young adults
In keeping with the original study and following reports that effects of any GxE may be expected to be greatest among young adults , we will first restrict our analyses to individuals with outcome measures at age 21–30 years.
Two arms differentiated by stressor will be the co-primary foci for this set of analyses.
Arm A: childhood maltreatment
No time limit on gap between maltreatment and depression
Stress exposure assumed to occur before depression, but need not be documented
Childhood maltreatment has been reported as a particular stressor of interest for understanding the relationship between 5-HTTLPR variation and depression. The effects of childhood maltreatment were deemed by the consortium members to have long-lasting adverse effects. As a consequence, no time limit between exposure to childhood maltreatment and adult depression outcome will be required. This is also in keeping with the original study. Furthermore, these analyses will assume that childhood maltreatment antedates the development of depression, so specific timing of when the maltreatment occurred relative to any depressive episodes will not be required.
Arm B: stressful life events (including childhood maltreatment)
Stressors other than childhood maltreatment must occur < 5 years prior to assessment
The second arm will take a broader measure of stress, incorporating both stressful life events and maltreatment history. Because stressful life events other than childhood maltreatment were deemed as less likely to have a lifelong impact, for this analysis, only life stressors occurring within 5 years of the outcome measure will be used. Furthermore, in order to elucidate the issue of causation in the event that an association is observed, only data in which the relative timing of exposure to stressful life events and depression outcome is known will be used. Individuals with a history of depression prior to stress exposure will be excluded from these analyses.
Several covariates may alter the relationship between 5-HTTLPR variation, stress, and depression. Effects due to sex, age, birth cohort, and genetic ancestry will be investigated in our analysis.
Analyses stratified by sex and using sex as a covariate will be conducted.
Age at interview will be included as a covariate in the primary analyses.
Cohort effects will be examined using decade of birth as a covariate. The primary models will not include birth cohort as a covariate.
Our analyses will stratified by genetic ancestry (European, Asian, African, Pacific Island, and Admixed European-African). The majority of data is from participants of European ancestry and there may be limited power to detect ethnic heterogeneity in the results. If there is sufficient power to effectively test for heterogeneity and none is found, then a meta-analysis across all ancestry groups will be evaluated.
Statistical models for primary analysis 1
Arm A analysis
Analysis model 1A1
D = diagnosis of DSM-IV major depressive disorder.
M = dichotomous measure of exposure to childhood maltreatment.
G = 5-HTTLPR genotype.
In this analysis, model fit using a likelihood ratio test is compared with and without the interaction term to evaluate whether there is statistically significant evidence for the interaction. Our primary analysis will use an additive coding for genotype based on the number of S alleles carried and lifetime diagnosis of depression.
Secondary analyses will evaluate whether alternate codings for genotype (such as adding a dominance factor) provide a significantly better fit to the data and the possibility of a main effect of 5-HTTLPR genotype on depression, and investigate both current depression and any depression as alternate outcomes.
Analysis model 1A2
D quant = DSM-IV symptom count major depressive disorder.
M quant = quantitative measure of exposure to childhood maltreatment.
G = 5-HTTLPR genotype.
This analysis will parallel the description of Model 1A1.
Arm B analysis
Analysis Models 1B1 and 1B2 will be analogous to 1A1 and 1A2, but substituting stressful life events, S, as the stressor. Stressors other than childhood maltreatment must have occurred no more than 5 years prior to the assessment of depression to be included.
These two arms of Primary Analysis 1 will most closely replicate the analyses in the original report. If, as has been suggested, the GxE effect is strongest for childhood maltreatment  or is seen primarily in young adults following recent stress exposure  this set of analyses will maximize statistical power.
Primary analysis 2: analysis of the impact of 5-HTTLPR variation across all ages
Our second set of primary analyses will involve larger sample sizes, including children and adults of all ages. The increase in sample size will result in increased power if there is a broad genetic association between 5-HTTLPR genotypes, stress, and depression. However, this comes at a cost; in these analyses, we give up the opportunity to investigate whether stress preceding depression was a potential cause of the depression, as relative timing of stress and depression may not be known, and thus will not be included in the models.
Parallel to Primary Analysis 1, these analyses will also utilize two co-primary arms differentiated by stressor.
Arm A: childhood maltreatment
No time limit on gap between maltreatment and depression.
Stress exposure assumed to occur before depression, but need not be documented.
As noted above, childhood maltreatment has been reported as a particular stressor of interest for understanding the relationship between 5-HTTLPR variation and depression. This portion of the analysis differs from the first primary analysis Arm A in that there is no limit on the ages of the subjects at the time of interview.
Arm B: stressful life events (including childhood maltreatment)
Stressors occurring < 5 years prior to assessment when information available.
Stressor timing unknown will not be reason for exclusion.
This arm of the analyses will include a series of nested analyses. The first will be similar to Arm B of the first primary analyses, except that there is no restriction on the ages of the subjects. Additional analyses will further reduce the restrictions on the included data (e.g. timing need not be known) as we attempt to determine what are the broadest general conditions under which an effect can be detected. As we loosen the restrictions, the sample size will increase allowing the possibility of detecting weaker associations in a broader setting.
Statistical models for primary analysis 2
These analyses will consist of 3 sets of analyses nested based on the subjects that are included.
Analysis models 2A1a through 2B2a
These are identical to Models 1A1 through 1B2 except that subjects are not restricted to be between age 21 and 30.
Analysis models 2B1b and 2B2b
These are identical to Models 2A1a through 2B2a except that the timing of the stressful life events relative to depression may be unknown. (Because childhood maltreatment is assumed to occur prior to the first major depressive episode, there are no models 2A1b and 2A2b.)
Analysis model 2C
Our broadest analysis will estimate allele frequencies among the cells of a 2×2 table defined by stress exposure and lifetime diagnosis of major depression, followed by a determination of whether there is evidence of a direct or interaction association between 5-HTTLPR variation and depression.
As noted above, in addition to the moderated regression models described in the 11 primary analysis models (1A1 through 2C), we will examine a variety of secondary models to help us interpret the results of our primary results. Included in these will be analyses where only stresses other than childhood maltreatment are considered. Secondary analyses will also include both alternate statistical models and analyses of more narrowly defined subsets of subjects (e.g. subjects from longitudinal studies, subjects for which the SNP occurring on the L allele has been genotyped).
Among these secondary analyses will be traditional logistic and linear regression models parallel to the moderated regression models 1A1 through 2B2b but without the interaction terms, as illustrated below.
Secondary Models S1A1 & S1B1
Results from previous studies (e.g. ) suggest that there is likely no main effect of 5-HTTLPR variation on depression and as a result, this is not part of our primary analysis. Nonetheless, our secondary analyses will evaluate the possibility of a main effect, both in isolation and as part of larger interaction models (cf. models S1A1 and S1B1 above) for completeness.
Variables included in the analysis datasets
Additional file 2: Table S2 is a comprehensive list of the variables used in the analyses. The studies will generally contain only a subset of the complete list and therefore each dataset will participate in only a subset of the proposed analyses. In addition to the variables contained in the datasets, we will gather additional information about the datasets to allow us to evaluate particular sources of heterogeneity through meta-analyses of refined subsets of the datasets.
Genetic ancestry (datasets are stratified by ancestry).
Cross-sectional or longitudinal.
Information gathered via interview or questionnaire.
Information on stress and depression is based on current or lifetime reports.
Additional secondary analyses
Genetic Ancestry (e.g. European, Asian, Pacific Island, Admixed European-African).
Study Type (e.g. cross-sectional versus longitudinal data collection).
Assessment type (e.g. interview versus questionnaire, diagnostic system).
Stress and depression phenotypes are based on current state or lifetime reports.
One source of heterogeneity within an individual study is the source of stress. A subset of our participating groups minimized this particular source of heterogeneity by ascertaining subjects that had all been exposed to a uniform stressor (e.g. pregnancy, military conscription, medical residency, coronary heart disease). Because the primary hypothesis supposes that the effect of genotype can be seen most strongly (or only) in subjects exposed to stress, analyses including only these datasets may have particular power to detect the hypothesized effect.
All analyses will be conducted using R due to its computational flexibility and free availability.
The leadership team is responsible for the project’s management decisions and the daily management of this collaboration. A series of conference calls with the contributing investigative teams discussed and reviewed many issues in the design of the meta-analysis. The leadership team, in collaboration with individual study sites, developed the initial protocol based on these discussions. The coordinating team at Washington University developed the analysis scripts and will perform the meta-analysis. External beta testers for the scripts were essential for the production and distribution of high-quality scripts to the consortium members.
All participating research groups have appropriate ethics approval for the use of their data in the proposed secondary analyses. A listing of the participating studies, the names of the study representatives collaborating on this project, and the organizations providing ethical review for the studies can be found in Additional file 3: Table S3. The Human Research Protection Office of Washington University in St. Louis has stated that this collaborative meta-analysis paradigm does not require ethical approval beyond what has been provided to the individual participating groups.
In this study, our emphasis is on harmonizing the analysis to maximize the number of studies to be included. The hope is that a large sample size will overcome limitations due to heterogeneity in measurements of depression and environment. This assumption is supported by many GWAS meta-analyses and studies which find many more genetic associations even when compromising on phenotyping, e.g. by considering anyone with a clozapine prescription a case, rather than a formal schizophrenia diagnosis (e.g. [44, 45]). However, there are limitations to this approach. Although the analysis will be uniform, neither the phenotype nor the environment was measured in a consistent fashion in all studies.
Second, the diathesis-stress model would predict that an alternative approach might be to study a population that was uniformly exposed to a specific stressor. A minority of the studies in our consortium are of this type (e.g. ASPIS (military conscription), Heart and Soul (coronary heart disease), Intern Health Study (medical internship), POUCH (pregnancy)).
Third, limiting the sample size to 300 was done for practical reasons. On the other hand, the small published studies were in their majority those with positive findings ). Small samples may be more likely subject to publication bias , but also tend to be assessed more carefully, and hence this criterion may exclude some of the best characterized samples.
Fourth, although we will perform a number of specific heterogeneity tests, it is impossible to test all combinations.
Hence, although we will include many possible confounds and expect to have power to detect a robust effect of genotype, a negative finding does not exclude the possibility that a genetic effect exists that is very sensitive to timing or to the method of measuring depression or stress.
There is an ongoing debate about what role, if any, 5-HTTLPR variation plays in depression. Various studies have argued for (e.g., ) or against (e.g., ) the proposition that an interaction between 5-HTTLPR variation and stressful life events alters the subsequent risk of depression. Both individual studies and meta-analyses of published results have come to differing conclusions. Numerous issues may contribute to the conflicting results including: heterogeneity among studies (varying study populations, varying definitions of depression, varying measures of stress, prospective versus retrospective assessments, varying analytical models); issues regarding timing of stress and depression; underpowered samples; and publication bias. To address the numerous complexities of the topic of the potential impact of 5-HTTLPR variation on depression, hypothesized as a moderator of the response to stress, we have designed a coordinated meta-analysis that performs consistent, de novo analyses of all available primary data, utilizing variables that are harmonized across the datasets and with analyses that were determined a priori. These analyses will be implemented in a set of primary analyses, arising from the original report of a GxE interaction involving 5-HTTLPR variation, and supplemented by secondary analyses intended to aid in the interpretation of the main findings and to address numerous issues related to possible heterogeneity between the contributing studies. The risk of data mining and of type 1 errors in large, multidimensional datasets such as ours is great, and there is a clear need for consensus on best practice before analyses are conducted. It is our hope that by publishing this protocol in advance of all analyses being conducted, we will minimize potential biases.
5-HTT: Serotonin transporter gene.
Official name: SLC6A4, location: 17q11.2. Also known as HTT; 5HTT; OCD1; SERT; 5-HTT; SERT1; hSERT.
Summary: This gene encodes an integral membrane protein that transports the neurotransmitter serotonin from synaptic spaces into presynaptic neurons. The encoded protein terminates the action of serotonin and recycles it in a sodium-dependent manner. This protein is a target of psychomotor stimulants, such as amphetamines and cocaine, and is a member of the sodium:neurotransmitter symporter family.
5-HTTLPR: serotonin-transporter-linked polymorphic region. Summary: A repeat length polymorphism in the promoter of the 5-HTT gene that has been shown to affect the rate of serotonin uptake. The short (“s”) allele is associated with lower transcriptional efficiency of the promoter compared to the long (“l”) allele.
GxE: Gene-environment interaction.
This manuscript was written on behalf of, and in consultation with, the 5-HTTLPR, Stress, and Depression Consortium, which consists of the following studies:
Avon Longitudinal Study of Parents and Children (ALSPAC), Athens Study of Psychosis Proneness and Incidence of Schizophrenia (ASPIS), University Mental Health Research Institute, Athens, Greece, Australian Temperament Project (ATP), BIGSIBS, Christchurch Health and Development Study (CHDS), Chinese Academy of Medical Sciences. Cognitive Function and Mood Study (CoFaMS), University of Adelaide, Collaborative Study on the Genetics of Alcoholism (COGA), Collaborative Genetic Study of Nicotine Dependence (COGEND), Community Twin and Longitudinal Twin Samples and National Youth and Family Study (CTS-LTS and NYFS), Depression Case–control study (DeCC), European Prospective Investigation into Cancer – Norfolk (EPIC-Norfolk), Enquête de Santé Psychologique – Risques, Incidence et Traitement Project (ESPRIT), The Genesis 12–19 Study (G1219), Genetic Study of Bipolar Disorder, GENESIS: GEnetics, NEuropsychology, functional neuroImaging of Suicidal behavior (Genetics Study of Suicidal Behaviour), Grady Trauma Project (GTP), Heart and Soul Study, Intern Health Study, Mannheim Study of Children at Risk (MARS), Michigan Longitudinal Study (MLS), MoodInflame (Münster), Universität Münster, Münster Neuroimaging Study, Universität Münster, Netherlands Study on Depression and Anxiety (NESDA), New molecules in mood disorders: a genomic, neurobiological and systems approach in animal models and human disorder (NEWMOOD), Netherlands Twin Register (Adult NTR and Young NTR), Personality And Total Health through life (PATH), Pregnancy Outcomes and Community Health Studies) – based 5-HTTLPR gene-environment interaction for meta-analysis (POUCH), CIBERSAM University of Granada, Spain (PREDICT-Gene), The Queensland Institute of Medical Research Twin and Family Study (QIMR Twin), Centre for Clinical Research, Västerås, Sweden. Survey of Adolescent Life in Vestmanland 2001 and 2006 (SALVe 2001 and SALVe 2006), Social Environment and Biomarkers of Aging Study (SEBAS), Study of Health in Pomerania (SHIP), TRacking Adolescents’ Individual Lives Survey (TRAILS), University of Bologna, Institute of Psychiatry, Department of Biomedical and Neuromotor Sciences, Bologna, Italy, University of Molise, Department of Health Sciences, Campobasso, Italy, and Victoria Adolescent Health Care Study (VAHCS).
The authors would like to acknowledge the following individuals, for their contributions to the development of the protocol and their roles in the creation of the participating studies:
Kaarin J. Anstey, Ricardo Araya, Volker Arolt, Cecilia Åslund, Gyorgy Bagdy, Tobias Banaschewski, Bernhard T. Baune, Dorret Boomsma, Daniel Brandeis, Peter Butterworth, Vladimir Carli, Jorge Cervilla, Helen Christensen, Sarah Cohen-Woods, Erika Comasco, Philippe Courtet, William L. Coventry, Udo Dannlowski, Eco de Geus, Bill Deakin, Katharina Domschke, Harmen Draisma, Simon Easteal, Thalia Eley, Anne Farmer, Helen L. Fisher, Ian Gotlib, Hans Jörgen Grabe, Blanca Gutiérrez, Brett Haberstick, John Hewitt, Amy Horton, John Horwood, Jouke-Jan Hottenga, Isabelle Jaussent, Anthony Jorm, Gabriella Juhasz, Manfred Laucht, Judit Lazary, Jerzy Leppert, Kathryn Lester, Keriann Little, Alain Malafosse, Laura Mandelli, Nicholas G. Martin, Peter McGuffin, Christel Middeldorp, Camelia Minica, Grant W. Montgomery, Matthias Nauck, Esther Nederhof, Kent W. Nilsson, Niklas Nordquist, Albertine J. Oldehinkel, Emilie Olié, Lars Oreland, Johan Ormel, Christian Otte, Brenda Penninx, Wouter Peyrot, Karen Ritchie, Bryan Rodgers, Marco Sarchiapone, Andrea Schulz, Christian Schwahn, Srijan Sen, Alessandro Serretti, Grant Sinnamon, Rickard L Sjöberg, Johannes Smit, Nicholas Stefanis, Paul Surtees, Sandra Villafuerte, Henry Völzke, Nick Wainwright, Mary Whooley, Gonneke Willemsen, Naomi R. Wray, and Robert A Zucker.
This work was supported by National Institutes of Health grants R21 DA033827 and R01 DA026911 from the National Institute on Drug Abuse, P01 CA089392 from the National Cancer Institute, and U10 AA008401 from the National Institute on Alcohol Abuse and Alcoholism.
- Sullivan PF, Neale MC, Kendler KS: Genetic epidemiology of major depression: review and meta-analysis. Am J Psychiatry. 2000, 157: 1552-1562. 10.1176/appi.ajp.157.10.1552.View ArticlePubMedGoogle Scholar
- Bierut LJ, Heath AC, Bucholz KK, Dinwiddie SH, Madden PA, et al: Major depressive disorder in a community-based twin sample: are there different genetic and environmental contributions for men and women?. Arch Gen Psychiatry. 1999, 56: 557-563. 10.1001/archpsyc.56.6.557.View ArticlePubMedGoogle Scholar
- Kendler KS, Gardner CO, Prescott CA: Are there sex differences in the reliability of a lifetime history of major depression and its predictors?. Psychol Med. 2001, 31: 617-625.PubMedGoogle Scholar
- Kendler KS, Neale MC, Kessler RC, Heath AC, Eaves LJ: The lifetime history of major depression in women. Reliability of diagnosis and heritability. Arch Gen Psychiatry. 1993, 50: 863-870. 10.1001/archpsyc.1993.01820230054003.View ArticlePubMedGoogle Scholar
- McGuffin P, Katz R, Rutherford J: Nature, nurture and depression: a twin study. Psychol Med. 1991, 21: 329-335. 10.1017/S0033291700020432.View ArticlePubMedGoogle Scholar
- McGuffin P, Katz R, Watkins S, Rutherford J: A hospital-based twin register of the heritability of DSM-IV unipolar depression. Arch Gen Psychiatry. 1996, 53: 129-136. 10.1001/archpsyc.1996.01830020047006.View ArticlePubMedGoogle Scholar
- Ripke S, Wray NR, Lewis CM, Hamilton SP, Weissman MM, et al: A mega-analysis of genome-wide association studies for major depressive disorder. Mol Psychiatry. 2013, 18: 497-511. 10.1038/mp.2012.21.View ArticlePubMedGoogle Scholar
- Cohen-Woods S, Craig IW, McGuffin P: The current state of play on the molecular genetics of depression. Psychol Med. 2013, 43: 673-687. 10.1017/S0033291712001286.View ArticlePubMedGoogle Scholar
- Kendler KS, Kessler RC, Walters EE, MacLean C, Neale MC, et al: Stressful life events, genetic liability, and onset of an episode of major depression in women. Am J Psychiatry. 1995, 152: 833-842.View ArticlePubMedGoogle Scholar
- Lesch KP, Greenberg MD, Higley JD, Bennett A, Murphy DL: Serotonin transporter, personality, and behavior: toward a disection of gene-gene and gene-environment interaction. Molecular genetics and the human personality. Edited by: Benjamin J, Ebstein RP, Belmaker RH. 2002, Washington, DC: American Psychiatric Association (APA), pp. 109-136.Google Scholar
- Lesch KP, Bengel D, Heils A, Sabol SZ, Greenberg BD, et al: Association of anxiety-related traits with a polymorphism in the serotonin transporter gene regulatory region. Science. 1996, 274: 1527-1531. 10.1126/science.274.5292.1527.View ArticlePubMedGoogle Scholar
- Akey J, Jin L, Xiong M: Haplotypes vs single marker linkage disequilibrium tests: what do we gain?. Eur J Hum Genet. 2001, 9: 291-300. 10.1038/sj.ejhg.5200619.View ArticlePubMedGoogle Scholar
- Nakamura M, Ueno S, Sano A, Tanabe H: The human serotonin transporter gene linked polymorphism (5-HTTLPR) shows ten novel allelic variants. Mol Psychiatry. 2000, 5: 32-38. 10.1038/sj.mp.4000698.View ArticlePubMedGoogle Scholar
- Araya R, Hu X, Heron J, Enoch MA, Evans J, et al: Effects of stressful life events, maternal depression and 5-HTTLPR genotype on emotional symptoms in pre-adolescent children. Am J Med Genet B Neuropsychiatr Genet. 2009, 150B: 670-682. 10.1002/ajmg.b.30888.View ArticlePubMedGoogle Scholar
- Caspi A, Sugden K, Moffitt TE, Taylor A, Craig IW, et al: Influence of life stress on depression: moderation by a polymorphism in the 5-HTT gene. Science. 2003, 301: 386-389. 10.1126/science.1083968.View ArticlePubMedGoogle Scholar
- Munafo MR, Durrant C, Lewis G, Flint J: Gene X environment interactions at the serotonin transporter locus. Biol Psychiatry. 2009, 65: 211-219. 10.1016/j.biopsych.2008.06.009.View ArticlePubMedGoogle Scholar
- Belsky J, Pluess M: Beyond diathesis stress: differential susceptibility to environmental influences. Psychol Bull. 2009, 135: 885-908.View ArticlePubMedGoogle Scholar
- Uher R, McGuffin P: The moderation by the serotonin transporter gene of environmental adversity in the aetiology of mental illness: review and methodological analysis. Mol Psychiatry. 2008, 13: 131-146. 10.1038/sj.mp.4002067.View ArticlePubMedGoogle Scholar
- Brown GW, Harris TO: Depression and the serotonin transporter 5-HTTLPR polymorphism: a review and a hypothesis concerning gene-environment interaction. J Affect Disord. 2008, 111: 1-12. 10.1016/j.jad.2008.04.009.View ArticlePubMedGoogle Scholar
- Clarke H, Flint J, Attwood AS, Munafo MR: Association of the 5- HTTLPR genotype and unipolar depression: a meta-analysis. Psychol Med. 2010, 40: 1767-1778. 10.1017/S0033291710000516.View ArticlePubMedGoogle Scholar
- Karg K, Burmeister M, Shedden K, Sen S: The serotonin transporter promoter variant (5-HTTLPR), stress, and depression meta-analysis revisited: evidence of genetic moderation. Arch Gen Psychiatry. 2011, 68: 444-454. 10.1001/archgenpsychiatry.2010.189.View ArticlePubMedPubMed CentralGoogle Scholar
- Risch N, Herrell R, Lehner T, Liang KY, Eaves L, et al: Interaction between the serotonin transporter gene (5-HTTLPR), stressful life events, and risk of depression: a meta-analysis. JAMA. 2009, 301: 2462-2471. 10.1001/jama.2009.878.View ArticlePubMedPubMed CentralGoogle Scholar
- Duncan LE, Keller MC: A critical review of the first 10 years of candidate gene-by-environment interaction research in psychiatry. Am J Psychiatry. 2011, 168: 1041-1049. 10.1176/appi.ajp.2011.11020191.View ArticlePubMedPubMed CentralGoogle Scholar
- Munafo MR, Flint J: Replication and heterogeneity in gene x environment interaction studies. Int J Neuropsychopharmacol. 2009, 12: 727-729. 10.1017/S1461145709000479.View ArticlePubMedGoogle Scholar
- Uher R, Caspi A, Houts R, Sugden K, Williams B, et al: Serotonin transporter gene moderates childhood maltreatment’s effects on persistent but not single-episode depression: replications and implications for resolving inconsistent results. J Affect Disord. 2011, 135: 56-65. 10.1016/j.jad.2011.03.010.View ArticlePubMedPubMed CentralGoogle Scholar
- Button KS, Ioannidis JP, Mokrysz C, Nosek BA, Flint J, et al: Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013, 14: 365-376. 10.1038/nrn3475.View ArticlePubMedGoogle Scholar
- Kim JM, Stewart R, Kim SW, Yang SJ, Shin IS, et al: Interactions between life stressors and susceptibility genes (5-HTTLPR and BDNF) on depression in korean elders. Biol Psychiatry. 2007, 62: 423-428. 10.1016/j.biopsych.2006.11.020.View ArticlePubMedGoogle Scholar
- Covault J, Tennen H, Armeli S, Conner TS, Herman AI, et al: Interactive effects of the serotonin transporter 5-HTTLPR polymorphism and stressful life events on college student drinking and drug use. Biol Psychiatry. 2007, 61: 609-616. 10.1016/j.biopsych.2006.05.018.View ArticlePubMedGoogle Scholar
- Wilhelm K, Mitchell PB, Niven H, Finch A, Wedgwood L, et al: Life events, first depression onset and the serotonin transporter gene. Br J Psychiatry. 2006, 188: 210-215. 10.1192/bjp.bp.105.009522.View ArticlePubMedGoogle Scholar
- Caspi A, Hariri AR, Holmes A, Uher R, Moffitt TE: Genetic sensitivity to the environment: the case of the serotonin transporter gene and its implications for studying complex diseases and traits. Am J Psychiatry. 2010, 167: 509-527. 10.1176/appi.ajp.2010.09101452.View ArticlePubMedPubMed CentralGoogle Scholar
- Taylor SE, Way BM, Welch WT, Hilmert CJ, Lehman BJ, et al: Early family environment, current adversity, the serotonin transporter promoter polymorphism, and depressive symptomatology. Biol Psychiatry. 2006, 60: 671-676. 10.1016/j.biopsych.2006.04.019.View ArticlePubMedGoogle Scholar
- Chipman P, Jorm AF, Prior M, Sanson A, Smart D, et al: No interaction between the serotonin transporter polymorphism (5-HTTLPR) and childhood adversity or recent stressful life events on symptoms of depression: results from two community surveys. Am J Med Genet B Neuropsychiatr Genet. 2007, 144B: 561-565. 10.1002/ajmg.b.30480.View ArticlePubMedGoogle Scholar
- Chipman P, Jorm AF, Tan XY, Easteal S: No association between the serotonin-1A receptor gene single nucleotide polymorphism rs6295C/G and symptoms of anxiety or depression, and no interaction between the polymorphism and environmental stressors of childhood anxiety or recent stressful life events on anxiety or depression. Psychiatr Genet. 2010, 20: 8-13. 10.1097/YPG.0b013e3283351140.View ArticlePubMedGoogle Scholar
- Kaufman J, Yang BZ, Douglas-Palumberi H, Grasso D, Lipschitz D, et al: Brain-derived neurotrophic factor-5-HTTLPR gene interactions and environmental modifiers of depression in children. Biol Psychiatry. 2006, 59: 673-680. 10.1016/j.biopsych.2005.10.026.View ArticlePubMedGoogle Scholar
- Kaufman J, Yang BZ, Douglas-Palumberi H, Houshyar S, Lipschitz D, et al: Social supports and serotonin transporter gene moderate depression in maltreated children. Proc Natl Acad Sci USA. 2004, 101: 17316-17321. 10.1073/pnas.0404376101.View ArticlePubMedPubMed CentralGoogle Scholar
- Zammit S, Lewis G, Dalman C, Allebeck P: Examining interactions between risk factors for psychosis. Br J Psychiatry. 2010, 197: 207-211. 10.1192/bjp.bp.109.070904.View ArticlePubMedGoogle Scholar
- Chen LS, Saccone NL, Culverhouse RC, Bracci PM, Chen CH, et al: Smoking and genetic risk variation across populations of European, Asian, and African American ancestry–a meta-analysis of chromosome 15q25. Genet Epidemiol. 2012, 36: 340-351. 10.1002/gepi.21627.View ArticlePubMedPubMed CentralGoogle Scholar
- Hartz SM, Short SE, Saccone NL, Culverhouse R, Chen L, et al: Increased genetic vulnerability to smoking at CHRNA5 in early-onset smokers. Arch Gen Psychiatry. 2012, 69: 854-860. 10.1001/archgenpsychiatry.2012.124.View ArticlePubMedPubMed CentralGoogle Scholar
- Saccone NL, Culverhouse RC, Schwantes-An TH, Cannon DS, Chen X, et al: Multiple independent loci at chromosome 15q25.1 Affect smoking quantity: a meta-analysis and comparison with lung cancer and COPD. PLoS Genet. 2010, 6:Google Scholar
- Sniderman AD, Williams K, Contois JH, Monroe HM, McQueen MJ, et al: A meta-analysis of low-density lipoprotein cholesterol, non-high-density lipoprotein cholesterol, and apolipoprotein B as markers of cardiovascular risk. Circ Cardiovasc Qual Outcomes. 2011, 4: 337-345. 10.1161/CIRCOUTCOMES.110.959247.View ArticlePubMedGoogle Scholar
- Bernstein DP, Fink L, Handelsman L, Foote J, Lovejoy M, et al: Initial reliability and validity of a new retrospective measure of child abuse and neglect. Am J Psychiatry. 1994, 151: 1132-1136.View ArticlePubMedGoogle Scholar
- Brugha TS, Cragg D: The list of threatening experiences: the reliability and validity of a brief life events questionnaire. Acta Psychiatr Scand. 1990, 82: 77-81. 10.1111/j.1600-0447.1990.tb01360.x.View ArticlePubMedGoogle Scholar
- Robins L, Cottler L, Bucholz K, Compton W: Diagnostic interview schedule for DSM-IV, pp. 1995, St. Louis (MO): Washington University School of MedicineGoogle Scholar
- Hamshere ML, Walters JT, Smith R, Richards AL, Green E, Grozeva D, Jones I, Forty L, Jones L, Gordon-Smith K, et al: Genome-wide significant associations in schizophrenia to ITIH3/4, CACNA1C and SDCCAG8, and extensive replication of associations reported by the Schizophrenia PGC. Mol Psychiatry. 2013, 18 (6): 708-712. 10.1038/mp.2012.67.View ArticlePubMedGoogle Scholar
- Ripke S, Hubner T, Mennigen E, Muller KU, Rodehacke S, et al: Reward processing and intertemporal decision making in adults and adolescents: the role of impulsivity and decision consistency. Brain Res. 2012, 1478: 36-47.View ArticlePubMedGoogle Scholar
- Fergusson DM, Horwood LJ, Miller AL, Kennedy MA: Life stress, 5-HTTLPR and mental disorder: findings from a 30-year longitudinal study. Br J Psychiatry. 2011, 198: 129-135. 10.1192/bjp.bp.110.085993.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1471-244X/13/304/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.