Open Access

Randomized controlled trial of a health plan-level mood disorders psychosocial intervention for solo or small practices

  • Amy M Kilbourne1, 2Email author,
  • Kristina M Nord1, 2,
  • Julia Kyle1, 2,
  • Celeste Van Poppelen1, 2,
  • David E Goodrich1, 2,
  • Hyungjin Myra Kim1,
  • Daniel Eisenberg3,
  • Hyong Un4 and
  • Mark S Bauer5, 6
BMC Psychology20142:48

DOI: 10.1186/s40359-014-0048-x

Received: 3 October 2014

Accepted: 22 October 2014

Published: 13 November 2014

Abstract

Background

Mood disorders represent the most expensive mental disorders for employer-based commercial health plans. Collaborative care models are effective in treating chronic physical and mental illnesses at little to no net healthcare cost, but to date have primarily been implemented by larger healthcare organizations in facility-based models. The majority of practices providing commercially insured care are far too small to implement such models. Health plan-level collaborative care treatment can address this unmet need. The goal of this study is to implement at the national commercial health plan level a collaborative care model to improve outcomes for persons with mood disorders.

Methods/Design

A randomized controlled trial of a collaborative care model versus usual care will be conducted among beneficiaries of a large national health plan from across the country seen by primary care or behavioral health practices. At discharge 344 patients identified by health plan claims as hospitalized for unipolar depression or bipolar disorder will be randomized to receive collaborative care (patient phone-based self-management support, care management, and guideline dissemination to practices delivered by a plan-level care manager) or usual care from their provider. Primary outcomes are changes in mood symptoms and mental health-related quality of life at 12 months. Secondary outcomes include rehospitalization, receipt of guideline-concordant care, and work productivity.

Discussion

This study will determine whether a collaborative care model for mood disorders delivered at the national health plan level improves outcomes compared to usual care, and will inform a business case for collaborative care models for these settings that can reach patients wherever they receive treatment.

Trial registration

ClinicalTrials.gov Identifier: NCT02041962; registered January 3, 2014.

Keywords

Depression Health behavior change Care management Health plans

Background

A recent report from the Department of Health and Human Services highlighted the prevalence, morbidity, and cost associated with clusters of co-occurring chronic conditions, both physical and mental (U.S. Department of Health and Human Services 2011). Evidence suggests that collaborative care models (CCMs) are effective in treating chronic medical and mental illnesses at little to no net healthcare cost (A National Agenda for Research in Collaborative Care. June 2011; Woltmann et al. 2012; Bodenheimer et al. 2002; Wagner et al. 1996; Coleman et al. 2009a). CCMs typically consist of patient self-management skill enhancement, expert decision support to providers via evidence-based practice guidelines, and enhanced access and continuity via care managers (Bauer 2001; Bauer et al. 2001). CCMs will become increasingly important as healthcare delivery systems evolve into accountable care organizations (Fisher et al. 2009; Shortell & Casalino 2010), thereby taking on broader responsibility for care coordination and quality while bearing financial risk for complex, chronic conditions. CCMs can provide either the foundation of, or an annex to, emerging medical home methodologies as well (Nutting et al. 2009; Carrier et al. 2009; Rittenhouse et al. 2008).

To date, evidence-based CCMs have primarily been implemented at the facility level in publically funded settings (A National Agenda for Research in Collaborative Care. June 2011; Woltmann et al. 2012; Coleman et al. 2009b; Collins et al. 2010) or within integrated healthcare systems (Rittenhouse et al. 2010; Casalino et al. 2003; Druss et al. 2010; Katon et al. 2010) but not in smaller practices (Bauer et al. 2012a). However, the majority (between 50-70%) of patients receive care from network-model health plans and within small practices of less than 20 providers (Bauer et al. 2012a; Findlay 1999). These smaller practices are less likely to be able to implement care management processes (Rittenhouse et al. 2011). The few trials involving CCMs delivered remotely (off-site) recommend a combination of rapport-building telephone care manager-patient contacts and personally tailored self-management resources (Datto et al. 2003; Hunkeler et al. 2000; Ludman et al. 2007a; Lynch et al. 2004; Mohr et al. 2005; Oslin et al. 2003; Ransom et al. 2008; Simon et al. 2000; Simon et al. 2009; Stein et al. 2007; Tutty et al. 2005; Lynch et al. 1997; Pariser & O'Hanlon 2005).

The goal of this study is to implement at the national level through a commercial health plan a CCM that is designed to improve outcomes for persons with mood disorders. Mood disorders represent optimal tracer conditions with which to improve management strategies using CCMs for individuals with multiple chronic conditions. Chronic mood disorders (e.g., bipolar disorder, depression) are common and are associated with extensive functional impairment, medical comorbidity, and personal and societal costs (Bauer 2008). National studies of the U.S. population estimate the lifetime prevalence for bipolar spectrum disorders as 6.4% (Judd & Akiskal 2003; Merikangas et al. 2007) and 16.6% for major depressive disorder (Kessler & Wang 2008). Quality of care is suboptimal for both chronic medical (Institute of Medicine 2003; Lopez & Murray 1998) and mental (Boardman 2006; Busch et al. 2004; Druss et al. 2000; Druss et al. 2002; Hogan 2003; Leslie & Rosenheck 2004; Leslie & Rosenheck 2003; Sernyak et al. 2003) disorders, underscoring the need for coordinated, comprehensive care. While unipolar depression is more common, patients with bipolar disorder incur the most health care costs of any mental illness (Peele et al. 2003). Up to 70% of direct treatment costs for mood disorders are generated outside the mental health sector, notably in primary care (Bryant-Comstock et al. 2002; Simon & Unutzer 1999; Dilsaver 2011). In response to extremely high costs and high disease burden associated with mood disorders, CCMs have been found to be effective in reducing symptom burden and improving health-related quality of life for depression (Woltmann et al. 2012; Gilbody et al. 2006; Badamgarav et al. 2003; Unutzer et al. 2008) and bipolar disorder (Bauer 2001; Bauer et al. 2001; Bauer et al. 2006a; Bauer et al. 2006b; Kilbourne et al. 2008; Simon et al. 2006) in separate studies and are now recommended in practice guidelines (American Psychiaric Association 2002; Yatham et al. 2009).

Aims and objectives

The primary aim of this study is to determine whether individuals with mood disorders from practices treated with a health plan-level CCM demonstrate improved health outcomes in 12 months compared to those who receive usual care.

Our primary hypotheses are that compared to usual care, the CCM will result in 1) decreased mood symptoms in 12 months based on the nine-item Patient Health Questionnaire (PHQ-9), or 2) improved mental health-related quality of life based on the Short Form Health Survey (SF-12). Our secondary hypotheses are that patients receiving CCM versus usual care will have 1) reduced probability of hospitalization, 2) improved guideline-concordant care (e.g., mood disorders treatment, cardiometabolic monitoring), and 3) improved work productivity within 12 months.

Exploratory aims of this study are to support subsequent CCM dissemination by identifying key patient characteristics associated with CCM engagement and outcomes, to estimate the costs of CCM versus usual care, and assess the incremental costs per difference in patient-level utility associated with CCM versus usual care over a 24-month period.

Methods

This single-blind randomized controlled effectiveness trial will compare patients receiving the CCM for mood disorders versus usual care. The population of interest will be Aetna adult enrollees and family members (beneficiaries) across the country hospitalized for an episode of unipolar depression or bipolar disorder. The University of Michigan Medical School Institutional Review Board approved this study with a waiver of documentation of written consent (IRBMED HUM00073753) and the study was registered with ClinicalTrials.gov on January 3, 2014 (NCT02041962). All participants will provide verbal informed consent to the Aetna care manager, and will receive a mailed copy of the consent for their records.

Setting

The CCM will be implemented by providers employed at Aetna Behavioral Health for beneficiaries from across the country who are hospitalized for depression or bipolar disorder. Aetna health plan is the fifth largest healthcare insurer in the country, providing benefits through employers in all 50 states. Serving approximately 12 million covered lives, with 244,971 providers filing claims within the past year, Aetna Behavioral Health has made the development and implementation of CCMs a top priority. Among its enrollees, over 90% were seen in solo or small practices of less than 4 providers (Bauer et al. 2012b).

Participant selection

The Aetna care manager will recruit participants by first screening and consenting them based on near-real time information of recent hospitalizations. At hospitalization, Aetna is notified for (pre)authorization, typically before or within 48 hours of admission. The care manager will be notified about patient hospitalizations via the Aetna care management registry and will contact the potential participant by phone, screen for eligibility, and obtain informed consent and authorization to release information to the research team and to coordinate care with their providers. Because patients have not been randomized at this point, Aetna care managers will be blind to treatment assignment at baseline.

Patient inclusion criteria as determined by the care managers include:
  1. a.

    Adult patients age 21 years or older from the contiguous United States (lower 48 states)

     
  2. b.

    Currently covered by Aetna’s HMO or preferred provider products (for whom Aetna provides mental and medical inpatient, outpatient, and pharmacy benefits) for at least 6 months

     
  3. c.

    Recent (past 6-month) hospitalization for an acute psychiatric or partial hospital unit with a manic or depressive episode and confirmation of mood disorder diagnosis in the medical record (presence of one inpatient or two outpatient designated by International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) diagnostic codes: 296.1×—296.8× in previous 6 months) (Kilbourne et al. 2008).

     
  4. d.

    Ability to speak and read English and provide informed consent.

     

Study design and randomization

As displayed by the Consort diagram in Figure 1, patients will be randomized to CCM or usual care using a computer generated algorithm that will stratify randomization by diagnosis at hospitalization discharge (unipolar disorder, bipolar disorder). The Care Manager, prior to randomization, will ascertain baseline information from enrolled and eligible patients via a brief survey (see Outcomes section below for questions). Remaining outcomes assessments will be completed by a separate research assistant who is not employed by the health plan, and will also be blinded to randomization assignment. The Care Manager will be trained to conduct baseline assessments by study staff on initiating calls across time zones and in human subjects risk reduction procedures used in prior studies (Bauer et al. 2001; Bauer et al. 2006a) that will minimize risk while not compromising study internal validity (Bauer et al. 2001).
Figure 1

Consort flow diagram.

Intervention

Patients randomized to the usual care arm will receive standard care from their practice provider, but none of the CCM components from the plan-level care manager.

Patients randomized to the intervention will receive the plan-level CCM in addition to their usual care from their provider. The CCM intervention will be delivered over a twelve-month period, and include an initial contact with patient enrolled in the CCM arm, 10 weekly self-management sessions, ongoing care management, and dissemination of guidelines and follow-up with patients’ principal healthcare providers regarding clinical issues.

The CCM is based on the Life Goals Collaborative Care program (Table 1), which was found in several randomized controlled trials to improve physical and mental health outcomes for persons with mood disorders (3). Life Goals Collaborative Care components delivered by the Care Manager include the Life Goals self-management program, care management via ongoing contacts to facilitate flow of current clinical status information between patients and their principal healthcare providers, and dissemination of evidence-based clinical practice guidelines for mood disorders to the providers.
Table 1

Mood disorders CCM core elements

Life goals self- management program

10 weekly 30-min telephonic sessions utilizing the Life Goals program that include core modules covering management of depressive symptoms and additional modules utilized as clinically indicated (e.g., mania, wellness, foods and moods, physical activity, substance use, anxiety, psychosis, anger/irritability):

 

Week 1: Introduction – Understanding your mental health and stigma

 

Week 2: Introduction (Continued) – Personal values and Life Goals

 

Week 3: Identifying personal symptoms of depression

 

Week 4: Identifying triggers and responses to depression

 

Week 5: Development of personal action plan for coping with depression

 

Week 6: Optional Session 1

 

Week 7: Optional Session 2

 

Week 8: Optional Session 3

 

Week 9: Managing Your Care – Provider visit preparation

 

Week 10: Plan for continuing to work toward your Life Goals

Access/ continuity/ care management

12 monthly patient telephone contacts for 1 year (in addition to the self-management program) to trouble-shoot self-management issues and summarize clinical status

 

• Ad hoc contacts at either care manager or participant initiation based on clinical or other concerns, including response to participants within one business day

 

• “In-reach” to treating clinicians for hospitalization, ER visits, or specialty consultation

 

• Collaboration with family as permitted

 

• Resource referral as needed

Provider decision support

Provider contacts

 

• Same content as clinic-based CCM

 

• Guidelines disseminated where appropriate based on AHRQ depression in primary care and APA bipolar guidelines

The Life Goals self-management program includes psychoeducation based on Social Cognitive Theory, emphasizing brief Motivational Interviewing and cognitive-behavioral techniques, particularly behavioral activation, to address symptom management and problem-solving skills. Ten core modules (see Table 1) will be delivered over 10 weekly telephonic sessions of 30 minutes (Ludman et al. 2007a; Ludman et al. 2007b). The care manager will deliver the 10 Life Goals self-management program modules via telephone and using a workbook mailed to patients that contains modules, exercises, and other information on mood disorders (Kilbourne et al. 2008; Bauer et al. 2008). For patients with bipolar disorder, at least one of the modules will focus on coping with manic symptoms, while patients with unipolar depression will also receive an additional module on depressive symptoms (Ludman et al. 2007b).

The care management calls with patients will continue on a monthly basis for up to a year after the self-management phone sessions are completed, with as-needed phone contacts made to follow up in the event of a hospitalization or emergency room visit. Imminent risk (suicidal or assaultive ideation, significant medication toxicity) will be managed via protocols used in prior studies (Bauer et al. 2001; Bauer et al. 2006a; Kilbourne et al. 2008). The care manager will also contact the patients’ providers on an as needed basis such as in the event of hospitalization, emergency room visit, or development of a new clinical issue, as well as to cue them if there is a crisis encounter (e.g., suicidality). It is important to note that, as in our prior studies (Bauer et al. 2006a; Bauer et al. 2006b; Kilbourne et al. 2008; Simon et al. 2006; Bauer et al. 1997), the CCM is designed to supplement care and does not replace or control provider decision-making. Clinical decision-making remains in the hands of the provider. The CCM therefore enhances care processes by: (a) enhancing patient skills to facilitate treatment participation, (b) offering the provider timely information, and (c) outlining situation-specific evidence-based treatment options.

Fidelity to the CCM will be maximized via a 2-day training session for the care manager, as well as regular ongoing calls with the care manager and training to review enrollment progress and review session content delivered to patients randomized to the CCM.

Measures and outcomes

Baseline and outcomes data will be ascertained from patients (including surveys, medical record reviews, and claims data) (Table 2). A 30-minute quantitative survey will be used to ascertain information from patients at baseline, 6, 12, 18, and 24 months thereafter. Patient data will be entered into a web-based data management system. The baseline assessment will include a brief survey on demographics and baseline outcomes measures for mood symptoms, quality of life, and employment and work productivity. Follow-up surveys will include questions on mood symptoms, quality of life, and employment and work productivity. There is the possibility that enrolled patients may inadvertently disclose their randomization status with the RA, and this will be mitigated through RA training (e.g., minimizing leading questions that would disclose treatment assignment).
Table 2

Primary and secondary outcomes and measures

Aims

Key measures

Source

Aim 1. primary outcomes

Mood symptoms: PHQ-9

Patient survey

 

Mental health-related quality of life-SF-12 (MCS)

Patient survey

Aim 1. secondary outcomes

Hospitalizations

Aetna claims data

 

Guideline concordant care:

Medical record/claims

 

Mood disorders: % receiving guideline-concordant antidepressants (if unipolar depression) or guideline-concordant anti-manic treatment (bipolar disorder dx) in 6-month period

 
 

Cardiometabolic monitoring: % receiving lipid profile, fasting glucose or HbA1C, blood pressure, and weight

 
 

Productivity (Work Limitations Questionnaire)

Patient survey

Aim 2

Patient demographics

Patient survey

 

Patient comorbidities

Medical record

Aim 3:

CCM costs, patient inpatient, outpatient, ER, Rx use

Medical record/claims data

Primary outcomes include changes in mood symptoms and mental health-related quality of life to be ascertained between baseline and 12 months later from the patient surveys. The surveys include the 9-item Patient Health Questionnaire (PHQ-9) (Kroenke et al. 2001; Spitzer et al. 1999) to assess mood symptoms, and health-related quality of life based on the SF-12 Mental and Physical Health Component Scores (MCS/PCS) (Ware et al. 1996).

Secondary outcomes will be ascertained from the health plan medical records, claims files, as well as the patient surveys (Table 2). Inpatient hospitalizations (including length of stay) and ER use will be ascertained from Aetna claims data. For hospitalizations, Agency for Healthcare Research and Quality definitions of ambulatory care–sensitive conditions, (http://archive.ahrq.gov/data/safetynet/index.html) will also be used to identify hospitalizations considered preventable.

Measures of guideline-concordant care will be ascertained from Aetna electronic medical and claims records based on diagnostic and treatment codes for medical and psychiatric conditions, as well as utilization, labs, and medication data from a year prior to and up to 24 months after enrollment. Guideline-concordant care measures include previously established metrics for measuring processes of care for mood disorders (Bauer et al. 2009; [STABLE: STAndards for BipoLar Excellence. A performance measurement and quality improvement program]; [42 CFR Part 425. Medicare Program]) as well as indicators from the Accountable Care Organization published rules for performance measures and shared savings ([42 CFR Part 425. Medicare Program]) (Table 2).

Health care costs will be ascertained from the health plan’s electronic record reviews using a standard assessment tool from the enrollment date to 24 months later (Kilbourne et al. 2010). Cost data will be estimated for each inpatient, ER, and outpatient visit using Current Procedural Terminology (CPT) codes. A relative value unit (RVU) weight will allow for the use of the Medicare Fee Schedule to calculate a standardized cost for each service. Costs incurred in different years will be discounted at an annual rate of 3% and adjusted for inflation and discounted to the baseline (first) year of the study. Preventable hospitalizations over the 12 and 24-month period will be defined using the AHRQ Ambulatory Care Sensitive Condition (ACSC) definition ([Prevention Quality Indicators Overview]), which identifies conditions for which “good” outpatient care can potentially prevent the need for hospitalization or for which early intervention can prevent complications or more severe disease.

Analyses

An intent-to-treat analysis will be performed for all analyses. Bivariate baseline analyses will first be conducted to see if randomization was successful by comparing patient demographics and clinical characteristics (e.g., mental health diagnoses) between randomization groups. If there is a lack of equal distribution across groups, these variables will be added as covariates to analyses or propensity scoring will be used. Baseline characteristics will be compared among those enrolled but dropped out over time to those who remained in the study.

Extent and pattern of missing data will be examined for outcome variables as well as for baseline covariates. We expect missing data to be completely at random or at random, in which case the proposed analytical methods will give unbiased estimates of treatment comparison. We will examine how sensitive our conclusions are to potential non-ignorable missingness using a pattern mixture model that will allow us to either model the observed pattern of missingness or change the imputations to represent the likely differences in conditional distributions between observed and missing data (Diggle & Kenward 1994; Little & Rubin 1987). For the latter, we will combine the results from each imputed data using Rubin’s rules (Rubin 1987).

Changes in primary outcomes from baseline to 12 months later (mood symptoms, quality of life) will be treated as continuous variables. Based on pilot data, these outcome measures are expected to be normally distributed. If a continuous outcome exhibits a significant lack of normality, other options will be considered including data transformation, categorization, and non-parametric analyses. We will first visualize the longitudinally assessed outcome data, including plots of cross-sectional means of outcome variables over time. Separate linear mixed-effects models will be run to assess the CCM effects compared to usual care on changes in PHQ-9 and SF-12 MCS scores over 6 and 12-months, adding as covariates the baseline values of the outcome measure, the CCM arm indicator, time, and CCM X time interaction. If CCM by time interaction is not significant, CCM effect averaged over 6 and 12 months will be obtained. Although we expect most study participants will be under the care of one unique provider, the model will account for potential clustering by providers as needed.

For guideline hospitalization and guideline-concordant care, the likelihood of hospitalization (and separately for hospitalizations involving ambulatory care sensitive conditions) and receipt of guideline-concordant treatment from baseline up to 12 months will be determined using a generalized linear mixed-effects model (GLM) with logit link. Similar to our primary hypotheses, linear mixed-effects models will be conducted to determine the effect of CCM versus usual care on changes in the Work and Social Adjustment Scale.

The secondary (exploratory) aim will focus on determining patient factors associated with variation in primary or secondary outcomes. In particular, similar linear mixed-effect and GLM models will be run as described above, but including patient baseline factors such as mood disorder diagnosis, presence of substance use disorders, and provider type (e.g., solo or small group practice) as potential covariates that might explain outcome differences (if any) between those randomized to receive CCM or usual care.

The third exploratory aim will be a cost-effectiveness analysis from the payer perspective involving a comparison of utilization costs of health service providers including the care manager’s time ascertained from time-motion survey. Generalized Linear Models with log link functions will be used to correct for heteroscedasticity and reduce the impact of outliers (Manning & Mullahy 2001). The incremental effectiveness of CCM compared to usual care will be measured by changes in health utilities, assessed using a method described by Zivin (Zivin et al. 2008) and Brazier (Brazier et al. 2005) which translates six of the SF-12 items to changes in health utility (SF-6) based on responses to standard gamble questions given by community members regarding all combinations of possible health states. Cost-effectiveness ratios will be calculated based on the difference in per patient costs and effectiveness of CCM versus usual care. To quantify uncertainty around these ratios, a standard nonparametric bootstrapping approach will be employed. For the business case, additional analyses will be conducted in which changes over time in utilization and costs of inpatient, ER, and outpatient services (medical, psychiatric) will be compared between patients in the CCM or usual care arms over a 2-year period, in order to determine the time dynamics by which the CCM led to changes in health care costs.

Sample size and power

The study sample size was estimated based on our primary aim and informed by our updated CCM pilot studies that estimate effects on changes in the most conservative outcome change to be expected (Cohen’s D = .36 based on changes in PHQ-9 symptom scores and Cohen’s D = .31 based on changes in SF-12 MCS scores from baseline to 12 months). Assuming a 20% dropout by 12 months, a projected 172 patients enrolled per arm (344 patients total per arm) would provide 82.5% power (two-sided alpha test) to detect the expected between-group difference in mean outcome scores assuming one or two patients per provider with a 0.05 within-provider correlation, and adjustment for multiple comparisons (Bauer et al. 2009).

Trial status

Staff training and finalization of recruitment procedures occurred in the spring of 2014. Recruitment and CCM implementation will begin by fall of 2014. Recruitment is anticipated to last 18 months, hence allowing for ample time to recruit patients with either bipolar disorder or depression. Years 3-5 will be devoted to follow up data, analyses for secondary aims, as well as study dissemination and implementation activities.

Discussion

We describe to date one of the first studies to implement a CCM at in a nationwide health plan for patients from small practices, where most mood disorders are seen. CCMs have mostly been implemented at the facility level, and primarily developed for and adopted by larger healthcare organizations. Implementation of evidence-based practices such as the CCM at the health plan level is essential in order to further spread these effective programs to those who need them the most.

Between 50-70% of Americans with mood disorders are managed by commercial insurance plans such as Aetna. A focused implementation of a cross-diagnosis CCM at the national level has implications for the tailoring of evidence-based programs to smaller and rural settings, personalized health care, and implementation of health information technology. As technologies around large databases become more sophisticated and complete, implementation programs that successfully apply these rich resources to helping vulnerable populations will serve as important milestones in the nation’s transition to a more public health model of care.

This study involves a number of strengths, including a groundbreaking health plan- academic partnership, comprehensive data sources, and emphasis on smaller and solo practices. By focusing on measurement dimensions of the Berwick Triple Aim (care, health, and cost), this proposed study is potentially generalizable across complex patient populations (Berwick et al. 2008). Nonetheless, there are key limitations of this proposed design to consider. In addition, while many persons with mood disorders are privately insured under network-model HMOs such as Aetna (Frank et al. 2003), the potential generalizability of this study is restricted to individuals with network-model health plan insurance. This study nonetheless complements a number of initiatives in the public sector that are currently being implemented to increase the uptake of CCMs for mental disorders such as health homes (Collins et al. 2010). Finally, the cost effectiveness analysis is exploratory and not fully powered, but will nonetheless provide valuable information for organizations considering its further adoption.

Conclusions

Health plan-level CCMs can potentially increase access to evidence –based care and improve outcomes for persons with mood disorders seen by solo or small group practices. This proposed study takes advantage of a unique partnership with a national health plan (Aetna) to develop and implement a CCM designed to improve outcomes for persons with mood disorders for solo or small practices, with an eye towards developing a business case for a generalizable plan-level CCM for chronic disorders. This study will contribute to the evolution of the business case for CCMs in general and enhance the utility of plan-level panel management focused on vulnerable populations across different treatment settings.

Authors’ contributions

All authors have made substantial contributions to conception and design, or acquisition of data, or analysis and interpretation of data, have been involved in drafting the manuscript or revising it critically for important intellectual content, and have given final approval of the version to be published. AK conceptualized the study, acquired funding, developed the Intervention and evaluation framework, and drafted the manuscript. AK, KN, JK, CV and DG contributed to the development of the implementation intervention tools and contributed to the editing of the manuscript; AK, HU, MB, HK and DE contributed to the methods and design of the manuscript draft and final revisions. All authors read and approved the final manuscript.

Abbreviations

CCM: 

Collaborative care model

PHQ-9: 

Patient Health Questionnaire

SF-12: 

Short Form Health Survey

ICD-9-CM: 

International Classification of Diseases, Ninth Revision, Clinical Modification

RA: 

Research assistant

MCS: 

Mental Component Score of SF-12

PCS: 

Physical Component Score of SF-12

CPT: 

Current procedural terminology

RVU: 

Relative value unit

ACSC: 

Ambulatory care sensitive condition

GLM: 

Generalized linear mixed-effects model

HMO: 

Health maintenance organization

Declarations

Acknowledgements

This research was supported by the U.S. Agency for Healthcare Research and Quality (HS21425). The views expressed in this article are those of the authors and do not necessarily represent the views of the Veterans Administration.

Authors’ Affiliations

(1)
VA Center for Clinical Management Research (CCMR), VA Ann Arbor Healthcare System
(2)
Department of Psychiatry, University of Michigan Medical School
(3)
Department of Health Management and Policy, School of Public Health, University of Michigan
(4)
Aetna Healthcare
(5)
Center for Healthcare Organization and Implementation Research, VA Boston Healthcare System 152M
(6)
Department of Psychiatry, Harvard Medical School

References

  1. 42 CFR Part 425. Medicare Program; Medicare Shared Savings Program; Accountable Care Organizations [], [http://www.gpo.gov/fdsys/pkg/FR-2011-11-02/pdf/2011-27461.pdf]
  2. A National Agenda for Research in Collaborative Care. June 2011. Agency for Healthcare Research and Quality, Rockville, MD. [], [http://www.ahrq.gov/research/findings/final-reports/collaborativecare/index.html]
  3. Practice guideline for the treatment of patients with bipolar disorder (revision). Am J Psychiatry. 2002, 159: 1-50. 10.1176/appi.ajp.159.1.1.
  4. Badamgarav E, Weingarten SR, Henning JM, Knight K, Hasselblad V, Gano A, Ofman JJ: Effectiveness of disease management programs in depression: a systematic review. Am J Psychiatry. 2003, 160: 2080-2090. 10.1176/appi.ajp.160.12.2080.View ArticlePubMedGoogle Scholar
  5. Bauer MS: The collaborative practice model for bipolar disorder: design and implementation in a multi-site randomized controlled trial. Bipolar Disord. 2001, 3: 233-244. 10.1034/j.1399-5618.2001.30502.x.View ArticlePubMedGoogle Scholar
  6. Bauer, MS. (2008). Bipolar (manic-depressive) disorder. In A Tasman, J Kay, J Lieberman, M Maj, & MB First (Eds.), Psychiatry (3rd ed.). London: Wiley-Blackwell.
  7. Bauer MS, McBride L, Shea N, Gavin C, Holden F, Kendall S: Impact of an easy-access VA clinic-based program for patients with bipolar disorder. Psychiatr Serv. 1997, 48: 491-496.View ArticlePubMedGoogle Scholar
  8. Bauer MS, Williford WO, Dawson EE, Akiskal HS, Altshuler L, Fye C, Gelenberg A, Glick H, Kinosian B, Sajatovic M: Principles of effectiveness trials and their implementation in VA cooperative study #430: 'Reducing the efficacy-effectiveness gap in bipolar disorder'. J Affect Disord. 2001, 67: 61-78. 10.1016/S0165-0327(01)00440-2.View ArticlePubMedGoogle Scholar
  9. Bauer MS, McBride L, Williford WO, Glick H, Kinosian B, Altshuler L, Beresford T, Kilbourne AM, Sajatovic M: Collaborative care for bipolar disorder: part I. intervention and implementation in a randomized effectiveness trial. Psychiatr Serv. 2006, 57: 927-936. 10.1176/appi.ps.57.7.927.View ArticlePubMedGoogle Scholar
  10. Bauer MS, McBride L, Williford WO, Glick H, Kinosian B, Altshuler L, Beresford T, Kilbourne AM, Sajatovic M: Collaborative care for bipolar disorder: part II. impact on clinical outcome, function, and costs. Psychiatr Serv. 2006, 57: 937-945. 10.1176/appi.ps.57.7.937.View ArticlePubMedGoogle Scholar
  11. Bauer, MS, Kilbourne, AM, Greenwald, DE, Ludman, EJ, & McBride, L. (2008). Overcoming Bipolar Disorder: A Comprehensive Workbook for Managing Your Symptoms & Achieving Your Life Goals. Oakland, CA: New Harbinger Publications, Inc.
  12. Bauer MS, Biswas K, Kilbourne AM: Enhancing multiyear guideline concordance for bipolar disorder through collaborative care. Am J Psychiatry. 2009, 166: 1244-1250. 10.1176/appi.ajp.2009.09030342.View ArticlePubMedGoogle Scholar
  13. Bauer MS, Leader D, Un H, Lai Z, Kilbourne AM: Primary care and behavioral health practice size: the challenge for health care reform. Med Care. 2012, 50: 843-848. 10.1097/MLR.0b013e31825f2864.View ArticlePubMedPubMed CentralGoogle Scholar
  14. Bauer MS, Leader D, Un H, Lai Z, Kilbourne AM: Primary Care and Behavioral Health Practice Size: The Challenge for Health Care Reform. Med Care. 2012, 50 (1): 843-848. 10.1097/MLR.0b013e31825f2864.View ArticlePubMedPubMed CentralGoogle Scholar
  15. Berwick DM, Nolan TW, Whittington J: The triple aim: care, health, and cost. Health Aff (Millwood). 2008, 27: 759-769. 10.1377/hlthaff.27.3.759.View ArticleGoogle Scholar
  16. Boardman JB: Health access and integration for adults with serious and persistent mental illness. Families, Systems, & Health. 2006, 21: 3-18. 10.1037/1091-7527.24.1.3.View ArticleGoogle Scholar
  17. Bodenheimer T, Wagner EH, Grumbach K: Improving primary care for patients with chronic illness: the chronic care model, part 2. JAMA. 2002, 288: 1909-1914. 10.1001/jama.288.15.1909.View ArticlePubMedGoogle Scholar
  18. Brazier J, Akehurst R, Brennan A, Dolan P, Claxton K, McCabe C, Sculpher M, Tsuchyia A: Should patients have a greater role in valuing health states?. Appl Health Econ Health Policy. 2005, 4: 201-208. 10.2165/00148365-200504040-00002.View ArticlePubMedGoogle Scholar
  19. Bryant-Comstock L, Stender M, Devercelli G: Health care utilization and costs among privately insured patients with bipolar I disorder. Bipolar Disord. 2002, 4: 398-405. 10.1034/j.1399-5618.2002.01148.x.View ArticlePubMedGoogle Scholar
  20. Busch S, Leslie D, Rosenheck R: Comparing the quality of antidepressant pharmacotherapy in the department of veterans affairs and the private sector. Psych Serv. 2004, 55: 1386-1391. 10.1176/appi.ps.55.12.1386.View ArticleGoogle Scholar
  21. Carrier E, Gourevitch MN, Shah NR: Medical homes: challenges in translating theory into practice. Med Care. 2009, 47: 714-722. 10.1097/MLR.0b013e3181a469b0.View ArticlePubMedPubMed CentralGoogle Scholar
  22. Casalino L, Gillies RR, Shortell SM, Schmittdiel JA, Bodenheimer T, Robinson JC, Rundall T, Oswald N, Schauffler H, Wang MC: External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases. JAMA. 2003, 289: 434-441. 10.1001/jama.289.4.434.View ArticlePubMedGoogle Scholar
  23. Coleman K, Austin BT, Brach C, Wagner EH: Evidence on the chronic care model in the new millennium. Health Aff (Millwood). 2009, 28: 75-85. 10.1377/hlthaff.28.1.75.View ArticleGoogle Scholar
  24. Coleman K, Mattke S, Perrault PJ, Wagner EH: Untangling practice redesign from disease management: how do we best care for the chronically ill?. Annu Rev Public Health. 2009, 30: 385-408. 10.1146/annurev.publhealth.031308.100249.View ArticlePubMedGoogle Scholar
  25. Collins C, Hewson DL, Munger R, Wade T. Evolving models of behavioral health integration in primary care. Milbank Memorial Fund 2010: New York, NY. [], [www.milbank.org/reports/10430EvolvingCare/EvolvingCare.pdf]
  26. Datto CJ, Thompson R, Horowitz D, Disbot M, Oslin DW: The pilot study of a telephone disease management program for depression. Gen Hosp Psychiatr. 2003, 25: 169-177. 10.1016/S0163-8343(03)00019-7.View ArticleGoogle Scholar
  27. Diggle PJ, Kenward MG: Informative dropout in longitudinal data analysis (with discussion). J Royal Stat Soc, Series C (applied statistics). 1994, 43: 49-94.Google Scholar
  28. Dilsaver SC: An estimate of the minimum economic burden of bipolar I and II disorders in the united states: 2009. J Affect Disord. 2011, 129: 79-83. 10.1016/j.jad.2010.08.030.View ArticlePubMedGoogle Scholar
  29. Druss BG, Bradford DW, Rosenheck RA, Radford MJ, Krumholz HM: Mental disorders and use of cardiovascular procedures after myocardial infarction [see comments] 1 31. JAMA. 2000, 283: 506-511. 10.1001/jama.283.4.506.View ArticlePubMedGoogle Scholar
  30. Druss BG, Rosenheck RA, Desai MM, Perlin JB: Quality of preventive medical care for patients with mental disorders. Med Care. 2002, 40: 129-136. 10.1097/00005650-200202000-00007.View ArticlePubMedGoogle Scholar
  31. Druss BG, Von Esenwein SA, Compton MT, Rask KJ, Zhao L, Parker RM: A randomized trial of medical care management for community mental health settings: the Primary Care Access, Referral, and Evaluation (PCARE) study. Am J Psychiatry. 2010, 167: 151-159. 10.1176/appi.ajp.2009.09050691.View ArticlePubMedGoogle Scholar
  32. Findlay S: Managed behavioral health care in 1999: an industry at a crossroads. Health Aff (Millwood). 1999, 18: 116-124. 10.1377/hlthaff.18.5.116.View ArticleGoogle Scholar
  33. Fisher ES, McClellan MB, Bertko J, Lieberman SM, Lee JJ, Lewis JL, Skinner JS: Fostering accountable health care: moving forward in medicare. Health Aff (Millwood). 2009, 28: w219-w231. 10.1377/hlthaff.28.2.w219.View ArticleGoogle Scholar
  34. Frank RG, Huskamp HA, Pincus HA: Aligning incentives in the treatment of depression in primary care with evidence-based practice. Psychiatr Serv. 2003, 54: 682-687. 10.1176/appi.ps.54.5.682.View ArticlePubMedGoogle Scholar
  35. Gilbody S, Bower P, Fletcher J, Richards D, Sutton AJ: Collaborative care for depression: a cumulative meta-analysis and review of longer-term outcomes. Arch Int Med. 2006, 166: 2314-2321. 10.1001/archinte.166.21.2314.View ArticleGoogle Scholar
  36. Hogan MF: The President's new freedom commission: recommendations to transform mental health care in america. Psychiatr Serv. 2003, 54: 1467-1474. 10.1176/appi.ps.54.11.1467.View ArticlePubMedGoogle Scholar
  37. Hunkeler EM, Meresman JF, Hargreaves WA, Fireman B, Berman WH, Kirsch AJ, Groebe J, Hurt SW, Braden P, Getzell M, Getzell M, Feigenbaum PA, Peng T, Salzer M: Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care. Arch Fam Med. 2000, 9: 700-708. 10.1001/archfami.9.8.700.View ArticlePubMedGoogle Scholar
  38. Committee on Quality of Health Care in America: Crossing the quality chasm: A new health system for the 21st century. 2003, National Academy Press, Washington, D.C.
  39. Judd LL, Akiskal HS: The prevalence and disability of bipolar spectrum disorders in the US population: re-analysis of the ECA database taking into account subthreshold cases. J Affect Disord. 2003, 73: 123-131. 10.1016/S0165-0327(02)00332-4.View ArticlePubMedGoogle Scholar
  40. Katon WJ, Lin EH, Von Korff M, Ciechanowski P, Ludman EJ, Young B, Peterson D, Rutter CM, McGregor M, McCulloch D: Collaborative care for patients with depression and chronic illnesses. N Engl J Med. 2010, 363: 2611-2620. 10.1056/NEJMoa1003955.View ArticlePubMedPubMed CentralGoogle Scholar
  41. Kessler RC, Wang PS: The descriptive epidemiology of commonly occurring mental disorders in the united states. Annu Rev Public Health. 2008, 29: 115-129. 10.1146/annurev.publhealth.29.020907.090847.View ArticlePubMedGoogle Scholar
  42. Kilbourne AM, Post EP, Nossek A, Drill L, Cooley S, Bauer MS: Improving medical and psychiatric outcomes among individuals with bipolar disorder: a randomized controlled trial. Psychiatr Serv. 2008, 59: 760-768. 10.1176/appi.ps.59.7.760.View ArticlePubMedGoogle Scholar
  43. Kilbourne AM, Farmer Teh C, Welsh D, Pincus HA, Lasky E, Perron B, Bauer MS: Implementing composite quality metrics for bipolar disorder: towards a more comprehensive approach to quality measurement. Gen Hosp Psychiatr. 2010, 32: 636-643. 10.1016/j.genhosppsych.2010.09.011.View ArticleGoogle Scholar
  44. Kroenke K, Spitzer RL, Williams JB: The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001, 16: 606-613. 10.1046/j.1525-1497.2001.016009606.x.View ArticlePubMedPubMed CentralGoogle Scholar
  45. Leslie DL, Rosenheck RA: Benchmarking the quality of schizophrenia pharmacotherapy: a comparison of the department of veterans affairs and the private sector. J Ment Health Policy Econ. 2003, 6: 113-121.PubMedGoogle Scholar
  46. Leslie DL, Rosenheck RA: Adherence of schizophrenia pharmacotherapy to published treatment recommendations: patient, facility, and provider predictors. Schizophr Bull. 2004, 30: 649-658. 10.1093/oxfordjournals.schbul.a007112.View ArticlePubMedGoogle Scholar
  47. Little RJA, Rubin DB: Satatistical analysis with missing data. 1987, Wiley, New York, NYGoogle Scholar
  48. Lopez AD, Murray CC: The global burden of disease, 1990-2020. Nat Med. 1998, 4: 1241-1243. 10.1038/3218.View ArticlePubMedGoogle Scholar
  49. Ludman EJ, Simon GE, Grothaus LC, Luce C, Markley DK, Schaefer J: A pilot study of telephone care management and structured disease self-management groups for chronic depression. Psychiatr Serv. 2007, 58: 1065-1072. 10.1176/appi.ps.58.8.1065.View ArticlePubMedGoogle Scholar
  50. Ludman EJ, Simon GE, Tutty S, Von Korff M: A randomized trial of telephone psychotherapy and pharmacotherapy for depression: continuation and durability of effects. J Consult Clin Psychol. 2007, 75: 257-266. 10.1037/0022-006X.75.2.257.View ArticlePubMedGoogle Scholar
  51. Lynch DJ, Tamburrino MB, Nagel R: Telephone counseling for patients with minor depression: preliminary findings in a family practice setting. J Fam Pract. 1997, 44: 293-298.PubMedGoogle Scholar
  52. Lynch D, Tamburrino M, Nagel R, Smith MK: Telephone-based treatment for family practice patients with mild depression. Psychol Rep. 2004, 94: 785-792. 10.2466/pr0.94.3.785-792.View ArticlePubMedGoogle Scholar
  53. Manning WG, Mullahy J: Estimating log models: to transform or not to transform?. J Health Econ. 2001, 20: 461-494. 10.1016/S0167-6296(01)00086-8.View ArticlePubMedGoogle Scholar
  54. Merikangas KR, Akiskal HS, Angst J, Greenberg PE, Hirschfeld RM, Petukhova M, Kessler RC: Lifetime and 12-month prevalence of bipolar spectrum disorder in the national comorbidity survey replication. Arch Gen Psychiatry. 2007, 64: 543-552. 10.1001/archpsyc.64.5.543.View ArticlePubMedPubMed CentralGoogle Scholar
  55. Mohr DC, Hart SL, Julian L, Catledge C, Honos-Webb L, Vella L, Tasch ET: Telephone-administered psychotherapy for depression. Arch Gen Psychiatry. 2005, 62: 1007-1014. 10.1001/archpsyc.62.9.1007.View ArticlePubMedGoogle Scholar
  56. Nutting PA, Miller WL, Crabtree BF, Jaen CR, Stewart EE, Stange KC: Initial lessons from the first national demonstration project on practice transformation to a patient-centered medical home. Ann Fam Med. 2009, 7: 254-260. 10.1370/afm.1002.View ArticlePubMedPubMed CentralGoogle Scholar
  57. Oslin DW, Sayers S, Ross J, Kane V, Ten Have T, Conigliaro J, Cornelius J: Disease management for depression and at-risk drinking via telephone in an older population of veterans. Psychosom Med. 2003, 65: 931-937. 10.1097/01.PSY.0000097335.35776.FB.View ArticlePubMedGoogle Scholar
  58. Pariser D, O'Hanlon A: Effects of telephone intervention on arthritis self-efficacy, depression, pain, and fatigue in older adults with arthritis. J Geriatr Phys Ther. 2005, 28: 67-73. 10.1519/00139143-200512000-00002.View ArticlePubMedGoogle Scholar
  59. Peele PB, Xu Y, Kupfer DJ: Insurance expenditures on bipolar disorder: clinical and parity implications. Am J Psychiatry. 2003, 160: 1286-1290. 10.1176/appi.ajp.160.7.1286.View ArticlePubMedGoogle Scholar
  60. Prevention Quality Indicators Overview: AHRQ Quality Indicators. In Book Prevention Quality Indicators Overview: AHRQ Quality Indicators (Editor ed.^eds.). City: Agency for Healthcare Research and Quality. , [http://www.qualityindicators.ahrq.gov/default.aspx]
  61. Ransom D, Heckman TG, Anderson T, Garske J, Holroyd K, Basta T: Telephone-delivered, interpersonal psychotherapy for HIV-infected rural persons with depression: a pilot trial. Psychiatr Serv. 2008, 59: 871-877. 10.1176/appi.ps.59.8.871.View ArticlePubMedGoogle Scholar
  62. Rittenhouse DR, Casalino LP, Gillies RR, Shortell SM, Lau B: Measuring the medical home infrastructure in large medical groups. Health Aff (Millwood). 2008, 27: 1246-1258. 10.1377/hlthaff.27.5.1246.View ArticleGoogle Scholar
  63. Rittenhouse DR, Shortell SM, Gillies RR, Casalino LP, Robinson JC, McCurdy RK, Siddique J: Improving chronic illness care: findings from a national study of care management processes in large physician practices. Med Care Res Rev. 2010, 67: 301-320. 10.1177/1077558709353324.View ArticlePubMedGoogle Scholar
  64. Rittenhouse DR, Casalino LP, Shortell SM, McClellan SR, Gillies RR, Alexander JA, Drum ML: Small and medium-size physician practices use few patient-centered medical home processes. Health Aff (Millwood). 2011, 30: 1575-1584. 10.1377/hlthaff.2010.1210.View ArticleGoogle Scholar
  65. Rubin D: Multiple imputation for non-response in surveys. 1987, Wiley, New York, NYView ArticleGoogle Scholar
  66. Sernyak MJ, Dausey D, Desai R, Rosenheck R: Prescribers' nonadherence to treatment guidelines for schizophrenia when prescribing neuroleptics. Psychiatr Serv. 2003, 54: 246-248. 10.1176/appi.ps.54.2.246.View ArticlePubMedGoogle Scholar
  67. Shortell SM, Casalino LP: Implementing qualifications criteria and technical assistance for accountable care organizations. JAMA. 2010, 303: 1747-1748. 10.1001/jama.2010.575.View ArticlePubMedGoogle Scholar
  68. Simon GE, Unutzer J: Health care utilization and costs among patients treated for bipolar disorder in an insured population. Psych Serv. 1999, 50: 1303-1308.View ArticleGoogle Scholar
  69. Simon GE, VonKorff M, Rutter C, Wagner E: Randomised trial of monitoring, feedback, and management of care by telephone to improve treatment of depression in primary care. BMJ. 2000, 320: 550-554. 10.1136/bmj.320.7234.550.View ArticlePubMedPubMed CentralGoogle Scholar
  70. Simon GE, Ludman EJ, Bauer MS, Unutzer J, Operskalski B: Long-term effectiveness and cost of a systematic care program for bipolar disorder. Arch Gen Psychiatry. 2006, 63: 500-508. 10.1001/archpsyc.63.5.500.View ArticlePubMedGoogle Scholar
  71. Simon GE, Ludman EJ, Rutter CM: Incremental benefit and cost of telephone care management and telephone psychotherapy for depression in primary care. Arch Gen Psychiatry. 2009, 66: 1081-1089. 10.1001/archgenpsychiatry.2009.123.View ArticlePubMedGoogle Scholar
  72. Spitzer RL, Kroenke K, Williams JB: Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. primary care evaluation of mental disorders. patient health questionnaire. JAMA. 1999, 282: 1737-1744. 10.1001/jama.282.18.1737.View ArticlePubMedGoogle Scholar
  73. STABLE: STAndards for BipoLar Excellence. A performance measurement and quality improvement program [], [http://www.cqaimh.org/pdf/measures_summary.pdf]
  74. Stein MD, Herman DS, Bishop D, Anderson BJ, Trisvan E, Lopez R, Flanigan T, Miller I: A telephone-based intervention for depression in HIV patients: negative results from a randomized clinical trial. AIDS Behav. 2007, 11: 15-23. 10.1007/s10461-006-9131-5.View ArticlePubMedGoogle Scholar
  75. Tutty S, Ludman EJ, Simon G: Feasibility and acceptability of a telephone psychotherapy program for depressed adults treated in primary care. Gen Hosp Psychiatr. 2005, 27: 400-410. 10.1016/j.genhosppsych.2005.06.009.View ArticleGoogle Scholar
  76. U.S. Department of Health and Human Services. (2011). U.S. Department of Health and Human Services (HHS) Inventory of Programs, Activities and Initiatives Focused on Improving the Health of Individuals with Multiple Chronic Conditions (MCC). In Compiled by the HHS Interagency Workgroup on Multiple Chronic Conditions under the direction of Anand Parekh, MD, MPH, Deputy Assistant Secretary for Health (Science and Medicine), Office of the Assistant Secretary for Health. U.S. Department of Health and Human Services. ., [http://www.hhs.gov/ash/initiatives/mcc/mcc-inventory-20111018.pdf]
  77. Unutzer J, Katon WJ, Fan MY, Schoenbaum MC, Lin EH, Della Penna RD, Powers D: Long-term cost effects of collaborative care for late-life depression. Am J Managed Care. 2008, 14: 95-100.Google Scholar
  78. Wagner EH, Austin BT, Von Korff M: Organizing care for patients with chronic illness. Milbank Q. 1996, 74: 511-544. 10.2307/3350391.View ArticlePubMedGoogle Scholar
  79. Ware J, Kosinski M, Keller SD: A 12-item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996, 34: 220-233. 10.1097/00005650-199603000-00003.View ArticlePubMedGoogle Scholar
  80. Woltmann E, Grogan-Kaylor A, Perron B, Georges H, Kilbourne AM, Bauer MS: Comparative effectiveness of collaborative chronic care models for mental health conditions across primary, specialty, and behavioral health care settings: systematic review and meta-analysis. Am J Psychiatry. 2012, 169: 790-804. 10.1176/appi.ajp.2012.11111616.View ArticlePubMedGoogle Scholar
  81. Yatham LN, Kennedy SH, Schaffer A, Parikh SV, Beaulieu S, O'Donovan C, MacQueen G, McIntyre RS, Sharma V, Ravindran A, Young LT, Young AH, Alda M, Milev R, Vieta E, Calabrese JR, Berk M, Ha K, Kapczinski F: Canadian Network for Mood and Anxiety Treatments (CANMAT) and International Society for Bipolar Disorders (ISBD) collaborative update of CANMAT guidelines for the management of patients with bipolar disorder: update 2009. Bipolar Disord. 2009, 11: 225-255. 10.1111/j.1399-5618.2009.00672.x.View ArticlePubMedGoogle Scholar
  82. Zivin K, McCarthy JF, McCammon RJ, Valenstein M, Post EP, Welsh DE, Kilbourne AM: Health-related quality of life and utilities among patients with depression in the department of veterans affairs. Psychiatr Serv. 2008, 59: 1331-1334. 10.1176/appi.ps.59.11.1331.View ArticlePubMedGoogle Scholar

Copyright

© Kilbourne et al.; licensee BioMed Central Ltd. 2014

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Advertisement