- Open Access
Consistency and coherence in treatment outcome measures for borderline personality disorder
Borderline Personality Disorder and Emotion Dysregulationvolume 2, Article number: 1 (2015)
There is little consensus regarding outcomes assessment in borderline personality disorder treatment trials, making comparisons of results and meta-analytic studies difficult and far less generalizable. The current article highlights a range of measures frequently employed and puts forth a set of recommendations for a core battery of outcome measures in BPD treatment efforts. The proposed core battery aims to be comprehensive while minimizing patient burden, clinician time and costs. The relative brevity of the proposed core battery would engender flexibility for adding specific processes and outcome measures unique to targeted interventions and treatment models.
Treatment options for borderline personality disorder (BPD) have increased in recent decades. Psychotherapies including dialectical behavior therapy and mentalization-based therapy  with adjunctive pharmacotherapy targeting specific symptoms and/or comorbid psychiatric disorders  have demonstrated efficacy. There is international consensus regarding this evidence-based practice [3-5]. Future treatments likely will relieve further suffering; however treatment options for BPD are still in their relative infancy. As such, there is opportunity to build consensus regarding what constitutes an “effective treatment.” This dialogue is notably missing from the current BPD treatment literature. Furthermore, there is little overlap of outcome measures across trials, making comparisons of results and meta-analytic studies far less generalizable. The current article highlights a range of outcome measures assessed in treatment trials and puts forth a set of recommendations for a core battery of outcome measures in BPD treatment efforts.
Recent meta-analyses and reviews highlight the variety of outcomes utilized to operationalize short-term outcomes. Similar to the heterogeneity in the diagnostic phenomenology of BPD, there, too, is significant heterogeneity in outcomes – both in terms of domains measured and in methods of measurement (e.g., self-report vs. interview). In their review of psychotherapy trials, Stoffers and colleagues  dichotomized outcomes as primary and secondary. Primary outcomes included: overall BPD severity and BPD symptom severity (i.e., anger, affective instability, chronic feelings of emptiness, impulsivity, suicidality, parasuicidality/self-harm, general interpersonal problems, avoidance of abandonment, identity disturbance, and dissociative/paranoid ideation). Secondary outcomes included: psychiatric comorbidity, general distress, global assessment of functioning, attrition/noncompliance with treatment, and adverse events. Additional outcomes included (in some studies) measurement of hospitalizations and emergency department visits. Note, however, that no study assessed all domains, and there was little overlap in measures used among the studies. Lieb et al.’s  review of pharmacotherapy trials included all of the aforementioned outcomes but also included medication tolerability and side-effects. There was a similar pattern of multiple domains assessed and multiple methods of measurement with little overlap across studies. Noting the lack of coherence and consistency across RCTs for BPD, Lieb and colleagues  as well as Zanarini and colleagues  both have called for a coherent set of measures to aid in systematic evaluation of treatment models and best practices.
Longer-term follow-up studies (e.g., [7-9]) suggest that many patients with BPD do well over time with most no longer meeting the required threshold number of diagnostic criteria; however, remission from a diagnosis and recovery from an illness are not comparable outcomes. With treatment and over time, some symptoms resolve (e.g., impulsivity) more readily than others (e.g., chronic dysphoria), but many individuals continue to have difficulties that require treatment [8,10,11]. These individuals will likely qualify for diagnosis of personality disorder, trait specified within the new DSM-5 system. Remission from a BPD diagnosis is a desired outcome but likely not the ultimate end point. The McLean Study of Adult Development and its extensions  define recovery as a constellation of symptomatic remission, good social and vocational functioning, and stability of the aggregate over an extended period of years. Recovery from BPD appears to be among the most stringent outcomes in the current literature; few treatment trials are likely to achieve this decades-long end point. Outside of formal research settings, assessment of recovery is rarely considered, much less done.
Based on broader experience with general mental health quality and outcomes efforts, we argue that a variety of additional outcomes may also define the efficacy of BPD treatment. Though infrequently and variably measured, quality of life (QOL) is gaining recognition as a primary treatment outcome, and the general consensus is that QOL is severely impaired in BPD but improves with treatment . Of note, QOL is a necessary component for cost-effectiveness analyses, a growing area of significance in an era of healthcare cost containment efforts . Measurement of QOL encompasses physical and somatic sensations in addition to other domains . Specific measures of health-related functioning may also capture treatment outcomes in BPD given the increased prevalence of obesity and obesity-related illnesses , chronic pain , sleep disturbance , and increased use of medical care in general . Finally, with the growing knowledge base of biomarkers of BPD, changes in inflammatory markers , neuropeptides , and/or neuroanatomical structures and functions such as the amygdala, hippocampus, and prefrontal cortex  are all promising outcomes of BPD treatments.
It is not surprising that such a heterogeneous, debilitating, and stigmatized disorder would have such a varied use of outcomes across its empirical treatment base. Unfortunately, important outcomes are frequently excluded from BPD treatment trials, likely in an effort to reduce participant burden. Though psychotherapy is the only empirically supported treatment for BPD [3-5], few process variables (e.g., therapeutic relationship) are included as primary or secondary outcomes, despite their potential to affect treatment outcomes . Furthermore, reductions in polypharmacy would also lend support to the effectiveness of an intervention – especially in light of increasing recognition that pharmacotherapy should only be used for targeted symptoms . Inclusion of global assessments of disability, such as the World Health Organization’s Disability Assessment Schedule 2.0 (WHO-DAS 2.0), would put outcomes measurement in BPD in line with the updated Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) system, which uses scores from the WHO-DAS 2.0 to replace Global Assessment of Functioning (GAF) scores. Finally, assessment of patient satisfaction is routinely done across medical, surgical and psychiatric settings given its known relationship with compliance with treatment recommendations; this could also be included in a BPD outcomes battery. Note, measurement of patient satisfaction tends to be treatment setting specific (e.g., ) and thus would vary among trials.
There have been calls for a consensus to identify outcomes measures that capture quality of life, functioning and symptoms that are relevant to both patients and care providers (e.g. ); these have yet to be answered. We agree that inclusion of these core constructs is relevant and likely achievable in research and clinical settings; however, as highlighted above, the number of outcomes for BPD are extensive. Unfortunately, even if possible in formal research settings, a comprehensive battery is unlikely to be assimilated into busy clinical practices – despite the link between routine assessment of outcomes and improved treatment outcomes . We are hopeful, however, that having an extensive but agreed upon battery of outcomes assessments will increase consistency across research settings and improve utilization within clinical practice. Based on broader experience with general mental health outcomes assessment in inpatient and outpatient psychiatric settings [23,25-27], we propose a self-report core battery in Table 1 that is comprehensive while minimizing patient burden, clinician time and costs. Each of these measures is commonly used in clinical and research settings, has sound psychometric properties, and provides a balanced but brief measurement of select underlying constructs. Many of the proposed measures have been translated in multiple languages and thus can be used globally. Of course, we encourage supplementing the core battery with additional self-report and interview-based measures as well as behavioral observation when possible. More in depth measurement will allow for a richer and potentially less-biased appreciation of treatment outcomes (e.g., measurement of changes in personality structure and/or adverse effects) but undoubtedly will be more time, labor and cost intensive.
Stoffers JM, Völlm BA, Rücker G, Timmer A, Huband N, Lieb K. Psychological therapies for people with borderline personality disorder. Cochrane Database Syst Rev. 2012;8:CD005652.
Lieb K, Völlm BA, Rücker G, Timmer A, Stoffers JM. Pharmacotherapy for borderline personality disorder: Cochrane systematic review of randomized trials. Br J Psychiatry. 2010;196:4–12.
American Psychiatric Association. Practice guideline for the treatment of patients with borderline personality disorder. Am J Psychiatry. 2001;158:1–52.
National Health and Medical Research Council. Clinical Practice Guidelines for the Management of Borderline Personality Disorder. Melbourne, Australia: National Health and Medical Research Council; 2012.
National Institute of Health and Clinical Excellence. NICE clinical guideline 78. Borderline personality disorder: treatment and management. London, United Kingdom: National Institute of Health and Clinical Excellence; 2009.
Zanarini MC, Stanley B, Black DW, Markowitz JC, Goodman M, Pilkonis P, et al. Methodological considerations for treatment trials of persons with borderline personality disorder. Ann Clin Psychiatry. 2010;22:75–83.
Paris J, Zweig-Frank H. A 27-year follow-up of patients with borderline personality disorder. Compr Psychiatry. 2001;42:482–7.
Gunderson JG, Stout RL, McGlashan TH, Shea MT, Morey LC, Grillo CM, et al. Ten-year course of borderline personality disorder: psychopathology and function from the Collaborative Longitudinal Personality Disorders Study. Arch Gen Psychiatry. 2011;68:827–37.
Zanarini MC, Frankenburg FR, Reich DB, Fitzmaurice G. Attainment and stability of sustained symptomatic remission and recovery among patients with borderline personality disorder and axis II comparison subjects: a 16-year prospective follow-up study. Am J Psychiatry. 2012;169:476–83.
Zanarini MC, Frankenburg FR, Reich DB, Silk KR, Hudson JI, McSweeney LB. The subsyndromal phenomenology of borderline personality disorder: a 10-year follow-up study. Am J Psychiatry. 2007;164:929–35.
Paris J. The outcome of borderline personality disorder: good for most but not all patients. Am J Psychiatry. 2012;169:445–6.
IsHak WW, Elbau I, Ismail A, Delaloye S, Ha K, Bolotaulo NI, et al. Quality of life in borderline personality disorder. Harv Rev Psychiatry. 2013;2:138–50.
Vos T, Haby MM, Magnus A, Mihalopoulos C, Andrews G, Carter R. Assessing cost-effectiveness in mental health: helping policy-makers prioritize and plan health services. Aust N Z J Psychiatry. 2005;39:701–12.
Schipper H, Clinch JJ, Olweny CLM. Quality of life studies: definitions and conceptual issues. In: Spilker B, editor. Quality of Life and Pharmacoeconomics in Clinical Trials. Lippincott-Raven Publishers: Philadelphia; 1996. p. 11–23.
Frankenburg FR, Zanarini MC. Obesity and obesity-related illnesses in borderline patients. J Pers Disord. 2006;20:71–80.
McWilliams LA, Higgins KS. Associations between pain conditions and borderline personality disorder symptoms: findings from the National Comorbidity Survey Replication. Clin J Pain. 2013;29:527–32.
Fleischer M, Schäfer M, Coogan A, Häßler F, Thome J. Sleep disturbances and circadian CLOCK genes in borderline personality disorder. J Neural Transm. 2012;119:1105–10.
Keuroghlian AS, Frankenburg FR, Zanarini MC. The relationship of chronic medical illnesses, poor health-related lifestyle choices, and health care utilization to recovery status in borderline patients over a decade of prospective follow-up. J Psychiatr Res. 2013;47:1499–506.
Díaz-Marsá M, Macdowell KS, Guemes I, Rubio V, Carrasco JL, Leza JC. Activation of the cholinergic anti-inflammatory system in peripheral blood mononuclear cells from patients with borderline personality disorder. J Psychiatr Res. 2012;46:1610–7.
Stanley B, Siever LJ. The interpersonal dimension of borderline personality disorder: toward a neuropeptide model. Am J Psychiatry. 2010;167:24–39.
Lis E, Greenfield B, Henry M, Guilé JM, Dougherty G. Neuroimaging and genetics of borderline personality disorder: a review. J Psychiatry Neurosci. 2007;32:162–73.
Barnicot K, Katsakou C, Bhatti N, Savill M, Fearns N, Priebe S. Factors predicting the outcome of psychotherapy for borderline personality disorder: a systematic review. Clin Psychol Rev. 2012;32:400–12.
Madan A, Fowler JC, Allen JG, Ellis TE, Hardesty S, Groat M, et al. Assessing and addressing patient satisfaction in a longer-term inpatient behavioral health setting: Preliminary findings on the Menninger Quality of Care measure and methodology. Qual Manag Health Care. 2014;23:178–87.
Azocar F, Cuffel B, McCulloch J, McCabe JF, Tani S, Brodey BB. Monitoring patient improvement and treatment outcomes in managed behavioral health. J Healthc Qual. 2007;29:4–12.
Fowler JC, Madan A, Allen, JG, Ellis T, Mahoney J, Hardesty S, Frueh BC, Oldham JM. Improvement in health-related quality of life among adults with serious mental illness receiving inpatient treatment. A prospective cohort study. J Clin Psych. in press.
Madan A, Borckardt JJ, Connell A, Book S, Campbell S, Gwynette MF, et al. Routine assessment of patient-reported outcomes in behavioral health: Room for improvement. Qual Manage Healthc. 2010;19:70–81.
Madan A, Borckardt JJ, Weinstein B, Wagner M, Dominick C, Cooney H, et al. Clinical Outcomes Assessment in Behavioral Healthcare: Searching for Practical Solutions. J Healthc Qual. 2008;30:30–7.
Bohus M, Limberger MF, Frank U, Chapman AL, Kühler T, Stieglitz R-D. Psychometric properties of the borderline symptom checklist. Psychopathology. 2007;40:126–32.
Kroneke K, Spitzer RL, Williams JB, Löwe B. The patient health questionnaire somatic, anxiety and depressive symptoms scales: a systemic review. Gen Hosp Psychiatry. 2010;32:345–59.
Humeniuk R, Ali R, on behalf of the WHO ASSIST Phase II Study Group. Validation of the alcohol, smoking and substance involvement screening test (ASSIST) and pilot brief intervention [electronic resource]: a technical report of the phast II findings of the WHO ASSIST Project. Geneva, Switzerland: World Health Organization (WHO) Press; 2006.
Ware Jr JE, Kosinski M, Keller SD. SF-12: How to score the SF-12 physical and mental health summary scales. 4th ed. Lincoln, RI: Quality Metric Incorporated; 2002. p. 32.
Üstün TB, Kostanjsek N, Chatterji S, Rehm J. Measuring Health and Disability: Manual for WHO Disability Schedule (WHODAS 2.0). Geneva, Switzerland: World Health Organization (WHO) Press; 2010.
Centers for Medicare & Medicaid Services & The Joint Commission. Specifications Manual for National Inpatient Quality Measures, Discharges 01-01-14 (1Q14) through 12-31-14 (4Q14), Version 3.3. Oakbrook Terrace, IL: The Joint Commission; 2014.
Mundt JC, Greist JH, Gelenberg AJ, Katzelnick DJ, Jefferson JW, Model JG. Feasibility and Validation of a Computer-Automated Columbia-Suicide severity Rating Scale Using Interactive Voice Response Technology. J Psych Res. 2010;44:1224–8.
Mundt JC, Greist JH, Jefferson JW, Federico M, Mann JJ, Posner K. Prediction of suicidal behavior in clinical research by lifetime suicidal ideation and behavior ascertained by the electronic Columbia-Suicide Severity Rating Scale. J Clin Psych. 2013;74:887–93.
This research was partially supported by the Menninger Foundation and McNair Medical Institute. The study follows the guidelines on good publication practices. The study sponsors were not involved in any aspect of the research activities and did not approve the specific protocol or manuscript. Thus, the authors were independent from study sponsors in the context of the research.