Skip to main content
Download PDF
Download ePub

The self-efficacy in distress tolerance scale (SE-DT): a psychometric evaluation

Borderline Personality Disorder and Emotion Dysregulation volume 9, Article number: 23 (2022) Cite this article

Abstract

Background

Skills training is believed to be essential in dialectical behavior therapy (DBT) and is also offered as a standalone intervention. There is a need to better understand each skills module’s separate contribution to treatment outcomes. Several assessment instruments are available, but none of them provides specific information about patients’ perceived ability to use skills promoting distress tolerance. The aim of the present study was to develop and evaluate the psychometric properties of a Swedish adaptation of the General Self-Efficacy scale (GSE) for skills use in distress tolerance – the Self-Efficacy in Distress Tolerance scale (SE-DT).

Methods

Cross-sectional and longitudinal data were gathered in a non-clinical (NC) community sample (n = 407) and a clinical psychiatric (CP) sample (n = 46). Participants in the NC sample were asked to complete a set of 19 self-report instruments, including the SE-DT, and 45 participants repeated the assessment after 2 weeks. The patients in the CP sample filled out a subset of eight instruments; twenty patients repeated the assessment after completing a treatment intervention including mindfulness skills and distress tolerance skills or emotion regulation skills.

Results

The analyses showed that the SE-DT is unidimensional with high internal consistency (Cronbach’s alpha = .92) and good test-retest reliability (intraclass correlation = .74). The SE-DT also showed good convergent and divergent validity, demonstrating positive correlations with general self-efficacy and self-compassion, and negative correlations with difficulties in emotion regulation, psychiatric symptoms, and borderline symptoms. The SE-DT showed sensitivity to change, when pre- and post-treatment assessments were compared (Cohen’s d = 0.82).

Discussion

This is preliminary evidence that the SE-DT has adequate to good psychometric properties, supporting the use of a total sum score. The results indicate that the SE-DT can adequately measure the construct of self-efficacy with regard to dealing with distress and emotional crises. The instrument enables continued investigation of standalone skills training and the specific contribution of distress tolerance skills to treatment outcomes in DBT. Further studies are needed to investigate whether these results are valid in other populations. In addition, the field would benefit from a common definition of distress tolerance.

Introduction

Difficulties in emotion regulation are considered a core feature of borderline personality disorder (BPD), triggering dysfunctional behaviors such as suicide attempts and self-harm [26, 32]. Dialectical behavior therapy (DBT) is a comprehensive treatment that targets these behaviors, helping BPD patients increase behavioral control and build a life worth living [32]. In addition to receiving individual therapy and telephone coaching, patients participate in a skills training group where they learn a wide range of skills grouped into four modules: emotion regulation, mindfulness, interpersonal effectiveness, and distress tolerance (DT) [31]. In recent years, the use of skills has been suggested as a key mechanism of change in DBT; for example, more frequent use of skills is associated with less frequent self-harm and dropout [6, 38, 51]. For some BPD patients, a standalone skills training group may be an effective intervention [37]. This may be the case in particular if higher risk patients are excluded [35]. Further, it has been reported that a standalone skills training group can be implemented across several different clinical settings and populations [54]. In some cases, individual online skills training may be a convenient treatment format in preparation and while waiting for standard DBT (i.e., DBT programs that include all treatment modes) (Vasiljevic S, Isaksson M, Wolf-Arehult M, Oster C, Ramklint M, Isaksson J. Brief internet-delivered skills training based on DBT for adults with borderline personality disorder – a qualitative study. Submitted). However, additional research on standalone skills training is needed, with improved research methodology; for example, it is important to improve the assessment of skills [54]. Valid and reliable assessment instruments are also a prerequisite for investigating if and how different skills modules are associated with treatment outcome and dropout in standard DBT. Although DBT is clearly effective as a treatment for BPD, only about 40% of patients are clinically recovered on general measures of psychopathology [9] and dropout rates are about 20% [33]. Thus, there is a need to improve the treatment.

Currently, there are several well-known and evaluated instruments available for the assessment of DBT skills. Linehan and colleagues developed the Dialectical Behavior Therapy Ways of Coping Checklist (DBT-WCCL), assessing coping via DBT skills, as well as dysfunctional behaviors [39]. However, this instrument involves only general assessment of skills use and is not able to differentiate between skills from different modules. In addition, emotion regulation skills have often been assessed with the Difficulties in Emotion Regulation Scale (DERS [8, 19];), interpersonal skills with the Inventory of Interpersonal Problems (IIP [30];), and DT skills with the Distress Tolerance Scale (DTS [50];). However, these questionnaires assess self-perceived problems, rather than the use of effective DBT skills. The following items can exemplify this: “When I’m upset, I have difficulty focusing on other things” (DERS) and “My feelings of distress or being upset scare me” (DTS). In contrast, mindfulness skills have been assessed with instruments such as the Kentucky Inventory of Mindfulness Skills (KIMS [2, 44];), demonstrating a more direct way of investigating the use of mindfulness skills: “When I’m doing something, I’m only focused on what I’m doing, nothing else” (KIMS). Thus, there is a need to develop additional instruments focusing on the assessment of skills use related to different skills.

The skills from the DT module may be the most difficult to assess, since there is no conclusive consensus on how to conceptualize or assess DT [28]. It has been suggested that DT represents an individual’s ability to handle uncomfortable emotion states and sensations [53]. In DBT, DT is defined in a more precise way as the ability to accept (tolerate) distress when it is unavoidable and to handle emotional crises in an effective way [31]. BPD pathology has been reported to be associated with low DT and difficulties in emotion regulation [21]. However, it has also been reported that BPD patients who exhibit high DT are at greater risk of engaging in serious suicidal behaviors, i.e., in some cases it is possible that a strong ability to tolerate distress enables the patient to perform otherwise unsustainable behaviors [1]. In other words, it seems that DT can sometimes be functional, and at other times dysfunctional. In particular, DT strategies become dysfunctional when they are performed instead of effective emotion regulation and problem solving (the failure to use emotion regulation and problem solving may very well be the main cause of distress in the first place). Interestingly, it has been suggested that DT lies at the intersection of emotion and self-control, and that lower willpower self-efficacy predicts subsequent distress intolerance [56]. It has also been suggested that DT is a trait-like construct, not likely to change over time [24].

A problem when assessing DBT skills is that patients are not familiar with these skills prior to treatment; asking patients about something they do not yet understand can make pre-treatment assessments difficult. In addition, it is difficult to compare patients receiving treatment-as-usual with patients receiving DBT if we investigate something that patients learn about in DBT (e.g., DBT skills). Therefore, researchers have underlined the importance of not using DBT-specific terminology in assessment instruments [6, 38]. Another solution to this problem is to ask patients indirectly about their ability to use skills, that is, to assess their perceived self-efficacy (SE).

SE refers to an individual’s belief in their ability to perform a specific behavior when confronted with a certain problem, and rests on the premise that an individual only engages in a behavior if they believe in their own ability to perform the behavior and in the possibility that the behavior leads to a desired goal [3]. During psychotherapy, SE may determine what challenges the patient takes on and how much they strive to achieve a goal [5]. In general, SE has been associated with positive affect and high life satisfaction [27, 34], and has been described as having a predictive role in health-promoting behaviors [49]. According to Bandura [3], SE differs between different areas of life, i.e., one and the same person can report a high level of SE in one area, but a low level of SE in another. Unsurprisingly, high SE in one area is believed to be generalizable to similar areas, as specific underlying skills can be relevant to several areas [3]. It has been suggested that SE consists of a general inherent belief in one’s own ability that is expressed within a broad spectrum of life’s various domains, rather than a belief in one’s ability within a defined area [55]. However, a domain-specific assessment of SE may be a stronger predictor of specific behaviors than an assessment of general SE [36]. A change in domain-specific SE during psychotherapy might also be easier to detect than changes in general SE. Indeed, our clinical experience shows that patients may report different SE levels in different areas. For example, a patient may report a high level of SE when it comes to supporting other people in distress and suggesting skills to use in such situations, while reporting major difficulties in applying the same expertise to themselves, i.e., reporting a low level of SE regarding DT skills in their own life. Patients may also report a high level of SE in working life, even though their private life is characterized by a low level of SE, as well as repeated self-harm and suicidal behaviors.

Since DBT includes skills training in a group format, it offers an excellent opportunity to improve SE levels. The reason is that SE is enhanced in group settings where patients see other patients master difficulties similar to those they are experiencing themselves [4]. SE is also associated with positive psychotherapeutic outcome in other psychiatric disorders, including substance use [22], social phobia [18], and anxiety disorders [13]. Skills use and SE have independently been associated with less frequent self-harm in BPD patients [6].

A commonly used measure of general SE is the General Self-Efficacy scale (GSE [47];) which is a 10-item self-report questionnaire with good to excellent psychometric properties that has been used in many studies and countries [34]. Previous studies indicate that the GSE is unidimensional with an average Cronbach’s alpha of .86 [45]. Evaluations of the Swedish version of the GSE have shown comparable results [14, 36]. The wording of the GSE items is possible to understand without having attended DBT skills training: No matter what comes my way, I’m usually able to handle it. The developers of the GSE recommend that the scale is adapted to the specific area of interest [46]. Importantly, studies conducted in several countries have shown that focusing on general SE, rather than specific SE, decreases the instrument’s sensitivity [34].

In summary, there is a need to develop assessment instruments focusing on the use of DBT skills from different skills modules. This will enable us to better understand each skills module’s separate contribution to treatment outcome and dropout in standalone skills training and skills training in standard DBT. Several instruments related to specific skills modules or the entire skills training are available, but to our knowledge none of them provides specific information about patients’ perceived ability to use skills to deal with distress and emotional crises. Assessment of SE in DT could therefore make an important contribution to future treatment studies. The aim of the present study was to develop and evaluate the psychometric properties of a Swedish adaptation of the GSE for skills use in DT – the Self-Efficacy in Distress Tolerance scale (SE-DT). We hypothesized that the SE-DT would show satisfactory to high internal consistency and test-retest reliability, and a factor structure indicating a single scale. Further, we hypothesized satisfactory convergent and divergent construct validity when the SE-DT was compared with other instruments, such as positive correlations with the GSE and self-compassion and negative correlations with psychiatric and BPD symptoms. The SE-DT was also hypothesized to show a significantly lower mean value in a clinical psychiatric (CP) sample than in a non-clinical (NC) community sample, and to be sensitive to treatment change in a CP sample after participation in a brief skills training program.

Methods

Procedure and participants

Data for psychometric analyses were collected in a NC community sample, using a set of 19 online self-report instruments, and a CP sample, using a subset of eight self-report instruments. Participants in the NC sample were recruited via convenience sampling using a website specifically designed for gathering participants for scientific research and advertisements on social media platforms. Interested participants signed up for more information and then received an e-mail with a link to more information about the study. Those who chose to participate were asked to sign an informed consent form and fill out the study instruments and background variables online. Two weeks after the first assessment, a subsample (n = 45) filled out the questionnaires a second time, for test-retest analysis. Participants in the NC sample were offered remuneration in the form of a movie ticket voucher for each assessment. All data were collected anonymously. In total, 407 people participated and filled out the instruments. The background variables are presented in Table 1.

Table 1 Background variables for the non-clinical community sample (n = 407)
Full size table

Participants in the CP sample were recruited at two sites: a general psychiatric outpatient clinic, primarily treating patients with depression, anxiety disorders, and personality disorders, and the BPD unit at Psychiatry Northwest in Stockholm, treating patients with full or sub-threshold (fulfilling four diagnostic criteria) BPD. During new patients’ initial appointment with a psychiatrist or a psychologist, health professionals routinely asked them to participate in diagnostic interviews, as well as to fill out a standard battery of self-report instruments. Diagnosis was based on the Mini-International Neuropsychiatric Interview (M.I.N.I.) [48] and the Structured Clinical Interview for DSM-IV Axis II Personality Disorders, borderline criteria (SCID-II) [17]. Patients were informed about the study during the diagnostic evaluation.

A total of 30 patients at the general psychiatric outpatient clinic, of whom 26 (87%) were female and 4 (13%) were male, chose to participate, signed an informed consent form, and completed the instruments in a baseline assessment. For 22 of these patients, the mean number of fulfilled BPD criteria was four; the remaining patients had depression or anxiety disorders. The patients with BPD-typical symptoms and/or self-harm were offered to participate in a standalone full-scale skills training group, including 24 sessions, or a standalone brief skills training group, including eight sessions (focusing only on mindfulness skills and DT skills), depending on in which group started next and the treatment goals of the patient. Twenty patients agreed to start treatment and filled out the questionnaires again in a second assessment after completing the skills group.

Sixteen patients at the BPD unit, thirteen female (81%) and three male (19%), chose to participate. The mean number of fulfilled BPD criteria was four. Seven of these patients participated in one of three treatment options: a standalone full-scale skills training group, including 24 sessions, a DBT program with both skills training and individual therapy (6–12 months), or emotion regulation group therapy (ERGT [43];) including 16 sessions. They filled out the questionnaires both before and after completing treatment. Standalone skills training and ERGT were offered to patients with less severe and subthreshold BPD, whereas the DBT program was offered to patients with more severe problems and self-harm.

In total, there were 46 patients in the CP sample and 27 of them provided data for the sensitivity analysis. The patients in the CP sample were between 18 and 54 years old, with a mean age of 28.15 years (SD = 7.8).

The self-efficacy scale for distress tolerance

The SE-DT assesses a person’s perceived SE in dealing with distress and emotional crises, focusing on the use of effective skills and avoiding dysfunctional and impulsive behaviors with negative consequences (such as self-harm) or doing things one later regrets. The SE-DT is an adaptation of the GSE [47]. The adaptation was made by the fourth and last authors, changing or adding some words in the ten items to ensure that the scale would assess the specific domain in question (see Table 2). Like the original scale, the SE-DT consists of ten items rated on a 4-point Likert scale, ranging from 1 (“not at all true”) to 4 (“exactly true”). The scale is hypothesized to be unidimensional and generates a sum score, ranging from 10 to 40. A higher score indicates a higher level of perceived SE.

Table 2 The wording of the instruction and the items in the self-efficacy for distress tolerance scale (SE-DT), as well as the original items in the General Self-Efficacy scale (GSE)
Full size table

Instruments

The Borderline Symptom List – short version (BSL-23) is a self-report questionnaire targeting experiences and emotions that are typical of BPD patients [10]. In the BSL-23, patients are asked to assess 23 items with regard to the preceding week on a 5-point Likert scale, ranging from 0 (“not at all”) to 4 (“very strong”). A total mean score between 0 and 4 is used in evaluations, where a higher score indicates stronger BPD symptoms. A mean score of 2.05 (SD = 0.90) has been reported among BPD patients and the internal consistency for the instrument is high, with a Cronbach’s alpha of .94–.97 [10]. These results are comparable to those of the original scale (BSL-95 [11];). In addition, comparisons between pre- and post-treatment assessment scores showed improvements with a large effect size for the BSL-23 (d = 0.47) after 3 months of inpatient DBT [10]. These psychometric properties have been replicated in several studies, investigating different translations of the BSL-23 [25]. In the current study, the alpha value of the BSL-23 was .92.

The Difficulties in Emotion Regulation Scale (DERS) is a 36-item self-report questionnaire and was developed to measure difficulties with emotion regulation. The original version of the scale has shown good psychometric properties [19], as has the shortened 16-item version (DERS-16 [8];). Patients are asked to assess the items with regard to the preceding week on a 5-point Likert scale, ranging from 1 (“almost never”) to 5 (“almost all the time”). The DERS-16 generates a sum score that ranges from 16 to 80, where a higher score indicates more difficulties in emotion regulation. The DERS-16 has demonstrated excellent internal consistency with a Cronbach’s alpha of .92–.94 [8, 20]. In the current study, the alpha value of the DERS-16 was .95.

The General Self-Efficacy scale (GSE) was developed as a self-report instrument, using ten items to assess, on a 4-point Likert scale, a person’s general belief that they can perform a difficult task and cope with adversities in life [47]. Thus, the total score of the GSE ranges from 10 to 40; higher scores indicate a greater sense of general SE. The GSE is available in over 30 languages and the original Swedish version of the GSE was developed by Koskinen-Hagman, Schwarzer, and Jerusalem (http://userpage.fu-berlin.de/~health/selfscal.htm). Both the original version [45] and the Swedish version [14, 36] of the GSE have been reported to have good psychometric properties. In the current study, the alpha value of the GSE was .92.

The Hopkins Symptom Checklist (HSCL-25) includes 25 items and assesses both anxiety (10 items) and depression (15 items) during the preceding week on a 4-point Likert scale, ranging from 1 (“not at all”) to 4 (“a lot”). The scale generates a total mean score, ranging from 1 to 4, with higher scores indicating higher levels of anxiety and depression. It is a short version of the original version of the HSCL [15] and has shown adequate psychometric properties [16, 41]. In the current study, the alpha value of the HSCL-25 was .95.

The Self-Compassion Scale – short form (SCS-SF) includes 12 items, assessing a person’s ability to hold their feelings of suffering. It encompasses three uncompassionate and three compassionate approaches, such as showing kindness, rather than being harsh on oneself, recognizing the shared human experience of being imperfect, and focusing on one’s mindful experience in the moment [42]. The items are rated on a 5-point Likert scale ranging from 1 (“almost never”) to 5 (“almost always”). The scale generates a total mean score ranging from 12 to 60, with higher scores indicating higher levels of self-compassion. The SCS-SF is a short version of the original instrument [40]. In a Swedish sample with older adults [12], acceptable internal consistency was reported (Cronbach’s alpha: .68), while the internal consistency was good in the current study (alpha value = .88).

Analyses

Data were screened for outliers and the data distribution for each variable was inspected. No outliers were identified, and all distributions were normal – except that for the HSCL-25, which had a positive skew. The HSCL-25 data were therefore inverse-transformed (1/x) before analysis, but since this did not affect the results, the original data were used in all analyses.

The factor structure of the SE-DT was investigated through explorative factor analysis using principal component analysis with promax rotation [52]. Associations between variables were assessed with Spearman’s rho, internal reliability with Cronbach’s alpha and test-retest with intra-class correlation, using a two-way mixed effects model with absolute agreement. Correlation matrices were calculated with polychoric correlations since the data were ordinal-scaled. Using polychoric correlations estimates latent variables more accurately than their ordinal expressions. Bartlett’s test of sphericity [7] was used to check that the correlation matrix was not random, and a KMO statistic [23] above .50 was required.

Comparisons between groups were made with independent t-tests or Mann-Whitney U-tests, depending on the data structure and measures of effect were calculated with Cohen’s d, pooled to correct for differences in sample size. A p value < .05 was regarded as the significance threshold in all analyses.

Results

Factor structure

The exploratory factor analysis suggested a one-factor solution with an eigenvalue of 5.83 that explained 58.28% of the variance. All items had factor loadings of between .70 and .83 on this single factor. It was the only solution with an eigenvalue above 1, so no further factor analyses were conducted.

Construct validity

The mean score and standard deviation for each instrument are presented in Table 3. The correlations between the SE-DT and the other instruments were significant and in the hypothesized directions (Table 4), i.e., analyses showed a strong positive correlation with general self-efficacy (GSE) and a moderate positive correlation with self-compassion (SCS-SF), whereas there were moderate negative correlations with difficulties with emotion regulation (DERS-16), psychiatric symptoms (HSCL-25), and BPD symptoms (BSL-23).

Table 3 Mean scores, standard deviations, and ranges for each instrument used in this study
Full size table
Table 4 Correlations (Spearman’s rho) between the SE-DT and the other instruments in the non-clinical community sample (n = 407)
Full size table

Reliability

The internal reliability of the SE-DT was high (alpha = .92) with inter-item correlations ranging from .40 to .67. All items correlated moderately (r = .63–.78) with the scale total and no deletion of items would improve the internal consistency markedly. The test-retest reliability was ICC = .74.

Difference between the non-clinical and the clinical samples

The mean value of the SE-DT in the CP sample (M = 16.63, SD = 4.28) was significantly lower (t(432) = 8.97, p < .001, d = 1.45) than that in the NC sample (M = 27.11, SD = 5.97). In the CP sample, the DERS-16 was significantly negatively correlated with the SE-DT (rho = −.46, p = .02); the BSL-23 also showed a negative correlation, but it was not significant (rho = −.27, p = .15).

Sensitivity to change

Participants who completed a brief or a full-scale skills training group (n = 27) reported a significant improvement in SE in regard to DT (t(19) = 4.89, p = .001, d = 0.82), when comparing the SE-DT scores before (M = 16.63, SD = 4.28) and after (M = 22.52, SD = 5.40) treatment. However, there were no statistical improvements in scores for emotion regulation measured with the DERS-16 (t(19) = 1.23, p = .24, d = 0.31) or borderline symptoms measured with the BSL-24 (t(19) = 1.37, p = .18).

Discussion

The aim of the present study was to evaluate the psychometric properties of the SE-DT, assessing a person’s perceived ability to handle distress caused by emotional crises. The SE-DT focuses on the use of effective behaviors (skills), as opposed to dysfunctional behaviors with negative consequences (such as self-harm) or which one regrets [31]. It is designed to facilitate the investigation of DT skills’ specific contributions to treatment effect and dropout in, for example, standalone skills training groups and skills training in full-scale DBT programs. Overall, the SE-DT showed adequate to good psychometric properties, displaying a single-factor structure with high internal consistency, good test-retest reliability, and moderate to strong correlations with other psychiatric instruments, in the hypothesized directions. The moderate correlations with some psychiatric instruments indicate that these instruments have a moderate and expected partial overlap with the SE-DT, but that they measure different constructs. The SE-DT therefore displays an adequate divergent validity when comparing instruments that assess variables relevant to psychiatric problems. The strong correlation with the GSE indicates good convergent validity, while the fact that the correlation was not perfect suggests that the GSE cannot completely replace the SE-DT, and that the SE-DT adds important information in investigation of the specific SE in DT. Overall, these results are in line with previous investigations of the original GSE, indicating that it is a reliable, homogeneous, and unidimensional scale [45]. In addition, the SE-DT could identify differences between a NC community sample and a CP sample with BPD patients and patients with borderline features, with lower scores on the SE-DT in the CP sample. This result was expected, since it is known that SE typically shows a negative association with psychiatric problems such as depression, anxiety, and self-harm [6, 36]. The SE-DT also showed an ability to detect improvements in patients’ belief in their ability to tolerate distress after a brief skills training. This result is in accordance with several treatment studies, reporting that skills training can improve BPD patients’ ability to perform skillful behaviors [37], and that higher levels of SE are associated with less frequent self-harm [6]. Interestingly, the SE-DT seemed to be more sensitive to change than other instruments used to evaluate skills, such as the DERS-16 and the SCS-SF. The reason for this could be that it is more complicated or takes longer to learn how to regulate specific emotions or develop self-compassion than to deal with distress and emotional crises, i.e., the SE-DT might be able to detect change at an earlier stage in the treatment process. However, these results must be replicated in a treatment study where a single treatment program is evaluated. In the present study, patients from different treatment interventions, targeting the improvement of emotion regulation and/or DT skills, were included. The results are therefore difficult to interpret with regard to this question.

As expected, the SE-DT (measuring domain-specific SE) showed the strongest association with the GSE (measuring general SE). This does not come as a surprise, since the two scales share similar item formulations. However, a domain-specific instrument like the SE-DT is believed to be a stronger predictor of specific behaviors such as effective DT skills. In addition, the aspects separating the two instruments might prove to be of particular importance in treatment studies where a domain-specific instrument is expected to show higher sensitivity to change than an instrument assessing general SE. Investigating this assumption further would require a study comparing the SE-DT and the GSE in a clinical sample during an evaluation of a treatment intervention.

The positive association between the SE-DT and self-compassion (SCS-SF) was also in line with expectations, since self-compassion involves showing warmth, understanding, and kindness to oneself, in particular in times of difficulties and suffering [40], which could strengthen the belief in one’s own ability to handle difficulties. Indeed, self-compassion has been suggested to protect a person’s SE in face of failures, and results have shown a positive association between the two variables [29].

The negative association between the SE-DT and difficulties in emotion regulation measured with the DERS-16 [8] was only moderate, even though both DT and emotion regulation represent important skills in DBT. However, a person can deal effectively with distress and emotional crises, for example, by distracting themself, without necessarily knowing how to regulate specific emotions. When levels of distress are high, it is difficult to be mindful of the emotion and making a decision on how to regulate it.

The SE-DT was negatively associated with the HSCL-25 (depression and anxiety) and the BSL-23 (symptoms of BPD) in the non-clinical sample. This was unsurprising, given that people with psychiatric problems would be expected to show low ability to handle distress. However, it may be surprising that the correlation between the SE-DT and the BSL-23 was not significant in the clinical sample. It is worth noting that the clinical sample was small and the analysis may have lacked statistical power to detect weak correlations. Another explanation could be that the association is non-linear and therefore levels out when one has reached a certain level of BPD symptoms. Explorative post-hoc analyses of non-linear associations between the variables were all non-significant. Again, the small sample size resulted in low statistical power for these analyses. Further, there may be other variables, such as the ability to regulate emotions (see also above), that are more important in explaining why some patients remain at high levels of borderline-typical problems. This needs to be further investigated in much larger samples.

The adaptation of the scale from the GSE to the SE-DT was made by two of the authors. There was no consultation with any outside specialists in this process, which might be a limitation worth noting. Also, the self-selected community sample and the small CP sample cause difficulties in interpreting and generalizing the results in the current study. There is always a risk of bias in studies with self-selected participants and it is difficult to say how this may have affected the current evaluation. However, the data distributions were, with some exceptions, satisfactory and there were no signs of floor or ceiling effects. Most of the variables, including emotion regulation, are relevant in the normal population and collecting data from NC community samples is therefore adequate. In spite of the small size of the CP sample, the results were significant when comparing groups, as well as pre- and post-treatment assessments. However, the results of this study should be replicated in larger clinical samples. Research investigating both BPD patients and patients with other diagnoses reporting self-harm would add valuable knowledge to this research field. In addition, since the CP sample consisted mostly of female participants, efforts should be made to include male patients. Nevertheless, these limitations are less problematic in a psychometric evaluation than for example in evaluation of treatment efficacy. Lastly, the research field would benefit from a common definition of DT and an analysis of the advantages of using domain-specific SE instruments (compared with general SE instruments) when investigating changes in treatment studies.

Conclusion

The present study provides preliminary evidence for the usefulness of a scale assessing self-efficacy in distress tolerance, showing it to be a valid and reliable instrument and indicating that the total score should be recommended for use. Future research should focus on evaluating the scale in a larger clinical sample, including male patients and patients with different diagnoses, preferably investigating the scale’s ability to detect change. In particular, the aim should be to investigate distress tolerance skills’ specific contributions to treatment outcome and dropout in standalone skills training and skills training in dialectical behavior therapy.

Availability of data and materials

Data will not be made publicly available due to confidentiality, but can be made available upon reasonable request to the corresponding author.

References

  1. Anestis MD, Gratz KL, Bagge CL, Tull MT. The interactive role of distress tolerance and borderline personality disorder in suicide attempts among substance users in residential treatment. Compr Psychiatry. 2012;53(8):1208–16.

    Article  PubMed  Google Scholar 

  2. Baer RA, Smith GT, Allen KB. Assessment of mindfulness by self-report: the Kentucky inventory of mindfulness skills. Assessment. 2004;11(3):191–206.

    Article  PubMed  Google Scholar 

  3. Bandura A. Guide for constructing self-efficacy scales. Self-Efficacy Beliefs Adolescents. 2006;5(1):307–37.

    Google Scholar 

  4. Bandura A, Adams NE, Beyer J. Cognitive processes mediating behavioral change. J Pers Soc Psychol. 1977;35(3):125.

    Article  CAS  PubMed  Google Scholar 

  5. Bandura A, Cervone D. Differential engagement of self-reactive influences in cognitive motivation. Organ Behav Hum Decis Process. 1986;38(1):92–113.

    Article  Google Scholar 

  6. Barnicot K, Gonzalez R, McCabe R, Priebe S. Skills use and common treatment processes in dialectical behaviour therapy for borderline personality disorder. J Behav Ther Exp Psychiatry. 2016;52:147–56.

    Article  PubMed  Google Scholar 

  7. Bartlett MS. Tests of significance in factor analysis. Br J Stat Psychol. 1950;3(2):77–85.

    Article  Google Scholar 

  8. Bjureberg J, Ljótsson B, Tull MT, Hedman E, Sahlin H, Lundh L-G, et al. Development and validation of a brief version of the difficulties in emotion regulation scale: the DERS-16. J Psychopathol Behav Assess. 2016;38(2):284–96.

    Article  PubMed  Google Scholar 

  9. Bohus M, Haaf B, Simms T, Limberger MF, Schmahl C, Unckel C, et al. Effectiveness of inpatient dialectical behavioral therapy for borderline personality disorder: a controlled trial. Behav Res Ther. 2004;42(5):487–99.

    Article  PubMed  Google Scholar 

  10. Bohus M, Kleindienst N, Limberger MF, Stieglitz R-D, Domsalla M, Chapman AL, et al. The short version of the borderline symptom list (BSL-23): development and initial data on psychometric properties. Psychopathology. 2009;42(1):32-39.

  11. Bohus M, Limberger MF, Frank U, Chapman AL, Kühler T, Stieglitz R-D. Psychometric properties of the borderline symptom list (BSL). Psychopathology. 2007;40(2):126–32.

    Article  PubMed  Google Scholar 

  12. Bratt A, Fagerström C. Self-compassion in old age: confirmatory factor analysis of the 6-factor model and the internal consistency of the self-compassion scale-short form. Aging Ment Health. 2020;24(4):642–8.

    Article  PubMed  Google Scholar 

  13. Brown LA, Wiley JF, Wolitzky-Taylor K, Roy-Byrne P, Sherbourne C, Stein MB, et al. Changes in self-efficacy and outcome expectancy as predictors of anxiety outcomes from the CALM study. Depression and Anxiety. 2014;31(8):678–89.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Carlstedt E, Lexell EM, Pessah-Rasmussen H, Iwarsson S. Psychometric properties of the Swedish version of the general self-efficacy scale in stroke survivors. Int J Rehabil Res. 2015;38(4):333–7.

    Article  PubMed  Google Scholar 

  15. Derogatis LR, Lipman RS, Rickels K, Uhlenhuth EH, Covi L. The Hopkins symptom checklist (HSCL): a self-report symptom inventory. Behav Sci. 1974;19(1):1–15.

    Article  CAS  PubMed  Google Scholar 

  16. Derogatis LR, Rickels K, Rock AF. The SCL-90 and the MMPI: a step in the validation of a new self-report scale. Br J Psychiatry. 1976;128(3):280–9.

    Article  CAS  PubMed  Google Scholar 

  17. First MB, Gibbon M, Spitzer RL, Williams JB, Benjamin LS. Structured clinical interview for DSM-IV® Axis II personality disorders SCID-II: American psychiatric pub; 1997.

    Google Scholar 

  18. Goldin PR, Ziv M, Jazaieri H, Werner K, Kraemer H, Heimberg RG, et al. Cognitive reappraisal self-efficacy mediates the effects of individual cognitive-behavioral therapy for social anxiety disorder. J Consult Clin Psychol. 2012;80(6):1034.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Gratz KL, Roemer L. Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. J Psychopathol Behav Assess. 2004;26(1):41–54.

    Article  Google Scholar 

  20. Hallion LS, Steinman SA, Tolin DF, Diefenbach GJ. Psychometric properties of the difficulties in emotion regulation scale (DERS) and its short forms in adults with emotional disorders. Front Psychol. 2018;9:539.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Iverson KM, Follette VM, Pistorello J, Fruzzetti AE. An investigation of experiential avoidance, emotion dysregulation, and distress tolerance in young adult outpatients with borderline personality disorder symptoms. Personal Disord Theory Res Treat. 2012;3(4):415.

    Article  Google Scholar 

  22. Kadden RM, Litt MD. The role of self-efficacy in the treatment of substance use disorders. Addict Behav. 2011;36(12):1120–6.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Kaiser HF, Rice J. Little jiffy, mark IV. Educ Psychol Meas. 1974;34(1):111–7.

    Article  Google Scholar 

  24. Kiselica AM, Webber T, Bornovalova MA. Stability and change in distress tolerance and its prospective relationship with borderline personality features: a short-term longitudinal study. Personal Disord Theory Res Treat. 2014;5(3):247.

    Article  Google Scholar 

  25. Kleindienst N, Jungkunz M, Bohus M. A proposed severity classification of borderline symptoms using the borderline symptom list (BSL-23). Borderline Personal Disord Emot Dysregul. 2020;7:1–11.

    Article  Google Scholar 

  26. Klonsky ED. The functions of deliberate self-injury: a review of the evidence. Clin Psychol Rev. 2007;27(2):226–39.

    Article  PubMed  Google Scholar 

  27. Leganger A, Kraft P, Roysamb E. Perceived self-efficacy in health behaviour research: conceptualisation, measurement and correlates. Psychol Health. 2000;15(1):51–69.

    Article  Google Scholar 

  28. Leyro TM, Zvolensky MJ, Bernstein A. Distress tolerance and psychopathological symptoms and disorders: a review of the empirical literature among adults. Psychol Bull. 2010;136(4):576.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Liao KY-H, Stead GB, Liao C-Y. A Meta-analysis of the relation between self-compassion and self-efficacy. Mindfulness. 2021:1–14.

  30. Lindberg K, Nevonen L, Gustafsson SA, Nyman-Carlsson E, Norring C. Validation of the inventory of interpersonal problems (IIP-64): a comparison of Swedish female outpatients with anorexia nervosa or bulimia nervosa and controls. Nordic J Psychiatry. 2018;72(5):347–53.

    Article  Google Scholar 

  31. Linehan M. DBT skills training manual: Guilford Publications; 2014a.

    Google Scholar 

  32. Linehan M. Cognitive-behavioral treatment of borderline personality disorder: Guilford Publications; 2018.

    Google Scholar 

  33. Linehan M, Korslund K, Harned M, Gallop R, Lungu A, Neacsiu A, et al. Dialectical behavior therapy for high suicide risk in individuals with borderline personality disorder: a randomized clinical trial and component analysis. JAMA Psychiatry. 2015;72(5):475–82.

    Article  PubMed  CAS  Google Scholar 

  34. Luszczynska A, Gutiérrez-Doña B, Schwarzer R. General self-efficacy in various domains of human functioning: evidence from five countries. Int J Psychol. 2005;40(2):80–9.

    Article  Google Scholar 

  35. Lyng J, Swales MA, Hastings RP, Millar T, Duffy DJ, Booth R. Standalone DBT group skills training versus standard (ie all modes) DBT for borderline personality disorder: a natural quasi-experiment in routine clinical practice. Community Ment Health J. 2020;56(2):238–50.

    Article  PubMed  Google Scholar 

  36. Löve J, Moore CD, Hensing G. Validation of the Swedish translation of the general self-efficacy scale. Qual Life Res. 2012;21(7):1249–53.

    Article  PubMed  Google Scholar 

  37. McMain SF, Guimond T, Barnhart R, Habinski L, Streiner DL. A randomized trial of brief dialectical behaviour therapy skills training in suicidal patients suffering from borderline disorder. Acta Psychiatr Scand. 2017;135(2):138–48.

    Article  PubMed  Google Scholar 

  38. Neacsiu AD, Rizvi SL, Linehan MM. Dialectical behavior therapy skills use as a mediator and outcome of treatment for borderline personality disorder. Behav Res Ther. 2010a;48(9):832–9.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Neacsiu AD, Rizvi SL, Vitaliano PP, Lynch TR, Linehan MM. The dialectical behavior therapy ways of coping checklist: development and psychometric properties. J Clin Psychol. 2010b;66(6):563–82.

    PubMed  Google Scholar 

  40. Neff KD. The self-compassion scale is a valid and theoretically coherent measure of self-compassion. Mindfulness. 2016;7(1):264–74.

    Article  Google Scholar 

  41. Nettelbladt P, Hansson L, Stefansson C-G, Borgquist L, Nordström G. Test characteristics of the Hopkins symptom check List-25 (HSCL-25) in Sweden, using the present state examination (PSE-9) as a caseness criterion. Soc Psychiatry Psychiatr Epidemiol. 1993;28(3):130–3.

    Article  CAS  PubMed  Google Scholar 

  42. Raes F, Pommier E, Neff KD, Van Gucht D. Construction and factorial validation of a short form of the self-compassion scale. Clin Psychol Psychother. 2011;18(3):250–5.

    Article  PubMed  Google Scholar 

  43. Sahlin H, Bjureberg J, Gratz KL, Tull MT, Hedman E, Bjarehed J, et al. Emotion regulation group therapy for deliberate selfharm: a multi-site evaluation in routine care using an uncontrolled open trial design. BMJ Open. 2017;7(10):e016220.

  44. Sauer S, Walach H, Schmidt S, Hinterberger T, Lynch S, Büssing A, et al. Assessment of mindfulness: review on state of the art. Mindfulness. 2013;4(1):3–17.

    Article  Google Scholar 

  45. Scholz U, Doña BG, Sud S, Schwarzer R. Is general self-efficacy a universal construct? Psychometric findings from 25 countries. Eur J Psychol Assess. 2002;18(3):242.

    Article  Google Scholar 

  46. Schwarzer R, Fuchs R. Changing risk behaviors and adopting health behaviors: the role of self-efficacy beliefs. Self-Efficacy Changing Soc. 1995;259:288.

    Google Scholar 

  47. Schwarzer R, Jerusalem M. Generalized self-efficacy scale. Measures in Health Psychology: a User’s portfolio. Causal Control Beliefs. 1995;1(1):35–7.

    Google Scholar 

  48. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-international neuropsychiatric interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(20):22–33.

    PubMed  Google Scholar 

  49. Sheer VC. A meta-synthesis of health-related self-efficacy instrumentation: problems and suggestions. J Nurs Meas. 2014;22(1):77–93.

    Article  PubMed  Google Scholar 

  50. Simons JS, Gaher RM. The distress tolerance scale: development and validation of a self-report measure. Motiv Emot. 2005;29(2):83–102.

    Article  Google Scholar 

  51. Stepp SD, Epler AJ, Jahng S, Trull TJ. The effect of dialectical behavior therapy skills use on borderline personality disorder features. J Personal Disord. 2008;22(6):549–63.

    Article  Google Scholar 

  52. Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics: international edition. Pearson 2012.

  53. Tonarely NA, Ehrenreich-May J. Confirming the factor structure and validity of the distress tolerance scale (DTS) in youth. Child Psychiatry Hum Dev. 2019:1–13.

  54. Valentine SE, Bankoff SM, Poulin RM, Reidler EB, Pantalone DW. The use of dialectical behavior therapy skills training as stand-alone treatment: a systematic review of the treatment outcome literature. J Clin Psychol. 2015;71(1):1–20.

    Article  PubMed  Google Scholar 

  55. van Diemen T, Craig A, van Nes IJ, Stolwijk-Swuste JM, Geertzen JH, Middleton J, et al. Enhancing our conceptual understanding of state and trait self-efficacy by correlational analysis of four self-efficacy scales in people with spinal cord injury. BMC Psychol. 2020;8(1):1–9.

    Article  Google Scholar 

  56. Veilleux JC, Skinner KD, Baker DE, Chamberlain KD. Perceived willpower self-efficacy fluctuates dynamically with affect and distress intolerance. J Res Pers. 2021;90:104058.

    Article  Google Scholar 

Download references

Acknowledgments

We thank Hans Arinell, region Uppsala, who provided statistical advice. Additionally, we thank all participants and our co-workers at the University Hospital in Uppsala and at Psychiatry Northwest for their contributions.

Funding

Open access funding provided by Karolinska Institute. This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

  1. Department of Clinical Neuroscience, Centre for Psychiatry Research, Karolinska Institutet and Stockholm City County, SE-171 77, Stockholm, Sweden

    Sven Alfonsson & Martina Wolf-Arehult

  2. Psychiatry Northwest, PO Box 98, Region Stockholm, SE-191 22, Sollentuna, Sweden

    Karolina Mardula & Christine Toll

  3. Department of Neuroscience, Psychiatry, Uppsala University, Entrance 10, Floor 3B, SE-751 85, Uppsala, Sweden

    Martina Isaksson & Martina Wolf-Arehult

Authors
  1. Sven Alfonsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Karolina Mardula
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Christine Toll
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Martina Isaksson
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Martina Wolf-Arehult
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed substantially to each part of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Martina Wolf-Arehult.

Ethics declarations

Ethics approval and consent to participate

This study was performed in line with the principles of the Declaration of Helsinki. The study was approved by the Regional Ethics Committee in Uppsala (Ref. no. 2018-367).

Informed consent was obtained from all participants included in the study.

Consent for publication

Patients gave written informed consent regarding publication of their data.

Competing interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alfonsson, S., Mardula, K., Toll, C. et al. The self-efficacy in distress tolerance scale (SE-DT): a psychometric evaluation. bord personal disord emot dysregul 9, 23 (2022). https://doi.org/10.1186/s40479-022-00195-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40479-022-00195-9

Keywords

Borderline Personality Disorder and Emotion Dysregulation

ISSN: 2051-6673