Project Overeview
The Perceived Stress Scale (PSS, 1) is a widely used tool for for assessing subjective stress. Despite its widespread application, empirical evidence regarding its psychometric properties within adolescent populations—particularly among Black youth—remains limited. This study sought to fill that gap by evaluating the scale’s validity and reliability in this population. Specifically, it pursued three objectives: (1) to evaluate the applicability of the widely supported two-factor model(2,3) within a nationally representative sample of Black adolescents, (2) to examine its measurement invariance across gender, and (3) to assess its predictive validity by analyzing the relationship between perceived stress scores and lifetime prevalence of Major Depressive Disorder (MDD).
Methods
Participants
This study used data from the National Survey of American Life – Adolescent Supplement (NSAL-A). The sample included 1,170 Black adolescents aged 13–17 (52% female).
Measures
Perceived Stress Scale (PSS)
The study used the 14-item PSS from the NSAL-A, which included 8 positive and 6 negative items, with one item rephrased positively. Adolescents rated their perceived stress over the past month on a 5-point scale from 1 (never) to 5 (very often). To align with prior research, responses were recoded to a 0–4 scale.
Major Depressive Disorder (MDD)
MDD was assessed using the World Mental Health Composite International Diagnostic Interview (CIDI) (4).
Statistical Analyses
Factor Structure
Confirmatory Factor Analysis (CFA) was performed to assess the factor structure of the PSS. We evaluated both one-factor and correlated two-factor models for the 14-item and 10-item versions. Model fit was evaluated using established indices: CFI and TLI (values > 0.95 indicate good fit), RMSEA (< 0.05 indicates good fit), and SRMR (< 0.05 indicates good fit).
Measurement Invariance
The study tested whether the structure of the PSS worked the same way for both males and females. We checked:
- Configural invariance (whether the scale measured stress similarly).
- Metric invariance (whether the questions were understood the same way).
- Scalar invariance (whether responses could be compared directly).
Predictive Validity
The study evaluated how well the PSS could identify adolescents with MDD using ROC curve analysis.
Data Preparation
- Missing values coded as 8 and 9 in the database were replaced with NA to ensure accurate handling.
- Positively worded items were reverse-scored for consistency with negatively worded items.
- Descriptive statistics were calculated for key variables to detect anomaly ( see Table 1).
- Correlation matrix was visualized through a heatmap to examine correlation patterns( see Figure 1).
- Missing data percentages were computed and visualized to identify variables with the most missing values ( see Figure 2).
Results
Factor Structure
The Tables below (Tables 2 and 3) summarizes the results of the goodness-of-fit tests for the one-factor and two-factor models of the PSS-14 and PSS-10.
The one-factor models for both versions showed poor fit, while the two-factor models fit the data significantly better. In the PSS-14, item 12 had a very low factor loading (.093) on the perceived distress factor and was removed, resulting in a revised PSS-13 model. Both the revised PSS-13 and the PSS-10 two-factor models demonstrated good fit, supporting the theory that stress consists of two dimensions: perceived coping and perceived distress (see Figures 3 & 4)
Figure 3. Path Diagram of the Two-Factor Model (PSS-13)
Figure 4. Path Diagram of the Two-Factor Model (PSS-10)
Measurement Invariance
The study found that the structure of the Perceived Stress Scale (PSS) is consistent and works equally well for both males and females, ensuring fairness in its use ( See Tables 4 & 5). However, girls reported significantly higher perceived stress levels than boys on both versions of the scale.
Predictive Validity
The Perceived Stress Scale (PSS) showed moderate success in identifying teens at risk for depression(See Roc Curves below). Among the study group, 7.5% were diagnosed with depression, and the PSS-13 and PSS-10 versions both performed reasonably well in distinguishing these individuals. The “perceived distress” part of the scale was particularly effective.
Implications
These findings have important implications for both researchers and clinicians working with this population:
- Use of the PSS-13 (excluding item 12) is recommended for Black adolescent populations, as it offers better model fit and construct representation compared to the full scale.
- Clinical screening efforts should prioritize the Perceived Distress subscale, which has greater relevance for identifying adolescents at risk for depression.
- Researchers and clinicians should avoid relying solely on the total PSS score, as it may obscure important distinctions between distress and coping and fails to capture the multidimensional nature of perceived stress in this population.
- The PSS demonstrates strong evidence of reliability and validity among Black adolescents, supporting its continued use in research and clinical assessments within this group.
- Measurement invariance across gender supports equitable interpretation of the PSS-13 scores, making it an appropriate tool for use with both male and female Black adolescents.
References
Cohen, S., Kamarch, T., & Mermelstein, R. (1983). A global measure of perceived stress. Journal of Health and Social Behavior, 24, 385–396.
Hewitt, P. L., Flett, G. L., & Mosher, S. W. (1992). The perceived stress scale: Factor structure and relation to depression symptoms in a psychiatric sample. Journal of Psychopathology and Behavioral Assessment, 14(3), 247–257. https://doi.org/10.1007/BF00962631
Roberti, J. W., Harrington, L. N., & Storch, E. A. (2006). Further psychometric support for the 10-item version of the perceived stress scale. Journal of College Counseling, 9(2), 135–147. https://doi.org/10.1002/j.2161-1882.2006.tb00100.x
Wittchen, H. U. (1994). Reliability and validity studies of the WHO–Composite International Diagnostic Interview (CIDI): A critical review. Journal of Psychiatric Research, 28(1), 57–84. https://doi.org/10.1016/0022-3956(94)90036-1
Arnett, J. J. (1999). Adolescent storm and stress, reconsidered. The American Psychologist, 54(5), 317–326. https://doi.org/10.1037//0003-066x.54.5.317