Slovak validation of the Levels of Self-Criticism Scale: An Item Response Theory analysis
Julia Halamová, Martin Kanovský & Monika Pacúchová
Abstract: Severe self-criticism is one of the underlying psychological factors which most influence susceptibility to psychopathology and its persistence. This study verifies the psychometric features and factor structure of the Slovak version of the Levels of Self-Criticism Scale. It entails the use of descriptive analysis, reliability analysis, validity analysis, and IRT confirmatory factor analysis. As opposed to the English version with two dimensions (Internalized Self-Criticism and Comparative Self-Criticism) using classical factor analysis, the Slovak translation has three factors (Internalized Self-Criticism, Unfavourable Comparison with Others and Favourable Comparison with Others) exploiting more advanced IRT factor analysis. It is important to explore this question in more detail in future, especially because the proposed three-dimensional structure is not very meaningful from the purely theoretical perspective. The Levels of Self-Criticism Scale appears to have acceptable level of reliability and validity. Therefore, we recommend using this instrument to assess the levels of self-criticism in the English and Slovak versions.
Keywords: Levels of Self-Criticism Scale, self-criticism, test construction, Item Response Theory analysis
Halamová, J., Kanovský, M., & Pacúchová, M. (2018). Slovak validation of the Levels of Self-Criticism Scale: An Item Response Theory analysis. Psihološka obzorja, 27, 155–166. https://doi.org/10.20419/2018.27.491
Anscombe, F. J., & Glynn, W. J. (1983). Distribution of kurtosis statistic for normal statistics. Biometrika, 70(1), 227–234.
Bartholomew, K., & Horowitz, L. M. (1991). Attachment styles among young adults: A test of a four-category model. Journal of Personality and Social Psychology, 61, 226–244. CrossRef
Bentler, P. M. (1992). On the fit of models to covariances and methodology to the Bulletin. Psychological Bulletin, 112, 400–404. CrossRef
Bishop, P. A., & Herron, R. L. (2015). Use and misuse of the Likert item responses and other ordinal measures. International Journal of Exercise Science, 8(3), 297–302.
Blatt, S. J. (1974). Levels of object representation in anaclitic and introjective depression. Psychoanalytic Study of the Child, 24, 107–157. CrossRef
Blatt, S. J., D'Afflitti, J. P., & Quinlan, D. M. (1976). Depressive Experiences Questionnaire. Unpublished manuscript, Yale University, New Haven, CT, USA.
Bowlby, J. (1980). Attachment and loss: Vol. 3: Loss, separation, and depression. New York, NY, USA: Basic Books.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA, USA: Sage.
Cai, L. (2010). Metropolis-Hastings Robbins-Monro algorithm for confirmatory item factor analysis. Journal of Educational and Behavioral Statistics, 35, 307–335. CrossRef
Carlson, M., Wilcox, R., Chou, C. P., Chang, M., Yang, F., Blanchard, J., Marterella, A., Kuo, A., & Clark, F. (2011). Psychometric properties of reverse-scored items on the CES-D in a sample of ethnically diverse older adults. Psychological Assessment, 23, 558–562. CrossRef
Castilho, P., Pinto-Gouveia, J., & Duarte J. (2015). Exploring Self-criticism: Confirmatory Factor Analysis of the FSCRS in Clinical and Nonclinical Samples. Clinical Psychology & Psychotherapy, 22(2), 153–164. CrossRef
Chalmers, R. P. (2012). mirt: A Multidimensional Item Response Theory Package for the R Environment. Journal of Statistical Software, 48(6), 1–29. CrossRef
Chen, S. X., Lam, B., Wu, W., Ng, J., Buchtel, E., Guan, Y., & Deng, H. (2016). 'Do people's world views matter? The why and how.' Journal of Personality and Social Psychology, 110(5), 743–765. CrossRef
Costa, P. T. & McCrae, R. (1992). Revised NEO Personality Inventory (NEO-PI-R) and NEO Five Factor Model (NEO-FFI). Professional manual. Odesa, FL, USA: Psychological Assesment Center.
Crăciun, B. (2013). Coping strategies, self-criticism and gender factor in relation to quality of life. Procedia - Social and Behavioral Sciences, 78, 466–470. CrossRef
Cucina, J. & Byle, K. (2017). The bifactor model fits better than the higher-order model in more than 90% of comparisons for mental abilities test batteries. Journal of Intelligence, 5(3), 27–41. CrossRef
D'Agostino, R. B. (1970). Transformation to normality of the null distribution of G1. Biometrika, 57(3), 679–681. CrossRef
Danielsson, G. (2012). En psykometrisk utprövning av The Levels of Self-Criticism Scale (LOSC) [A psychometric test of The Levels of Self-Criticism Scale (LOSC)]. Lund, Norway: Psykoterapeutexamensuppsats, Lunds universitet, Institutionen för psykologi.
Dinno, A. (2009). Exploring the sensitivity of Horn's parallel analysis to the distributional form of random data. Multivariate Behavioral Research, 44, 362–388. CrossRef
Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399–412. CrossRef
Falconer, C. J., King, J.A., & Brewin, C. R. (2015). Demonstrating mood repair with a situation-based measure of self-compassion and self-criticism. Psychology and Psychotherapy, 88(4), 351–365. CrossRef
Gel, Y. R., & Gastwirth, J. L. (2008). A robust modification of the Jarque-Bera test of normality. Economics Letters, 99, 30–32. CrossRef
Ghorbani, N., Mousavi, A., Watson, P. J., & Chen, Z. (2011). Integrative self-knowledge and the harmony of purpose model in Iranian autoimmune patients. Electronic Journal of Applied Psychology, 7(2), 1–8.
Gilbert, P., & Choden. (2013). Mindful compassion. London, United Kingdom: Constable-Robinson.
Gilbert, P., Clark, M., Hempel, S., Miles, J. N. V., & Irons, C. (2004) Criticising and reassuring oneself: An exploration of forms, styles and reasons in female students. British Journal of Clinical Psychology, 43, 31–50. CrossRef
Gilbert, P., & Irons, C. (2009). Shame, self-criticism, and self-compassion in adolescence. In N. B. Allen (Ed.), Adolescent emotional development and the emergence of depressive disorders (pp. 195–214). Cambridge, United Kingdom: Cambridge University Press.
Greenberg, L. S. (2011). Emotion-focused therapy. Washington DC, USA: American Psychological Association.
Halamová, J., & Kanovský, M. (2017). Sebasúcit a sebakritickosť: Psychometrická analýza meracích nástrojov [Self-criticism and self-blame: Psychometric analysis of measuring instruments]. Bratislava, Slovakia: Univerzita Komenského v Bratislave.
Halamová, J., Kanovský, M., & Pacúchová, M. (2017). Robust psychometric analysis and factor structure of The Forms of Self–criticizing/Attacking and Self–reassuring Scale. Československá psychologie, 61(4), 331–349.
Halamová, J., Kanovský, M., and Pacúchová, M. (2018). Self-Compassion Scale: IRT Psychometric Analysis, Validation, and Factor Structure – Slovak Translation. Psychologica Belgica, 57(4), 190–209. CrossRef
Hewitt, P. L. & Flett, G. (1989). The Multidimensional Perfectionism Scale: development and validation. Canadian Psychology, 30, 339.
Horn, J. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179–185. CrossRef
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. CrossRef
Levinger, G., & Pietromonaco, P. (1989). Conflict Style Inventory. Unpublished scale, University of Massachusetts, Amherst.
Li, C. H. (2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48(3), 936–949. CrossRef
Manfredi, C., Caselli, G., Pescini, F., Rossi, M., Rebecchi, D., Ruggiero, G. M., & Sassaroli S. (2016). Parental criticism, self-criticism and their relation to depressive mood: An exploratory study among a non-clinical population. Research in Psychotherapy: Psychopathology, Process and Outcome, 19(1), 41–48. CrossRef
Maydeu-Olivares, A., Cai, L., & Hernández, A. (2011). Comparing the fit of item response theory and factor analysis models. Structural Equation Modeling: A Multidisciplinary Journal, 18(3), 333–356. CrossRef
McDonald, R. P. (1997). Normal-ogive multidimensional model. In W.J. Linden, & Hambleton R. K. (Eds.), Handbook of modern item response theory (pp. 258–270). New York, NY, USA: Springer. CrossRef
Neff, K. D. (2003a). The development and validation of a scale to measure self-compassion. Self and identity, 2(3), 223–250. CrossRef
Neff, K. D. (2003b). Self-compassion: An alternative conceptualization of a healthy attitude toward oneself. Self and Identity, 2, 85–101. CrossRef
Neff, K. D., & Dahm, K. A. (2015). Self-compassion: What it is, what it does, and how it relates to mindfulness. In M. Robinson, B. Meier, & B. Ostafin (Eds.) Mindfulness and self-regulation (pp. 1–40). New York, NY, USA: Springer. CrossRef
Öngen, D. (2006). The relationships between self-criticism, submissive behavior and depression among Turkish adolescents. Personality and Individual Differences, 41(5), 793–800. CrossRef
R Core Team (2015). R: A language and environment for statistical computing. R Foundation for Statistical Computing. Vienna, Austria. Retrieved from: http://www.R-project.org/
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667–696. CrossRef
Revelle, W. (2015). psych: Procedures for Personality and Psychological Research. Retrieved from: http://CRAN.R-project.org/package=psych
Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354–373. CrossRef
Rockliff, H., Gilbert, P., McEwan, K., Lightman, S., & Glover, D. (2008). A pilot exploration of heart rate variability and salivary cortisol responses to compassion-focused imagery. Clinical Neuropsychiatry: Journal of Treatment Evaluation, 5(3), 132–139.
Rosenberg, M. (1965). Society and the adolescent self-image. Princeton, NJ, USA: Princeton University Press. CrossRef
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34(4, Pt. 2), 100. CrossRef
Samejima F. (1974). Normal ogive model for the continuous response level in the multidimensional latent space. Psychometrika, 39, 111–121. CrossRef
Smart, L. M., Peters, J. R., & Baer, R. A. (2016). Development and validation of a measure of self-critical rumination. Assessment, 23(3), 321–332. CrossRef
Thompson, R., & Zuroff, C. (2004). The Levels of Self-Criticism Scale: Comparative self-criticism and internalized self-criticism. Personality and Individual Differences, 36(2), 419–430. CrossRef
Weijters, B., Baumgartner, H., & Schillewaert, N. (2013). Reversed item bias: An integrative model. Psychological Methods, 18(3), 320–334. CrossRef
Yamaguchi, A., & Kim, M. S. (2013). Effects of self-criticism and its relationship with depression across cultures. International Journal of Psychological Studies, 5, 1. CrossRef
Yamaguchi, A., Kim, M. S., & Akutsu, S. (2014). The effects of self-construals, self-criticism, and self-compassion on depressive symptoms. Personality and Individual Differences, 68, 65–70. CrossRef
Zumbo, B. D., Gadermann, A. M., & Zeisser, C. (2007). Ordinal versions of coefficients Alpha and Theta for Likert rating scales. Journal of Modern Applied Statistical Methods, 6, 21–29. CrossRef