The comparison of ‌the fit person Statistics Precision based on the Rasch model to identify the response style of acquiescence

Dehghan Nayeri, Tayebe; Farrokhi, Noorali; Borjali, Ahmad; Alizadeh, Ebrahim

doi:10.22054/jep.2025.42356.2678

Document Type : Research Paper

Authors

¹ PhD in Measurement and Measurement, Allameh Tabataba’i University, Tehran, Iran

² Professor, Department of Educational Psychology, Allameh Tabatabae'i University, Tehran, Iran

³ Professor, Department of Clinical Psychology, Allameh Tabatabaei University, Tehran, Iran

⁴ Assistant Professor, Department of Counseling, Shahid Beheshti University, Tehran, Iran

https://doi.org/10.22054/jep.2025.42356.2678

Abstract

The purpose of the present study was to investigate the precision of the statistics based on the Rasch model (Up , Wp‌, lp‌ &lzp) to detect response style of acquiescence in polytomouse data. Two sampels size (2000 and 500 data) was simulated according to Partial Credit model.The precision of person-fit statistics was compared under different testing conditions (Sample size, test length‌, percentages of aberrant-responding examinees and percentages of aberrant items) together. In order to investigate precision of the statistics used area under the ROC curve. The results showed that Up and Wp statistics had high precision to detect response style of acquiescence in all situations. About these statistics distinguished between the compatible and aberrant response patterns with the highest precision (>./9). lp‌ and lzp statistics had low precision(./5<) in more situations and they could not distinguish response style of acquiescence. It is suggested that be used Up and Wp statistics to detect of the response style of acquiescence . Especially when persons want to be hired and they try to justify themselves.

Keywords

References

امبرتسون، سوزان ای؛ رایس، استیون پی (2000). نظریه‏های جدید روان‏سنجی برای روان‌شناسان، ترجمه حسن پاشا شریفی و همکاران. (1388). تهران: رشد.

Armstrong, R. D. & M. Shi.‏ (2009).A parametric cumulative sum statistic for person fit. Appllied Psychological Measurement, 33, 391-410.

Baumgartner, H. & Steenkamp, J. B. E. M. (2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38, 143–156.

Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., & Kaemmer, B. (2001). MMPI–2 (Minnesota Multiphasic Personality Inventory–2): Manual for administration and scoring (Revised). Minneapolis, MN: University of Minnesota Press.

Conijn, J.M. Emons, W.H. De Jong, K. & Sijtsma, K. (2015). Using person-fit analysis to detect and explain aberrant responding to the Outcome Questionnaire-45. Assessment, 22, 5312-524.

Conijn, J. M. Emons W. H. M. & Sijtsma, K. (2014). Statistic lz-based person-fit methods for noncognitive multiscale measures. Applied psychological Measurement, 38, 122–136.

Cabooter, E. F. K. (2010). The impact of situational and dispositional variables on response styles with respect to attitude measures. Doctoral dissertation, Ghent University, Ghent, Belgium.

Conrad K. J. Bezruczko N. Chan Y. Riley B. Diamond G. Dennis M. L. (2010). Screening for atypical suicide risk with person fit statistics among people presenting to alcohol and other drug treatment. Drug and Alcohol Dependence, 106, 92-100.

Curtis, D. D. (2004). Person misfit in attitude surveys: Influences, impacts and implications. International Education Journal, 5, 125-143.

Chen, C. I., Lee, M. N., & Yen, C. L. (2004). Faking intention on the internet: Effects of test types and situational factors. Chinese Journal of Psychology, 46(4), 349- 359.

De Ayala, R. J. (2009). The Theory and Practice of Item Response Theory.

De la Torre, J. & Deng, W. (2008). Improving person fit assessment by correcting the ability estimate and its reference distribution. Journal of Educational Measurement, 45, 159±1177.

Emons, W. H. M. (2009). Detection and diagnosis of person misfit from patterns of summed polytomous item. Applied Psychological Measurement, 33, 599-619.

Emons, W. H. M. (2008). Nonparametric person-fit analysis of polytomous item scores. Applied Psychological Measurement, 32, 224-247.

Ferrando, P. J. (2012). Assessing inconsistent responding in E and N measures: An application of person-fit analysis in personality. Personality and Individual Differences, 52, 718-722.

Ferrando, P.J. & Chico, E. (2001).Detecting dissimulation in personality test scores: A comparison between person-fit indices and detection scales. Educational and Psychological Measurement, 61, 997-1012.

Glas, C. A. W& Meijer, R. R. (2003). A Bayesian approach to person fit analysis in item response theory models, Applied Psychological Measurement 27(3), 217-233.

Huang, T.W. (2012). Aberrance Detection Powers of the BW and Person-Fit Indices. Educational Technology & Society, 15(1),128–37.

Han, K. T. (2007). WinGen: Windows software that generates IRT parameters and
item responses.‏ Applied Psychological Measurement, ‏31(5),‏457-459.

Karabatsos, G. (2003). Comparing the aberrant response detection performance of thirty-six person-fit statistics. Applied Measurement in Education, 16, 277-298.

Meyers, L. S. Gamst, G. & Guarino, A. J. (2016). Applied multivariate research: Design and interpretation. Sage publications.

Meijer, R. R., Niessen, A. S. M., & Tendeiro, J. N. (2016). A Practical Guide to Check the Consistency of Item Response Patterns in Clinical Research Through Person-Fit Statistics: Examples and a Computer Program. Assessment, 23(1), 52-62.

Meijer, R. R. (2003). Diagnosing item score patterns on a test using item response theorybased person-fit statistics. Psychological Methods, 8, 72-87.

Meyer IH. (2003). Prejudice, social stress and mental health in lesbian, gay, and bisexual populations: Conceptual issues and research evidence. Psychological Bulletin, 129, 674–697.

Meijer, R. R. & Sijtsma, K. (2001). Methodology review: Evaluating person fit. Applied Psychological Measurement, 25, 107-135.

Rupp, A. A. (2013). A systematic review of the methodology for person fit research in Item Response Theory: Lessons about generalizability of inferences from the design of simulation studies. Psychological Test and Assessment Modeling, 55.

Razavi, Tiffani. (2001). Self-report measures: an overview of concerns and mitations of questionnaire use in occupational stress research, Southampton, UK University of Southampton 23pp. (Discussion Papers in Accounting and Management Science, 01-175).

Schoonees, P. C., Van de Velden, M., Groenen, P. J.F. (2015). Constrained dual scaling for detecting response styles in categorical data, Econometric Institute Rep ort, Psychometric Society, 804, 968-994.

Syu, J. J. (2013). Applying person – ‏fit in faking detection the simulation and practice of non- parametric item response theory (Unpublished doctoral dissertation). chengchi university.

St-Onge, C. Valois, P. Abdous, B. & Germain, S. (2011). Accuracy of person-fit statistics: A Monte Carlo study of the influence of aberrance rates. Applied Psychological Measurement, 35, 419-432.

Tendeiro, J. N. (2015). Package ‘PerFit.Version 1.4.

Tippins, N. T. (2011). Technology-Enhanced Assessment of Talent. Hoboken, NJ, USA: Jossey-Bass, ProQuest ebrary. Web. 21 November 2015.

Woods, C. M. Oltmanns, T. F. &Turkheimer, E. (2008). Detection of aberrant responding on a personality scale in a military sample: An application of evaluating person fit with twolevel logistic regression. Psychological assessment, 20(2), 159.

Weijters, B. (2006). Response styles in consumer research Doctoral dissertation, Ghent University, Ghent, Belgium.

Zicker, M. J. & Drasgow, F. (1996). Detecting faking on a personality instrument using appropriate measurement. Applied Psychological Meagurement, 20, 71,87.

The comparison of ‌the fit person Statistics Precision based on the Rasch model to identify the response style of acquiescence

References

References

Volume 20, Issue 73October 2024Pages 69-90

Volume 20, Issue 73
October 2024
Pages 69-90