PL EN


2016 | 2/2016 (60), t.2 | 61-82
Article title

Extreme Response Style in Correlational Research

Content
Title variants
PL
Skrajny Styl Odpowiadania w badaniach korelacyjnych
Languages of publication
EN
Abstracts
EN
Extreme Response Style, defined as the tendency to consistently use (or avoid) the extreme ends of response scales in questionnaires with a multiple response category format (Clark, 2000), is one of the most studied response styles. The reason for this is its potential to distort survey results, especially in cross-cultural research (Cheung & Rensvold, 2000). Furthermore, the relationships between ERS and most frequently analyzed socio-demographic variables (such as gender, age, education) are inconclusive. We replicated a number of well-established effects, using data from the World Value Survey, and expanded these analyses by including an ERS index, to determine its possible effect on the original results. We found no significant effects of ERS in any of the replicated studies, as long as the ERS index is uncorrelated with the dependent variable. We followed with a theoretical model and a recount of simulation results in an attempt to define boundaries for the phenomenon of ERS significantly affecting research conclusions. We argue that even for interval-level correlation measures, e.g. as used in the ordinary least squares regression analysis, the effect on real data is negligible.
PL
Extreme Response Style (Skrajny Styl Odpowiadania), definiowany jako skłonność do konsekwentnego korzystania (albo unikania) z krańcowych odpowiedzi w kwestionariuszach (Clark, 2000), jest jednym z najczęściej badanych stylów odpowiadania. Uważa się, że może on zniekształcać wyniki analiz, szczególnie w badaniach międzykulturowych (Cheung i Rensvold, 2000). Wyniki badań nad związkiem ERS z innymi zmiennymi (np. płcią, wiekiem) również są niejednoznaczne. W celu sprawdzenia wpływu ERS, wykorzystując dane z World Value Survey, zreplikowaliśmy kilka analiz, dołączając do nich wskaźnik ERS. W przypadku, gdy wskaźnik ERS nie był skorelowany ze zmienną zależną, nie wpływał on na wyniki. W następnym kroku przeprowadziliśmy symulacje mające na celu określenie sytuacji, w których ERS mógłby istotnie wpływać na relacje pomiędzy zmiennymi. Uważamy, że nawet w przypadku korelacji mierzonych na skalach przedziałowych wykorzystywanych np. w analizie regresji metodą najmniejszych kwadratów, efekt ten jest zaniedbywalny.
Year
Pages
61-82
Physical description
Dates
published
2016-06-30
Contributors
  • Department of Managerial Psychology and Sociology, University of Warsaw, gkrol@wz.uw.edu.pl
References
  • Austin, E.J., Deary, I.J. & Egan, V.(2006). Individual differences in response scale use: mixed Rasch modelling of responses to NEO-FFI items. Personality and Individual Differences, 40, 1235–1245.
  • Baumgartner, H. & Steenkamp, J-B. E. M. (2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38(2), 143–156.
  • Batchelor, J.H., Miao, C. & McDaniel, M.A. (2013). Extreme Response Style: A Meta- Analysis. Presented at the 28th Annual Conference of the Society for Industrial and Organizational Psychology.
  • De Beuckelaer, A., WeijtErs, B. &·Rutten, A. (2010). Using ad hoc measures for response styles: a cautionary note. Qual Quant, 44, 761–775, DOI 10.1007/s11135-009-9225-z.
  • Bond, M.H. & Lun, V.M. (2013). Examining the Relation of Religion and Spirituality to Subjective Well-Being Across National Cultures. Psychology of Religion and Spirituality, 5(4), 304–315.
  • Bond, M.H. & Lun, V.M. (2014). Citizen-making: The role of national goals for socializing children. Social Science Research, 44, 75–85.
  • Cronbach, L.J. (1946). A case study of the split-half reliability coefficient. The Journal of Educational Psychology, 37(3), 473–480.
  • Cheung, G.W. & Rensvold, R.B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling. Journal of Cross- Cultural Psychology, 31(2), 187–212.
  • Clarke III, I. (2000). Extreme response style in cross-cultural research: An empirical investigation. Journal of Social Behavior & Personality, 15(1), 137–152.
  • Crandall, J. (1973). Sex Differences in Extreme Response Style: Differences in Frequency of Use of Extreme Positive and Negative Ratings. The Journal of Social Psychology, 89, 281–293.
  • De Jong, M.G., Steenkamp, J.-B.E.M., Fox, J.-P. & Baumgartner, H. (2008). Using item response theory to measure extreme response style in marketing research: a global investigation. Journal of Marketing Research, 45, 104–115.
  • Engle, P.J. (2011). An Experimental Assessment of Extreme Response Style, Prepared for the American Politics Workshop, available online, 20.12.2014, https://moodle.ied.edu.hk/pluginfile.php/28242/mod_forum/attachment/20436/An_Experimental_Assessment_of_Extreme_Response_Style.pdf.
  • Frowin, F., Memmert, D. & Unkelbach, C. (2013). Calibration processes in a serial talent test. Psychology of Sport and Exercise, 4, 488–492.
  • Greenleaf, E.A. (1992). Measuring Extreme Response Style, Public Opinion Quarterly, 56, 328–51.
  • Grim, S. & Church, A. (1999). A Cross-Cultural Study of Response Biases in Personality Measures, Journal of Research in Personality, 33(4), 415–441.
  • Harzing, A., Brown, M., Köster, K. & Zhao, S. (2011). Response style differences in cross-national research: Dispositional and situational determinants. Management International Review, 52(3), 341–363.
  • Hui, C.H. & Triandis, H.C. (1989). Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20, 296–309.
  • Johnson, T.R., Kulesa, P., Cho, Y.I. & Shavitt, S. (2005). The relation between culture and response styles: evidence from 19 countries. Journal of Cross-Cultural Psychology, 36, 264–277.
  • Kieruj, N.D. & Moors, G.(2013). Response style behavior: question format dependent or personal style? Qual Quant, 47, 193–211, DOI 10.1007/s11135-011-9511-4.
  • Lau, M.Y. (2008). Extreme response style: An empirical investigation of the effects of scale response format and fatigue, doctoral thesis, University of Notre Dame. Retrieved from https://books.google.pl/books?hl=pl&id=f8qePyfQbhwC&q= (10.09.2015).
  • Marshall, R. & Lee, C. (1998). A Cross-Cultural, Between-Gender Study of Extreme Response Style. European Advances in Consumer Research, 3, 90–95. Retrieved from http://www.acrwebsite.org/search/view-conference-proceedings.aspx?Id=11158.
  • Meisenberg, G. & Wiliams, A.(2008). Are acquiescent and extreme response styles related to low intelligence and education? Personality and Individual Differences, 44, 1539–1550.
  • Napier, J.L. & Jost, J.T. (2008). Why are conservatives happier than liberals? Psychological Science, 19(6), 565–572.
  • Naemi, B.D., Beal, D.J. & Payne, S.C. (2009). Personality predictors of extreme response style. Journal of Personality, 77, 261–286.
  • Nisbett, R.E. (2009). Geografia myślenia. Sopot: SAW Smak Słowa.
  • PetErson, R.A., Rhi-Perez, P. & Albaum, G. (2014). A cross-national comparison of extreme response style measures. International Journal of Market Research, 56(1), 89–110.
  • Roster, C.A., Albaum, G. & Rogers, R.D. (2006). Can cross-national/cultural studies presume etic equivalency in respondents’ use of extreme categories of Likert rating scales? The Market Research Society, 48(6), 741–759.
  • Warnecke, R.B., Johnson, T.P., Chávez, N., Sudman, S., O’Rourke, D.P., Lacey, L. &
  • Horm, J. (1997). Improving question wording in surveys of culturally diverse populations. Ann. Epidemiol., 7, 334–342.
  • Wieczorkowska, G. (1993). Pułapki statystyczne. In: Z. Smoleńska (ed.), Badania nad rozwojem w okresie dorastania (pp. 211–234). Warszawa: PAN. [WWK] Wieczorkowska-Wierzbińska, G., Wierzbiński, J. & Kuźmińska, A. (2014). Porównywalność danych sondażowych zebranych w różnych krajach. Psychologia Społeczna, 2(29), 128–143.
Document Type
Publication order reference
Identifiers
ISSN
1644-9584
YADDA identifier
bwmeta1.element.desklight-19ce3185-d6e6-42e2-88aa-471028e83687
JavaScript is turned off in your web browser. Turn it on to take full advantage of this site, then refresh the page.