Full-text resources of CEJSH and other databases are now available in the new Library of Science.
Visit https://bibliotekanauki.pl

PL EN


2018 | 18 | 2 | 653-664

Article title

Ratings or pairwise comparisons? An experimental study on scale usability

Content

Title variants

PL
Skale ratingowe czy porównania parami? Badania eksperymentalne nad użytecznością skal pomiarowych

Languages of publication

EN

Abstracts

EN
A series of experiments was run in order to evaluate the usability of two different measurement approaches: ratings and ranks (pairwise comparisons). Respondents were asked to assess perceived characteristics (i.e. height and length) of different physical objects by using either a rating or a ranking scale. An artificial neural network model was built to analyse the ranks and standard statistical tests were applied to analyse the ratings. The results were then statistically compared with actual (real) characteristics of objects (i.e. their real height and length). Both systems for measuring values were found equally valid in projecting reality. Such findings offer some methodological and epistemological insights, as they provide information on the measurement power of each scale in terms of approximating real-life phenomena.
PL
Celem badania była ocena użyteczności dwóch różnych skal pomiarowych (ratingowej i rangowej, czyli tzw. porównań parami) w zakresie aproksymacji rzeczywistych zjawisk. Uczestnicy eksperymentu zostali losowo podzieleni na kilka grup badawczych, w ramach których mieli za zadanie ocenić postrzegane cechy różnych obiektów (tj. wysokość lub długość). Ocen tych dokonywali za pomocą jednej z badanych skal pomiarowych. W celu analizy wyników skali rangowej zbudowano model sztucznej sieci neuronowej, natomiast do zanalizowania rezultatów skali ratingowej zastosowano standardowe testy statystyczne. Następnie wszystkie wyniki porównywano z rzeczywistymi charakterystykami obiektów (tj. ich prawdziwą wysokością lub długością). Oba systemy pomiaru okazały się równie dobre w aproksymacji rzeczywistości. Eksperyment ten niesie pewną wartość poznawczą w kontekście metodologicznym oraz epistemologicznym, ponieważ dostarcza informacji o sile pomiarowej każdej ze skal pod względem trafności odzwierciedlania badanych zjawisk.

Year

Volume

18

Issue

2

Pages

653-664

Physical description

Dates

published
2018-06-01

Contributors

  • University of Lodz, Poland

References

  • Brown, M.R., R.K. Bhadury, N. Pope (2010). The impact of comedic violence on viral advertising effectiveness. Journal of Advertising 39: 49-66.
  • Bruner, G (2009). Marketing Scales Handbook: A Compilation of Multi-Item Measures for Consumer Behavior & Advertising Research, vol. 5, GCBII Productions, Carbondale, Illinois.
  • Cabooter, E., B. Weijters, M. Geuens, I. Vermeir (2016). Scale Format Effects on Response Option Interpretation and Use. Journal of Business Research 69(7): 2574-2584.
  • Cline, T.W., M.B. Altsech, J.J. Kellaris (2003). When Does Humor Enhance or Inhibit Ad Responses? The Moderating Role of the Need for Humor. Journal of Advertising 32(3): 31-45.
  • Das, E., M. Galekh, C. Vonkeman (2015). Is sexy better than funny? Disentangling the persuasive effects of pleasure and arousal across sex and humour appeals. International Journal of Advertising 34(3): 406-420.
  • Dhar, R., I. Simonson (2003). The Effect of Forced Choice on Choice. Journal of Marketing Research 40(2): 146-160.
  • Eisend, M., J. Plagemann, J. Sollwedel (2014). Gender Roles and Humor in Advertising: The Occurrence of Stereotyping in Humorous and Nonhumorous Advertising and Its Consequences for Advertising Effectiveness. Journal of Advertising, 43(3), 256-273.
  • Farrugia, V.E., H.P. Martínez, G.N. Yannakakis (2015). The preference learning toolbox. [arXiv:1506.01709].
  • Geuens, M., P. De Pelsmacker (2017). Planning and Conducting Experimental Advertising Research and Questionnaire Design. Journal of Advertising, 46(1), 83-100.
  • Gosling, S.D., A. Augustine, S. Vazire, N. Holtzman, S. Gaddis (2011). Manifestations of Personality in Online Social Networks: Self-Reported Facebook-Related Behaviors and Observable Profile Information. Cyberpsychology, Behavior and Social Networking 14: 483-488.
  • Jamieson, S. (2004). Likert scales: How to (ab)use them. Medical Education 38: 1217-1218.
  • Kim, E., S. Ratneshwar, E. Thorson (2017). Why Narrative Ads Work: An Integrated Process Explanation. Journal of Advertising 46(2): 283-296.
  • Kim, Y., H. Yoon (2014). What Makes People Comedic-Violence Advertisements? A Model for Predicting Attitude and Sharing Intention. Journal of Advertising Research June: 217-232.
  • Knapp, T. (1990). Treating Ordinal Scales as Interval Scales: An Attempt To Resolve the Controversy. Nursing Research 39(2): 121-123.
  • Linn,,R., N. Gronlund (2000). Measurement and Assessment in Teaching. Upper Saddle River, NJ: Prentice-Hall
  • Martinez, H.P., G.N. Yannakakis, J. Hallam (2014). Don’t Classify Ratings of Affect; Rank them! IEEE Transactions on Affective Computing 1-14.
  • Ovadia, S. (2004). Ratings and rankings: reconsidering the structure of values and their measurement. International Journal of Social Research Methodology 7(5): 403–414.
  • Rajabi, M., N. Dens, P. De Pelsmacker, P. Goos (2015). Consumer responses to different degrees of advertising adaptation: the moderating role of national openness to foreign markets. International Journal of Advertising, doi:10.1080/02650487.2015.1110949.
  • Ruch, W., R.T. Proyer. (2009). Extending the study of gelotophobia: On gelotophiles and katagelasticists. Humor – International Journal of Humor Research 22, 1/2: 183-212.
  • Samson, A.C., Y. Meyer (2010). Perception of aggressive humor in relation to gelotophobia, gelotophilia, and katagelasticism. Psychological Test and Assessment Modeling 52(2): 217-230.
  • Schwarz, N., B. Knäuper, H. Hippler, E. Noelle-Neumann, L. Clark (1991). Rating Scales: Numeric Values May Change the Meaning of Scale Labels. Public Opinion Quarterly, 55(4), 570-582.
  • Stokburger-Sauer, N., S. Ratneshwar, S. Sen (2012). Drivers of Consumer-Brand Identification. International Journal of Research in Marketing 29(4): 406-418.
  • Voss, K.E., E.R. Spangenberg, and B. Grohmann (2003). Measuring the Hedonic and Utilitarian Dimensions of Consumer Attitude. Journal of Marketing Research 40(3): 310–320.
  • Wang, S.S. (2013). I Share, Therefore I Am: Personality Traits, Life Satisfaction, and Facebook Check-Ins. Cyberpsychology, Behavior, and Social Networking 16: 870-877.
  • Wänke, M., N. Schwarz (1992). Comparative judgements: how the direction of comparison determines the answer. Conference paper; Zentrum für Umfragen, Methoden und Analysen –ZUMA, Mannheim. Available at: file:///C:/Users/User/Downloads/ssoar-1992-wanke_et_al-comparative_judgements_how_the_direction.pdf. Accessed 29 March 2018.
  • Warren, C., P. McGraw (2013). When humor backfires: revisiting the relationship between humorous marketing and brand attitude. Marketing Science Institute Working Paper Series 13(124): 1-40.
  • Weijters, B., M. Geuens, H. Baumgartner (2013). The Effect of Familiarity with the Response Category Labels on Item Response to Likert Scales. Journal of Consumer Research 40(2): 368-381.
  • Yang, T. (2012). The Decision Behavior of Facebook Users. Journal of Computer Information Systems 52: 50-59.
  • Yang, Y.H., H.H. Chen (2011). Ranking-based emotion recognition for music organization and retrieval. IEEE Transactions on Audio, Speech, and Language Processing 19: 762-774.
  • Yannakakis, G.N., H.P. Martinez (2015). Ratings are Overrated! Frontiers in ICT 2(13): 1-5.
  • Yannakakis, G.N., J. Hallam (2011). Rating vs. preference: A comparative study of self-reporting. Affective Computing and Intelligent Interaction, 6974: 437-446.
  • Yoon, H.J., Y. Kim (2014). The Moderating Role of Gender Identity in Responses to Comedic Violence Advertising. Journal of Advertising 43: 382-396.

Document Type

Publication order reference

Identifiers

YADDA identifier

bwmeta1.element.desklight-2ed0b3d6-5b62-4c01-b711-378e054166fe
JavaScript is turned off in your web browser. Turn it on to take full advantage of this site, then refresh the page.