Using the Center for Epidemiologic Studies Depression Scale (CES-D) to Classify Participants of a Questionnaire Survey with Regard to Their Individual Inclination to Respond at Random

• Authors: Maciej Górkiewicz
• Languages of publication: EN

Abstracts

EN

In this study, the well-known CES-D depression scale was considered as a prototypical tool for assessing an individual’s inclination to respond at random. It was postulated that the set of the responses obtained from the participants of a questionnaire survey could be divided into three classes: the honest responses class; the pure random class, characterized by the same prob- ability of each admissible score; the smart random class, characterized by the same distribution of the probability of scores as in the honest responses class. A two-step classifying procedure was recommended. According to this procedure, the first step should be to separate the pure random responses from the others. As needed, at the second step the smart random responses should be separated from the honest responses. The CES-D scale consists of sixteen direct questions and four reverse questions, each question with four admissible score values, 0, 1, 2, or 3. The material for the analyses includes all of the 4 294 967 296 possible arrangements of the four scores for the sixteen direct questions, and all of the 256 arrangements of the four scores for the four reverse questions, and all of the possible 49 · 13 = 637 pairs of the possible values of the mean scores from the sixteen direct questions and from the four reverse questions, respectively. It was assumed, without loss of generality, that the honest responses to the sixteen direct questions lead to the resulting distribution: P = (8/16; 5/16; 2/16; 1/16), for a score equal to 0, 1, 2, or 3, respectively. The original iterative procedure was used to compute the exact distributions of the mean scores in the pure random class, and in the smart random class. The discriminant ability to dis- tinguish between the two classes was characterized with the Receiver Operating Characteristic (ROC) curve. In result, the excellent discriminant properties of the CES-D were confirmed. The area under the ROC curve was estimated equal to AUC = 0.98 with standard error SE = 0.004 for the screening of the pure random responses from all of the others, and equal to AUC = 0.87 with standard error SE = 0.006 for the purpose of distinguishing the smart random responses from the honest ones.

• Publisher: Sciendo
• Journal: Studies in Logic, Grammar and Rhetoric
• Year: 2014
• Volume: 39
• Issue: 1
• Pages: 89-103

Dates

published

2014-12-01

online

2014-12-30

Contributors

author

Maciej Górkiewicz

• Faculty of Health Sciences, Jagiellonian University Medical College, Krakow, Poland

References

• Bereziewicz, W., & Gorkiewicz, M. (2012). Jak dużo a priori w a posteriori: poznanie naukowe z zastosowaniem metod statystyki. Cogitatum, 2, 1-9, Retrieved from http://filozof.uni.lodz.pl/knf/cogitatum/numer2/cog2bereziewicz.pdf.
• Chmiel, I., & Gorkiewicz, M. (2010). The scope of acceptance by patients motherly and friendly style of nurse’s supporting behaviour in palliative care. Problemy Pielęgniarstwa, 18(4), 399-405.
• Chmiel, I., & Gorkiewicz, M. (2011). Method for evaluating an individual inclina- tion to guess Yes-or-No answers in case of a diversity of opinion at group of trustworthy responders. In L. Bobrowski, T. Burzykowski, J. Doroszewski, & C. Enachescu (Eds.). 114-th ICB Seminar - VIII-th International Seminar: Statistics and Clinical Practice, 8-11 June 2011 (pp. 59-61). Warsaw, Poland: IBIB PAN.
• Chmiel, I., & Gorkiewicz, M. (2012). How much credible are the responses obtained from an individual respondent in a non-repeated questionnaire survey: looking for practical methods with a statistical support. Studies in Logic Grammar and Rhetoric. Logical, Statistical and Computer Methods in Medicine, 29(42), 55-73. Retrieved from http://logika.uwb.edu.pl/studies/vol42.html.
• Chmiel, I., & Gorkiewicz, M. (2014). Measuring physical ability among convalescents on the base of patient-reported quality of life: statistical support for credibility of an individual patient’s report. In L. Bobrowski, U. Mansmann, & C. Enachescu (Eds.). Statistics and Clinical Practice. Lecture Notes of the ICB Seminar., ICB Polish Academy of Sciences, June 2014 (pp. 84). Warsaw, Poland: IBIB PAN.
• Collins, D. (2003). Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research, 12(3), 229-238.
• Counselling Resource Research Staff. (2012). Welcome to the Center for Epi- demiologic Studies Depression Scale (CES-D), a Screening Test for Depression. Retrieved from http://counsellingresource.com/lib/quizzes/depression-testing/cesd/.
• Dojka, E., Gorkiewicz, M., & Pająk, A. (2003). Psychometric value of CES-D scale for the assessment of depression in Polish population. Psychiatria Polska, 37(2), 281-292.[PubMed]
• Eng, J. (n.d.). ROC analysis: web-based calculator for ROC curves. Retrieved from http://www.jrocfit.org.
• Fava, G. A. (1983). Assessing depressive symptoms across cultures: Italian validation of the CES-D self-rating scale. J Clin Psychol., 39(2), 249-251.[Crossref][PubMed]
• Fawcett, T, & Flash, P. A. (2005). A Response to Webb and Ting’s On the Application of ROC Analysis to Predict Classification Performance Under varying Class Distributions. Machine Learning, 58(1), 33-38.[Crossref]
• Garb, H. N, Wood, J. M., & Fiedler, E. R. (2011). A Comparison of Three Strategies for Scale Construction to Predict a Specific Behavioral Outcome. Assessment, 18(4), 399-411.[PubMed][Crossref][WoS]
• Gerrie, M. P., Belcher, & L. E., Garry, M. (2006). Mind the gap: false memories for missing aspects of an event, Applied Cognitive Psychology, 20(5), 689-696.[Crossref]
• Gniadek, A., Kozicka, M., & Gorkiewicz, M. (2010). Nieoczekiwane, pośrednie i pozorne powiązania czynnikow jakości życia osob starszych. In Z. Sienkiewicz, W. Fidecki, & G. Wojcik (Eds.). Wybrane Determinanty Pielęgniarstwa, Część II (pp. 118-127). Warsaw, Poland: Oficyna Wydawnicza Warszawskiego Uniwersytetu Medycznego.
• Górkiewicz, M. (2009). Using Propensity Score with Receiver Operating Characteristics (ROC) and Bootstrap to Evaluate Effect Size in Observational Studies. Biocybernetics and Biomedical Engineering, 29(4), 41-61.
• Górkiewicz, M. (2010). Kognitywistyczne spojrzenie na skale psychometryczne: kiedy trudne jest łatwiejsze od łatwego... In A. Pohl, M. Goc, M. Kittel, T. Konik, & M. Siedlecka (Eds.). Rocznik Kognitywistyczny, IV (pp. 81-86). Krakow, Poland: Wydawnictwo Uniwersytetu Jagiellońskiego.
• Górkiewicz, M. (2014). Detecting patient’s random answers to questionnaire with opposite items and the shifted population norm. In L. Bobrowski, U. Mans- mann, & C. Enachescu (Eds.). Statistics and Clinical Practice. Lecture Notes of the ICB Seminar., ICB Polish Academy of Sciences, June 2014 (pp. 127-130). Warsaw, Poland: IBIB PAN.
• Górkiewicz, M., Ciszek, E., & Szczygieł, A. (2005). Ocenianie kompetencji eksperta na podstawie procedury powtornego rozmieszczania. In Z. J. Brzeziński (Ed.). Horyzonty Metodyczne w Epidemiologii (pp. 125-129). Warsaw, Poland: Komisja Epidemiologii i Zdrowia Publicznego PAN.
• Górkiewicz, M., & Gniadek, A. (2012). The practicality of any nonparametric statistical procedure should be confirmed thoroughly with regard to the data distribution under study. Studies in Logic Grammar and Rhetoric. Logical, Statistical and Computer Methods in Medicine, 29(42), 27-42. Retrieved from http://logika.uwb.edu.pl/studies/vol42.html.
• Górkiewicz, M., & Kołacz, J. (2001). Statystyka Medyczna. Podejście praktyczne przy zastosowaniu programu MS Excel. Krakow, Poland: Wydawnictwo Uniwersytetu Jagiellońskiego.
• Górkiewicz, M., & Kreiner, D. S. (2007). Gender Differences in Creating False Memory under the DRM Paradigm. European Epi-Marker, 11(2), 6-12.
• Hambleton, R. K., & Patsula, L. (1999). Increasing the Validity of Adapted Test: Myths to be Avoided and Guidelines for Improving Test Adaptation Prac- tices. J Appl Testing Technology, 1(1), 1-30.
• Hand, D. J., & Till, R. J. (2001). A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems. Machine Learning, 45(2), 171-186.[Crossref]
• Hanley, J. A., & McNeil, B. J. (1982). The meaning and use of the area under a receiver operating characteristics (ROC) curve. Radiology, 143, 29-36.
• Hanley, J. A., & McNeil, B. J. (1983). A method of comparing the areas under receiver operating characteristics curves derived from the same cases. Radio- logy, 148, 839-843.
• Hann, D., Winter, K., & Jacobsen, P. (1999). Measurement of depressive symptoms in cancer patients: Evaluation of the Center for Epidemiological Studies Depression Scale (CES-D). Journal of Psychosomatic Research, 46, 437-443.[PubMed][Crossref]
• Helmes, E., & Nielson, W. R. (1998). An examination of the internal structure of the Center for Epidemiological Studies-Depression Scale in two medical samples. Personality and Individual Differences, 25, 735-743.
• Miller, W. C., Anton, H. A., & Townson, A. F. (2008). Measurement properties of the CESD scale among individuals with spinal cord injury. Spinal Cord., 46(4), 287-292.[PubMed][Crossref][WoS]
• Obuchowski, N. A. (1998). Sample size calculations in studies of test accuracy, Stat. Meth. Med. Res., 7, 371-392.
• Orme, J. G., Reis, J., & Herz, E. (1988). Factorial and discriminant of the Center for Epidemiologic Studies Depression (CES-D) Scale. Med. Care, 26, 775-789.
• Park, N. S., Jang, Z., Lee, B. S., Ko, J. E., & Chiriboga, D. A. (2014). The Impact of Social Resources on Depressive Symptoms in Racially and Ethnically Diverse Older Adults: Variations by Groups With Differing Health Risks. Research on Aging, 36, 322-342.[WoS][Crossref]
• Peña-Sánchez, J. N., Domagala, A., Gorkiewicz, M., Targowska, M., & Oleszczyk, M. (2011). Adapting a tool in Poland for the measurement of the physicians’ career satisfaction. Journal of Family Medicine Topics, 12(1), 58-65. Retrieved from http://pmr.org.pl/.
• Radloff, L. S. (1977). The CES-D Scale: A Self-Report Depression Scale for Re- search in the General Population. Appl Psych Measurement, 3, 385-401.[Crossref]
• Radloff, L. S. (1991). The Use of the Center for Epidemiological Studies of Depression Scale in Adolescents and Young Adults. J Youth Adoles, 20(2), 149-166.
• Roediger, H. L., & McDermott, K. B. (1995). Creating false memories: Remembering words not presented in lists. Journal of Experimental Psychology: Learning, Memory, and Cognition, 21(4), 803-814.
• Sijtsma, K. (2009). On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha, Psychometrika, 74(1), 107-120.[Crossref][WoS]
• West, R. L., & Stone, K. R. (2014). Age Differences in Eyewitness Memory for a Realistic Event. J Gerontol B Psychol Sci Soc Sci, 69(3), 338-347.[Crossref][PubMed]
• Wiklund, I. (2004). Assessment of patient-reported outcomes in clinical trials: the example of health-related quality of life, Fundamental & Clinical Pharmacology, 18(3), 351-363.
• Zweig, M. H., & Campbell, G. (1993). Receiver operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem, 39(4), 561-577.[PubMed]

Identifiers

DOI

10.2478/slgr-2014-0041