Structured Analysis of Critical Decision Method Data – Emergency Medicine Case Study

• Authors: Hana Harenčárová
• Languages of publication: EN

Abstracts

EN

The critical decision method is a semi-structured retrospective interview used mainly in researching professional decision making within the naturalistic decision making paradigm. There are currently, two main methods of performing analysis: ETA - Emergent Themes Analysis and the structured approach (Wong, 2004). The structured approach consists of five steps: 1. decision chart, 2. incident summary, 3. decision analysis tables, 4. identification of items of interest and 5. collation and comparison of common items of interest across incidents. Naturalistic decision making can be time-consuming, involve high stakes, poorly-structured problems, uncertain dynamic environments and ill-defined or competing goals. For this reason we will demonstrate how to the structured approach to perform an analysis using the example of a decision making situation in emergency medicine.

Keywords

EN

critical decision method; structured approach; data analysis; paramedics; decision making

• Publisher: Sciendo
• Journal: Human Affairs
• Year: 2015
• Volume: 25
• Issue: 4
• Pages: 443-459

Dates

published

2015-10-01

online

2015-10-06

Contributors

author

Hana Harenčárová

• Institute of Experimental Psychology, Slovak Academy of Sciences, Dúbravská cesta 9, 841 04 Bratislava, Slovakia

References

• Adamovová, L., & Halama, P. (2013). Emócie a emočná sebaregulácia v práci zdravotníckych záchranárov: kvalitatívny prístup [Emotions and emotional self-regulation in the work of paramedics: A qualitative approach]. In J. Gurňáková et al. (Ed.), Rozhodovanie profesionálov: Sebaregulácia, stres a osobnosť (pp. 247-276). Bratislava: Ústav experimentálnej psychológie SAV.
• Blandford, A., & Wong, B. L. W. (2004). Situation awareness in emergency medical dispatch. International Journal of Human Computer Studies, 61(4), 421-452.[Crossref][WoS]
• Crandall, B., & Calderwood, R. (1989). Clinical assessment skills of experienced neonatal intensive care nurses. Yellow Springs, OH.
• Crandall, B., Klein, G., & Hoffman, R. R. (2006). Working minds: A practitioner’s guide to cognitive task analysis. Cambridge, MA: MIT Press.
• Gamer, M., Lemon, J., Fellows, I., & Singh, P. (2012). irr: Various coefficients of interrater reliability and agreement. R package version 0.84. Retrieved from http://cran.r-project.org/package=irr
• Harenčárová, H. (2013). Sonda do problémov zdravotníckych záchranárov súvisiacich s rozhodovaním v náročných situáciách a s výkonom ich profesie [Insight into the problems paramedics have in relation to decision making in difficult situations and in performing their duties]. In J. Gurňáková et al. (Ed.), Rozhodovanie profesionálov: Sebaregulácia, stres a osobnosť (pp. 217-245). Bratislava: Ústav experimentálnej psychológie SAV.
• Harenčárová, H. (in press). Managing uncertainty in paramedics’ decision making. In International Conference on Naturalistic Decision Making 2015. McLean, VA.
• Hayes, A. F., & Krippendorff, K. (2007). Answering the call for a standard reliability measure for coding data. Communication Methods and Measures, 1(1), 77-89.
• Hoffman, R. R., Crandall, B., & Klein, G. (2008). Protocols for cognitive task analysis. Pensacola, FL.
• Hoffman, R. R., Crandall, B., & Shadbolt, N. R. (1998). Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis. Human Factors, 40(2), 254-276.[Crossref]
• Horberry, T., & Cooke, T. (2010). Using the critical decision method for incident analysis in mining. Journal of Health & Safety Research & Practice, 2(2), 11-22.
• Hutchins, S. G., Pirolli, P. L., & Card, S. K. (2007). What makes intelligence analysis difficult? A cognitive task analysis. In R. R. Hoffman (Ed.), Expertise out of Context: Proceedings of the Sixth International Conference on Naturalistic Decision Making (pp. 281-316). New York: Lawrence Erlbaum Associates.
• Klein, G. (2008). Naturalistic decision making. Human Factors, 50(3), 456-460.[PubMed][WoS][Crossref]
• Klein, G. A., Calderwood, R., & MacGregor, D. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19(3), 462-472.
• Krippendorff, K. (2004). Reliability in content analysis: Some common misconceptions and recommendations. Human Communication Research, 30(3), 411-433.
• Lipshitz, R., Klein, G., Orasanu, J., & Salas, E. (2001). Taking stock of naturalistic decision making. Journal of Behavioral Decision Making, 14(5), 331-352.[Crossref]
• Lipshitz, R., Omodei, M., McClellan, J., & Wearing, A. (2007). What’s burning? The RAWFS heuristic on the fire ground. In R. R. Hoffman (Ed.), Expertise out of context: Proceedings of the Sixth International Conference on Naturalistic Decision Making (pp. 97-111). Lawrence Erlbaum Associates.
• Lipshitz, R., & Strauss, O. (1997). Coping with uncertainty: A naturalistic decision-making analysis. Organizational Behavior and Human Decision Processes, 69(2), 149-163.[Crossref]
• Okoli, J. O., Weller, G., Watt, J., & Wong, B. L. W. (2013). Decision making strategies used by experts and the potential for training intuitive skills: A preliminary study. In H. Chaudet, L. Pellegrin, & N. Bonnardel (Eds.), Proceedings of the 11th International Conference on Naturalistic Decision Making (NDM 2013), Marseille, France, 21-24 May 2013 (pp. 227-232). Paris: Arpege Science Publishing.
• Orasanu, J., & Connolly, T. (1993). The reinvention of decision making. In G. A. Klein, J. Orasanu, R. Calderwood, & C. E. Zsambok (Eds.), Decision making in action: models and methods (pp. 3-20). Norwood, NJ: Ablex Publishing.
• R Core Team. (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved from http://www.r-project.org/
• Weitzenfeld, J. S., Freeman, J. T., Riedl, T. R., & Klein, G. A. (1990). The critical decision method (CDM): A knowledge-mapping technique. In Proceedings of Behavioral Sciences Days ´90. AT&T.
• Wong, B. L. W. (2004). Critical decision method data analysis. In D. Diaper & N. A. Stanton (Eds.), The handbook of task analysis for human-computer interaction (pp. 327-346). Mahwah, NJ: Lawrence Erlbaum Associates.
• Wong, B. L. W., & Blandford, A. (2002). Analysing ambulance dispatcher decision making: Trialing emergent themes analysis. In F. Vetere, L. Johnson, & R. Kushinsky (Eds.), Proceedings of the HF2002 Human Factors Conference: Design for the whole person: integrating physical, cognitive and social aspects. Canberra, Australia: Ergonomics Society of Australia.
• Wong, B. L. W., O’Hare, D., & Sallis, P. J. (1996). A goal-oriented approach for designing decision support displays in dynamic environments. In Proceedings Sixth Australian Conference on Computer Human Interaction (pp. 1-8).
• Wong, B. L. W., Sallis, J. P., & O’Hare, D. (1997). Eliciting information portrayal requirements: Experiences with the critical decision method. Chart, 97, 397-415.
• Zannier, C., Chiasson, M., & Maurer, F. (2007). A model of design decision making based on empirical results of interviews with software designers. Information and Software Technology, 49(6), 637-653.[WoS]
• CMapTools [Computer software]. (2015). Retrieved from http://cmap.ihmc.us
• XMind 6 [Computer software]. (2014). Retrieved from http://www.xmind.net

Identifiers

DOI

10.1515/humaff-2015-0036