Attempt at Detection of Deception Based on Records of Physiological Reactions Remotely Captured with FaceReader Software. Part 1

• Authors: Jan Widacki , Bartosz Wójcik , Anna Szuba-Boroń

Abstracts

EN

Strong emotions are among others manifested in the expressive movements (facial expression). Facial expressions are natural and universal by nature. They do not depend on ethnicity, culture, social status, age, etc. Nonetheless, humans are sometimes capable of controlling their facial expressions and hiding their emotions. Simulating emotions is a fundamental acting skill. However, controlling facial impressions takes time. The onset of such a control is delayed by anything from 0.25 to even 0.1 second – the period when the authentic facial expression, adequate to the emotion is demonstrated – and therefore remains imperceptible to an external observer. This short-lived facial expression observed in that short meantime is known as microexpression. FaceReader, designed by Dutch company Noldus (established and directed by Professor Lucas Noldus), is a software package for automatic recognition and analysis of facial expression. As its diagnostic value for validity as well as reliability, that is the level of correct indications, remains unknown, we decided to determine it experimentally and have chosen to run an experiment comparing its diagnostic value with that of a traditional polygraph examination.

Keywords

EN

FaceReader; FaceReader (Noldus); detection of deception; facial expressions; microexpression; Noldus

• Publisher: Krakowska Akademia im. Andrzeja Frycza Modrzewskiego
• Journal: European Polygraph
• Year: 2022
• Volume: 16
• Issue: 2(56)
• Pages: 38-51

Dates

published

2022

Contributors

author

Jan Widacki

• Andrzej Frycz Modrzewski Krakow University

author

Bartosz Wójcik

• Andrzej Frycz Modrzewski Krakow University

author

Anna Szuba-Boroń

• Andrzej Frycz Modrzewski Krakow University

References

• Barland G. (2002), Use of voice changes in the detection of deception. Polygraph, 31, 2.
• Cannon W. (1932), The wisdom of the body. Northon & Comp. Inc.
• Curtis D.A. (2021), Deception detection and emotion recognition: Investigating F.A.C.E software. Psychotherapy Research, 31, 6, 802–816.
• Dimberg U., Thunberg M. & Grunedal S. (2002), Facial reactions to emotional stimuli: Automatically controlled emotional responses. Cognition and Emotion, 16 (4), 449–471.
• Duchowski A.T. (2004), Tracking Methodology: Theory and Practice. Springer, London.
• Ekman P. (2001), Telling lies. Clues to deceit in marketplace, politics, and marriage. W.W. Norton.
• Ekman P. (2003), Kłamstwo i jego wykrywanie w biznesie, polityce i małżeństwie, tłum. polskie. PWN, Warszawa.
• Ekman P. (2009), Lie Catching and Microexpressions. In: The Philosophy of Deception, ed. C.W. Martin. Oxford University Press, NY, 118–138.
• Ekman P. & Davidson R.J. (eds) (2012), Natura emocji. Podstawowe zagadnienia. Gdańskie Wydawnictwo Psychologiczne, Sopot.
• Ekman P. (2011), Emocje ujawnione. Odkryj co ludzie chcą przed tobą zataić i dowiedz się czegoś więcej o sobie, Wydawnictwo Sensus, Gliwice.
• Ekman P. & Friesen W.V. (1974), Nonverbal behavior and psychopathology. In: Psychology of depression: contemporary theory and research, R.J. Friedman, M.N. Katz. Inston, Washington.
• Ekman P. & Friesen W.V. (1978), Facial action coding system: manual. Consulting Psychologists Press, Palo Alto. Ekman P., Friesen W.V. & Hager J.C. (2002), Facial action coding system. The Manuel on CD-ROM. A human face. University of Utah, Salt Lake City.
• Ekman P. & Hager J.S. (1979), Long distance transmission of facial affect signals. Ethology and Sociobiology, 1, 78–82
• Ekman P., Friesen W.V. & Ancoli S. (1980), Facial signs of emotional experience. Journal of Personality and Social Psychology, 39, 1125–1134.
• Gadea M., Aliño M., Espert R. & Salvador A. (2015), Deceit and facial expression in children: the enabling role of the “poker face” child and the dependent personality of the detector. Frontiers in Psychology, 6.
• Gołaszewski M., Zając P. & Widacki J. (2015), Thermal Vision as a Method of Detection of Deception. A Review of Experiences. European Polygraph 9, 1(31), 5–24.
• Gordon N.J. & Fleisher W.L. (2011), Effective Interviewing and Interrogation Techniques, 3rd edition, Elselvier Science & Technology.
• Gramatyka M. (2008), Teoretyczne i praktyczne aspekty analizy poziomu stresu w głosie ludzkim na przykładzie urządzenia LVA 6.50. In: Kryminalistyka i nauki penalne
• wobec przestępczości. Księga pamiątkowa dedykowana Profesorowi Mirosławowi Owocowi, ed. H. Kołecki. Wydawnictwo Poznańskie, Poznań, 367–377.
• Hacker D.J., Kuhlman B., Kircher J.C., Cook A.E. & Woltz D.J. (2014), Detecting deception using ocular metrics during reading. In: Credibility assessment: Scientific research and applications, eds D.C. Raskin, C.R. Honts, J.C. Kircher. Elsevier.
• Hilgard E.R. (1967), Wprowadzenie do psychologii. PWN, Warszawa.
• Hjortsjö C.H. (1970), Man’s face and mimic language. Nordens Boktryckeri, Malmö.
• Horvath F. (2002), Experimental comparison of the psychological stress evaluator and the galvanic skin response in detection of deception. Polygraph, 31, 2.
• Ioannou S.V., Raozaiou A. ZZT., Tzouuvaras V.A., Mailis T.P, Karapouzis K.C. & Kollias S.D. (2005), Emotion recognition through facial expression analysis based on a neurofuzzy network. Neural Networks, 18, 423–435.
• Izard C.D. (1977), Human emotions. Plenum, New York.
• Izard C.D. (1994), Innate and universal facial expressions: evidence from developmental and cross-cultural research. Psychological Bulletin, 115, 288–299.
• Izard C.D. & Rosen J.B. (1998), Brain system, emotions and psychology. Contemporary Psychology: A Journal of Reviews, 43, 101–103.
• Jacob R.J.K. & Karn K.S., (2003), Eye Tracking in Human-Computer Interaction and Usability Research: Ready to Deliver the Promises. Mind 2 (8): 573–605.
• Kępiński A. (1972), Rytm życia. Wydawnictwo Literackie, Kraków, 166–167.
• Kircher J.C. & Raskin D.C. (2016), Laboratory and Field Research on the Ocular-motor Deception Test. European Polygraph, 10, 4 (38), 159–172.
• Laszczak B. (2021), Ekspresja mimiczne – podstawowy katalog do wykrywania kłamstwa i emocji (część 1). Prokuratura i Prawo, 3, 144–161.
• Leśniak M., Leśniak B. & Gramatyka M. (2011), Trafność wiarygodności wypowiedzi na podstawie wskazań analizatora głosu LVA 6.5. In: Psychologiczne i interdyscyplinarne problemy w opiniodawstwie sądowym w sprawach cywilnych, ed. J.M. Stanik. Katowice, 228–236.
• Mikrut Z., Widacki M. & Widacki J. (2018), Experiments in Using Face Temperature Changes as an Indicator in Instrumental Detection of Deception. European Polygraph, 3, 85–105.
• Mikrut Z., Widacki M. & Widacki J. (2018), Próba wykorzystania zmiany temperatury twarzy jako wskaźnika w instrumentalnej detekcji kłamstwa. In: Kierunki rozwoju instrumentalnej i nieinstrumentalnej detekcji kłamstwa. Problemy kryminalistyczne, etyczne i prawne, ed. J. Widacki, Kraków, 133–148.
• Monaro M., Maldera S., Scarpazza C., Sarton G. & Navarin N., (2022), Detecting deception through facial expression in a dataset of videotaped interviews: A comparison between human judges and machine learning models, Computers and Human Behavior, 127, February 2022.
• Orquin J.L. & Holmquist K. (2018), Threats to the validity of eye-movement research in Psychology. Behavior Research Methods, 50 (4), 1645–1656.
• Paśko I. (2017), Eyetrackingowe badania we wczesnej edukacji przyrodniczej. Pedagogika Przedszkolna i Wczesnoszkolna, 5, 2/1, 205–215.
• Pietruszka J. (2006), O perspektywach zastosowania analizatorów poziomu stresu w głosie. Problemy Kryminalistyki, 252, 64–72.
• Pietruszka J. (2008), Wykorzystanie analizatora głosu (poligrafu – wariografu głosowego) w postępowaniu karnym i stosunkach pracy, unpublished doctoral dissertation, Katedra Kryminalistyki Uniwersytetu Warszawskiego, Warszawa.
• Pietruszka J. (2009), A renaissance in voice analysers as tools for detection of deception? European Polygraph, 1(7), 33–37.
• Samuel S.G., Chatterjee T., Thapliyal H. & Kacker P. (2019), Facial psychophysiology in forensic investigation: A novel idea for deception detection. Journal of Forensic Dental Sciences, 11, 2, 90–94.
• Shen X., Fan G., Niu C. & Chen Zh. (2021), Catching a Liar Through Facial Expression of Fear. Frontiers in Psychology, 12, https://doi.org/10.3389/fpsyg.2021.675097.
• Starostenko O., Contreras R., Aquina V.A., Pulido L.F., Asomoza J.R., Sergiyenko O. & Tyrsa V. (2011), A Fuzzy Reasoning Model for Recognition of Facial Expression, Computación y Sistemas, 15, 2, 163–180.
• Stolecka A. & Wolny R. (2014), Możliwości zastosowania techniki okulograficznej w ilościowych badaniach marketingowych. Zeszyty Naukowe UE w Katowicach. Studia Ekonomiczne 195, 195–205.
• Tomkins S.S. (1999), Communicating emotions, Cambridge University Press, Cambridge–London.
• Tomkins S. S., (2008), Affect imagery consciousness, Springer Publ. Comp.
• Widacki J. (2014), Results of polygraph examinations: direct or circumstantial evidence? European Polygraph, 8, 2(28): 61–67.
• Widacki J. (2021), History of polygraph examination. Polskie Towarzystwo Kryminalistyczne.
• Widacki J. (ed). (2018), Kryminalistyka, 4th ed. C.H. Beck, Warszawa, 457.
• Widacki J. (2007), From forensic psychophysiology to forensic neurophysiology. New trends in examinations in the detection of deception. European Polygraph, 2.
• Widacki J. (2011), Logical Identity of Conclusions from Polygraph Testing Performed in Control Questions Test (CQT) and Guilty Knowledge Test (GKT) Techniques. European Polygraph, 1(15), 6–10.
• Widacki J. & Dukała K. (2015), Detekcja kłamstwa – czyli czego?, Problemy kryminalistyki, 287 (1), 3–16.
• Widacki J. & Dukała K. (2015), Lie detection – of what?, Problemy kryminalistyki, 287 (1), 61–74.
• Widacki J., Widacki M. & Antos J. (2016), Preparation to experimental testing of the potential from using facial temperature changes registered with an infrared camera in lie-detection. European Polygraph, 10, 1(35) 17–23.
• Woodworth R.S. & Schlosberg H. (1966), Psychologia eksperymentalna. PWN, Warszawa, vol. 1.

Identifiers

DOI

10.2478/ep-2022-0010

Biblioteka Nauki

2179251