Role of Visual Speech Cues (Cued Speech) in Foreign Language Learning by Hearing School-Age Children

• Authors: Olga Grabowska-Chenczke , Piotr Francuz , Bibianna Bałaj

Abstracts

EN

In this study, we aimed to determine the role of visual speech cues in the process of foreign language learning by hearing school-age children. Our experiments used Cued Speech, a method designed for people who are deaf or hard of hearing. We expected that the principles of the method might also be beneficial for people with normal hearing because they may help distinguish the sounds of foreign speech that are difficult to hear. This study mainly focused on the effects of speech perception. We tested 126 Polish junior high school students (66 girls and 60 boys) with a normal range of phonemic hearing and language aptitude. We envisaged that foreign language learners using visual speech cues would achieve a higher score on a test of foreign language than learners who had studied the language in the traditional manner. We also formulated a hypothesis concerning the interaction of training type and training conditions on the effectiveness of foreign language learning: that the difference in the effects of foreign language learning between participants who received visual or executive training and typical training would be more significant in the presence of auditory distractors than in their absence. We observed interactions between conditions and types of training for speech sound identification. Under conditions of auditory distraction, foreign language learners using Cued Speech scored significantly higher than learners who had traditional training.

Keywords

EN

speech perception; foreign language learning; auditory distraction; visual speech cues; Cued Speech

• Publisher: Katolicki Uniwersytet Lubelski Jana Pawła II. Towarzystwo Naukowe KUL
• Journal: Roczniki Psychologiczne
• Year: 2023
• Volume: 26
• Issue: 3
• Pages: 215-240

Dates

published

2023

Contributors

author

Olga Grabowska-Chenczke

• Poznań University of Life Sciences

• https://orcid.org/000000021154667X

author

Piotr Francuz

author

Bibianna Bałaj

• Nicolaus Copernicus University in Toruń

• https://orcid.org/0000000150667493

References

• Alegria, J., Charlier, B. L., & Mattys, S. (1999). The role of lip-reading and cued speech in the processing of phonological information in French-educated deaf children. European Journal of Cognitive Psychology, 11(4), 451–472. https://doi.org/10.1080/095414499382255
• Aparicio, M., Peigneux, P., Charlier, B., Balériaux, D., Kavec, M., & Leybaert, J. (2017). The neural basis of speech perception through lipreading and manual cues: Evidence from deaf native users of cued speech. Frontiers in Psychology, 8, Article 426. https://doi.org/10.3389/fpsyg.2017.00426
• Baills, F., Suárez-González, N., González-Fuente, S., & Prieto, P. (2019). Observing and producing pitch gestures facilitates the learning of mandarin Chinese tones and words. Studies in Second Language Acquisition, 41(1), 33–58. https://doi.org/10.1017/S0272263118000074
• Bayard, C., Machart, L., Strauß, A., Gerber, S., Aubanel, V., & Schwartz, J.-L. (2019). Cued speech enhances speech-in-noise perception. Journal of Deaf Studies and Deaf Education, 24(3), 223–233. https://doi.org/10.1093/deafed/enz003
• Birdsong, D. (2018). Plasticity, variability and age in second language acquisition and bilingualism. Frontiers in Psychology, 9, Article 81. https://doi.org/10.3389/fpsyg.2018.00081
• Bourguignon, M., Baart, M., Kapnoula, E. C., & Molinaro, N. (2020). Lip-reading enables the brain to synthesize auditory features of unknown silent speech. Journal of Neuroscience, 40(5), 1053–1065. https://doi.org/10.1523/JNEUROSCI.1101-19.2019
• Cornett, R. O. (1967). Cued Speech. American Annals of the Deaf, 112, 3–13.
• DeLuca, V., Miller, D., Pliatsikas, C., & Rothman, J. (2019). Brain adaptations and neurological indices of processing in adult second language acquisition: Challenges for the critical period hypothesis. In J. W. Schweiter (Ed.), The handbook of the neuroscience of multilingualism (pp. 192–218). Wiley-Blackwell. https://doi:10.1002/9781119387725.ch8
• Domagała-Zyśk, E. (2013). English as a foreign language for the deaf and hard of hearing persons in Europe. Wydawnictwo KUL.
• Dörnyei, Z. (2013). Motivation in second language learning. In M. Celce Murcia, D. M. Brinton, & M. A. Snow (Eds.), Teaching English as a second or foreign language (4th ed., pp. 518–531). Heinle Cengage ELT.
• Elsabbagh, M., Hohenberger, A., Campos, R., Van Herwegen, J., Serres, J., de Schonen, S., Aschersleben, G., & Karmiloff-Smith, A. (2013). Narrowing perceptual sensitivity to the native language in infancy: Exogenous influences on developmental timing. Behavioral Sciences, 3(1), 120–132. https://doi.org/10.3390/bs3010120
• Hannah, B., Wang, Y., Jongman, A., Sereno, J. A., Cao, J., & Nie, Y. (2017). Cross-modal association between auditory and visuospatial information in mandarin tone perception in noise by native and non-native perceivers. Frontiers in Psychology, 8, Article 2051. https://doi.org/10.3389/fpsyg.2017.02051
• Hardison, D. M. (2003). Acquisition of second-language speech: Effects of visual cues, context, and talker variability. Applied Psycholinguistics, 24(4), 495–522. https://doi.org/10.1017/s0142716403000250
• Hardison, D. M. (2021). Multimodal input in second-language speech processing. Language Teaching, 54(2), 206–220. https://doi.org/10.1017/S0261444820000592
• Hartshorne, J. K., Tenenbaum, J. B., & Pinker, S. (2018). A critical period for second language acquisition: Evidence from 2/3 million English speakers. Cognition, 177, 263–277. https://doi.org/10.1016/j.cognition.2018.04.007
• Hayes, E. A., Tiippana, K., Nicol, T. G., Sams, M., & Kraus, N. (2003). Integration of heard and seen speech: A factor in learning disabilities in children. Neuroscience Letters, 351(1), 46–50. https://doi.org/10.1016/s0304-3940(03)00971-6
• Hirata, Y., & Kelly, S. D. (2010). Effects of lips and hands on auditory learning of second-language speech sounds. Journal of Speech, Language, and Hearing Research, 53(2), 298–310. https://doi.org/10.1044/1092-4388(2009/08-0243)
• Hirata, Y., Kelly, S. D., Huang, J., & Manansala, M. (2014). Effects of hand gestures on auditory learning of second-language vowel length contrasts. Journal of Speech, Language, and Hearing Research, 57(6), 2090–2101. https://doi.org/10.1044/2014_ JSLHR-S-14-0049
• Hoetjes, M., & van Maastricht, L. (2020). Using gesture to facilitate L2 phoneme acquisition: The importance of gesture and phoneme complexity. Frontiers in Psychology, 11, Article 575032. https://doi: 10.3389/fpsyg.2020.575032
• Houston, D. M., Tincoff, R., & Jusczyk, P. W. (2003). 7.5-month-olds’ memory for words after a 1-week delay. In D. Houston, A Seidl, G.Hollich, E. Johnson, & A. Jusczyk (Eds.), Jusczyk lab final report. Retrieved September 14, 2023, from http://hincapie.psych.purdue.edu/Jusczyk/pdf/Memory.pdf
• Hubbard, A. L., Wilson, S. M., Callan, D. E., & Dapretto, M. (2009). Giving speech a hand: Gesture modulates activity in auditory cortex during speech perception. Human Brain Mapping, 30(3), 1028–1037. https://doi.org/10.1002/hbm.20565
• Johnson, E. K., & Jusczyk, P. W. (2001). Word segmentation by 8-month-olds: When speech cues count more than statistics. Journal of Memory and Language, 44(4), 548–567. https://doi.org/10.1006/jmla.2000.2755
• Kissling, E. M. (2015). Phonetics instruction improves learners’ perception of L2 sounds. Language Teaching Research, 19(3), 254–275. https://doi.org/10.1177/1362168814541735
• Krakowiak, K. (1995). Fonogesty jako narzędzie formowania języka dzieci z uszkodzonym słuchem. Wydawnictwo UMCS.
• Krakowiak, K. (2006). Studia i szkice o wychowaniu dzieci z uszkodzeniami słuchu. Wydawnictwo KUL.
• Krakowiak, K., & Sękowska, J. (1996). Mówimy z fonogestami. Przewodnik dla rodziców i przyjaciół dzieci i młodzieży z uszkodzonym słuchem. Wydawnictwa Szkolne i Pedagogiczne.
• Krashen, S. D. (1981). Second language acquisition and second language learning. Pergamon.
• Kuhl, P. K. (2010). Brain Mechanisms in Early Language Acquisition. Neuron, 67(5), 713–727. https://doi.org/10.1016/j.neuron.2010.08.038
• Kuhl, P. K., Conboy, B. T., Padden, D., Nelson, T., & Pruitt, J. (2005). Early speech perception and later language development: Implications for the “Critical Period.” Language Learning and Development, 1(3–4), 237–264. https://doi.org/10.1080/15475441.2005.9671948
• Kuhl, P. K., Tsao F.-M., & Liu H.-M. (2003). Foreign-language experience in infancy: Effects of short-term exposure and social interaction on phonetic learning. Proceedings of the National Academy of Sciences, 100(15), 9096–9101. https://doi.org/10.1073/pnas.1532872100
• Kuliniak, R. (2013). Testy predyspozycji językowych. Instytut Badań Kompetencji.
• Lehmann, S., & Murray, M. M. (2005). The role of multisensory memories in unisensory object discrimination. Brain Research. Cognitive Brain Research, 24(2), 326–334. https://doi.org/10.1016/j.cogbrainres.2005.02.005
• Lewis, D., Hoover, B., Choi, S., & Stelmachowicz, P. (2010). Relationship between speech perception in noise and phonological awareness skills for children with normal hearing. Ear and Hearing, 31(6), 761–768. https://doi.org/10.1097/AUD.0b013e3181e5d188
• Leybaert, J., & LaSasso, C. J. (2010). Cued speech for enhancing speech perception and first language development of children with cochlear implants. Trends in Amplification, 14(2), 96–112. https://doi.org/10.1177/1084713810375567
• Leybaert, J., Aparicio, M., & Alegria, J. (2011). The role of cued speech in language development of deaf children. Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199750986.013.0020
• Li, P., Baills, F., & Prieto, P. (2020). Observing and producing durational hand gestures facilitates the pronunciation of novel vowel-length contrasts. Studies in Second Language Acquisition, 42(5), 1015–1039. https://doi.org/10.1017/S0272263120000054
• Li, P., Xiaotong, X, Baills F., & Prieto, P. (2021). Training non-native aspirated plosives with hand gestures: Learners’ gesture performance matters. Language, Cognition and Neuroscience, 36(10), 1313–1328. https://doi.org/10.1080/23273798.2021.1937663
• Liu, D., Wang, S., Gao, Q., Dong, R., Fu, X., Pugh, E., & Hu, J. (2020). Learning a second language in adulthood changes subcortical neural encoding. Neural Plasticity, 2020, Article 8836161. https://doi.org/10.1155/2020/8836161
• Logan, G. D., & Cowan, W. B. (1984). On the ability to inhibit thought and action: A theory of an act of control. Psychological Review, 91(3), 295–327. https://doi.org/10.1037/0033-295X.91.3.295
• Logan, G.D. (1982). On the ability to inhibit complex actions: A stop-signal study of typewriting. Journal of Experimental Psychology: Human Perception and Performance, 8, 778–792. https://doi.org/10.1037/0096-1523.8.6.778
• MacDonald, J., & McGurk, H. (1978). Visual influences on speech perception processes. Perception & Psychophysics, 24(3), 253–257. https://doi.org/10.3758/BF03206096
• MacLeod, A., & Summerfield, Q. (1987). Quantifying the contribution of vision to speech perception in noise. British Journal of Audiology, 21(2), 131–141. https://doi.org/10.3109/03005368709077786
• Mandel, D. R., Jusczyk, P. W., & Nelson, D. G. (1994). Does sentential prosody help infants organize and remember speech information? Cognition, 53(2), 155–180. https://doi.org/10.1016/0010-0277(94)90069-8
• Mayberry, R. I., & Kluender, R. (2018). Rethinking the critical period for language: New insights into an old question from American Sign Language. Bilingualism: Language and Cognition, 21(5), 886–905. https://doi.org/10.1017/S1366728917000724
• Morais, J., & Kolinsky, R. (1994). Perception and awareness in phonological processing: The case of the phoneme. Cognition, 50(1), 287–297. https://doi.org/10.1016/0010-0277(94)90032-9
• Morais, J., & Kolinsky, R. (2002). Literacy effects on language and cognition. In L. Bäckman & C. von Hofsten (Eds.), Psychology at the turn of the millennium, Vol. 1: Cognitive, biological, and health perspectives (pp. 507–530). Psychology Press/Taylor & Francis.
• Morais, J., & Kolinsky, R. (2017). The consequences of phonemic awareness. In B. D. Gelder & J. Morais (Eds.), Speech and reading (pp. 317–337). Routledge. https://doi.org/10.4324/9781315111810-16
• Newport, E. L. (2018). Is there a critical period for L1 but not L2? Bilingualism, 21(5), 928–929. https://doi.org/10.1017/S1366728918000305
• Niżegorodcew, A. (2007). Uwaga w procesie nauki języka obcego. In J. Majer & J. Nijakowska (Eds.), Język – Poznanie – Zachowanie. Studia nad psycholingwistycznymi aspektami przyswajania języka (pp. 52–67). Wydawnictwo Uniwersytetu Łódzkiego.
• Pallier, C., Bosch, L., & Sebastián-Gallés, N. (1997). A limit on behavioral plasticity in speech perception. Cognition, 64(3), B9–B17. https://doi.org/10.1016/S0010-0277(97)00030-9
• Pilling, M., & Thomas, S. (2011). Audiovisual cues and perceptual learning of spectrally distorted speech. Language and Speech, 54(4), 487–497. https://doi.org/10.1177/0023830911404958
• Podlewska, A. (2013). Cued speech as an empirically-based approach to teaching English as a foreign language to hard of hearing students. In E. Domagała-Zyśk (Ed.), English as a foreign language for the deaf and hard of hearing persons in Europe. Wydawnictwo KUL.
• Rees, R., Fitzpatrick, C., Foulkes, J., Peterson, H., & Newton, C. (2017). Can explicit training in cued speech improve phoneme identification? Deafness & Education International, 19(1), 13–21. https://doi.org/10.1080/14643154.2017.1281595
• Schwartz, J.-L., Berthommier, F., & Savariaux, C. (2004). Seeing to hear better: Evidence for early audio-visual interactions in speech identification. Cognition, 93(2), B69–B78. https://doi.org/10.1016/j.cognition.2004.01.006
• Sparks, R. L., & Miller, K. S. (2000). Teaching a foreign language using multisensory structured language techniques to at-risk learners: A review. Dyslexia, 6(2), 124–132. https://doi.org/10.1002/(SICI)1099-0909(200004/06)6:2<124::AID-DYS152>3.0.CO;2-3
• Stevens, A. A., & Weaver, K. E. (2009). Functional characteristics of auditory cortex in the blind. Behavioural Brain Research, 196(1), 134–138. https://doi.org/10.1016/j.bbr.2008.07.041
• Summerfield, Q. (1992). Lipreading and audio-visual speech perception. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 335(1273), 71–78. https://doi.org/10.1098/rstb.1992.0009
• Swain, I. U., Zelazo, P. R. & Clifton, R. K. (1993). Newborn infants’ memory for speech sounds retained over 24 hours. Developmental Psychology, 29(2), 312–323. https://doi.org/10.1037/0012-1649.29.2.312
• Szeląg, E., & Szymaszek, A. (2006). Test do badania słuchu fonematycznego dzieci i młodzieży. GWP.
• Ungerer, J. A., Brody, L. R., & Zelazo, P. R. (1978). Long-term memory for speech in 2 to 4-week-old infants. Infant Behavior and Development, 1, 177–186. https://doi.org/10.1016/S0163-6383(78)80028-9
• Werker, J. F. (2018). Perceptual beginnings to language acquisition. Applied Psycholinguistics, 39(4), 703–728.https://doi.org/10.1017/S0142716418000152
• Werker, J. F., & Pegg, J. E. (1992). Infant speech perception and phonological acquisition. In C. A. Ferguson, L. Menn, & C. Stoel-Gammon (Eds.), Phonological development: Models, research, implications (pp. 131–164). Timonium.
• Werker, J. F., & Tees, R. C. (1984). Cross-language speech perception: Evidence for perceptual reorganization during the first year of life. Infant Behavior & Development, 7(1), 49–63. https://doi.org/10.1016/S0163-6383(84)80022-3
• Werker, J. F., & Tees, R. C. (2005). Speech perception as a window for understanding plasticity and commitment in language systems of the brain. Developmental Psychobiology, 46(3), 233–251. https://doi.org/10.1002/dev.20060
• White, E., Hutka, S., Williams, L., & Moreno, S. (2013). Learning, neural plasticity and sensitive periods: Implications for language acquisition, music training and transfer across the lifespan. Frontiers in Systems Neuroscience, 7, Article 90. https://www.frontiersin.org/articles/10.3389/fnsys.2013.00090
• White-Schwoch, T., Woodruff Carr, K., Thompson, E. C., Anderson, S., Nicol, T., Bradlow, A. R., Zecker, S. G., & Kraus, N. (2015). Auditory processing in noise: A preschool biomarker for literacy. PLoS Biology, 13(7), Article e1002196. https://doi.org/10.1371/journal.pbio.1002196
• Woodhouse, L., Hickson, L., & Dodd, B. (2009). Review of visual speech perception by hearing and hearing-impaired people: Clinical implications. International Journal of Language & Communication Disorders, 44(3), 253–270. https://doi.org/10.1080/13682820802090281
• Xiaotong, X., Li, P., Baills, F., & Prieto, P. (2020). Hand gestures facilitate the acquisition of novel phonemic contrasts when they appropriately mimic target phonetic features. Journal of Speech, Language, and Hearing Research, 63(11), 3571–3585. https://doi.org/10.1044/2020_JSLHR-20-00084.
• Zhen, A., Van Hedger, S., Heald, S., Goldin-Meadow, S., & Tian, X. (2019). Manual directional gestures facilitate cross-modal perceptual learning. Cognition, 187, 178–187. https://doi.org/10.1016/j.cognition.2019.03.004

Identifiers

DOI

10.18290/rpsych2023.0013

Biblioteka Nauki

31343465