The KTH synthesis of singing

• Authors: Johan Sundberg

Abstracts

EN

This is an overview of the work with synthesizing singing that has been carried out at the Speech Music Hearing Department, KTH since 1977. The origin of the work, a hardware synthesis machine, is described and some aspects of the control program, a modified version of a text-to-speech conversion system are reviewed. Three applications are described in which the synthesis system has paved the way for investigations of specific aspects of the singing voice. One concerns the perceptual relevance of the center frequency of the singer's formant, one deals with characteristics of an ugly voice, and one regards intonation. The article is accompanied by 18 sound examples, several of which were not published before. Finally, limitations and advantages of singing synthesis are discussed.

Keywords

EN

singing voice; formants; voice source; music performance; analysis-by-synthesis

• Publisher: Wyższa Szkoła Finansów i Zarządzania w Warszawie
• Journal: Advances in Cognitive Psychology
• Year: 2006
• Volume: 2
• Issue: 2-3
• Pages: 131-143

Contributors

author

Johan Sundberg

• Department of Speech, Music Hearing, School of Computer Science and Communication, KTH, Stockholm

References

• Berndtsson, G., & Sundberg, J. (1994). The MUSSE DIG singing synthesis. In A Friberg, J. Iwarsson, E. Jansson, & J. Sundberg (Eds.),SMAC 93 (Proceedings of the Stockholm Music Acoustics Conference 1993)(pp. 279-281). Stockholm: Royal Swedish Academy of Music.
• Berndtsson, G. (1995).Systems for synthesizing singing and for enhancing the acoustics of music rooms.Dissertation, KTH, Department of Speech Communication and Music Acoustics, Royal Institute of Technology, Stockholm.
• Carlson, R., & Granström, B. (1975). A phonetically oriented programming language for rule description of speech. In G. Fant (Ed.),Speech communication(Vol. 2, pp. 245-253). Stockholm: Almqvist & Wicksell.
• Carlson, G., Ternström, S., Sundberg, J., & Ungvary, T. (1991). A new digital system for singing synthesis allowing expressive control.Proceedings of the International Computer Music Conference, Montreal, 315-318.
• Cleveland, T., Sundberg, J., & Stone, R. E. (2001). Long-term-average spectrum characteristics of country singers during speaking and singing.Journal of Voice, 15, 54-60.
• Friberg, A., Iwarsson, J., Jansson, E., & Sundberg, J., (Eds.) (1994).SMAC 93 (Proceedings of the Stockholm Music Acoustics Conference 1993), Stockholm, Royal Swedish Academy of Music, 79.
• Gauffin, J., & Sundberg, J. (1989). Spectral correlates of glottal voice source waveform characteristics.Journal of Speech and Hearing Researches, 32, 556-565.
• Ipolyi, I (1952).Innföring i musikspråkets opprinnelse og struktur.Bergen, Norway: JW Eides Forlag.
• Larsson, B. (1977). Music and singing synthesis equipment (MUSSE).Speech Transmission Laboratory Quarterly Progress and Status Report (STL-QPSR), 1, 38-40.
• Leanderson, R., Sundberg, J., & von Euler, C. (1987). Role of the diaphragmatic activity during singing: A study of transdiaphragmatic pressures.Journal of Applyed Physiology, 62, 1987, 259-270.
• Malmgren, J. (1978).MUSSE Interface Unit MIU.Thesis work, Department of Speech Music Hearing, KTH.
• Ponteus, J. (1979).Mimmi, en utrustning för konsonantsyntes avsedd att komplettera MUSSE. (Mimmi, an equipment for consonant synthesis intended as a complement for MUSSE).Thesis work, Department of Speech Music Hearing, KTH.
• Rapp, K. (1971). A study of syllable timing.Speech Transmission Laboratory Quarterly Progress and Status Report (STL-QPSR), 1, 14-19.
• Shonle, J. I., & Horan, K. E. (1980). The pitch of vibrato tones.J. Acoust. Soc. Amer., 67, 246-252.
• Sundberg, J. (1975). Formant technique in a professional female singer,Acustica, 32, 89-96.
• Sundberg, J. (1978a). Effects of the vibrato and the "singing formant" on pitch.Musica Slovaca,VI, 51-69.
• Sundberg, J. (1978b). Synthesis of singing.Sw. J. Musicol., 60, 107-112.
• Sundberg, J. (1981). Synthesis of singing. InMusica e Tecnologia: Industria e Cultura per lo Sviluppo del Mezzagiorno. Proceedings of a symposium in Venice, Venedig: Unicopli (pp. 145-162).
• Sundberg, J. (1987).The science of the singing voice.Dekalb, IL: Northern Illinois University Press.
• Sundberg, J. (1989). Synthesis of singing by rule. In M. Mathews & J. Pierce (Eds.),Current directions in computer music research(pp. 45-55, 401-403). Cambridge, MA: The MIT Press.
• Sundberg, J. (1995). Vocal fold vibration patterns and modes of phonation.Folia Phoniatrica, 9, 20-26.
• Sundberg, J. (2001). Level and center frequency of the singer's formant.Journal of Voice, 15, 176-186.
• Sundberg, J., & Askenfelt, A. (1983). Larynx height and voice source: a relationship? In J. Abbs & D. Bless (Eds.),Voice physiology(pp. 307-316). Houston, TX: Collegehill.
• Titze, I. R. (1994).Principles of voice production.Englewood Cliffs, NJ: Prentice-Hall.
• Zera, J., Gauffin, J., & Sundberg, J. (1984). Synthesis of selected VCV-syllables in singing. InProceedings of International Computer Music Conference, IRCAM(pp. 83-86), Paris.

Identifiers

DOI

10.2478/v10053-008-0051-y