The reliability of evaluation musical performance by music experts

• Authors: Maria Manturzewska
• Languages of publication: PL

Abstracts

PL

To test the reliability of the evaluation of musical performances by musical experts, the protocols of the jury of an international music contest have been subjected to statistical analysis. The object of the analysis were 2156 jurors’ points and rank ratings, given by 28 members of the jury, assessing 77 different performances of one of Fryderyk Chopin’s polonaises, evaluated during the first stage of an international music competition. The analysis revealed the following: 1. very large interpersonal (inter-rater) differences of the jurors’ ratings, 2. despite these differences, there was a very high level of statistical significance of the inter-rater agreement (p<.ool) of the jurors’ evaluation, 3. despite the high level of statistical significance of inter-rater agreement of the evaluation of musical performance, this accounts for only 1/3 of the general variance of ratings. Conclusion: individual ratings of musical performance are not a reliable measure of musical achievement, even when given by music experts of the highest level.

Keywords

PL

evaluation; musical performance; music contest; reliability; music experts

• Publisher: Uniwersytet im. Adama Mickiewicza w Poznaniu
• Journal: Interdisciplinary Studies in Musicology
• Year: 2011
• Issue: 10
• Pages: 97-110

Dates

published

2018-10-17

Contributors

author

Maria Manturzewska

• music psychologist, Professor Emeritus, Fryderyk Chopin University of Music, Warsaw. She was the founder of the first Chair of Music Psychology at the Fryderyk Chopin Academy of Music in Warsaw and was its head for many years (1985-2000). She was also one of the founders of the first network of psychological counseling centers for music schools (1957-1974). She studied philosophy, psychology and anthropology at the Jagiellonian University, Cracow (1948-1952) where she graduated and specialized in the psychology of music under the supervision of Professor Stefan Szuman. She received her Ph.D. from the Jagiellonian University in 1965 and her full professorship in 1993. She was vice president of the International Association of Empirical Aesthetics (IAEA), a member of the Society for Research in Psychology of Music and Music Education, a member of the Committee of Applied Psychology, Polish Psychological Association, president of the Warsaw Division of the Polish Psychological Association, member of the International Association of Applied Psychology, and a member of the European Council for High Ability (ECHA). She is the pionier of the life-span development research in psychology of music, the multimethods and multidimentional research on the psychological and environmental factors influencing achievement and success in music education and in music careers, the research on the reliability of evaluation musical achievement by musical experts and the empirical fundations of psychological consulting professional musicans and music school students. She is the author and coeditor of books and papers on these topics.