Double-digit coding of examination math problems

• Authors: Agnieszka Sułowska , Marcin Karpiński
• Languages of publication: EN

Abstracts

EN

Various methods are used worldwide to evaluate student solutions to examination tasks. Usually the results simply provide information about student competency and after aggregation, are also used as a tool of making comparisons between schools. In particular, the standard evaluation methods do not allow conclusions to be drawn about possible improvements of teaching methods. There are however, task assessment methods which not only allow description of student achievement, but also possible causes of failure. One such method, which can be applied to extended response tasks, is double-digit coding which has been used in some international educational research. This paper presents the first Polish experiences of applying this method to examination tasks in mathematics, using a special coding key to carry out the evaluation. Lessons learned during the coding key construction and its application in the assessment process are described.

Keywords

EN

evaluation; double-digit coding; final exam; PISA; TIMSS

• Publisher: Instytut Badań Edukacyjnych
• Journal: Edukacja
• Year: 2013
• Issue: Edukacja. An interdisciplinary approach 1
• Pages: 59–69

Dates

issued

2013-08-30

Contributors

author

Agnieszka Sułowska

• Educational Research Institute

author

Marcin Karpiński

• Educational Research Institute

References

• CKE (Centralna Komisja Egzaminacyjna – Central Examination Board) (2011). Badanie diagnostyczne w roku szkolnym 2011/2012. Część matematyczno-przyrodnicza. Matematyka. Odpowiedzi i propozycje oceniania zadań [Diagnostic test in the school year 2011/2012. Mathematics and science. Maths. Answers and suggestions of task assessment]. Retrieved from http://www.cke.edu.pl/images/stories/000011_gim_pr/matem/GM-M1.zip
• Dossey, J. A., Jones, C. O. i Martin, T. S. (2002). Analyzing student responses in mathematics using two-digit rubrics. In D. F. Robitaille, A. E. Beaton (eds.), Secondary analysis of the TIMSS data. Dordrecht: Kluwer Academic Publishers.
• Eurydice (2009). National testing of pupils in Europe: objectives, organisation and use of results. Bruxelles: The Education, Audiovisual and Culture Executive Agency (EACEA) – Eurydice.
• Foy P. and Olson J. F. (eds.). (2010). TIMSS 2007 user guide for the international database. Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Lynch School of Education, Boston College.
• Kołodziej, K. (2007). Kategoryzacja rozwiązań zadań otwartych części matematyczno-przyrodniczej egzaminu gimnazjalnego. Materiały z XIII Konferencji Diagnostyki Edukacyjnej [Categorization solutions of open tasks in mathematics and science of lower secondary school exam. Proceedings of the XIII Conference on Educational Diagnostics], Łomża.
• Mullis, I. V. S., Martin, M. O. and Foy, P. (2008). TIMSS 2007 international mathematics report: findings from IEA’s trends in international mathematics and science study at the fourth and eighth grades, Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.
• OECD [Organisation for Economic Co-operation and Development] (2004). Learning for tomorrow’s world – first results from PISA 2003. Paris: OECD.
• OECD (2005). PISA 2003. Technical report, Paris: OECD.
• OECD (2007). PISA 2006 science competencies for tomorrow’s world (volume I). Paris: OECD.
• OECD (2009). PISA 2006. Technical report. Paris: OECD.
• OECD (2010a). PISA 2009 results: what students know and can do. Student performance in reading, mathematics and science (volume I). Paris: OECD.
• OECD (2010b). Learning mathematics for life. A perspective from PISA. Paris: OECD.
• OECD (2012). PISA 2009, Technical report. Paris: OECD.
• Ruddock, G. J., O’Sullivan, Ch. Y., Arora, A. and Erberber, E. (2008). Developing the TIMSS 2007 mathematics and science assessments and scoring guides. In J. F. Olson, M. O. Martin, I. V. S. Mullis, (eds.), TIMSS 2007 technical report (pp. 30–32), Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.
• Turmo A., Kjærnsli M. and Pettersson A. (2003). Mathematical literacy and competency classes. In S. Lie, P. Linnakylä, A. Roe (eds.), Northern lights on PISA. Unity and diversity in the Nordic countries in PISA 2000. Oslo: University of Oslo.

Notes

EN

http://www.edukacja.ibe.edu.pl/images/numery/2013/6-4-sulowska-karpinski-double-digit-coding.pdf