The Error Analysis Approach for the Assessment of Automatic Translation

• Authors: DE LA CRUZ-CABANILLAS Isabel , TEJEDOR-MARTÍNEZ Cristina
• Languages of publication: EN

Abstracts

EN

The Error Analysis Approach has been widely used to improve the learning of foreign languages and to evaluate human translation, but Error Analysis can also be applied to automatic translation, as shown by different scholars (see M. Koponen 2010). This article reports on a European project, called Organic.Lingua, which tries to demonstrate the potential of a multilingual web portal for Sustainable Agricultural & Environmental Education by using a machine translator in order to make available all materials in different languages. The selected texts are taken from the corpus compiled for this project. The source texts are translated into various target languages using computer translation tools. We have chosen some of these texts in English and their translations into Spanish, and have applied a classification of human errors to check whether the errors generated by machines could be avoided if we can ‘teach’ the machines or to what extent they are specific to computer tools or human beings. Some metric systems, such as BLEU (Bilingual Evaluation Understudy), are being employed to evaluate the quality of the target translation. However, our role as philologers is to concentrate on more specific linguistic features. By defining the different types of errors and by trying to establish a scale of gravity, we intend to determine the quality of the automatic translations. After analysing the data, we will propose linguistic measures for improvement that would be implemented by computer experts working on the project.

• Publisher: Instytut Komunikacji Specjalistycznej i Interkulturowej
• Journal: Lingwistyka Stosowana / Applied Linguistics / Angewandte Linguistik
• Year: 2016
• Issue: 16
• Pages: 1-9

Dates

published

2016

Contributors

author

DE LA CRUZ-CABANILLAS Isabel

• University of Alcala, Spain

author

TEJEDOR-MARTÍNEZ Cristina

• University of Alcala, Spain

References

• Altenberg, B./ S. Granger (2002), Recent trends in cross-linguistic lexical studies. In: B. Altenberg/ S. Granger (eds), Lexis in Contrast. Corpus-Based approaches. Amsterdam, 3–48.
• Borrego Ledesma, I. (2001), Errores y aprendizaje. In: A. Larrañaga Domínguez (coord.), FORMA. Formación de Formadores. Vol. 2 Interferencias, Cruces y Errores. Madrid, 85–100.
• Callison-Burch, C./ M. Osborne/ P. Koehn (2006), Re-evaluating the Role of BLEU in Machine Translation Research. In: EACL-2006: 11th Conference of the European Chapter of the Association for Computational Linguistics, 249–256.
• Colina, S. (2009), Further evidence for a functionalist approach to translation quality evaluation. In: Target 21/2, 235–264.
• Condon, S./ D. Parvaz/ J. Aberdeen/ C. Doran/ A. Freeman/ M. Awad (2011), Machine Translation Errors: English and Iraqi Arabic. In: ACM Transactions on Asian Language Information Processing 10/1. (URL doi>10.1145/1929908.1929910). [Retrieved April 2015].
• Koponen, M. (2010), Assessing Machine Translation Quality with Error Analysis. In: Electronic proceedings of the KäTu symposium on translation and interpreting studies 4, 1–12. (URL http://www.sktl.fi/@Bin/40701/Koponen_MikaEL2010.pdf). [Retrieved March 2015].
• Kutuzov, A. (2008), Using descriptive mark-up to formalize translation quality assessment. In: Translation industry and information supply in international business activities: materials of international conference. Perm, 90–101.
• Luengo, J.C./ M.Á. Sicilia/ S. Sánchez (forthcoming), Evaluating MT Systems for Metadata Records in Organic Edunet.
• Popovich, M./ H. Newy (2011), Towards Automatic Error Analysis of Machine Translation Output. In: Computational Linguistics 37/4, 657–988. (URL http://aclweb.org/anthology-new/J/J11/J11-4002.pdf). [Retrieved April 2015].
• Moliner, M. (2008), Diccionario de uso del español. Madrid. 3rd ed. on DVD.
• Rabadán, R./ B. Labrador/ N. Ramón (2009), Corpus-based contrastive analysis and translation universals. In: Babel 55/4, 300–328.
• Real Academia Española. Diccionario de la Lengua Española (DRAE). Available in URL www.rae.es
• Santos Gargallo, I. (1993), Análisis Contrastivo, Análisis de Errores e Interlengua en el marco de la Lingüística Contrastiva. Madrid.
• Vázquez, G. (1999), ¿Errores? ¡Sin falta! Madrid.

Identifiers

ISSN

2080-4814