AL-MUTARĞIM المترجم
Volume 24, Numéro 1, Pages 21-47
2024-12-22

Assessing Meteor And Mqm Effectiveness In Measuring The Quality Of Machine Legal Translation From English Into Arabic: A Corpus-based Study

Authors : Ali Naeimah . Babchikh Mohamed .

Abstract

This study examines the role of Quality Assessment Metrics METEOR and MQM framework in assessing the accuracy of legal Amazon Translate output. The researchers assume that the fully reliance on the use of automatic metrics in assessing Machine Translation (MT) quality cannot lead to achieving reliable results. Instead, they recommend assessing MT production based on MQM typology. The findings showed that the MQM assessment was mostly faithful in rating the MT production. However, in order that METEOR achieves precise evaluation, it should correlate with human translation, since the MQM framework revealed that Amazon Translate output has inferior quality, and the same is true for METEOR.

Keywords

Metrics ; MQM framework ; METEOR ; Legal translation ; Machine Translation ; Quality assessment ; Amazon Translate