پديد آورندگان :
Somayyeh ، Karami University of Isfahan , Nejadansari ، Dariush University of Isfahan - English Language and Literature Department , Hesabi ، Akbar University of Isfahan - English Language and Literature Department
كليدواژه :
Automated scoring , translation evaluation , validity , lexical ATQEUMs , Certified Translator Accreditation Tests
چكيده فارسي :
This study tries to explore the validity of lexical Automated Translation Quality Evaluation Understudy Metrics (ATQEUM) in scoring Certified Translator Accreditation Tests in Islamic Republic of Iran as an instance of legal texts. This is conducted against non-test indicators of translation competence, including the participants records of their scores in “The Translation of Documents and Deeds I and II” courses, their average score of all courses of practical translation nature, and their BA GPA score in Translation Studies Major. Although, they have not revealed a significant correlation with the nontest indicators of translation competence, they have had a highly significant correlation with the scores granted by human expert scorers on the two sample tests. Therefore, according to all the data collected and analyzed, it has ultimately been concluded that a collection of “-PER, -TERp-A, BLEU-1, NIST-1, ROUGE-1, GTM-1” lexical ATQEUMs (including all various lexical similarity-based techniques of edit distance, precision, recall, and F-measure) can be considered as the optimal translation meta-evaluation set to score certified translator accreditation tests.