TAILIEUCHUNG - Báo cáo khoa học: "Applications of Automatic Evaluation Methods to Measuring a Capability of Speech Translation System"

The main goal of this paper is to propose automatic schemes for the translation paired comparison method. This method was proposed to precisely evaluate a speech translation system's capability. Furthermore, the method gives an objective evaluation result, ., a score of the Test of English for International Communication (TOEIC). The TOEIC score is used as a measure of one's speech translation capability. However, this method requires tremendous evaluation costs. Accordingly, automatization of this method is an important subject for study. In the proposed method, currently available automatic evaluation methods are applied to automate the translation paired comparison method. . | Applications of Automatic Evaluation Methods to Measuring a Capability of Speech Translation System Keiji Yasuda ATR Spoken Language Translation Research Laboratories 2-2-2 Hikaridai Keihanna Science City Kyoto 619-0288 Japan kei j Also at Graduate School of Engineering Doshisha University Fumiaki Sugaya KDDI R D Laboratorie 2-1-15 Ohara Kamifukuoka-city Saitama 356-8502 Japan fsugaya@ Seiichi Yamamoto ATR Spoken Language Translation Research Laboratories 2-2-2 Hikaridai Keihanna Science City Kyoto 619-0288 Japan I Toshiyuki Takezawa ATR Spoken Language Translation Research Laboratories -2-2 Hikaridai Keihanna Science City Kyoto 619-0288 Japan Masuzo Yanagida Doshisha University 1-3 Tatara-miyakodani Kyotanabe Kyoto 610-0394 Japan nyanagid@ Abstract The main goal of this paper is to propose automatic schemes for the translation paired comparison method. This method was proposed to precisely evaluate a speech translation system s capability. Furthermore the method gives an objective evaluation result . a score of the Test of English for International Communication TOE1C . The TOEIC score is used as a measure of one s speech translation capability. However this method requires tremendous evaluation costs. Accordingly automatization of this method is an important subject for study. In the proposed method currently available automatic evaluation methods are applied to automate the translation paired comparison method. In the experiments several automatic evaluation methods BLEU NIST DPbased method are applied. The exper imental results of these automatic measures show a good correlation with evaluation results of the translation paired comparison method. 1 Introduction ATR Interpreting Telecommunications Research Laboratories ATR-1TL developed the ATR-MATRIX ATR s Multilingual Automatic Translation System for Information Exchange speech translation system Takezawa et al. 1998 which .

• Báo cáo khoa học
• Applications of Automatic Evaluation Methods
• Measuring a Capability
• Speech Translation System
• scientific reports
• model language
• process natural language
• Dialog Control
• Natural Language System
• Dialog Control in a Natural Language System
• Expanding the Horizons
• Natural Language Interfaces
• Phil Hayes
• PROSPECTS OR PRACTICAL
• NATURAL LANGUAGE SYSTEMS
• Workshops
• NATURAL LANGUAGE
• INTERACTION WITH MACHINES
• Long Papers
• COMPUTER INTEBFACE DESIGN MURRAY TUROFF DEPARTMENT OF COMPUTER
• IiVFORMATION SCIENCE IIEW JERSEY INSTITUTE OF TECHNOLOGY
• EVALUATION OF NATURAL LANGUAGE
• INTERFACES TO DATABASE SYSTEMS
• A PANEL DISCUSSION
• database query system
• J
• Norwood Crout
• INTERFACES TO DATA BASE SYSTEMS
• Bozena Henisz
• INTERPRETING NATURAL LANGUAGE
• DATABASE UPDATES
• S
• Jermld Kaplan Jim David
• TRANSPORTABLE NATURAL LANGUAGE
• INTERFACES TO DATABASES
• Gary G
• Hendrlx and William H
• Lewis
• DATABASES THEORETICAL
• TECHNICAL ISSUES
• TRANSPORTABLE NATURAL LANGUAGE INTERFACES
• PROBLEMS AND TECHNIQUES
• Barbara J
• Grosz
• THEORETICAL TECHNICAL ISSUES
• NATURAL LANGUAGE ACCESS TO DATABASES
• R
• Petrick
• Domain Independent
• Database Access Systems
• ISSUES IN NATURAL LANGUAGE
• ACCESS TO DATABASES
• A LOGIC PROGRAMMING PERSPECTIVE
• Sharon C
• Salveter David Maier
• PLANNING NATURAL LANGUAGE
• EXPRESSIONS REFERRING
• Douglas E
• Appelt
• THE TEXT SYSTEM
• NATURAL LANGUAGE GENERATION
• Kathleen R
• M
• MENTING A DATABASE
• KNOWLEDGE REPRESENTATION
• THE KEY TO THE SELECTION PROBLEM
• E
• Jeffrey Conklin David D
• McDonald
• A KNOWLEDGE ENGINEERING
• NATURAL LANGUAGE UNDERSTANDING
• Stuart C
• Shapiro
• NATURAL LANGUAGE TEXTS
• NECESSARILY GRAMMATICAL
• EVEN COMPLETE
• UNGRAMHATICALITY
• EXTRA GRAMMATICALITY
• NATURAL LANGUAGE UNDERSTANDING SYSTEMS
• Taxonomy
• Descriptions
• Individuals in Natural
• Language Understanding
• The Use of Ooject Special Knowledge
• Natural Language Processing
• Mark H
• Bursteln