TAILIEUCHUNG - Báo cáo khoa học: "Tree-to-String Alignment Template for Statistical Machine Translation"

We present a novel translation model based on tree-to-string alignment template (TAT) which describes the alignment between a source parse tree and a target string. A TAT is capable of generating both terminals and non-terminals and performing reordering at both low and high levels. The model is linguistically syntaxbased because TATs are extracted automatically from word-aligned, source side parsed parallel texts. To translate a source sentence, we first employ a parser to produce a source parse tree and then apply TATs to transform the tree into a target string. . | Tree-to-String Alignment Template for Statistical Machine Translation Yang Liu Qun Liu and Shouxun Lin Institute of Computing Technology Chinese Academy of Sciences Kexueyuan South Road Haidian District P O. BoX 2704 Beijing 100080 China yliu liuqun sxlin @ Abstract We present a novel translation model based on tree-to-string alignment template TAT which describes the alignment between a source parse tree and a target string. A TAT is capable of generating both terminals and non-terminals and performing reordering at both low and high levels. The model is linguistically syntaxbased because TATs are extracted automatically from word-aligned source side parsed parallel texts. To translate a source sentence we first employ a parser to produce a source parse tree and then apply TATs to transform the tree into a target string. Our experiments show that the TAT-based model significantly outperforms Pharaoh a state-of-the-art decoder for phrase-based models. 1 Introduction Phrase-based translation models Marcu and Wong 2002 Koehn et al. 2003 Och and Ney 2004 which go beyond the original IBM translation models Brown et al. 1993 1 by modeling translations of phrases rather than individual words have been suggested to be the state-of-the-art in statistical machine translation by empirical evaluations. In phrase-based models phrases are usually strings of adjacent words instead of syntactic constituents excelling at capturing local reordering and performing translations that are localized to 1The mathematical notation we use in this paper is taken from that paper a source string fl fl . fj . fj is to be translated into a target string el el . ei . ei. Here I is the length of the target string and J is the length of the source string. substrings that are common enough to be observed on training data. However a key limitation of phrase-based models is that they fail to model reordering at the phrase level robustly. Typically phrase reordering is modeled in terms .

• Báo cáo khoa học
• Tree to String Alignment Template
• Statistical Machine Translation
• Yang Liu
• Qun Liu
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học