TAILIEUCHUNG - Báo cáo khoa học: "Word Alignment with Synonym Regularization"

We present a novel framework for word alignment that incorporates synonym knowledge collected from monolingual linguistic resources in a bilingual probabilistic model. Synonym information is helpful for word alignment because we can expect a synonym to correspond to the same word in a different language. We design a generative model for word alignment that uses synonym information as a regularization term. | Word Alignment with Synonym Regularization Hiroyuki Shindo Akinori Fujino and Masaaki Nagata NTT Communication Science Laboratories NTT Corp. 2-4 Hikaridai Seika-cho Soraku-gun Kyoto 619-0237 Japan shindo @ Abstract We present a novel framework for word alignment that incorporates synonym knowledge collected from monolingual linguistic resources in a bilingual probabilistic model. Synonym information is helpful for word alignment because we can expect a synonym to correspond to the same word in a different language. We design a generative model for word alignment that uses synonym information as a regularization term. The experimental results show that our proposed method significantly improves word alignment quality. 1 Introduction Word alignment is an essential step in most phrase and syntax based statistical machine translation SMT . It is an inference problem of word correspondences between different languages given parallel sentence pairs. Accurate word alignment can induce high quality phrase detection and translation probability which leads to a significant improvement in SMT performance. Many word alignment approaches based on generative models have been proposed and they learn from bilingual sentences in an unsupervised manner Vogel et al. 1996 Och and Ney 2003 Fraser and Marcu 2007 . One way to improve word alignment quality is to add linguistic knowledge derived from a monolingual corpus. This monolingual knowledge makes it easier to determine corresponding words correctly. For instance functional words in one language tend to correspond to functional words in another language Deng and Gao 2007 and the syntactic dependency of words in each language can help the alignment process Ma et al. 2008 . It has been shown that such grammatical information works as a constraint in word alignment models and improves word alignment quality. A large number of monolingual lexical semantic resources such as .

• Báo cáo khoa học
• Word Alignment
• Synonym Regularization
• Hiroyuki Shindo
• báo cáo khoa học
• báo cáo ngôn ngữ
• ngôn ngữ tự nhiên
• Smaller Alignment Models for Better Translations
• Unsupervised Word Alignment with the 0
• Ashish Vaswani Liang Huang David Chiang
• Alignment Model Adaptation
• Domain Specific Word Alignment
• WU Hua
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Word Alignment Combination
• Multiple Word Segmentation
• Ning Xi
• Guangchao Tang
• Bootstrapping Word Alignment
• Word Packing
• Yanjun Ma
• Nicolas Stroppa
• Sentence alignment
• Parallel corpora
• word clustering
• Natural language processing
• Alignment algorithms
• IBM model
• Hierarchical Search
• Long Papers
• Diversify and Combine
• Improving Word Alignment
• Machine Translation
• Low Resource Languages
• Supervised Word Alignment
• Jinxi Xu and Jinying Chen
• Active Learning Based Elicitation
• Semi Supervised Word Alignment
• Vamshi Ambati
• Submodular Maximization over Matroids
• Hui Lin
• Dealing with Spurious Ambiguity
• Learning ITG based Word Alignment
• Stephan Vogel
• Confidence Measure
• Fei Huang
• Unsupervised Word Alignment
• Arbitrary Features
• Chris Dyer Jonathan
• An Algorithm
• Unsupervised Transliteration Mining
• Application to Word Alignment
• Data Cleaning
• Tsuyoshi Okita
• Mining Parenthetical Translations
• Web by Word Alignment
• Dekang Lin
• Discriminative Word Alignment
• Conditional Random Fields
• Phil Blunsom and Trevor Cohn
• Improved Discriminative
• Bilingual Word Alignment
• Robert C
• Moore Wen tau Yih
• Word Alignment in English Hindi Parallel Corpus
• Recency Vector Approach
• Some Studies
• Soft Syntactic Constraints
• Discriminative Training
• Semi Supervised Training
• Statistical Word Alignment
• Alexander Fraser
• Yet Another Word Alignment Tool
• Ulrich Germann
• Optimizing Word Alignment Combination
• Phrase Table Training
• Yonggang Deng and Bowen Zhou
• Finding Synonyms
• Automatic Word Alignment
• Measures of Distributional Similarity