TAILIEUCHUNG - Báo cáo khoa học: "Word Alignment for Languages with Scarce Resources Using Bilingual Corpora of Other Language Pairs"

This paper proposes an approach to improve word alignment for languages with scarce resources using bilingual corpora of other language pairs. To perform word alignment between languages L1 and L2, we introduce a third language L3. Although only small amounts of bilingual data are available for the desired language pair L1-L2, large-scale bilingual corpora in L1-L3 and L2-L3 are available. Based on these two additional corpora and with L3 as the pivot language, we build a word alignment model for L1 and L2. . | Word Alignment for Languages with Scarce Resources Using Bilingual Corpora of Other Language Pairs Haifeng Wang Hua Wu Zhanyi Liu Toshiba China Research and Development Center 5 F. Tower W2 Oriental Plaza East Chang An Ave. Dong Cheng District Beijing 100738 China wanghaifeng wuhua liuzhanyi @ Abstract This paper proposes an approach to improve word alignment for languages with scarce resources using bilingual corpora of other language pairs. To perform word alignment between languages L1 and L2 we introduce a third language L3. Although only small amounts of bilingual data are available for the desired language pair L1-L2 large-scale bilingual corpora in L1-L3 and L2-L3 are available. Based on these two additional corpora and with L3 as the pivot language we build a word alignment model for L1 and L2. This approach can build a word alignment model for two languages even if no bilingual corpus is available in this language pair. In addition we build another word alignment model for L1 and L2 using the small L1-L2 bilingual corpus. Then we interpolate the above two models to further improve word alignment between L1 and L2. Experimental results indicate a relative error rate reduction of as compared with the method only using the small bilingual corpus in L1 and L2. 1 Introduction Word alignment was first proposed as an intermediate result of statistical machine translation Brown et al. 1993 . Many researchers build alignment links with bilingual corpora Wu 1997 Och and Ney 2003 Cherry and Lin 2003 Zhang and Gildea 2005 . In order to achieve satisfactory results all of these methods require a large-scale bilingual corpus for training. When the large-scale bilingual corpus is unavailable some researchers acquired class-based alignment rules with existing dictionaries to improve word alignment Ker and Chang 1997 . Wu et al. 2005 used a large-scale bilingual corpus in general domain to improve domain-specific word alignment when only a .

• Báo cáo khoa học
• Word Alignment
• Languages with Scarce Resources
• Bilingual Corpora of Other Language Pairs
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Smaller Alignment Models for Better Translations
• Unsupervised Word Alignment with the 0
• Ashish Vaswani Liang Huang David Chiang
• báo cáo ngôn ngữ
• ngôn ngữ tự nhiên
• Alignment Model Adaptation
• Domain Specific Word Alignment
• WU Hua
• Word Alignment Combination
• Multiple Word Segmentation
• Ning Xi
• Guangchao Tang
• Bootstrapping Word Alignment
• Word Packing
• Yanjun Ma
• Nicolas Stroppa
• Sentence alignment
• Parallel corpora
• word clustering
• Natural language processing
• Alignment algorithms
• IBM model
• Hierarchical Search
• Long Papers
• Diversify and Combine
• Improving Word Alignment
• Machine Translation
• Low Resource Languages
• Synonym Regularization
• Hiroyuki Shindo
• Supervised Word Alignment
• Jinxi Xu and Jinying Chen
• Active Learning Based Elicitation
• Semi Supervised Word Alignment
• Vamshi Ambati
• Submodular Maximization over Matroids
• Hui Lin
• Dealing with Spurious Ambiguity
• Learning ITG based Word Alignment
• Stephan Vogel
• Confidence Measure
• Fei Huang
• Unsupervised Word Alignment
• Arbitrary Features
• Chris Dyer Jonathan
• An Algorithm
• Unsupervised Transliteration Mining
• Application to Word Alignment
• Data Cleaning
• Tsuyoshi Okita
• Mining Parenthetical Translations
• Web by Word Alignment
• Dekang Lin
• Discriminative Word Alignment
• Conditional Random Fields
• Phil Blunsom and Trevor Cohn
• Improved Discriminative
• Bilingual Word Alignment
• Robert C
• Moore Wen tau Yih
• Word Alignment in English Hindi Parallel Corpus
• Recency Vector Approach
• Some Studies
• Soft Syntactic Constraints
• Discriminative Training
• Semi Supervised Training
• Statistical Word Alignment
• Alexander Fraser
• Yet Another Word Alignment Tool
• Ulrich Germann
• Optimizing Word Alignment Combination
• Phrase Table Training
• Yonggang Deng and Bowen Zhou
• Finding Synonyms
• Automatic Word Alignment
• Measures of Distributional Similarity