TAILIEUCHUNG - Báo cáo khoa học: "Char_align:A Program for Aligning Parallel Texts at the Character Level"

There have been a number of recent papers on aligning parallel texts at the sentence level, ., Brown et al (1991), Gale and Church (to appear), Isabelle (1992), Kay and R/Ssenschein (to appear), Simard et al (1992), WarwickArmstrong and Russell (1990). On clean inputs, such as the Canadian Hansards, these methods have been very successful (at least 96% correct by sentence). Unfortunately, if the input is noisy (due to OCR and/or unknown markup conventions), then these methods tend to break down because the noise can make it difficult to find paragraph boundaries, let alone sentences. . | Char align A Program for Aligning Parallel Texts at the Character Level Kenneth Ward Church AT T Bell Laboratories 600 Mountain Avenue Murray Hill NJ 07974-0636 kwc@ Abstract There have been a number of recent papers on aligning parallel texts at the sentence level . Brown et al 1991 Gale and Church to appear Isabelle 1992 Kay and Rõsenschein to appear Simard et al 1992 WarwickArmstrong and Russell 1990 . On clean inputs such as the Canadian Hansards these methods have been very successful at least 96 correct by sentence . Unfortunately if the input is noisy due to OCR and or unknown markup conventions then these methods tend to break down because the noise can make it difficult to find paragraph boundaries let alone sentences. This paper describes a new program char_align that aligns texts at the character level rather than at the sentence paragraph level based on the cognate approach proposed by Simard et al. 1. Introduction Parallel texts have recently received considerable attention in machine hanslation . Brown et al 1990 bilingual lexicography . Klavans and Tzoukermann 1990 and terminology research for human translators . Isabelle 1992 . We have been most interested in the terminology application. Translators find it extremely embarrassing when store in the computer sense is translated as grocery or when magnetic fields is translated as magnetic meadows. Terminology eưors of this kind are all too common because the translator is generally not as familiar with the subject domain as the author of the source text or the readers of the target text. Parallel texts could be used to help translators overcome their lack of domain expertise by providing them with the ability to search previously translated documents for examples of potentially difficult expressions and see how they were translated in the past. While pursuing this possibility with a commercial translation organization AT T Language Line Services we discovered that we needed

• Báo cáo khoa học
• Char align
• A Program for Aligning Parallel Texts
• Character Level
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học