TAILIEUCHUNG - Báo cáo khoa học: "AUTOMATIC ALIGNMENT IN PARALLEL CORPORA"

This paper addresses the alignment issue in the framework of exploitation of large bimultilingual corpora for translation purposes. A generic alignment scheme is proposed that can meet varying requirements of different applications. Depending on the level at which alignment is sought, appropriate surface linguistic information is invoked coupled with information about possible unit delimiters. Each text unit (sentence, clause or phrase) is represented by the sum of its content tags. The results are then fed into a dynamic programming framework that computes the optimum alignment of units. . | AUTOMATIC ALIGNMENT IN PARALLEL CORPORA Harris Papageorgiou Lambros Cranias Stelios Piperidis Institute for Language and speech Processing 22 Margari Street 115 25 Athens Greece ABSTRACT This paper addresses the alignment issue in the framework of exploitation of large bi-multilingual corpora for translation purposes. A generic alignment scheme is proposed that can meet varying requữements of different applications. Depending on the level at which alignment is sought appropriate surface linguistic information is invoked coupled with information about possible unit delimiters. Each text unit sentence clause or phrase is represented by the sum of its content tags. The results are then fed into a dynamic programming framework that computes the optimum alignment of units. The proposed scheme has been tested at sentence level on parallel corpora of the CELEX database. The success rate exceeded 99 . The next steps of the work concern the testing of the scheme s efficiency at lower levels endowed with necessary bilingual information about potential delimiters. INTRODUCTION Parallel linguistically meaningful text units are indispensable in a number of NLP and lexicographic applications and recently in the so called Example-Based Machine Translation EBMT . As regards EBMT a large amount of bi-multilingual translation examples is stored in a database and input expressions are rendered in the target language by retrieving from the database that example which is most similar to the input. A task of crucial importance in this framework is the establishment of correspondences between units of multilingual texts at sentence phrase or even word level. The adopted criteria for ascertaining the adequacy of alignment methods are stated as follows 1This research was supported by the LRE I TRANSLEARN project of the European Union an alignment scheme must cope with the embedded extra-linguistic data tables anchor points SGML markers etc and theữ possible .

• Báo cáo khoa học
• AUTOMATIC ALIGNMENT
• PARALLEL CORPORA
• Harris Papageorgiou
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Finding Synonyms
• Automatic Word Alignment
• Measures of Distributional Similarity
• Vietnamese automatic speech recognition
• Transcription system
• Force alignment procedure
• Discriminative training
• State of the art Vietnamese ASR
• BMC Bioinformatics
• Cry protein
• Protein analysis
• Sequence alignment
• Automatic data retrieval
• Alignment free comparison
• Domain architectures
• Multi domain proteins
• Protein classification
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học