TAILIEUCHUNG - Báo cáo khoa học: "Automatic clustering of collocation for detecting practical sense boundary"

This paper talks about the deciding practical sense boundary of homonymous words. The important problem in dictionaries or thesauri is the confusion of the sense boundary by each resource. This also becomes a bottleneck in the practical language processing systems. This paper proposes the method about discovering sense boundary using the collocation from the large corpora and the clustering methods. In the experiments, the proposed methods show the similar results with the sense boundary from a corpus-based dictionary and sense-tagged corpus. . | Automatic clustering of collocation for detecting practical sense boundary Saim Shin KAIST KorTerm BOLA miror@ Key-Sun Choi KAIST KorTerm BOLA kschoi@ Abstract This paper talks about the deciding practical sense boundary of homonymous words. The important problem in dictionaries or thesauri is the confusion of the sense boundary by each resource. This also becomes a bottleneck in the practical language processing systems. This paper proposes the method about discovering sense boundary using the collocation from the large corpora and the clustering methods. In the experiments the proposed methods show the similar results with the sense boundary from a corpus-based dictionary and sense-tagged corpus. 1 Introduction There are three types of sense boundary confusion for the homonyms in the existing dictionaries. One is sense boundaries overlapping two senses are overlapped from some semantic features. Second some senses in the dictionary are null or non-existing in the used corpora. Conversely we have to generate more senses depending on the corpora and we define these senses with practical senses. Our goal in this study is to revise sense boundary in the existing dictionaries with practical senses from the large-scaled corpus. The collocation from the large-scaled corpus contains semantic information. The collocation for ambiguous words also contains semantic information about multiple senses for this ambiguous word. This paper uses the ambiguity of collocation for the homonyms. With the clustering algorithms we extract practical sense boundary from the collocations. This paper explains the collocation ambiguity in chapter 2 defines the extracted collocation and proposes the used clustering methods and the labeling algorithms in chapter 3. After explaining the experimental results in chapter 4 this paper comes to the conclusion in chapter 5. 2 Collocation and Senses Impractical senses in dictionary In Patrick and Lin 2002 senses .

• Báo cáo khoa học
• Automatic clustering of collocation
• detecting practical sense boundary
• Saim Shin
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học