TAILIEUCHUNG - Báo cáo khoa học: "Combining Association Measures for Collocation Extraction"

We introduce the possibility of combining lexical association measures and present empirical results of several methods employed in automatic collocation extraction. First, we present a comprehensive summary overview of association measures and their performance on manually annotated data evaluated by precision-recall graphs and mean average precision. Second, we describe several classification methods for combining association measures, followed by their evaluation and comparison with individual measures. . | Combining Association Measures for Collocation Extraction Pavel Pecina and Pavel Schlesinger Institute of Formal and Applied Linguistics Charles University Prague Czech Republic pecina schlesinger @ Abstract We introduce the possibility of combining lexical association measures and present empirical results of several methods employed in automatic collocation extraction. First we present a comprehensive summary overview of association measures and their performance on manually annotated data evaluated by precision-recall graphs and mean average precision. Second we describe several classification methods for combining association measures followed by their evaluation and comparison with individual measures. Finally we propose a feature selection algorithm significantly reducing the number of combined measures with only a small performance degradation. 1 Introduction Lexical association measures are mathematical formulas determining the strength of association between two or more words based on their occurrences and cooccurrences in a text corpus. They have a wide spectrum of applications in the field of natural language processing and computational linguistics such as automatic collocation extraction Manning and Schutze 1999 bilingual word alignment Mihalcea and Pedersen 2003 or dependency parsing. A number of various association measures were introduced in the last decades. An overview of the most widely used techniques is given . in Manning and Schutze 1999 or Pearce 2002 . Several researchers also attempted to compare existing methods and suggest different evaluation schemes Kita 1994 and Evert 2001 . A comprehensive study of statistical aspects of word cooccurrences can be found in Evert 2004 or Krenn 2000 . In this paper we present a novel approach to automatic collocation extraction based on combining multiple lexical association measures. We also address the issue of the evaluation of association measures by precision-recall graphs and

• Báo cáo khoa học
• Combining Association Measures
• Collocation Extraction
• Pavel Pecina and Pavel Schlesinger
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học