TAILIEUCHUNG - Báo cáo khoa học: "Guiding Semi-Supervision with Constraint-Driven Learning"

Over the last few years, two of the main research directions in machine learning of natural language processing have been the study of semi-supervised learning algorithms as a way to train classifiers when the labeled data is scarce, and the study of ways to exploit knowledge and global information in structured learning tasks. In this paper, we suggest a method for incorporating domain knowledge in semi-supervised learning algorithms. Our novel framework unifies and can exploit several kinds of task specific constraints. . | Guiding Semi-Supervision with Constraint-Driven Learning Ming-Wei Chang Lev Ratinov Dan Roth Department of Computer Science University of Illinois at Urbana-Champaign Urbana IL 61801 mchang21 ratinov2 danr @ Abstract Over the last few years two of the main research directions in machine learning of natural language processing have been the study of semi-supervised learning algorithms as a way to train classihers when the labeled data is scarce and the study of ways to exploit knowledge and global information in structured learning tasks. In this paper we suggest a method for incorporating domain knowledge in semi-supervised learning algorithms. Our novel framework unihes and can exploit several kinds of task specific constraints. The experimental results presented in the information extraction domain demonstrate that applying constraints helps the model to generate better feedback during learning and hence the framework allows for high performance learning with significantly less training data than was possible before on these tasks. 1 Introduction Natural Language Processing NLP systems typically require large amounts of knowledge to achieve good performance. Acquiring labeled data is a dif-hcult and expensive task. Therefore an increasing attention has been recently given to semi-supervised learning where large amounts of unlabeled data are used to improve the models learned from a small training set Collins and Singer 1999 Thelen and Riloff 2002 . The hope is that semi-supervised or even unsupervised approaches when given enough 280 knowledge about the structure of the problem will be competitive with the supervised models trained on large training sets. However in the general case semi-supervised approaches give mixed results and sometimes even degrade the model performance Nigam et al. 2000 . In many cases improving semi-supervised models was done by seeding these models with domain information taken from dictionaries or ontology Cohen and Sarawagi .

• Báo cáo khoa học
• Guiding Semi Supervision
• Constraint Driven Learning
• Ming Wei Chang Lev Ratinov Dan Roth
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học