TAILIEUCHUNG - Báo cáo khoa học: "Text Chunking using Regularized Winnow"

Many machine learning methods have recently been applied to natural language processing tasks. Among them, the Winnow algorithm has been argued to be particularly suitable for NLP problems, due to its robustness to irrelevant features. However in theory, Winnow may not converge for nonseparable data. To remedy this problem, a modification called regularized Winnow has been proposed. In this paper, we apply this new method to text chunking. We show that this method achieves state of the art performance with significantly less computation than previous approaches. . | Text Chunking using Regularized Winnow Tong Zhangf and Fred DamerauỊ and David Johnson IBM TJ. Watson Research Center Yorktown Heights New York 10598 USA ftzhang@ Ịdamerau@ dejohns@ Abstract Many machine learning methods have recently been applied to natural language processing tasks. Among them the Winnow algorithm has been argued to be particularly suitable for NLP problems due to its robustness to irrelevant features. However in theory Winnow may not converge for non-separable data. To remedy this problem a modification called regularized Winnow has been proposed. In this paper we apply this new method to text chunking. We show that this method achieves state of the art performance with significantly less computation than previous approaches. 1 Introduction Recently there has been considerable interest in applying machine learning techniques to problems in natural language processing. One method that has been quite successful in many applications is the SNoW architecture Dagan et al. 1997 Khardon et al. 1999 . This architecture is based on the Winnow algorithm Littlestone 1988 Grove and Roth 2001 which in theory is suitable for problems with many irrelevant attributes. In natural language processing one often encounters a very high dimensional feature space although most of the features are irrelevant. Therefore the robustness of Winnow to high dimensional feature space is considered an important reason why it is suitable for NLP tasks. However the convergence of the Winnow algorithm is only guaranteed for linearly separable data. In practical NLP applications data are often linearly non-separable. Consequently a direct application of Winnow may lead to numerical instability. A remedy for this called regularized Winnow has been recently proposed in Zhang 2001 . This method modifies the original Winnow algorithm so that it solves a regularized optimization problem. It converges both in the linearly separable case and in the .

• Báo cáo khoa học
• Text Chunking
• Regularized Winnow
• IBM T
• Watson
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• A High Performance Semi Supervised
• Learning Method
• Combining Hand Crafted Rules
• Memory Based Learning
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học