TAILIEUCHUNG - Báo cáo khoa học: "A Practical Solution to the Problem of Automatic Part-of-Speech Induction from Text"

The problem of part-of-speech induction from text involves two aspects: Firstly, a set of word classes is to be derived automatically. Secondly, each word of a vocabulary is to be assigned to one or several of these word classes. In this paper we present a method that solves both problems with good accuracy. Our approach adopts a mixture of statistical methods that have been successfully applied in word sense induction. | A Practical Solution to the Problem of Automatic Part-of-Speech Induction from Text Reinhard Rapp University of Mainz FASK D-76711 Germersheim Germany rapp@ Abstract The problem of part-of-speech induction from text involves two aspects Firstly a set of word classes is to be derived automatically. Secondly each word of a vocabulary is to be assigned to one or several of these word classes. In this paper we present a method that solves both problems with good accuracy. Our approach adopts a mixture of statistical methods that have been successfully applied in word sense induction. Its main advantage over previous attempts is that it reduces the syntactic space to only the most important dimensions thereby almost eliminating the otherwise omnipresent problem of data sparseness. 1 Introduction Whereas most previous statistical work concerning parts of speech has been on tagging this paper deals with part-of-speech induction. In part-of-speech induction two phases can be distinguished In the first phase a set of word classes is to be derived automatically on the basis of the distribution of the words in a text corpus. These classes should be in accordance with human intuitions . common distinctions such as nouns verbs and adjectives are desirable. In the second phase based on its observed usage each word is assigned to one or several of the previously defined classes. The main reason why part-of-speech induction has received far less attention than part-of-speech tagging is probably that there seemed no urgent need for it as linguists have always considered classifying words as one of their core tasks and as a consequence accurate lexicons providing such information are readily available for many languages. Nevertheless deriving word classes automatically is an interesting intellectual challenge with relevance to cognitive science. Also advantages of the automatic systems are that they should be more objective and can provide precise .

• Báo cáo khoa học
• A Practical Solution to the Problem
• Automatic Part of Speech
• Induction from Text
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• A Practical Solution
• Problem of Automatic Word Sense Induction
• Reinhard Rapp
• Power system
• Manta ray foraging algorithm
• Reactive power optimization
• Reactive power optimization scheduling problem
• Evolutionary algorithm
• Particle swarm optimization
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học