TAILIEUCHUNG - Báo cáo khoa học: "A Quantitative Evaluation of Linguistic Tests for the Automatic Prediction of Semantic Markedness"

We present a corpus-based study of methods that have been proposed in the linguistics literature for selecting the semantically unmarked term out of a pair of antonymous adjectives. Solutions to this problem are applicable to the more general task of selecting the positive term from the pair. Using automatically collected data, the accuracy and applicability of each method is quantified, and a statistical analysis of the significance of the results is performed. | A Quantitative Evaluation of Linguistic Tests for the Automatic Prediction of Semantic Markedness Vasileios Hatzivassiloglou and Kathleen McKeown Department of Computer Science 450 Computer Science Building Columbia University New York . 10027 vh kathy @ Abstract We present a corpus-based study of methods that have been proposed in the linguistics literature for selecting the semantically unmarked term out of a pair of antonymous adjectives. Solutions to this problem are applicable to the more general task of selecting the positive term from the pair. Using automatically collected data the accuracy and applicability of each method is quantified and a statistical analysis of the significance of the results is performed. We show that some simple methods are indeed good indicators for the answer to the problem while other proposed methods fail to perform better than would be attributable to chance. In addition one of the simplest methods text frequency dominates all others. We also apply two generic statistical learning methods for combining the indications of the individual methods and compare their performance to the simple methods. The most sophisticated complex learning method offers a small but statistically significant improvement over the original tests. 1 Introduction The concept of markedness originated in the work of Prague School linguists Jakobson 1984a and refers to relationships between two complementary or antonymous terms which can be distinguished by the presence or absence of a feature A versus a . Such an opposition can occur at various linguistic levels. For example a markedness contrast can arise at the morphology level when one of the two words is derived from the other and therefore contains an explicit formal marker such as a prefix . profitable- unprofitable. Markedness contrasts also appear at the semantic level in many pairs of gradable antonymous adjectives especially scalar ones Levinson 1983 such as tall-short. The .

• Báo cáo khoa học
• A Quantitative Evaluation of Linguistic Tests
• the Automatic Prediction
• Semantic Markedness
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học