TAILIEUCHUNG - Báo cáo khoa học: "Empirical Measurements of Lexical Similarity in Noun Phrase Conjuncts"

The ability to detect similarity in conjunct heads is potentially a useful tool in helping to disambiguate coordination structures - a difficult task for parsers. We propose a distributional measure of similarity designed for such a task. We then compare several different measures of word similarity by testing whether they can empirically detect similarity in the head nouns of noun phrase conjuncts in the Wall Street Journal (WSJ) treebank. | Empirical Measurements of Lexical Similarity in Noun Phrase Conjuncts Deirdre Hogan Department of Computer Science Trinity College Dublin Dublin 2 Ireland dhogan@ Abstract The ability to detect similarity in conjunct heads is potentially a useful tool in helping to disambiguate coordination structures - a difficult task for parsers. We propose a distributional measure of similarity designed for such a task. We then compare several different measures of word similarity by testing whether they can empirically detect similarity in the head nouns of noun phrase con-juncts in the Wall Street Journal WSJ treebank. We demonstrate that several measures of word similarity can successfully detect conjunct head similarity and suggest that the measure proposed in this paper is the most appropriate for this task. 1 Introduction Some noun pairs are more likely to be conjoined than others. Take the follow two alternate bracketings 1. busloads of executives and their spouses and 2. busloads of executives and their spouses . The two head nouns coordinated in 1 are executives and spouses and incorrectly in 2 busloads and spouses. Clearly the former pair of head nouns is more likely and for the purpose of discrimination a parsing model would benefit if it could learn that executives and spouses is a more likely combination than busloads and spouses. If nouns co-occurring in coordination patterns are often semantically similar and if a simi Now at the National Centre for Language Technology Dublin City University Ireland. 149 larity measure could be defined so that for example sim executives spouses sim busloads spouses then it is potentially useful for coordination disambiguation. The idea that nouns co-occurring in conjunctions tend to be semantically related has been noted in Riloff and Shepherd 1997 and used effectively to automatically cluster semantically similar words Roark and Charniak 1998 Caraballo 1999 Widdows and Dorow 2002 . The tendency for conjoined .

• Báo cáo khoa học
• Empirical Measurements
• Lexical Similarity
• Noun Phrase Conjuncts
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Next Generation Sequencing
• RNA seq
• Disease conditions
• Bayesian based approach
• qRT PCR measurements
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học