TAILIEUCHUNG - Báo cáo khoa học: "Orthogonal Negation in Vector Spaces for Modelling Word-Meanings and Document Retrieval"

Standard IR systems can process queries such as “web NOT internet”, enabling users who are interested in arachnids to avoid documents about computing. The documents retrieved for such a query should be irrelevant to the negated query term. Most systems implement this by reprocessing results after retrieval to remove documents containing the unwanted string of letters. This paper describes and evaluates a theoretically motivated method for removing unwanted meanings directly from the original query in vector models, with the same vector negation operator as used in quantum logic. . | Orthogonal Negation in Vector Spaces for Modelling Word-Meanings and Document Retrieval Dominic Widdows Stanford University dwiddows@ Abstract Standard IR systems can process queries such as web NOT internet enabling users who are interested in arachnids to avoid documents about computing. The documents retrieved for such a query should be irrelevant to the negated query term. Most systems implement this by reprocessing results after retrieval to remove documents containing the unwanted string of letters. This paper describes and evaluates a theoretically motivated method for removing unwanted meanings directly from the original query in vector models with the same vector negation operator as used in quantum logic. Irrelevance in vector spaces is modelled using orthogonality so query vectors are made orthogonal to the negated term or terms. As well as removing unwanted terms this form of vector negation reduces the occurrence of synonyms and neighbours of the negated terms by as much as 76 compared with standard Boolean methods. By altering the query vector itself vector negation removes not only unwanted strings but unwanted meanings. 1 Introduction Vector spaces enjoy widespread use in information retrieval Salton and McGill 1983 Baeza-Yates and This research was supported in part by the Research Collaboration between the NTT Communication Science Laboratories Nippon Telegraph and Telephone Corporation and CSLI Stanford University and by EC NSF grant IST-1999-11438 for the MUCHMORE project. Ribiero-Neto 1999 and from this original application vector models have been applied to semantic tasks such as word-sense acquisition Landauer and Dumais 1997 Widdows 2003 and disambiguation Schiitze 1998 . One benefit of these models is that the similarity between pairs of terms or between queries and documents is a continuous function automatically ranking results rather than giving just a YES NO judgment. In addition vector models can be freely built from .

• Báo cáo khoa học
• Orthogonal Negation in Vector
• Spaces for Modelling Word Meanings
• Document Retrieval
• Dominic Widdows
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học