TAILIEUCHUNG - Báo cáo khoa học: "Examining the Content Load of Part of Speech Blocks for Information Retrieval"

We investigate the connection between part of speech (POS) distribution and content in language. We define POS blocks to be groups of parts of speech. We hypothesise that there exists a directly proportional relation between the frequency of POS blocks and their content salience. We also hypothesise that the class membership of the parts of speech within such blocks reflects the content load of the blocks, on the basis that open class parts of speech are more content-bearing than closed class parts of speech. We test these hypotheses in the context of Information Retrieval, by syntactically representing queries, and. | Examining the Content Load of Part of Speech Blocks for Information Retrieval Christina Lioma Department of Computing Science University of Glasgow 17 Lilybank Gardens Scotland . xristina@ ladh Ounis Department of Computing Science University of Glasgow 17 Lilybank Gardens Scotland . ounis@ Abstract We investigate the connection between part of speech POS distribution and content in language. We define POS blocks to be groups of parts of speech. We hypothesise that there exists a directly proportional relation between the frequency of POS blocks and their content salience. We also hypothesise that the class membership of the parts of speech within such blocks reflects the content load of the blocks on the basis that open class parts of speech are more content-bearing than closed class parts of speech. We test these hypotheses in the context of Information Retrieval by syntactically representing queries and removing from them content-poor blocks in line with the aforementioned hypotheses. For our first hypothesis we induce POS distribution information from a corpus and approximate the probability of occurrence of POS blocks as per two statistical estimators separately. For our second hypothesis we use simple heuristics to estimate the content load within POS blocks. We use the Text REtrieval Conference TREC queries of 1999 and 2000 to retrieve documents from the WT2G and WT10G test collections with five different retrieval strategies. Experimental outcomes confirm that our hypotheses hold in the context of Information Retrieval. 1 Introduction The task of an Information Retrieval IR system is to retrieve documents from a collection in response to a user need which is expressed in the form of a query. Very often this task is realised by indexing the documents in the collection with keyword descriptors. Retrieval consists in matching the query against the descriptors of the documents and returning the ones that appear closest in ranked

• Báo cáo khoa học
• Examining the Content
• Load of Part of Speech Blocks
• Information Retrieval
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học