TAILIEUCHUNG - Báo cáo khoa học: "A Generative Blog Post Retrieval Model that Uses Query Expansion based on External Collections"

User generated content is characterized by short, noisy documents, with many spelling errors and unexpected language usage. To bridge the vocabulary gap between the user’s information need and documents in a specific user generated content environment, the blogosphere, we apply a form of query expansion, ., adding and reweighing query terms. Since the blogosphere is noisy, query expansion on the collection itself is rarely effective but external, edited collections are more suitable. We propose a generative model for expanding queries using external collections in which dependencies between queries, documents, and expansion documents are explicitly modeled. . | A Generative Blog Post Retrieval Model that Uses Query Expansion based on External Collections Wouter Weerkamp Krisztian Balog ISLA University of Amsterdam Maarten de Rijke mdr@ Abstract User generated content is characterized by short noisy documents with many spelling errors and unexpected language usage. To bridge the vocabulary gap between the user s information need and documents in a specific user generated content environment the blogosphere we apply a form of query expansion . adding and reweighing query terms. Since the blogosphere is noisy query expansion on the collection itself is rarely effective but external edited collections are more suitable. We propose a generative model for expanding queries using external collections in which dependencies between queries documents and expansion documents are explicitly modeled. Different instantiations of our model are discussed and make different in dependence assumptions. Results using two external collections news and Wikipedia show that external expansion for retrieval of user generated content is effective besides conditioning the external collection on the query is very beneficial and making candidate expansion terms dependent on just the document seems sufficient. 1 Introduction One of the grand challenges in information retrieval is to bridge the vocabulary gap between a user and her information need on the one hand and the relevant documents on the other Baeza-Yates and Ribeiro-Neto 1999 . In the setting of blogs or other types of user generated content bridging this gap becomes even more challenging. This has several causes i the spelling errors unusual creative or unfocused language usage resulting from the lack of top-down rules and editors in the content creation process and ii the often limited length of user generated documents. Query expansion . modifying the query by adding and reweighing terms is an often used technique to bridge the .

• Báo cáo khoa học
• A Generative Blog Post Retrieval Model
• Uses Query Expansion
• External Collections
• báo cáo khoa học
• báo cáo ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học