TAILIEUCHUNG - Báo cáo khoa học: "Linguistically Motivated Features for Enhanced Back-of-the-Book Indexing"

In this paper we present a supervised method for back-of-the-book index construction. We introduce a novel set of features that goes beyond the typical frequency-based analysis, including features based on discourse comprehension, syntactic patterns, and information drawn from an online encyclopedia. In experiments carried out on a book collection, the method was found to lead to an improvement of roughly 140% as compared to an existing state-of-the-art supervised method. | Linguistically Motivated Features for Enhanced Back-of-the-Book Indexing Andras Csomai and Rada Mihalcea Department of Computer Science University of North Texas csomaia@ rada@ Abstract In this paper we present a supervised method for back-of-the-book index construction. We introduce a novel set of features that goes beyond the typical frequency-based analysis including features based on discourse comprehension syntactic patterns and information drawn from an online encyclopedia. In experiments carried out on a book collection the method was found to lead to an improvement of roughly 140 as compared to an existing state-of-the-art supervised method. 1 Introduction Books represent one of the oldest forms of written communication and have been used since thousands of years ago as a means to store and transmit information. Despite this fact given that a large fraction of the electronic documents available online and elsewhere consist of short texts such as Web pages news articles scientific reports and others the focus of natural language processing techniques to date has been on the automation of methods targeting short documents. We are witnessing however a change more and more books are becoming available in electronic format in projects such as the Million Books project http .org details millionbooks the Gutenberg project http or Google Book Search http . Similarly a large number of the books published in recent years are often available - for purchase or through libraries - in electronic format. This means that the need for language processing techniques able to handle very large documents such as books is becoming increasingly important. This paper addresses the problem of automatic back-of-the-book index construction. A back-of-the-book index typically consists of the most important keywords addressed in a book with pointers to the relevant pages inside the book. The construction of such indexes is

• Báo cáo khoa học
• Linguistically Motivated Features
• Enhanced Back of the Book Indexing
• Andras Csomai and Rada Mihalcea
• báo cáo khoa học
• báo cáo ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học