TAILIEUCHUNG - Báo cáo khoa học: "Locating noun phrases with finite state transducers"

We present a method for constructing, maintaining and consulting a database of proper nouns. We describe noun phrases composed of a proper noun a n d / o r a description of a human occupation. They are formalized by finite state transducers (FST) and large coverage dictionaries and are applied to a corpus of newspapers. We take into account synonymy and hyperonymy. This first stage of our parsing procedure has a high degree of accuracy. We show how we can handle requests such as: 'Find all newspaper articles in a general corpus mentioning the French prime minister', or 'How. | Locating noun phrases with finite state transducers. Jean Senellart LADL Laboratoire d automatique documentaire et linguistique. ưniversité Paris VII 2 place Jussieu 75251 PARIS Cedex 05 email senella@ Abstract We present a method for constructing maintaining and consulting a database of proper nouns. We describe noun phrases composed of a proper noun and or a description of a human occupation. They are formalized by finite state transducers FST and large coverage dictionaries and are applied to a corpus of newspapers. We take into account synonymy and hyperonymy. This first stage of our parsing procedure has a high degree of accuracy. We show how we can handle requests such as Find all newspaper articles in a general corpus mentioning the French prime minister or How is Mr. X referred to in the corpus what have been his different occupations through out the period over which our corpus extends In the first case non trivial occurrences of noun phrases are located that is phrases not containing words present in the request but either synonyms or proper nouns relevant to request. The results of the search is far better than than those obtained by a key-word based engine. Most answers are correct except some cases of homonymy where a human reader would also fail without more context . Also the treatment of people having several different occupations is not fully resolved. We have built for French a library of about one thousand such FSTs and English FSTs are under construction. The same method can be used to locate and propose new proper nouns simply by replacing given proper names in the same FSTs by variables. 1 Introduction Information Retrieval in full texts is one of the challenges of the next years. Web engines attempt to select among the millions of existing Web Sites those corresponding to some input request. Newspaper archives is another exam ple there are several gigabytes of news on electronic support and the size is increasing every day. .

• Báo cáo khoa học
• Locating noun phrases
• finite state transducers
• Jean Senellart
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học