TAILIEUCHUNG - Báo cáo khoa học: "Morphological Analysis of a Large Spontaneous Speech Corpus in Japanese"

This paper describes two methods for detecting word segments and their morphological information in a Japanese spontaneous speech corpus, and describes how to tag a large spontaneous speech corpus accurately by using the two methods. The first method is used to detect any type of word segments. The second method is used when there are several definitions for word segments and their POS categories, and when one type of word segments includes another type of word segments. | Morphological Analysis of a Large Spontaneous Speech Corpus in Japanese Kiyotaka I chimoto Chikashi Nobata1 Atsushi Yamada1 Satoshi Sekine1 Hitoshi Isahara1 Communications Research Laboratory 3-5 Hikari-dai Seika-cho Soraku-gun Kyoto 619-0289 Japan uchimoto nova ark isahara @ New York University 715 Broadway 7th floor New York NY 10003 USA sekine@ Abstract This paper describes two methods for detecting word segments and their morphological information in a Japanese spontaneous speech corpus and describes how to tag a large spontaneous speech corpus accurately by using the two methods. The first method is used to detect any type of word segments. The second method is used when there are several definitions for word segments and their POS categories and when one type of word segments includes another type of word segments. In this paper we show that by using semiautomatic analysis we achieve a precision of better than 99 for detecting and tagging short words and 97 for long words the two types of words that comprise the corpus. We also show that better accuracy is achieved by using both methods than by using only the first. 1 Introduction The Spontaneous Speech Corpus and Processing Technology project is sponsoring the construction of a large spontaneous Japanese speech corpus Corpus of Spontaneous Japanese CSJ Maekawa et al. 2000 . The CSJ is a collection of monologues and dialogues the majority being monologues such as academic presentations and simulated public speeches. Simulated public speeches are short speeches presented specifically for the corpus by paid non-professional speakers. The CSJ in cludes transcriptions of the speeches as well as audio recordings of them. One of the goals of the project is to detect two types of word segments and corresponding morphological information in the transcriptions. The two types of word segments were defined by the members of The National Institute for Japanese Language and are called short word and .

• Báo cáo khoa học
• Morphological Analysis of a Large Spontaneous Speech
• Corpus in Japanese
• Kiyotaka Uchimoto
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học