TAILIEUCHUNG - Báo cáo khoa học: "HUMAN INTENTION-BASED SEGMENTATION: RELIABILITY AND CORRELATION WITH LINGUISTIC CUES"

Certain spans of utterances in a discourse, referred to here as segments, are widely assumedto form coherent units. Further, the segmental structure of discourse has been claimed to constrain and be constrained by many phenomena. However, there is weak consensus on the nature of segments and the criteria for recognizing or generating them. We present quantitative results of a two part study using a corpus of spontaneous, narrative monologues. The first part evaluates the statistical reliability of human segmentation of our corpus, where speaker intention is the segmentation criterion. . | INTENTION-BASED SEGMENTATION HUMAN RELIABILITY AND CORRELATION WITH LINGUISTIC CUES Rebecca J. Passonneau Department of Computer Science Columbia University New York NY 10027 becky@ Abstract Certain spans of utterances in a discourse referred to here as segments are widely assumed to form coherent units. Further the segmental structure of discourse has been claimed to constrain and be constrained by many phenomena. However there is weak consensus on the nature of segments and the criteria for recognizing or generating them. We present quantitative results of a two part study using a corpus of spontaneous narrative monologues. The first part evaluates the statistical reliability of human segmentation of our corpus where speaker intention is the segmentation criterion. We then use the subjects segmentations to evaluate the correlation of discourse segmentation with three linguistic cues referential noun phrases cue words and pauses using information retrieval metrics. INTRODUCTION A discourse consists not simply of a linear sequence of utterances 1 but of meaningful relations among the utterances. As in much of the literature on discourse processing we assume that certain spans of utterances referred to here as discourse segments form coherent units. The segmental structure of discourse has been claimed to constrain and be constrained by disparate phenomena cue phrases Hirschberg and Litman 1993 Grosz and Sidner 1986 Reichman 1985 Cohen 1984 lexical cohesion Morris and Hirst 1991 plans and intentions Carberry 1990 Lit-man and Allen 1990 Grosz and Sidner 1986 prosody Grosz and Hirschberg 1992 Hirschberg and Grosz 1992 Hirschberg and Pierrehumbert 1986 reference Webber 1991 Grosz and Sidner 1986 Linde 1979 and tense Webber 1988 Hwang and Schubert 1992 Song and Cohen 1991 . However there is weak consensus on the nature of segments and the criteria for recognizing or generating them in a natural language processing system. Until recently little empirical .

• Báo cáo khoa học
• HUMAN INTENTION BASED
• SEGMENTATION RELIABILITY AND CORRELATION
• LINGUISTIC CUES
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học