TAILIEUCHUNG - Báo cáo khoa học: "Conditional Modality Fusion for Coreference Resolution"

Non-verbal modalities such as gesture can improve processing of spontaneous spoken language. For example, similar hand gestures tend to predict semantic similarity, so features that quantify gestural similarity can improve semantic tasks such as coreference resolution. However, not all hand movements are informative gestures; psychological research has shown that speakers are more likely to gesture meaningfully when their speech is ambiguous. | Conditional Modality Fusion for Coreference Resolution Jacob Eisenstein and Randall Davis Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology Cambridge MA 02139 USA jacobe davis @ Abstract Non-verbal modalities such as gesture can improve processing of spontaneous spoken language. For example similar hand gestures tend to predict semantic similarity so features that quantify gestural similarity can improve semantic tasks such as coreference resolution. However not all hand movements are informative gestures psychological research has shown that speakers are more likely to gesture meaningfully when their speech is ambiguous. Ideally one would attend to gesture only in such circumstances and ignore other hand movements. We present conditional modality fusion which formalizes this intuition by treating the informativeness of gesture as a hidden variable to be learned jointly with the class label. Applied to coreference resolution conditional modality fusion significantly outperforms both early and late modality fusion which are current techniques for modality combination. 1 Introduction Non-verbal modalities such as gesture and prosody can increase the robustness of NLP systems to the inevitable disfluency of spontaneous speech. For example consider the following excerpt from a dialogue in which the speaker describes a mechanical device So this moves up and it - everything moves up. And this top one clears this area here and goes all the way up to the top. 352 The references in this passage are difficult to disambiguate but the gestures shown in Figure 1 make the meaning more clear. However non-verbal modalities are often noisy and their interactions with speech are complex McNeill 1992 . Gesture for example is sometimes communicative but other times merely distracting. While people have little difficulty distinguishing between meaningful gestures and irrelevant hand motions . selftouching adjusting glasses .

• Báo cáo khoa học
• Conditional Modality Fusion
• Coreference Resolution
• Jacob Eisenstein and Randall Davis
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học