TAILIEUCHUNG - Báo cáo khoa học: "Evaluating Response Strategies in a Web-Based Spoken Dialogue Agent"

While the notion of a cooperative response has been the focus of considerable research in natural language dialogue systems, there has been little empirical work demonstrating how such responses lead to more efficient, natural, or successful dialogues. This paper presents an experimental evaluation of two alternative response strategies in TOOT, a spoken dialogue agent that allows users to access train schedules stored on the web via a telephone conversation. We compare the performance of two versions of TOOT (literal and cooperative), by having users carry out a set of tasks with each version. By using hypothesis testing methods, we. | Evaluating Response Strategies in a Web-Based Spoken Dialogue Agent Diane J. Litman AT T Labs - Research 180 Park Avenue Florham Park NJ 07932 USA diane@ Shimei Pan Computer Science Department Columbia University New York NY 10027 USA pan @ Marilyn A. Walker AT T Labs - Research 180 Park Avenue Florham Park NJ 07932 USA walker@ Abstract While the notion of a cooperative response has been the focus of considerable research in natural language dialogue systems there has been little empirical work demonstrating how such responses lead to more efficient natural or successful dialogues. This paper presents an experimental evaluation of two alternative response strategies in TOOT a spoken dialogue agent that allows users to access train schedules stored on the web via a telephone conversation. We compare the performance of two versions of TOOT literal and cooperative by having users carry out a set of tasks with each version. By using hypothesis testing methods we show that a combination of response strategy application task and task strategy interactions account for various types of performance differences. By using the PARADISE evaluation framework to estimate an overall performance function we identify interdependencies that exist between speech recognition and response strategy. Our results elaborate the conditions under which TOOT s cooperative rather than literal strategy contributes to greater performance. 1 Introduction The notion of a cooperative response has been the focus of considerable research in natural language and spoken dialogue systems Allen and Perrault 1980 Mays 1980 Kaplan 1981 Joshi et al. 1984 McCoy 1989 Pao and Wilpon 1992 Moore 1994 Seneff et al. 1995 Goddeau et al. 1996 Pierac-cini et al. 1997 . However despite the existence of many algorithms for generating cooperative responses there has been little empirical work addressing the evaluation of such algorithms in the context of real-time natural .

• Báo cáo khoa học
• Evaluating Response Strategies
• Web Based Spoken Dialogue Agent
• Diane J
• Litman
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học