TAILIEUCHUNG - Báo cáo khoa học: "Using Reinforcement Learning to Build a Better Model of Dialogue State"

Given the growing complexity of tasks that spoken dialogue systems are trying to handle, Reinforcement Learning (RL) has been increasingly used as a way of automatically learning the best policy for a system to make. While most work has focused on generating better policies for a dialogue manager, very little work has been done in using RL to construct a better dialogue state. This paper presents a RL approach for determining what dialogue features are important to a spoken dialogue tutoring system. . | Using Reinforcement Learning to Build a Better Model of Dialogue State Pittsburgh PA 15260 USA tetreaul@ Joel R. Tetreault Diane J. Litman University of Pittsburgh University of Pittsburgh Learning Research and Development Center Department of Computer Science Learning Research and Development Center Pittsburgh PA 15260 USA litman@ Abstract Given the growing complexity of tasks that spoken dialogue systems are trying to handle Reinforcement Learning RL has been increasingly used as a way of automatically learning the best policy for a system to make. While most work has focused on generating better policies for a dialogue manager very little work has been done in using RL to construct a better dialogue state. This paper presents a RL approach for determining what dialogue features are important to a spoken dialogue tutoring system. Our experiments show that incorporating dialogue factors such as dialogue acts emotion repeated concepts and performance play a significant role in tutoring and should be taken into account when designing dialogue systems. 1 Introduction This paper presents initial research toward the long-term goal of designing a tutoring system that can effectively adapt to the student. While most work in Markov Decision Processes MDPs and spoken dialogue have focused on building better policies Walker 2000 Henderson et al. 2005 to date very little empirical work has tested the utility of adding specialized features to construct a better dialogue state. We wish to show that adding more complex factors to a representation of student state is a worthwhile pursuit since it alters what action the tutor should make. The five dialogue factors we explore are dialogue acts certainty level frustration level concept repetition and student performance. All five are factors that are not just unique to the tutoring domain but are important to dialogue systems in general. Our results show that using these features combined with the common baseline

• Báo cáo khoa học
• Using Reinforcement Learning
• Better Model
• Dialogue State
• scientific reports
• model language
• process natural language
• Journal of Automation and Control Engineering
• Efficient transfer learning
• Reinforcement learning using sparse coding
• Normal Q learning
• Means of sparse coding
• Proposed method significantly
• Decreasing induction motor loss using reinforcement learning
• Decreasing induction motor loss
• The motor works
• The standard driver of motor
• Reinforcement learning
• Q Learning
• Multi agent system
• Distributed system
• Markov decision process
• Factored Markov decision process
• International Journal of Computer Networks and Communications Security
• Improve the routing algorithm
• Wireless sensor networks
• Reinforcement learning strategy
• The semi processed data
• Journal of Computer Science and Cybernetics
• Reinforcement learning algorithm
• Efficient navigation framework
• Autonomous mobile robots
• The mobile robots
• báo cáo khoa học
• báo cáo hóa học
• công trình nghiên cứu về hóa học
• tài liệu về hóa học
• cách trình bày báo cáo
• Energy Management
• Buildings Using MATLAB
• Control Applications
• Synchronous Generator
• Advanced Control
• Strategies Simulation
• Dialog Control
• Natural Language System
• Dialog Control in a Natural Language System
• Expanding the Horizons
• Natural Language Interfaces
• Phil Hayes
• PROSPECTS OR PRACTICAL
• NATURAL LANGUAGE SYSTEMS
• Workshops
• NATURAL LANGUAGE
• INTERACTION WITH MACHINES
• Long Papers
• COMPUTER INTEBFACE DESIGN MURRAY TUROFF DEPARTMENT OF COMPUTER
• IiVFORMATION SCIENCE IIEW JERSEY INSTITUTE OF TECHNOLOGY
• EVALUATION OF NATURAL LANGUAGE
• INTERFACES TO DATABASE SYSTEMS
• A PANEL DISCUSSION
• database query system
• J
• Norwood Crout
• INTERFACES TO DATA BASE SYSTEMS
• Bozena Henisz
• INTERPRETING NATURAL LANGUAGE
• DATABASE UPDATES
• S
• Jermld Kaplan Jim David
• TRANSPORTABLE NATURAL LANGUAGE
• INTERFACES TO DATABASES
• Gary G
• Hendrlx and William H
• Lewis
• DATABASES THEORETICAL
• TECHNICAL ISSUES
• TRANSPORTABLE NATURAL LANGUAGE INTERFACES
• PROBLEMS AND TECHNIQUES
• Barbara J
• Grosz
• THEORETICAL TECHNICAL ISSUES
• NATURAL LANGUAGE ACCESS TO DATABASES
• R
• Petrick
• Domain Independent
• Database Access Systems
• ISSUES IN NATURAL LANGUAGE
• ACCESS TO DATABASES
• A LOGIC PROGRAMMING PERSPECTIVE
• Sharon C
• Salveter David Maier
• PLANNING NATURAL LANGUAGE
• EXPRESSIONS REFERRING
• Douglas E
• Appelt
• THE TEXT SYSTEM
• NATURAL LANGUAGE GENERATION
• Kathleen R
• M
• MENTING A DATABASE
• KNOWLEDGE REPRESENTATION
• THE KEY TO THE SELECTION PROBLEM
• E
• Jeffrey Conklin David D
• McDonald
• A KNOWLEDGE ENGINEERING
• NATURAL LANGUAGE UNDERSTANDING
• Stuart C
• Shapiro
• NATURAL LANGUAGE TEXTS
• NECESSARILY GRAMMATICAL
• EVEN COMPLETE
• UNGRAMHATICALITY
• EXTRA GRAMMATICALITY
• NATURAL LANGUAGE UNDERSTANDING SYSTEMS
• Taxonomy
• Descriptions
• Individuals in Natural
• Language Understanding
• The Use of Ooject Special Knowledge
• Natural Language Processing
• Mark H
• Bursteln