TAILIEUCHUNG - Báo cáo khoa học: "Combining Statistical and Knowledge-based Spoken Language Understanding in Conditional Models"

Spoken Language Understanding (SLU) addresses the problem of extracting semantic meaning conveyed in an utterance. The traditional knowledge-based approach to this problem is very expensive -- it requires joint expertise in natural language processing and speech recognition, and best practices in language engineering for every new domain. On the other hand, a statistical learning approach needs a large amount of annotated data for model training, which is seldom available in practical applications outside of large research labs. . | Combining Statistical and Knowledge-based Spoken Language Understanding in Conditional Models Ye-Yi Wang Alex Acero Milind Mahajan Microsoft Research One Microsoft Way Redmond WA 98052 USA yeyiwang alexac milindm @ John Lee Spoken Language Systems MIT CsAiL Cambridge MA 02139 USA jsylee@ Abstract Spoken Language Understanding SLU addresses the problem of extracting semantic meaning conveyed in an utterance. The traditional knowledge-based approach to this problem is very expensive -- it requires joint expertise in natural language processing and speech recognition and best practices in language engineering for every new domain. On the other hand a statistical learning approach needs a large amount of annotated data for model training which is seldom available in practical applications outside of large research labs. A generative HMM CFG composite model which integrates easy-to-obtain domain knowledge into a data-driven statistical learning framework has previously been introduced to reduce data requirement. The major contribution of this paper is the investigation of integrating prior knowledge and statistical learning in a conditional model framework. We also study and compare conditional random fields CRFs with perceptron learning for SLU. Experimental results show that the conditional models achieve more than 20 relative reduction in slot error rate over the HMM CFG model which had already achieved an SLU accuracy at the same level as the best results reported on the ATIS data. 1 Introduction Spoken Language Understanding SLU addresses the problem of extracting meaning conveyed in an utterance. Traditionally the problem is solved with a knowledge-based approach which requires joint expertise in natural language processing and speech recognition and best practices in language engineering for every new domain. In the past decade many statistical learning approaches have been proposed most of which exploit generative models as surveyed in

• Báo cáo khoa học
• Combining Statistical
• Knowledge based Spoken Language Understanding
• Conditional Models
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Combining a Statistical Language Model
• Logistic Regression to Predict the Lexical
• Syntactic Difficulty of Texts for FFL
• scientific reports
• model language
• process natural language
• báo cáo hóa học
• công trình nghiên cứu về hóa học
• tài liệu về hóa học
• cách trình bày báo cáo
• Microarray technology
• Microarray meta analysis
• Multiple microarray
• Biological hypotheses
• Meta analysis methods
• Elastic deformation
• Interstitial alloy
• Mie Lennard Jones potential
• Model atomic potential
• Statistical moment method
• Multilingual corpus generation
• Statistical machine translation
• Biomedical domain
• Non native speakers
• Biomedical information
• Education research
• The mie lennard jones
• Interstitial alloy AGC
• FCC structure under pressure
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học