TAILIEUCHUNG - Báo cáo khoa học: "A Collaborative Framework for Collecting Thai Unknown Words from the Web"

We propose a collaborative framework for collecting Thai unknown words found on Web pages over the Internet. Our main goal is to design and construct a Webbased system which allows a group of interested users to participate in constructing a Thai unknown-word open dictionary. The proposed framework provides supporting algorithms and tools for automatically identifying and extracting unknown words from Web pages of given URLs. The system yields the result of unknownword candidates which are presented to the users for verification. . | A Collaborative Framework for Collecting Thai Unknown Words from the Web Choochart Haruechaiyasak Chatchawal Sangkeettrakarn Pornpimon Palingoon Sarawoot Kongyoung and Chaianun Damrongrat Information Research and Development Division RDI National Electronics and Computer Technology Center NECTEC Thailand Science Park Klong Luang Pathumthani 12120 Thailand rdi5@ Abstract We propose a collaborative framework for collecting Thai unknown words found on Web pages over the Internet. Our main goal is to design and construct a Webbased system which allows a group of interested users to participate in constructing a Thai unknown-word open dictionary. The proposed framework provides supporting algorithms and tools for automatically identifying and extracting unknown words from Web pages of given URLs. The system yields the result of unknownword candidates which are presented to the users for verification. The approved unknown words could be combined with the set of existing words in the lexicon to improve the performance of many NLP tasks such as word segmentation information retrieval and machine translation. Our framework includes word segmentation and morphological analysis modules for handling the non-segmenting characteristic of Thai written language. To take advantage of large available text resource on the Web our unknown-word boundary identification approach is based on the statistical string pattern-matching algorithm. Keywords Unknown words open dictionary word segmentation morphological analysis word-boundary detection. 1 Introduction The advent of the Internet and the increasing popularity of the Web have altered many aspects of natural language usage. As more people turn to the Internet as a new communicating channel the textual information has increased tremendously and is also widely accessible. More importantly the available information is varied largely in terms of topic difference and multi-language characteristic. It is not uncommon to .

• Báo cáo khoa học
• A Collaborative Framework
• Collecting Thai Unknown Words from the Web
• Choochart Haruechaiyasak
• Chatchawal Sangkeettrakarn
• Pornpimon Palingoon Sarawoot Kongyoung and Chaianun Damrongrat
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• European Atomic Energy Community
• Training framework programme
• Pan European collaborative
• Pan European education
• Training collaborative efforts
• Framework of collaborative activities
• European projects H2020 NARSIS
• FP7 ASAMPSA E
• EU Framework programme project
• Probabilistic Safety Assessment
• BMC Pediatrics
• Demographic data collection
• Electronic health record
• Health care organizations
• Angiotensin converting
• combination therapies
• Health Action International
• Plant Heavy
• Metal Interaction
• Water Relations
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học