TAILIEUCHUNG - Báo cáo khoa học: "Lexicalization in Crosslinguistic Probabilistic Parsing: The Case of French"

This paper presents the first probabilistic parsing results for French, using the recently released French Treebank. We start with an unlexicalized PCFG as a baseline model, which is enriched to the level of Collins’ Model 2 by adding lexicalization and subcategorization. The lexicalized sister-head model and a bigram model are also tested, to deal with the flatness of the French Treebank. The bigram model achieves the best performance: 81% constituency F-score and 84% dependency accuracy. All lexicalized models outperform the unlexicalized baseline, consistent with probabilistic parsing results for English, but contrary to results for German, where lexicalization has only. | Lexicalization in Crosslinguistic Probabilistic Parsing The Case of French AbhishekArun and Frank Keller School of Informatics University of Edinburgh 2 Buccleuch Place Edinburgh EH8 9LW UK keller@ Abstract This paper presents the first probabilistic parsing results for French using the recently released French Treebank. We start with an unlexicalized PCFG as a baseline model which is enriched to the level of Collins Model 2 by adding lexical-ization and subcategorization. The lexi-calized sister-head model and a bigram model are also tested to deal with the flatness of the French Treebank. The bigram model achieves the best performance 81 constituency F-score and 84 dependency accuracy. All lexicalized models outperform the unlexicalized baseline consistent with probabilistic parsing results for English but contrary to results for German where lexicalization has only a limited effect on parsing performance. 1 Introduction This paper brings together two strands of research that have recently emerged in the field of probabilistic parsing crosslinguistic parsing and lexicalized parsing. Interest in parsing models for languages other than English has been growing starting with work on Czech Collins et al. 1999 and Chinese Bikel and Chiang 2000 Levy and Manning 2003 . Probabilistic parsing for German has also been explored by a range of authors Dubey and Keller 2003 Schiehlen 2004 . In general these authors have found that existing lexicalized parsing models for English . Collins 1997 do not straightforwardly generalize to new languages this typically manifests itself in a severe reduction in parsing performance compared to the results for English. A second recent strand in parsing research has dealt with the role of lexicalization. The conventional wisdom since Magerman 1995 has been that lexicalization substantially improves performance compared to an unlexicalized baseline model . a probabilistic context-free grammar PCFG . .

• Báo cáo khoa học
• Lexicalization in Crosslinguistic
• Probabilistic Parsing
• The Case of French
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học