TAILIEUCHUNG - Báo cáo khoa học: "Head Automata and Bilingual Tiling: Translation with Minimal Representations"

We present a language model consisting of a collection of costed bidirectional finite state automata associated with the head words of phrases. The model is suitable for incremental application of lexical associations in a dynamic programming search for optimal dependency tree derivations. We also present a model and algorithm for machine translation involving optimal "tiling" of a dependency tree with entries of a costed bilingual lexicon. Experimental results are reported comparing methods for assigning cost functions to these models. We conclude with a discussion of the adequacy of annotated linguistic strings as representations for machine translation. 1 associated with. | INVITED TALK Head Automata and Bilingual Tiling Translation with Minimal Representations Hiyan Alshawi AT T Research 600 Mountain Avenue Murray Hill NJ 07974 USA hiyan@ Abstract We present a language model consisting of a collection of costed bidirectional finite state automata associated with the head words of phrases. The model is suitable for incremental application of lexical associations in a dynamic programming search for optimal dependency tree derivations. We also present a model and algorithm for machine translation involving optimal tiling of a dependency tree with entries of a costed bilingual lexicon. Experimental results are reported comparing methods for assigning cost functions to these models. We conclude with a discussion of the adequacy of annotated linguistic strings as representations for machine translation. 1 Introduction Until the advent of statistical methods in the mainstream of natural language processing syntactic and semantic representations were becoming progressively more complex. This trend is now reversing itself in part because statistical methods reduce the burden of detailed modeling required by constraint-based grammars and in part because statistical models for converting natural language into complex syntactic or semantic representations is not well understood at present. At the same time lexically centered views of language have continued to increase in popularity. We can see this in lexical-ized grammatical theories head-driven parsing and generation and statistical disambiguation based on lexical associations. These themes simple representations statistical modeling and lexicalism form the basis for the models and algorithms described in the bulk of this paper. The primary purpose is to build effective mechanisms for machine translation the oldest and still the most commonplace application of non-superficial natural language processing. A secondary motivation is to test the extent to which a non-trivial .

• Báo cáo khoa học
• Head Automata
• Bilingual Tiling
• Translation with Minimal Representations
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học