TAILIEUCHUNG - Báo cáo khoa học: "Evaluating the Inferential Utility of Lexical-Semantic Resources"

Lexical-semantic resources are used extensively for applied semantic inference, yet a clear quantitative picture of their current utility and limitations is largely missing. We propose system- and application-independent evaluation and analysis methodologies for resources’ performance, and systematically apply them to seven prominent resources. Our findings identify the currently limited recall of available resources, and indicate the potential to improve performance by examining non-standard relation types and by distilling the output of distributional methods. . | Evaluating the Inferential Utility of Lexical-Semantic Resources Shachar Mirkin Ido Dagan Eyal Shnarch Computer Science Department Bar-Ilan University Ramat-Gan 52900 Israel mirkins dagan shey @ Abstract Lexical-semantic resources are used extensively for applied semantic inference yet a clear quantitative picture of their current utility and limitations is largely missing. We propose system- and application-independent evaluation and analysis methodologies for resources performance and systematically apply them to seven prominent resources. Our findings identify the currently limited recall of available resources and indicate the potential to improve performance by examining non-standard relation types and by distilling the output of distributional methods. Further our results stress the need to include auxiliary information regarding the lexical and logical contexts in which a lexical inference is valid as well as its prior validity likelihood. 1 Introduction Lexical information plays a major role in semantic inference as the meaning of one term is often inferred form another. Lexical-semantic resources which provide the needed knowledge for lexical inference are commonly utilized by applied inference systems Giampiccolo et al. 2007 and applications such as Information Retrieval and Question Answering Shah and Croft 2004 Pasca and Harabagiu 2001 . Beyond WordNet Fell-baum 1998 a wide range of resources has been developed and utilized including extensions to WordNet Moldovan and Rus 2001 Snow et al. 2006 and resources based on automatic distributional similarity methods Lin 1998 Pantel and Lin 2002 . Recently Wikipedia is emerging as a source for extracting semantic relationships Suchanek et al. 2007 Kazama and Tori-sawa 2007 . As of today only a partial comparative picture is available regarding the actual utility and limitations of available resources for lexical-semantic inference. Works that do provide quantitative information regarding resources .

• Báo cáo khoa học
• Evaluating the Inferential Utility
• Lexical Semantic Resources
• Shachar Mirkin
• Ido Dagan
• scientific reports
• model language
• process natural language
• Dialog Control
• Natural Language System
• Dialog Control in a Natural Language System
• Expanding the Horizons
• Natural Language Interfaces
• Phil Hayes
• PROSPECTS OR PRACTICAL
• NATURAL LANGUAGE SYSTEMS
• Workshops
• NATURAL LANGUAGE
• INTERACTION WITH MACHINES
• Long Papers
• COMPUTER INTEBFACE DESIGN MURRAY TUROFF DEPARTMENT OF COMPUTER
• IiVFORMATION SCIENCE IIEW JERSEY INSTITUTE OF TECHNOLOGY
• EVALUATION OF NATURAL LANGUAGE
• INTERFACES TO DATABASE SYSTEMS
• A PANEL DISCUSSION
• database query system
• J
• Norwood Crout
• INTERFACES TO DATA BASE SYSTEMS
• Bozena Henisz
• INTERPRETING NATURAL LANGUAGE
• DATABASE UPDATES
• S
• Jermld Kaplan Jim David
• TRANSPORTABLE NATURAL LANGUAGE
• INTERFACES TO DATABASES
• Gary G
• Hendrlx and William H
• Lewis
• DATABASES THEORETICAL
• TECHNICAL ISSUES
• TRANSPORTABLE NATURAL LANGUAGE INTERFACES
• PROBLEMS AND TECHNIQUES
• Barbara J
• Grosz
• THEORETICAL TECHNICAL ISSUES
• NATURAL LANGUAGE ACCESS TO DATABASES
• R
• Petrick
• Domain Independent
• Database Access Systems
• ISSUES IN NATURAL LANGUAGE
• ACCESS TO DATABASES
• A LOGIC PROGRAMMING PERSPECTIVE
• Sharon C
• Salveter David Maier
• PLANNING NATURAL LANGUAGE
• EXPRESSIONS REFERRING
• Douglas E
• Appelt
• THE TEXT SYSTEM
• NATURAL LANGUAGE GENERATION
• Kathleen R
• M
• MENTING A DATABASE
• KNOWLEDGE REPRESENTATION
• THE KEY TO THE SELECTION PROBLEM
• E
• Jeffrey Conklin David D
• McDonald
• A KNOWLEDGE ENGINEERING
• NATURAL LANGUAGE UNDERSTANDING
• Stuart C
• Shapiro
• NATURAL LANGUAGE TEXTS
• NECESSARILY GRAMMATICAL
• EVEN COMPLETE
• UNGRAMHATICALITY
• EXTRA GRAMMATICALITY
• NATURAL LANGUAGE UNDERSTANDING SYSTEMS
• Taxonomy
• Descriptions
• Individuals in Natural
• Language Understanding
• The Use of Ooject Special Knowledge
• Natural Language Processing
• Mark H
• Bursteln