TAILIEUCHUNG - Báo cáo khoa học: "PEAS, the first instantiation of a comparative framework for evaluating parsers of French"

This paper presents PEAS, the first comparative evaluation framework for parsers of French whose annotation formalism allows the annotation of both constituents and functional relations. A test corpus containing an assortment of different text types has been built and part of it has been manually annotated. Precision/Recall and crossing brackets metrics will be adapted to our formalism and applied to the parses produced by one parser from academia and another one from industry in order to validate the framework. . | PEAS the first instantiation of a comparative framework for evaluating parsers of French V. Gendner G. Illouz M. Jardino L. Monceaux p. Paroubek I. Robba A. Vilnat LIMSI - CNRS BP 133 91403 Orsay - France gendner gabrieli jardino monceaux pap isabelle anne @ Abstract This paper presents PEAS the first comparative evaluation framework for parsers of French whose annotation formalism allows the annotation of both constituents and functional relations. A test corpus containing an assortment of different text types has been built and part of it has been manually annotated. Precision Recall and crossing brackets metrics will be adapted to our formalism and applied to the parses produced by one parser from academia and another one from industry in order to validate the framework. 1 Introduction In natural language understanding many complex applications use a syntactic parser as a basic functionality. Today in particular for the French language the developers face the great diversity of the offer in the domain. Therefore the need for a complete comparative evaluation framework - including a pivot annotation formalism a reference treebank evaluation metrics and the associated software - is increasing. It is worth noting that most of the recently developed parsers use a robust approach. Consequently they do not always produce a complete parse of the sentence but they are able to produce a result whatever the size the particularities and the grammaticality of the input. For this reason it is essential to be able to compare in a fair way the parses they produce against those produced by other parsers whatever thefr characteristics. One possible solution is to offer a common reference annotation formalism along with a fully parsed reference corpus and a set of robust metrics allowing for both complete and selective evaluation over an assortment of different text types and syntactic phenomena. The aim of our research is to build such evaluation framework which to date

• Báo cáo khoa học
• PEAS
• the first instantiation
• comparative framework
• evaluating parsers of French
• scientific reports
• model language
• process natural language
• Transgenic pea
• Genetic stability
• Stress tolerance
• Phenotypic evaluation
• Transgenic peas
• Plants overcome abiotic stresses
• Green peas
• Mathematical modeling
• Quality characteristics
• Many culinary preparations
• Several medicinal actions
• Disease management
• Meteorological factors
• Role of meteorological factors
• Relative impact of rust disease management
• Field peas through fungicides
• Tarai region of Indo gangetic plains
• Compounds in Field Peas
• Chemotaxonomic
• Study Based
• Quinone Compounds
• Heartwood
• Javanese Teak
• Pre treatments
• Drying time
• Drying rate
• Drying air temperature
• Quality evaluation
• BMC Plant Biology
• Plant microbe interaction
• Seaweed extract
• Plant immunity
• Sustainable agriculture
• Iron oxide nanoparticle
• Bok choy
• Plant growth
• Fauna ecosystems
• Non toxic
• Pisum sativum
• International Journal of Computer Networks and Communications Security
• Coverage aware battery regression curve node scheduling
• Wireless sensor networks
• Longer network coverage lifetime
• RBSP and PEAS
• Dialog Control
• Natural Language System
• Dialog Control in a Natural Language System
• Expanding the Horizons
• Natural Language Interfaces
• Phil Hayes
• PROSPECTS OR PRACTICAL
• NATURAL LANGUAGE SYSTEMS
• Workshops
• NATURAL LANGUAGE
• INTERACTION WITH MACHINES
• Long Papers
• COMPUTER INTEBFACE DESIGN MURRAY TUROFF DEPARTMENT OF COMPUTER
• IiVFORMATION SCIENCE IIEW JERSEY INSTITUTE OF TECHNOLOGY
• EVALUATION OF NATURAL LANGUAGE
• INTERFACES TO DATABASE SYSTEMS
• A PANEL DISCUSSION
• database query system
• J
• Norwood Crout
• INTERFACES TO DATA BASE SYSTEMS
• Bozena Henisz
• INTERPRETING NATURAL LANGUAGE
• DATABASE UPDATES
• S
• Jermld Kaplan Jim David
• TRANSPORTABLE NATURAL LANGUAGE
• INTERFACES TO DATABASES
• Gary G
• Hendrlx and William H
• Lewis
• DATABASES THEORETICAL
• TECHNICAL ISSUES
• TRANSPORTABLE NATURAL LANGUAGE INTERFACES
• PROBLEMS AND TECHNIQUES
• Barbara J
• Grosz
• THEORETICAL TECHNICAL ISSUES
• NATURAL LANGUAGE ACCESS TO DATABASES
• R
• Petrick
• Domain Independent
• Database Access Systems
• ISSUES IN NATURAL LANGUAGE
• ACCESS TO DATABASES
• A LOGIC PROGRAMMING PERSPECTIVE
• Sharon C
• Salveter David Maier
• PLANNING NATURAL LANGUAGE
• EXPRESSIONS REFERRING
• Douglas E
• Appelt
• THE TEXT SYSTEM
• NATURAL LANGUAGE GENERATION
• Kathleen R
• M
• MENTING A DATABASE
• KNOWLEDGE REPRESENTATION
• THE KEY TO THE SELECTION PROBLEM
• E
• Jeffrey Conklin David D
• McDonald
• A KNOWLEDGE ENGINEERING
• NATURAL LANGUAGE UNDERSTANDING
• Stuart C
• Shapiro
• NATURAL LANGUAGE TEXTS
• NECESSARILY GRAMMATICAL
• EVEN COMPLETE
• UNGRAMHATICALITY
• EXTRA GRAMMATICALITY
• NATURAL LANGUAGE UNDERSTANDING SYSTEMS
• Taxonomy
• Descriptions
• Individuals in Natural
• Language Understanding
• The Use of Ooject Special Knowledge
• Natural Language Processing
• Mark H
• Bursteln