TAILIEUCHUNG - Báo cáo khoa học: "A Figure of Merit for the Evaluation of Web-Corpus Randomness"

In this paper, we present an automated, quantitative, knowledge-poor method to evaluate the randomness of a collection of documents (corpus), with respect to a number of biased partitions. The method is based on the comparison of the word frequency distribution of the target corpus to word frequency distributions from corpora built in deliberately biased ways. We apply the method to the task of building a corpus via queries to Google. | A Figure of Merit for the Evaluation of Web-Corpus Randomness Massimiliano Ciaramita Marco Baroni Institute of Cognitive Science and Technology National Research Council Roma Italy SSLMIT Universita di Bologna Forli Italy baroni@ Abstract In this paper we present an automated quantitative knowledge-poor method to evaluate the randomness of a collection of documents corpus with respect to a number of biased partitions. The method is based on the comparison of the word frequency distribution of the target corpus to word frequency distributions from corpora built in deliberately biased ways. We apply the method to the task of building a corpus via queries to Google. Our results indicate that this approach can be used reliably to discriminate biased and unbiased document collections and to choose the most appropriate query terms. 1 Introduction The Web is a very rich source of linguistic data and in the last few years it has been used intensively by linguists and language technologists for many tasks Kilgarriff and Grefenstette 2003 . Among other uses the Web allows fast and inexpensive construction of general purpose corpora . corpora that are not meant to represent a specific sub-language but a language as a whole. There are several recent studies on the extent to which Web-derived corpora are comparable in terms of variety of topics and styles to traditional balanced corpora Fletcher 2004 Sharoff 2006 . Our contribution in this paper is to present an automated quantitative method to evaluate the variety or randomness with respect to a number of non-random partitions of a Web corpus. The more random less-biased towards specific partitions a corpus is the more it should be suitable as a general purpose corpus. We are not proposing a method to evaluate whether a sample of Web pages is a random sample of the Web although this is a related issue Bharat and Broder 1998 Henzinger et al. 2000 . Instead we propose a method based on .

• Báo cáo khoa học
• A Figure of Merit
• the Evaluation of Web Corpus Randomness
• Massimiliano Ciaramita Marco Baroni
• scientific reports
• model language
• process natural language
• A Figure of Merit Technique for the Resolution of Non Grammatical Ambiguity
• Swaminathan Madhu
• General Dynamics
• Electronics
• báo cáo khoa học
• báo cáo ngôn ngữ
• ngôn ngữ tự nhiên
• Automatic Compensation
• Parser Figure of Merit Flaws
• Don Blaheta and Eugene Charniak
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Manufacture of a fast neutron detector
• EJ 301 liquid scintillator
• The charge comparison
• The Figure of Merit
• The range of energy 50–1000 keVee
• Dialog Control
• Natural Language System
• Dialog Control in a Natural Language System
• Expanding the Horizons
• Natural Language Interfaces
• Phil Hayes
• PROSPECTS OR PRACTICAL
• NATURAL LANGUAGE SYSTEMS
• Workshops
• NATURAL LANGUAGE
• INTERACTION WITH MACHINES
• Long Papers
• COMPUTER INTEBFACE DESIGN MURRAY TUROFF DEPARTMENT OF COMPUTER
• IiVFORMATION SCIENCE IIEW JERSEY INSTITUTE OF TECHNOLOGY
• EVALUATION OF NATURAL LANGUAGE
• INTERFACES TO DATABASE SYSTEMS
• A PANEL DISCUSSION
• database query system
• J
• Norwood Crout
• INTERFACES TO DATA BASE SYSTEMS
• Bozena Henisz
• INTERPRETING NATURAL LANGUAGE
• DATABASE UPDATES
• S
• Jermld Kaplan Jim David
• TRANSPORTABLE NATURAL LANGUAGE
• INTERFACES TO DATABASES
• Gary G
• Hendrlx and William H
• Lewis
• DATABASES THEORETICAL
• TECHNICAL ISSUES
• TRANSPORTABLE NATURAL LANGUAGE INTERFACES
• PROBLEMS AND TECHNIQUES
• Barbara J
• Grosz
• THEORETICAL TECHNICAL ISSUES
• NATURAL LANGUAGE ACCESS TO DATABASES
• R
• Petrick
• Domain Independent
• Database Access Systems
• ISSUES IN NATURAL LANGUAGE
• ACCESS TO DATABASES
• A LOGIC PROGRAMMING PERSPECTIVE
• Sharon C
• Salveter David Maier
• PLANNING NATURAL LANGUAGE
• EXPRESSIONS REFERRING
• Douglas E
• Appelt
• THE TEXT SYSTEM
• NATURAL LANGUAGE GENERATION
• Kathleen R
• M
• MENTING A DATABASE
• KNOWLEDGE REPRESENTATION
• THE KEY TO THE SELECTION PROBLEM
• E
• Jeffrey Conklin David D
• McDonald
• A KNOWLEDGE ENGINEERING
• NATURAL LANGUAGE UNDERSTANDING
• Stuart C
• Shapiro
• NATURAL LANGUAGE TEXTS
• NECESSARILY GRAMMATICAL
• EVEN COMPLETE
• UNGRAMHATICALITY
• EXTRA GRAMMATICALITY
• NATURAL LANGUAGE UNDERSTANDING SYSTEMS
• Taxonomy
• Descriptions
• Individuals in Natural
• Language Understanding
• The Use of Ooject Special Knowledge
• Natural Language Processing
• Mark H
• Bursteln