TAILIEUCHUNG - Báo cáo khoa học: "SELECTIVE PLANNING OF INTERFACE EVALUATION"

The Scope of Evaluations The basic ides behind evaluation is 8 simple one: An object is neatly all of them are like obsorvem of the recent space shuttle: They can understand liftoff, landing and some of the discus=dons of the heat of re(retry, but the critical details are completely out of reach. Rather than carefully controlled evaluations, the public needs competent and honest interpretations of the action. | SELECTIVE PLANNING OF INTERFACE EVALUATIONS William c. Mann use Information Sciences Institute 1 The Scope of Evaluations The basic idea behind evaluation is a simple one An object is produced and then subjected to trials of its performance. Observing the trials reveals things about the character of the object and reasoning about those observations leads to statements about the value of the object a collection of such statements beinr an evaluation. An evaluation thus differs from a description a critique or an estimate. For our purposes here the object is a database system with a natural language interface for users. Ideally the trials are an instrumented variant of normal usage. The character of the users their tasks the data and so forth are representative of the intended use of the system. In thinking about evaluations we need to be clear about the intended scope. Is it the whole system that is to be evaluated or just the natural language interface portion or possibly both The decision is crucial for planning the evaluation and understanding the results. As we will see choice of the whole system as the scope of evaluation leads to very different designs than the choice of the interface module. It is unlikely that an evaluation which Í3 supposed to cover both scopes will cover both well. 2 Different Plans tor Different Consumers We can t expect a single form or method of evaluation to be suitable for all uses. In planning to evaluate or not to evaluate it helps a great deal to identity the potential user of the evaluation. There are some obvious principles 1. If we can t identify the consumer of the evaluation don t evaluate. 2. If something other than an evaluation meets the consumer s needs better plan to use it instead. Who are the potential consumers Clearly they are not the same as the sponsors who have often lost interest by the time an evaluation is timely. Instead they are 1. Organizations that Might Use the System These consumers need a good overview of

• Báo cáo khoa học
• SELECTIVE PLANNING
• INTERFACE EVALUATION
• William C
• Mann
• scientific reports
• model language
• process natural language
• Dialog Control
• Natural Language System
• Dialog Control in a Natural Language System
• Expanding the Horizons
• Natural Language Interfaces
• Phil Hayes
• PROSPECTS OR PRACTICAL
• NATURAL LANGUAGE SYSTEMS
• Workshops
• NATURAL LANGUAGE
• INTERACTION WITH MACHINES
• Long Papers
• COMPUTER INTEBFACE DESIGN MURRAY TUROFF DEPARTMENT OF COMPUTER
• IiVFORMATION SCIENCE IIEW JERSEY INSTITUTE OF TECHNOLOGY
• EVALUATION OF NATURAL LANGUAGE
• INTERFACES TO DATABASE SYSTEMS
• A PANEL DISCUSSION
• database query system
• J
• Norwood Crout
• INTERFACES TO DATA BASE SYSTEMS
• Bozena Henisz
• INTERPRETING NATURAL LANGUAGE
• DATABASE UPDATES
• S
• Jermld Kaplan Jim David
• TRANSPORTABLE NATURAL LANGUAGE
• INTERFACES TO DATABASES
• Gary G
• Hendrlx and William H
• Lewis
• DATABASES THEORETICAL
• TECHNICAL ISSUES
• TRANSPORTABLE NATURAL LANGUAGE INTERFACES
• PROBLEMS AND TECHNIQUES
• Barbara J
• Grosz
• THEORETICAL TECHNICAL ISSUES
• NATURAL LANGUAGE ACCESS TO DATABASES
• R
• Petrick
• Domain Independent
• Database Access Systems
• ISSUES IN NATURAL LANGUAGE
• ACCESS TO DATABASES
• A LOGIC PROGRAMMING PERSPECTIVE
• Sharon C
• Salveter David Maier
• PLANNING NATURAL LANGUAGE
• EXPRESSIONS REFERRING
• Douglas E
• Appelt
• THE TEXT SYSTEM
• NATURAL LANGUAGE GENERATION
• Kathleen R
• M
• MENTING A DATABASE
• KNOWLEDGE REPRESENTATION
• THE KEY TO THE SELECTION PROBLEM
• E
• Jeffrey Conklin David D
• McDonald
• A KNOWLEDGE ENGINEERING
• NATURAL LANGUAGE UNDERSTANDING
• Stuart C
• Shapiro
• NATURAL LANGUAGE TEXTS
• NECESSARILY GRAMMATICAL
• EVEN COMPLETE
• UNGRAMHATICALITY
• EXTRA GRAMMATICALITY
• NATURAL LANGUAGE UNDERSTANDING SYSTEMS
• Taxonomy
• Descriptions
• Individuals in Natural
• Language Understanding
• The Use of Ooject Special Knowledge
• Natural Language Processing
• Mark H
• Bursteln