TAILIEUCHUNG - Báo cáo khoa học: "INFORMATION RETRIEVAL USING ROBUST NATURAL LANGUAGE PROCESSING"

We developed a prototype information retrieval system which uses advanced natural language processing techniques to enhance the effectiveness of traditional key-word based document retrieval. The backbone of our system is a statistical retrieval engine which performs automated indexing of documents, then search and ranking in response to user queries. This core architecture is augmented with advanced natural language processing tools which are both robust and efficient. | INFORMATION RETRIEVAL USING ROBUST NATURAL LANGUAGE PROCESSING Tomek Sfrzalkowski and Barbara Vautheyt Cour ant Institute of Mathematical Sciences New York University 715 Broadway rm. 704 New York NY 10003 tomek@ ABSTRACT We developed a prototype information retrieval system which uses advanced natural language processing techniques to enhance the effectiveness of traditional key-word based document retrieval. The backbone of our system is a statistical retrieval engine which performs automated indexing of documents then search and ranking in response to user queries. This core architecture is augmented with advanced natural language processing tools which are both robust and efficient. In early experiments the augmented system has displayed capabilities that appear to make it superior to the purely statistical base. INTRODUCTION A typical information retrieval IR task is to select documents from a database in response to a user s query and rank these documents according to relevance. This has been usually accomplished using statistical methods often coupled with manual encoding but it is now widely believed that these traditional methods have reached thefr limits. 1 2 These limits are particularly acute for text databases where natural language processing NLP has long been considered necessary for further progress. Unfortunately the difficulties encountered in applying computational linguistics technologies to text processing have contributed to a wide-spread belief that automated NLP may not be suitable in IR. These difficulties included inefficiency limited coverage and prohibitive cost of manual effort requữeđ to build lexicons and knowledge bases for each new text domain. On the other hand while numerous t Current address Laboratoire d lnformatique Universite de Fribourg ch. du Musee 3 1700 Fribourg Switzerland vauthey@cfnmi51 .bitnet. 1 As far as the automatic document retrieval is concerned. Techniques involving various forms of relevance feedback

• Báo cáo khoa học
• INFORMATION RETRIEVAL
• ROBUST NATURAL LANGUAGE PROCESSING
• Long Papers
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Lecture Information retrieval techniques
• Bài giảng Kỹ thuật truy xuất thông tin
• Information retrieval techniques
• Boolean retrieval model
• Rank retrieval model
• Information retrieval ingredients
• Performance evaluation of information retrieval systems
• Information retrieval systems
• The search engine
• Information retrieval models
• Commercial bibliographic systems
• Database management research
• Modern information retrieval
• Web information retrieval
• Multimedia information retrieval
• Multimedia digital libraries
• Content based retrieval
• Paradigms in information visualisation
• Multimedia information retrieval research
• Geo temporal browsing
• Library management system
• Search computing
• Principles of visual information retrieval
• Visual information retrieval
• Digital technique
• Color Based retrieval
• Color system taxonomy
• Non Parametric PDF methods
• International Journal of Computer Networks and Communications Security
• Distributed backup of user profiles for information retrieval
• Profiles for information retrieval
• Information research systems
• Vector space retrieval model
• Term frequency tf
• Document frequency
• Unranked retrieval evaluation
• Mean average precision
• Computing recall/precision points
• Clustering algorithms
• Cluster based retrieval
• Term statistical similarity
• Creative Language Retrieval
• A Robust Hybrid
• Linguistic Creativity
• báo cáo ngôn ngữ
• ngôn ngữ tự nhiên
• Automated multimedia indexing
• Basic multimedia search technologies
• Content based retrieval architecture
• Information and communication technology
• Discourse based information retrieval for tamil literary texts
• Discourse based information retrieval
• Tamil literary texts
• Keyword based match strategy
• International Journal of Computer Science & Communication Networks
• Issues in data mining and information retrieval
• Information retrieval and data warehousing
• The nature of the available data
• Information retrieval techniques and applications
• Traditional IR models
• Different searching techniques
• Fault tolerance approach in mobile agents
• Information retrieval applications using check points
• Information retrieval applications
• Mobile agents in Internet application
• Reliable migration time
• Query languages for multimedia databases
• Query languages for heterogeneous multimedia databases
• Unified feature representation
• Dimensionality reduction
• Computing the random projection
• Latent semantic indexing (LSI)
• Multimedia information retrieval: Theory and techniques
• Video browsing modes
• Multimedia content based indexing
• Content based multimedia search
• Textual textual search
• Human Information
• Enabling Technologies
• Quantitative Data
• Search Algorithms
• TF IDF weighting
• Document representation in vector space
• Query representation in vector space
• Similarity measures
• Cosine similarity measure
• Vector space model
• Parsing documents
• Basic indexing pipeline
• Parsing a document
• Tokenization language issues