TAILIEUCHUNG - Near duplicate document detection survey

Search engines are the major breakthrough on the web for retrieving the information. But List of retrieved documents contains a high percentage of duplicated and near document result. So there is the need to improve the performance of search results. Some of current search engine use data filtering algorithm which can eliminate duplicate and near duplicate documents to save the users’ time and effort. | ISSN:2249-5789 Bassma S Alsulami et al, International Journal of Computer Science & Communication Networks,Vol 2(2), 147-151 Near Duplicate Document Detection Survey Bassma S. Alsulami, Maysoon F. Abulkhair, Fathy E. Eassa Faculty of Computing and Information Technology King AbdulAziz University Jeddah, Saudi Arabia Abstract—Search engines are the major breakthrough on the web for retrieving the information. But List of retrieved documents contains a high percentage of duplicated and near document result. So there is the need to improve the performance of search results. Some of current search engine use data filtering algorithm which can eliminate duplicate and near duplicate documents to save the users’ time and effort. The identification of similar or near-duplicate pairs in a large collection is a significant problem with wide-spread applications. In this paper survey present an up-to-date review of the existing literature in duplicate and near duplicate detection in Web. Keyword—Duplicate document, near duplicate pages, near duplicate detection, Detection approaches 1. INTRODUCTION Information on the Web is very huge in size. There is a need to use this big volume of information efficiently for effectively satisfying the information need of the user on the Web. Search engines become the major breakthrough on the web for retrieving the information. Where, among users looking for information on the Web, 85% submit information requests to various Internet search engines. Search engines are critically important to help users find relevant information on the Web. Search engines in response to a user's query typically produces the list of documents ranked according to closest to the user's request. These documents are presented to the user for examination and evaluation. Web users have to go through the long list and inspect the titles, and snippets sequentially to recognize the required results. Filtering the search engines' results consumes the users' effort and

• Hệ điều hành
• International Journal of Computer Networks and Communications Security
• Near duplicate document detection survey
• Near duplicate pages
• Near duplicate detection
• The major breakthrough
• Securing the sip communications with XML security mechanisms
• VoIP application awareness
• Question of confidentiality and integrity
• Client authentication and data confidentiality
• Proposing minimum performance of proposed topology
• Plateau State University
• Computer networks and Communications Security
• Performance evaluation of manet protocols in communications
• Management of robots in simulation modelling
• Manet protocols in communications
• End To End Delay
• Show network optimization rate including PDR
• Deployment of voip communications in B&A spy agency
• Design and implementation
• Voip communications in B&A spy agency
• VoIP simulated in OPNET
• Proposed architecture and protocol stack for improving QoS
• Wide vehicular communications
• Vehicle to Vehicle
• An enhanced data security with compression for manets
• Enhanced data security
• Self organizing networks
• Wireless local area network security enhancement through penetration testing
• WLANs to achieve
• The frame security
• The standard network security
• Increasing the lifetime of wireless sensor networks
• Selforganizing map algorithm
• Wireless sensor networks
• Self organizing map neural networks
• Cloud computing architecture
• Wireless sensor networks for agricultural applications
• Wireless sensor actor networks
• Adaptive scheme for outliers detection in wireless sensor networks
• The Quality of Service
• Given sensor networks
• Infrared sensor and FBUS technology
• House security system based on mobile phone
• House security system
• Secure the place
• Potential applications of linear wireless sensor networks
• Linear wireless sensor networks
• LWSN in various applications
• LWSN in network topology
• Time dependent finite state machine
• Method for intrusion detection in mobile ad hoc networks
• Mobile ad hoc networks
• Malicious behavior in AODV
• Performance analysis of multimedia traffic
• MPLS communication networks with traffic engineering
• MPLS communication networks
• Conventional IP network
• Inter cluster communication in wireless sensor networks
• Inter cluster communication
• Carrying out efficient diffusion
• Cluster merging and cluster diffusion
• An optimized model for transition from Ipv4 to Ipv6 networks
• Cloud computing environment
• Ipv4 to Ipv6 networks
• Identical traffic and network loads
• The optical communications
• Simulating an optical high debit transmission chain
• Optisystem with comparison of optical windows
• Comparison of optical windows
• New unicast routing algorithm for load balancing
• Multigateway wireless mesh networks
• Negative percent algorithms
• Wireless mesh networks
• Detection of service attack
• Defense against distributed denial of service attack
• Packet filtration in wireless sensor networks
• An advance security technique challenges to government
• Wireless sensor network for health
• Emphasize ongoing treatment challenges
• Wireless sensor network
• Medical information systems
• The security of information in financial transactions via mobile
• Financial transactions via mobile
• Implement a particular algorithm
• A comprehensive approach to security requirements engineering
• Incorporating the strengths
• Best practices found
• Evaluation of security function of flipora plug in on browsers
• Flipora plug in on browsers
• Plug in in upon
• Flipora plug in
• Multi perspective analysis framework
• Multi level analysis framework
• Network security situational awareness
• Multi data analyzing researc
• Improving security and performance in the tor network
• The tor network
• IP hidden in the server