TAILIEUCHUNG - Ant colony optimization based scheduling for load balancing in partition and aggregation of map reduce for big data applications

In our proposed system, introduced new meta heuristic algorithm to perform the load balancing. The Ant Colony Optimization algorithm (ACO) is a probabilistic technique for solving computational problems which can be reduced to finding good paths through graphs. | ISSN:2249-5789 R Bahirathy et al, International Journal of Computer Science & Communication Networks,Vol 6(2),54-60 Ant Colony Optimization based scheduling for load balancing in partition and Aggregation of Map Reduce for Big Data Applications Student Deptartment of Computer science Engineering PTR Engineering college, e-mail bahirathyphd@ Basha Head of the Department Department of computer science Engineering PTR Engineering college, e-mail jjbasha@ Assitant Professor Department of computer science Engineering PTR Engineering college, e-mail svijimecse@ Abstract MapReduce is a framework for processing and managing large scale data sets in a distributed cluster, which has been used for applications such as generating search indexes, document clustering, access log analysis, and various other forms of data analytics. In existing system, a hash function is used to partition intermediate data among reduce tasks. In this project the system proposed a decomposition-based distributed algorithm to deal with the large-scale optimization problem for big data application and an online algorithm is also designed to adjust data partition and aggregation in a dynamic manner. In our proposed system, introduced new meta heuristic algorithm to perform the load balancing. The Ant Colony Optimization algorithm (ACO) is a probabilistic technique for solving computational problems which can be reduced to finding good paths through graphs. Ant colony optimization is random optimization search approach that will be used for allocating the incoming jobs to the virtual machines. 1. Introduction MapReduce [1] [2] [3] has appeared as the very popular calculating framework for big data processing appropriate to its simple programming model and automatic parallel execution. MapReduce and its open source fulfillment Hadoop [4] [5] have been used by many big companies, such as Yahoo!, Google and Facebook, fordifferent big data

TỪ KHÓA LIÊN QUAN
TAILIEUCHUNG - Chia sẻ tài liệu không giới hạn
Địa chỉ : 444 Hoang Hoa Tham, Hanoi, Viet Nam
Website : tailieuchung.com
Email : tailieuchung20@gmail.com
Tailieuchung.com là thư viện tài liệu trực tuyến, nơi chia sẽ trao đổi hàng triệu tài liệu như luận văn đồ án, sách, giáo trình, đề thi.
Chúng tôi không chịu trách nhiệm liên quan đến các vấn đề bản quyền nội dung tài liệu được thành viên tự nguyện đăng tải lên, nếu phát hiện thấy tài liệu xấu hoặc tài liệu có bản quyền xin hãy email cho chúng tôi.
Đã phát hiện trình chặn quảng cáo AdBlock
Trang web này phụ thuộc vào doanh thu từ số lần hiển thị quảng cáo để tồn tại. Vui lòng tắt trình chặn quảng cáo của bạn hoặc tạm dừng tính năng chặn quảng cáo cho trang web này.