A new grouping genetic algorithm for the MapReduce placement problem in cloud computing


Autoria(s): Xu, Xiaoyong; Tang, Maolin
Data(s)

01/07/2014

Resumo

MapReduce is a computation model for processing large data sets in parallel on large clusters of machines, in a reliable, fault-tolerant manner. A MapReduce computation is broken down into a number of map tasks and reduce tasks, which are performed by so called mappers and reducers, respectively. The placement of the mappers and reducers on the machines directly affects the performance and cost of the MapReduce computation. From the computational point of view, the mappers/reducers placement problem is a generation of the classical bin packing problem, which is NPcomplete. Thus, in this paper we propose a new grouping genetic algorithm for the mappers/reducers placement problem in cloud computing. Compared with the original one, our grouping genetic algorithm uses an innovative coding scheme and also eliminates the inversion operator which is an essential operator in the original grouping genetic algorithm. The new grouping genetic algorithm is evaluated by experiments and the experimental results show that it is much more efficient than four popular algorithms for the problem, including the original grouping genetic algorithm.

Formato

application/pdf

Identificador

http://eprints.qut.edu.au/70355/

Publicador

IEEE

Relação

http://eprints.qut.edu.au/70355/1/cec14_Xu%26Tang.pdf

DOI:10.1109/CEC.2014.6900361

Xu, Xiaoyong & Tang, Maolin (2014) A new grouping genetic algorithm for the MapReduce placement problem in cloud computing. In Proceedings of the IEEE Congress on Evolutionary Computation, IEEE, Beijing International Convention Center, Beijing, China, pp. 1601-1608.

Direitos

Copyright 2014 Please consult the authors

Fonte

School of Electrical Engineering & Computer Science; Science & Engineering Faculty

Palavras-Chave #080108 Neural Evolutionary and Fuzzy Computation #080599 Distributed Computing not elsewhere classified #Genetic algorithm #MapReduce Placement #Cloud Computing
Tipo

Conference Paper