Dynamic Multi-Objective Optimization With jMetal and Spark: a Case Study


Autoria(s): Cordero, José A.; Nebro, Antonio J.; Barba-González, Cristóbal; Durillo, Juan J.; García-Nieto, José; Navas-Delgado, Ismael; Aldana-Montes, José
Data(s)

15/09/2016

15/09/2016

2016

15/09/2016

Resumo

Technologies for Big Data and Data Science are receiving increasing research interest nowadays. This paper introduces the prototyping architecture of a tool aimed to solve Big Data Optimization problems. Our tool combines the jMetal framework for multi-objective optimization with Apache Spark, a technology that is gaining momentum. In particular, we make use of the streaming facilities of Spark to feed an optimization problem with data from different sources. We demonstrate the use of our tool by solving a dynamic bi-objective instance of the Traveling Salesman Problem (TSP) based on near real-time traffic data from New York City, which is updated several times per minute. Our experiment shows that both jMetal and Spark can be integrated providing a software platform to deal with dynamic multi-optimization problems.

Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tech.

Identificador

http://hdl.handle.net/10630/12015

http://orcid.org/0000-0001-5580-0484

Idioma(s)

eng

Relação

MOD 2016 - The Second International Workshop on Machine Learning, Optimization and Big Data

Volterra - Italia

26/08/2016 - 29/08/2016

Direitos

info:eu-repo/semantics/openAccess

Palavras-Chave #Optimización matemática #Multi-Objective Optimization #Big Data Technologies #Sreaming Processing
Tipo

info:eu-repo/semantics/preprint

info:eu-repo/semantics/conferenceObject