Large scale data processing using MapReduce

As massive data sets become increasingly available, people are facing the problem of how to effectively process and understand these data. Traditional sequential computing models are giving way to parallel and distributed computing models, such as MapReduce, both due to the large size of the data sets and their high dimensionality. This dissertation, as in the same direction of other researches that are based on MapReduce, tries to develop effective techniques and applications using MapReduce that can help people solve large-scale problems. Three different problems are tackled in the dissertation. The first one deals with processing terabytes of raster data in a spatial data management system. Aerial imagery files are broken into tiles to enable data parallel computation. The second and third problems deal with dimension reduction techniques that can be used to handle data sets of high dimensionality. Three variants of the nonnegative matrix factorization technique are scaled up to factorize matrices of dimensions in the order of millions in MapReduce based on different matrix multiplication implementations. Two algorithms, which compute CANDECOMP/PARAFAC and Tucker tensor decompositions respectively, are parallelized in MapReduce based on carefully partitioning the data and arranging the computation to maximize data locality and parallelism.

The study of thermal stresses in a single long elastic fiber embedded in an infinite matrix

This work considered the micro-mechanical behavior of a long fiber embedded in an infinite matrix. Using the theory of elasticity, the idea of boundary layer and some simplifying assumptions, an approximate analytical solution was obtained for the normal and shear stresses along the fiber. The analytical solution to the problem was found for the case when the length of the embedded fiber is much greater than its radius, and the Young's modulus of the matrix was much less than that of the fiber. The analytical solution was then compared with a numerical solution based on Finite Element Analysis (FEA) using ANSYS. The numerical results showed the same qualitative behavior of the analytical solution, serving as a validation tool against lack of experimental results. In general this work provides a simple method to determine the thermal stresses along the fiber embedded in a matrix, which is the foundation for a better understanding of the interaction between the fiber and matrix in the case of the classical problem of thermal-stresses.