A Research of Resource Scheduling Algorithm Based on Hadoop

With the development of electronic devices, more and more mobile clients are connected to the Internet and they generate massive data every day. We live in an age of “Big Data”, and every day we generate hundreds of million magnitude data. By analyzing the data and making prediction, we can carry out better development plan. Unfortunately, traditional computation framework cannot meet the demand, so the Hadoop would be put forward. First the paper introduces the background and development status of Hadoop, compares the MapReduce in Hadoop 1.0 and YARN in Hadoop 2.0, and analyzes the advantages and disadvantages of them. Because the resource management module is the core role of YARN, so next the paper would research about the resource allocation module including the resource management, resource allocation algorithm, resource preemption model and the whole resource scheduling process from applying resource to finishing allocation. Also it would introduce the FIFO Scheduler, Capacity Scheduler, and Fair Scheduler and compare them. The main work has been done in this paper is researching and analyzing the Dominant Resource Fair algorithm of YARN, putting forward a maximum resource utilization algorithm based on Dominant Resource Fair algorithm. The paper also provides a suggestion to improve the unreasonable facts in resource preemption model. Emphasizing “fairness” during resource allocation is the core concept of Dominant Resource Fair algorithm of YARM. Because the cluster is multiple users and multiple resources, so the user’s resource request is multiple too. The DRF algorithm would divide the user’s resources into dominant resource and normal resource. For a user, the dominant resource is the one whose share is highest among all the request resources, others are normal resource. The DRF algorithm requires the dominant resource share of each user being equal. But for these cases where different users’ dominant resource amount differs greatly, emphasizing “fairness” is not suitable and can’t promote the resource utilization of the cluster. By analyzing these cases, this thesis puts forward a new allocation algorithm based on DRF. The new algorithm takes the “fairness” into consideration but not the main principle. Maximizing the resource utilization is the main principle and goal of the new algorithm. According to comparing the result of the DRF and new algorithm based on DRF, we found that the new algorithm has more high resource utilization than DRF. The last part of the thesis is to install the environment of YARN and use the Scheduler Load Simulator (SLS) to simulate the cluster environment.

To Succeed Is to Believe: Comparison of Self-Efficacy Beliefs in Language Learning between Learner Groups of English and Swedish in Finland

In this thesis, I studied self-efficacy in the learning of English and Swedish in Finland. The theory of self-efficacy, which was created by Albert Bandura, suggests that the beliefs a person has of his or her capabilities in a certain task affect the person’s performance in the task. My aim was to study whether there are differences in self-efficacy beliefs between the learners of English and Swedish, and whether these beliefs correlate with the performance in the language in question. My hypotheses were that the learners of English have higher self-efficacy beliefs than the learners of Swedish and that self-efficacy beliefs correlate with language performance. The study was quantitative, and it consisted of a self-efficacy questionnaire and a language test which were distributed to students of English and Swedish in an upper secondary school in Rovaniemi. The study was answered by 137 students, of whom 93 were learners of English and 44 were learners of Swedish. The results indicated that the learners of English had a higher sense of efficacy than the learners of Swedish. The analysis proved that there was a significant correlation between English students’ self-efficacy and their performance in the language measured by the test and the grades. In addition, a significant correlation existed between Swedish students’ self-efficacy and their grades. However, there was no correlation between the Swedish students’ self-efficacy and their test results. The difference in the self-efficacy beliefs of the two language groups indicates that people in Finland are more confident in using English than Swedish, which also implies that English is more valued in Finnish society than Swedish. It is important to acknowledge the lower self-efficacy beliefs in Swedish because various studies have proven that self-efficacy affects academic achievement. As a suggestion for further research, the self-efficacy beliefs of different language groups could be compared in a qualitative study in order to understand the development of self-efficacy more profoundly.