Evolutionary tuning of SVM parameter values in multiclass problems

Support vector machines (SVMs) were originally formulated for the solution of binary classification problems. In multiclass problems, a decomposition approach is often employed, in which the multiclass problem is divided into multiple binary subproblems, whose results are combined. Generally, the performance of SVM classifiers is affected by the selection of values for their parameters. This paper investigates the use of genetic algorithms (GAs) to tune the parameters of the binary SVMs in common multiclass decompositions. The developed GA may search for a set of parameter values common to all binary classifiers or for differentiated values for each binary classifier. (C) 2008 Elsevier B.V. All rights reserved.

HIERARCHICAL DECOMPOSITION OF MULTICLASS PROBLEMS

Several popular Machine Learning techniques are originally designed for the solution of two-class problems. However, several classification problems have more than two classes. One approach to deal with multiclass problems using binary classifiers is to decompose the multiclass problem into multiple binary sub-problems disposed in a binary tree. This approach requires a binary partition of the classes for each node of the tree, which defines the tree structure. This paper presents two algorithms to determine the tree structure taking into account information collected from the used dataset. This approach allows the tree structure to be determined automatically for any multiclass dataset.

Evolutionary model trees for handling continuous classes in machine learning

Model trees are a particular case of decision trees employed to solve regression problems. They have the advantage of presenting an interpretable output, helping the end-user to get more confidence in the prediction and providing the basis for the end-user to have new insight about the data, confirming or rejecting hypotheses previously formed. Moreover, model trees present an acceptable level of predictive performance in comparison to most techniques used for solving regression problems. Since generating the optimal model tree is an NP-Complete problem, traditional model tree induction algorithms make use of a greedy top-down divide-and-conquer strategy, which may not converge to the global optimal solution. In this paper, we propose a novel algorithm based on the use of the evolutionary algorithms paradigm as an alternate heuristic to generate model trees in order to improve the convergence to globally near-optimal solutions. We call our new approach evolutionary model tree induction (E-Motion). We test its predictive performance using public UCI data sets, and we compare the results to traditional greedy regression/model trees induction algorithms, as well as to other evolutionary approaches. Results show that our method presents a good trade-off between predictive performance and model comprehensibility, which may be crucial in many machine learning applications. (C) 2010 Elsevier Inc. All rights reserved.

Cross-situational and supervised learning in the emergence of communication

Scenarios for the emergence or bootstrap of a lexicon involve the repeated interaction between at least two agents who must reach a consensus on how to name N objects using H words. Here we consider minimal models of two types of learning algorithms: cross-situational learning, in which the individuals determine the meaning of a word by looking for something in common across all observed uses of that word, and supervised operant conditioning learning, in which there is strong feedback between individuals about the intended meaning of the words. Despite the stark differences between these learning schemes, we show that they yield the same communication accuracy in the limits of large N and H, which coincides with the result of the classical occupancy problem of randomly assigning N objects to H words.

Translation, Communication and 'Learning' : Experiences from teaching a master program in Viet Nam

In Vietnam, as in other Asian countries, co-operation with foreign universities plays an important role for the development of higher education. This paper is based on personal experiences from teaching a Swedish Master Programme in Education Science at Vietnam National University in Hanoi. Using theories developed by Lev Vygotsky and Donald Schon, the programme is explored as an inter-cultural learning process. Three aspects are focused upon. Firstly, the fact that communication between students and teachers is conducted with the help of translators who support both teachers and students in their attempt to understand and make themselves understood. Secondly, the expressed need to connect the ideas and techniques which are studied in the programme to the students´ professional worlds. Thirdly, the need to construct a framework wherein the students can inquire into their own situations and to encourage them to try new and more productive ways to deal with problems they are confronted with.

Building a Learning Architecture : e-Learning and e-Services

With the rapid advancement of the webtechnology, more and more educationalresources, including software applications forteaching/learning methods, are available acrossthe web, which enables learners to access thelearning materials and use various ways oflearning at any time and any place. Moreover,various web-based teaching/learning approacheshave been developed during the last decade toenhance the capability of both educators andlearners. Particularly, researchers from bothcomputer science and education are workingtogether, collaboratively focusing ondevelopment of pedagogically enablingtechnologies which are believed to improve theinfrastructure of education systems andprocesses, including curriculum developmentmodels, teaching/learning methods, managementof educational resources, systematic organizationof communication and dissemination ofknowledge and skills required by and adapted tousers. Despite of its fast development, however,there are still great gaps between learningintentions, organization of supporting resources,management of educational structures,knowledge points to be learned and interknowledgepoint relationships such as prerequisites,assessment of learning outcomes, andtechnical and pedagogic approaches. Moreconcretely, the issues have been widelyaddressed in literature include a) availability andusefulness of resources, b) smooth integration ofvarious resources and their presentation, c)learners’ requirements and supposed learningoutcomes, d) automation of learning process interms of its schedule and interaction, and e)customization of the resources and agilemanagement of the learning services for deliveryas well as necessary human interferences.Considering these problems and bearing in mindthe advanced web technology of which weshould make full use, in this report we willaddress the following two aspects of systematicarchitecture of learning/teaching systems: 1)learning objects – a semantic description andorganization of learning resources using the webservice models and methods, and 2) learningservices discovery and learning goals match foreducational coordination and learning serviceplanning.

School leaders as agents of change : a case study on how two head teachers are trying to implement the learning study method in their school

This paper seeks to describe and discuss the impact of inspections of schools in Sweden. It outlines the political context, based on New Public Management (NPM) theory, according to what role the Schools Inspectorate is supposed to play in order to govern and control. Attention is also devoted, referring an on-going case study, to how inspections influence head teachers and their leadership in their everyday work.   Reports from the Schools inspectorate are public. This forces both politicians and head teachers to take measures. In this case, the head teachers perceived that the inspection reports confirmed what they already knew, but it also gave them an alibi and a tool to push their teachers to take part in everyday school development work. During the first year after the inspection the head teachers mainly strived to adjust formal deficiencies in local steering documents. However, some of the deviations reported from the Schools inspectorate are regarding pedagogical problems that are complicated and difficult to handle. As interventions in many cases will show up much later the results are, for example as increased goal fulfilment, in this case, still an open question. Nevertheless, it seems obvious that the Schools Inspectorate must be seen as a result of the governing philosophy that denotes New Public Management NPM).

Flipped classroom and learning strategies

This paper seeks to answer the research question "How does the flipped classroom affect students’ learning strategies?" In e-learning research, several studies have focused on how students and teachers perceive the flipped classroom approach. In general, these studies have reported pleasing results. Nonetheless, few, if any, studies have attempted to find out the potential effects of the flipped classroom approach on how students learn. This study was based on two cases: 1) a business modelling course and 2) a research methodology course. In both cases, participating students were from information systems courses at Dalarna University in Sweden. Recorded lectures replaced regular lectures. The recorded lectures were followed by seminars that focused on the learning content of each lecture in various ways. Three weeks after the final seminar, we arranged for two focus group interviews to take place in each course, with 8 to 10 students participating in each group. We asked open questions on how the students thought they had been affected and more dedicated questions that were generated from a literature study on the effects of flipped classroom courses. These questions dealt with issues about mobility, the potential for repeating lectures, formative feedback, the role of seminars, responsibility, empowerment, lectures before seminars, and any problems encountered. Our results show that, in general, students thought differently about learning after the courses in relation to more traditional approaches, especially regarding the need to be more active. Most students enjoyed the mobility aspect and the accessibility of recorded lectures, although a few claimed it demanded a more disciplined attitude. Most students also expressed a feeling of increased activity and responsibility when participating in seminars. Some even felt empowered because they could influence seminar content. The length of and possibility to navigate in recorded lectures was also considered important. The arrangement of the seminar rooms should promote face-to-face discussions. Finally, the types of questions and tasks were found to affect the outcomes of the seminars. The overall conclusion with regard to students’ learning strategies is that to be an active, responsible, empowered, and critical student you have to be an informed student with possibilities and mandate to influence how, where and when to learn and be able to receive continuous feedback during the learning process. Flipped classroom can support such learning.

Machine Learning Algorithms in Heavy Process Manufacturing

In a global economy, manufacturers mainly compete with cost efficiency of production, as the price of raw materials are similar worldwide. Heavy industry has two big issues to deal with. On the one hand there is lots of data which needs to be analyzed in an effective manner, and on the other hand making big improvements via investments in cooperate structure or new machinery is neither economically nor physically viable. Machine learning offers a promising way for manufacturers to address both these problems as they are in an excellent position to employ learning techniques with their massive resource of historical production data. However, choosing modelling a strategy in this setting is far from trivial and this is the objective of this article. The article investigates characteristics of the most popular classifiers used in industry today. Support Vector Machines, Multilayer Perceptron, Decision Trees, Random Forests, and the meta-algorithms Bagging and Boosting are mainly investigated in this work. Lessons from real-world implementations of these learners are also provided together with future directions when different learners are expected to perform well. The importance of feature selection and relevant selection methods in an industrial setting are further investigated. Performance metrics have also been discussed for the sake of completion.

Japanese Expatriate Managers in Japanese Subsidiaries in Brazil: Why Not Learning-driven?

It has been said that international assignments are traditionally “demand- driven” (DD) that is a way of expatriation of executives focused on control, solution of problems and transference of tacit knowledge. Besides that, according to the international literature, “adjustment” is the determinant factor for success in overseas assignments and Japan usually sends their own executives to subsidiaries in other developing countries for “DD” purpose. However, according to the initial empirical study and in-depth interviews, it seems that Japanese expatriate managers in Brazil were sent to learn how to adjust the local staff to their philosophy instead of adjust themselves to a new complete scenario. This paper found that “adjustment” would not be fundamental for Japanese expatriate manager’s success in their assignments to Brazil, since they were under a special “learning-driven” type of expatriation process. This paper also highlights the challenges of the Japanese expatriate managers in Brazil and their contribution to the development of local staff under the internationalization process.

Algoritmo Q-learning como estratégia de exploração e/ou explotação para metaheurísticas GRASP e algoritmo genético

Techniques of optimization known as metaheuristics have achieved success in the resolution of many problems classified as NP-Hard. These methods use non deterministic approaches that reach very good solutions which, however, don t guarantee the determination of the global optimum. Beyond the inherent difficulties related to the complexity that characterizes the optimization problems, the metaheuristics still face the dilemma of xploration/exploitation, which consists of choosing between a greedy search and a wider exploration of the solution space. A way to guide such algorithms during the searching of better solutions is supplying them with more knowledge of the problem through the use of a intelligent agent, able to recognize promising regions and also identify when they should diversify the direction of the search. This way, this work proposes the use of Reinforcement Learning technique - Q-learning Algorithm - as exploration/exploitation strategy for the metaheuristics GRASP (Greedy Randomized Adaptive Search Procedure) and Genetic Algorithm. The GRASP metaheuristic uses Q-learning instead of the traditional greedy-random algorithm in the construction phase. This replacement has the purpose of improving the quality of the initial solutions that are used in the local search phase of the GRASP, and also provides for the metaheuristic an adaptive memory mechanism that allows the reuse of good previous decisions and also avoids the repetition of bad decisions. In the Genetic Algorithm, the Q-learning algorithm was used to generate an initial population of high fitness, and after a determined number of generations, where the rate of diversity of the population is less than a certain limit L, it also was applied to supply one of the parents to be used in the genetic crossover operator. Another significant change in the hybrid genetic algorithm is the proposal of a mutually interactive cooperation process between the genetic operators and the Q-learning algorithm. In this interactive/cooperative process, the Q-learning algorithm receives an additional update in the matrix of Q-values based on the current best solution of the Genetic Algorithm. The computational experiments presented in this thesis compares the results obtained with the implementation of traditional versions of GRASP metaheuristic and Genetic Algorithm, with those obtained using the proposed hybrid methods. Both algorithms had been applied successfully to the symmetrical Traveling Salesman Problem, which was modeled as a Markov decision process

HOW FAR do WE GET USING MACHINE LEARNING BLACK-BOXES?

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

A integração do tutorial interativo TryLogic via IMS Learning Tools Interoperability: construindo uma infraestrutura para o ensino de Lógica através de estratégias de demonstração e refutação

Logic courses represent a pedagogical challenge and the recorded number of cases of failures and of discontinuity in them is often high. Amont other difficulties, students face a cognitive overload to understand logical concepts in a relevant way. On that track, computational tools for learning are resources that help both in alleviating the cognitive overload scenarios and in allowing for the practical experimenting with theoretical concepts. The present study proposes an interactive tutorial, namely the TryLogic, aimed at teaching to solve logical conjectures either by proofs or refutations. The tool was developed from the architecture of the tool TryOcaml, through support of the communication of the web interface ProofWeb in accessing the proof assistant Coq. The goals of TryLogic are: (1) presenting a set of lessons for applying heuristic strategies in solving problems set in Propositional Logic; (2) stepwise organizing the exposition of concepts related to Natural Deduction and to Propositional Semantics in sequential steps; (3) providing interactive tasks to the students. The present study also aims at: presenting our implementation of a formal system for refutation; describing the integration of our infrastructure with the Virtual Learning Environment Moodle through the IMS Learning Tools Interoperability specification; presenting the Conjecture Generator that works for the tasks involving proving and refuting; and, finally to evaluate the learning experience of Logic students through the application of the conjecture solving task associated to the use of the TryLogic

Structural change and productivity growth, 20 years later: old problems, new opportunities

Includes bibliography

Labour markets, worker protection and lifelong learning in a global economy: experiences and perspectives of Latin America and the Caribbean

Includes bibliography