Análise funcional comparativa de algoritmos de aprendizagem por reforço

De entre todos os paradigmas de aprendizagem actualmente identificados, a Aprendizagem por Reforço revela-se de especial interesse e aplicabilidade nos inúmeros processos que nos rodeiam: desde a solitária sonda que explora o planeta mais remoto, passando pelo programa especialista que aprende a apoiar a decisão médica pela experiencia adquirida, até ao cão de brincar que faz as delícias da criança interagindo com ela e adaptando-se aos seus gostos, e todo um novo mundo que nos rodeia e apela crescentemente a que façamos mais e melhor nesta área. Desde o aparecimento do conceito de aprendizagem por reforço, diferentes métodos tem sido propostos para a sua concretização, cada um deles abordando aspectos específicos. Duas vertentes distintas, mas complementares entre si, apresentam-se como características chave do processo de aprendizagem por reforço: a obtenção de experiência através da exploração do espaço de estados e o aproveitamento do conhecimento obtido através dessa mesma experiência. Esta dissertação propõe-se seleccionar alguns dos métodos propostos mais promissores de ambas as vertentes de exploração e aproveitamento, efectuar uma implementação de cada um destes sobre uma plataforma modular que permita a simulação do uso de agentes inteligentes e, através da sua aplicação na resolução de diferentes configurações de ambientes padrão, gerar estatísticas funcionais que permitam inferir conclusões que retractem entre outros aspectos a sua eficiência e eficácia comparativas em condições específicas.

Fractional-order control and simulation of wind energy systems with PMSG/full-power converter topology

This paper presents a new integrated model for the simulation of wind energy systems. The proposed model is more realistic and accurate, considering a variable-speed wind turbine, two-mass rotor, permanent magnet synchronous generator (PMSG), different power converter topologies, and filters. Additionally, a new control strategy is proposed for the variable-speed operation of wind turbines with PMSG/full-power converter topology, based on fractional-order controllers. Comprehensive simulation studies are carried out with matrix and multilevel power converter topologies, in order to adequately assert the system performance in what regards the quality of the energy injected into the electric grid. Finally, conclusions are duly drawn.

Simulation of defects in bubble clusters

Topological defects in foam, either isolated (disclinations and dislocations) or in pairs, affect the energy and stress, and play an important role in foam deformation. Surface Evolver simulations were performed on large finite clusters of bubbles. These allow us to evaluate the effect of the topology of the defects, and the distance between defects, on the energy and pressure of foam clusters of different sizes. The energy of such defects follows trends similar to known analytical results for a continuous medium.

Utilization of Interactive Internet in High Education

The present work reports on the practical cooperation between two Universities from Hungary and Portugal. Students from Portugal are remotely accessing an experimental facility, which is physically in Hungary. The cooperation among these Higher Education establishments allowed the development and testing of a Remote Laboratory at the BME. This paper reports on the characteristics and initial testing of the Thermocouples Rise Time Measurement System and provides information on development and students' feedback.

A simulation study on the abatement of CO2 emissions by de-absorption with monoethanolamine

Because of the adverse effect of CO2 from fossil fuel combustion on the earth's ecosystems, the most cost-effective method for CO2 capture is an important area of research. The predominant process for CO2 capture currently employed by industry is chemical absorption in amine solutions. A dynamic model for the de-absorption process was developed with monoethanolamine (MEA) solution. Henry's law was used for modelling the vapour phase equilibrium of the CO2, and fugacity ratios calculated by the Peng-Robinson equation of state (EOS) were used for H2O, MEA, N-2 and O-2. Chemical reactions between CO2 and MEA were included in the model along with the enhancement factor for chemical absorption. Liquid and vapour energy balances were developed to calculate the liquid and vapour temperature, respectively.

Transport properties in microcrystalline silicon solar cells under AM1.5 illumination analysed by two-dimensional numerical simulation

Microcrystalline silicon is a two-phase material. Its composition can be interpreted as a series of grains of crystalline silicon imbedded in an amorphous silicon tissue, with a high concentration of dangling bonds in the transition regions. In this paper, results for the transport properties of a mu c-Si:H p-i-n junction obtained by means of two-dimensional numerical simulation are reported. The role played by the boundary regions between the crystalline grains and the amorphous matrix is taken into account and these regions are treated similar to a heterojunction interface. The device is analysed under AM1.5 illumination and the paper outlines the influence of the local electric field at the grain boundary transition regions on the internal electric configuration of the device and on the transport mechanism within the mu c-Si:H intrinsic layer.

Simulation of default events in a CDX and estimation of the spread

The portfolio generating the iTraxx EUR index is modeled by coupled Markov chains. Each of the industries of the portfolio evolves according to its own Markov transition matrix. Using a variant of the method of moments, the model parameters are estimated from a data set of Standard and Poor's. Swap spreads are evaluated by Monte-Carlo simulations. Along with an actuarially fair spread, at least squares spread is considered.

e-learning in the classroom?

As teachers, we are challenged everyday to solve pedagogical problems and we have to fight for our students’ attention in a media rich world. I will talk about how we use ICT in Initial Teacher Training and give you some insight on what we are doing. The most important benefit of using ICT in education is that it makes us reflect on our practice. There is no doubt that our classrooms need to be updated, but we need to be critical about every peace of hardware, software or service that we bring into them. It is not only because our budgets are short, but also because e‐learning is primarily about learning, not technology. Therefore, we need to have the knowledge and skills required to act in different situations, and choose the best tool for the job. Not all subjects are suitable for e‐learning, nor do all students have the skills to organize themselves their own study times. Also not all teachers want to spend time programming or learning about instructional design and metadata. The promised land of easy use of authoring tools (e.g. eXe and Reload) that will lead to all teachers become Learning Objects authors and share these LO in Repositories, all this failed, like previously HyperCard, Toolbook and others. We need to know a little bit of many different technologies so we can mobilize this knowledge when a situation requires it: integrate e‐learning technologies in the classroom, not a flipped classroom, just simple tools. Lecture capture, mobile phones and smartphones, pocket size camcorders, VoIP, VLE, live video broadcast, screen sharing, free services for collaborative work, save, share and sync your files. Do not feel stressed to use everything, every time. Just because we have a whiteboard does not mean we have to make it the centre of the classroom. Start from where you are, with your preferred subject and the tools you master. Them go slowly and try some new tool in a non‐formal situation and with just one or two students. And you don’t need to be alone: subscribe a mailing list and share your thoughts with other teachers in a dedicated forum, even better if both are part of a community of practice, and share resources. We did that for music teachers and it was a success, in two years arriving at 1.000 members. Just do it.

Enhancing reflexivity and technology in translation learning: case study on the use of ePortfolio as a training environment

In this paper we describe a casestudy of an experiment on how reflexivity and technology can enhance learning, by using ePorfolios as a training environment to develop translation skills. Translation is today a multiskilled job and translators need to assure their clients a good performance and quality, both in language and in technology domains. In order to accomplish it, for the translator all the tasks and processes he develops appear as crucial, being pretranslation and posttranslation processes equally important as the translation itself, namely as far as autonomy, reflexive and critical skills are concerned. Finally, the need and relevance for collaborative tasks and networks amongst virtual translation communities, led us to the decision of implementing ePortfolios as a tool to develop the requested skills and extend the use of Internet in translation, namely in terminology management phases, for the completion of each task, by helping students in the management of the projects deadlines, improving their knowledge on the construction and management of translation resources and deepening their awareness about the concepts related to the development and usability of ePorfolios.

Learning management systems usage on higher education institutions

Learning Management Systems (LMS) are used all over Higher Education Institutions (HEI) and the need to know and understand its adoption and usage arises. However, there is a lack of information about how LMSs are being used, which are the most adopted, whether there is a country adoption standard and which countries use more LMSs. A research team is developing a project that tries to fill this lack of information and provide the needed answers. With this purpose, on a first phase, it a survey was taken place. The results of this survey are presented in this paper. Another purpose of this paper is to disseminate the ongoing project.

Formação combinada: reutilizando learning objects

O uso crescente da Internet (World Wide Web), e das suas potencialidades tecnológicas têm contribuído para uma proliferação de ambientes de ensino/aprendizagem, baseados em Tecnologia. A comunidade científica reúne consenso quanto às vantagens da reutilização de conteúdos de aprendizagem e à adopção de standards com vista à interoperabilidade entre conteúdos/objectos partilháveis e plataformas. Este artigo tem como objectivo reflectir sobre o desenvolvimento de uma metodologia de ensino combinada de aprendizagem com recurso a Learning Objects, no âmbito do trabalho de doutoramento.

Thinking over b‐learning strategy: the MIPO model approach

This article describes the main research results in a new methodology, in which the stages and strategies of the technology integration process are identified and described. A set of principles and recommendations are therefore presented. The MIPO model described in this paper is a result of the effort made regarding the understanding of the main success features of good practices, in the web environment, integrated in the information systems/information technology context. The initial model has been created, based on experiences and literature review. After that, it was tested in the information and technology system units at higher school and also adapted as a result of four cycles of an actionresearch work combined with a case study research. The information, concepts and procedures presented here give support to teachers and instructors, instructional designers and planning teams – anyone who wants to develop effective b‐learning instructions.

A Game of learning: a b-activity

Th The purpose of this article is to share the implementation of workgroup activities: a game of learning supported by web technology; Effective educational strategies that encourage a dynamic combination of being flexible, individualized and personalized must be the aim of every school; The blended-learning plays an important role; In this article we describe an online collaborative game which uses an inside and outside collaboration in order to promote the motivation and effective learning; Pedagogical strategies, that use technologies appropriately, in higher education, can promote active learning, centered on students and thus valuing their personal experiences and participation;

Challenges for e-learning and adult students in higher education

This article examines Lifelong Learning, from the perspective of the adult learner in higher education, by presenting some of the results of a project, funded by the European Commission's Socrates Programme, LIHE, Learning in Higher Education. It is structured as follows: first, the background of the project is described, then the experiences of the adult student, concerning their induction and tuition, are presented. Some future trends concerning adults in higher education and lifelong learning are outlined and conclusions drawn.

Building a knowledge and learning society in Portugal: adult students in technological schools and higher education institutions

Lifelong learning (LLL) has received increasing attention in recent years. It implies that learning should take place at all stages of the “life cycle and it should be life-wide, that is embedded in all life contexts from the school to the work place, the home and the community” (Green, 2002, p.613). The ‘learning society’, is the vision of a society where there are recognized opportunities for learning for every person, wherever they are and however old they happen to be. Globalization and the rise of new information technologies are some of the driving forces that cause depreciation of specialised competences. This happens very quickly in terms of economic value; consequently, workers of all skills levels, during their working life, must have the opportunity to update “their technical skills and enhance general skills to keep pace with continuous technological change and new job requirements” (Fahr, 2005, p. 75). It is in this context that LLL tops the policy agenda of international bodies, national governments and non-governmental organizations, in the field of education and training, to justify the need for LLL opportunities for the population as they face contemporary employability challenges. It is in this context that the requirement and interest to analyse the behaviour patterns of adult learners has developed over the last few years