Dynamic equilibrium through reinforcement learning

Reinforcement Learning is an area of Machine Learning that deals with how an agent should take actions in an environment such as to maximize the notion of accumulated reward. This type of learning is inspired by the way humans learn and has led to the creation of various algorithms for reinforcement learning. These algorithms focus on the way in which an agent’s behaviour can be improved, assuming independence as to their surroundings. The current work studies the application of reinforcement learning methods to solve the inverted pendulum problem. The importance of the variability of the environment (factors that are external to the agent) on the execution of reinforcement learning agents is studied by using a model that seeks to obtain equilibrium (stability) through dynamism – a Cart-Pole system or inverted pendulum. We sought to improve the behaviour of the autonomous agents by changing the information passed to them, while maintaining the agent’s internal parameters constant (learning rate, discount factors, decay rate, etc.), instead of the classical approach of tuning the agent’s internal parameters. The influence of changes on the state set and the action set on an agent’s capability to solve the Cart-pole problem was studied. We have studied typical behaviour of reinforcement learning agents applied to the classic BOXES model and a new form of characterizing the environment was proposed using the notion of convergence towards a reference value. We demonstrate the gain in performance of this new method applied to a Q-Learning agent.

Advanced side information creation techniques and framework for Wyner-Ziv video coding

Recently, several distributed video coding (DVC) solutions based on the distributed source coding (DSC) paradigm have appeared in the literature. Wyner-Ziv (WZ) video coding, a particular case of DVC where side information is made available at the decoder, enable to achieve a flexible distribution of the computational complexity between the encoder and decoder, promising to fulfill novel requirements from applications such as video surveillance, sensor networks and mobile camera phones. The quality of the side information at the decoder has a critical role in determining the WZ video coding rate-distortion (RD) performance, notably to raise it to a level as close as possible to the RD performance of standard predictive video coding schemes. Towards this target, efficient motion search algorithms for powerful frame interpolation are much needed at the decoder. In this paper, the RD performance of a Wyner-Ziv video codec is improved by using novel, advanced motion compensated frame interpolation techniques to generate the side information. The development of these type of side information estimators is a difficult problem in WZ video coding, especially because the decoder only has available some reference, decoded frames. Based on the regularization of the motion field, novel side information creation techniques are proposed in this paper along with a new frame interpolation framework able to generate higher quality side information at the decoder. To illustrate the RD performance improvements, this novel side information creation framework has been integrated in a transform domain turbo coding based Wyner-Ziv video codec. Experimental results show that the novel side information creation solution leads to better RD performance than available state-of-the-art side information estimators, with improvements up to 2 dB: moreover, it allows outperforming H.264/AVC Intra by up to 3 dB with a lower encoding complexity.

e-learning in the classroom?

As teachers, we are challenged everyday to solve pedagogical problems and we have to fight for our students’ attention in a media rich world. I will talk about how we use ICT in Initial Teacher Training and give you some insight on what we are doing. The most important benefit of using ICT in education is that it makes us reflect on our practice. There is no doubt that our classrooms need to be updated, but we need to be critical about every peace of hardware, software or service that we bring into them. It is not only because our budgets are short, but also because e‐learning is primarily about learning, not technology. Therefore, we need to have the knowledge and skills required to act in different situations, and choose the best tool for the job. Not all subjects are suitable for e‐learning, nor do all students have the skills to organize themselves their own study times. Also not all teachers want to spend time programming or learning about instructional design and metadata. The promised land of easy use of authoring tools (e.g. eXe and Reload) that will lead to all teachers become Learning Objects authors and share these LO in Repositories, all this failed, like previously HyperCard, Toolbook and others. We need to know a little bit of many different technologies so we can mobilize this knowledge when a situation requires it: integrate e‐learning technologies in the classroom, not a flipped classroom, just simple tools. Lecture capture, mobile phones and smartphones, pocket size camcorders, VoIP, VLE, live video broadcast, screen sharing, free services for collaborative work, save, share and sync your files. Do not feel stressed to use everything, every time. Just because we have a whiteboard does not mean we have to make it the centre of the classroom. Start from where you are, with your preferred subject and the tools you master. Them go slowly and try some new tool in a non‐formal situation and with just one or two students. And you don’t need to be alone: subscribe a mailing list and share your thoughts with other teachers in a dedicated forum, even better if both are part of a community of practice, and share resources. We did that for music teachers and it was a success, in two years arriving at 1.000 members. Just do it.

Enhancing reflexivity and technology in translation learning: case study on the use of ePortfolio as a training environment

In this paper we describe a casestudy of an experiment on how reflexivity and technology can enhance learning, by using ePorfolios as a training environment to develop translation skills. Translation is today a multiskilled job and translators need to assure their clients a good performance and quality, both in language and in technology domains. In order to accomplish it, for the translator all the tasks and processes he develops appear as crucial, being pretranslation and posttranslation processes equally important as the translation itself, namely as far as autonomy, reflexive and critical skills are concerned. Finally, the need and relevance for collaborative tasks and networks amongst virtual translation communities, led us to the decision of implementing ePortfolios as a tool to develop the requested skills and extend the use of Internet in translation, namely in terminology management phases, for the completion of each task, by helping students in the management of the projects deadlines, improving their knowledge on the construction and management of translation resources and deepening their awareness about the concepts related to the development and usability of ePorfolios.

Learning management systems usage on higher education institutions

Learning Management Systems (LMS) are used all over Higher Education Institutions (HEI) and the need to know and understand its adoption and usage arises. However, there is a lack of information about how LMSs are being used, which are the most adopted, whether there is a country adoption standard and which countries use more LMSs. A research team is developing a project that tries to fill this lack of information and provide the needed answers. With this purpose, on a first phase, it a survey was taken place. The results of this survey are presented in this paper. Another purpose of this paper is to disseminate the ongoing project.

Formação combinada: reutilizando learning objects

O uso crescente da Internet (World Wide Web), e das suas potencialidades tecnológicas têm contribuído para uma proliferação de ambientes de ensino/aprendizagem, baseados em Tecnologia. A comunidade científica reúne consenso quanto às vantagens da reutilização de conteúdos de aprendizagem e à adopção de standards com vista à interoperabilidade entre conteúdos/objectos partilháveis e plataformas. Este artigo tem como objectivo reflectir sobre o desenvolvimento de uma metodologia de ensino combinada de aprendizagem com recurso a Learning Objects, no âmbito do trabalho de doutoramento.

Thinking over b‐learning strategy: the MIPO model approach

This article describes the main research results in a new methodology, in which the stages and strategies of the technology integration process are identified and described. A set of principles and recommendations are therefore presented. The MIPO model described in this paper is a result of the effort made regarding the understanding of the main success features of good practices, in the web environment, integrated in the information systems/information technology context. The initial model has been created, based on experiences and literature review. After that, it was tested in the information and technology system units at higher school and also adapted as a result of four cycles of an actionresearch work combined with a case study research. The information, concepts and procedures presented here give support to teachers and instructors, instructional designers and planning teams – anyone who wants to develop effective b‐learning instructions.

A Game of learning: a b-activity

Th The purpose of this article is to share the implementation of workgroup activities: a game of learning supported by web technology; Effective educational strategies that encourage a dynamic combination of being flexible, individualized and personalized must be the aim of every school; The blended-learning plays an important role; In this article we describe an online collaborative game which uses an inside and outside collaboration in order to promote the motivation and effective learning; Pedagogical strategies, that use technologies appropriately, in higher education, can promote active learning, centered on students and thus valuing their personal experiences and participation;

Challenges for e-learning and adult students in higher education

This article examines Lifelong Learning, from the perspective of the adult learner in higher education, by presenting some of the results of a project, funded by the European Commission's Socrates Programme, LIHE, Learning in Higher Education. It is structured as follows: first, the background of the project is described, then the experiences of the adult student, concerning their induction and tuition, are presented. Some future trends concerning adults in higher education and lifelong learning are outlined and conclusions drawn.

Os desafios da qualificação profissional pós-secundária não-superior (nível 4) para a inovação empresarial no contexto da União Europeia e dos países da OCDE

A maioria das nações mais desenvolvidas deve, em larga medida, a sua prosperidade à produtividade da sua força de trabalho. Esta produtividade relaciona-se, fundamentalmente, com dois aspectos essenciais. Por um lado, com o nível e adequação das qualificações e competências da população activa, as quais permitem desenvolver o empreendedorismo e criar riqueza e, por outro, com a qualidade e grau de sofisticação dos equipamentos, tecnologias, modelos de organização e sistemas de gestão de que as empresas dispõem. Nesta comunicação, elaborada por convite para apresentação na sessão comemorativa do 20º aniversário da AFTEM, no Porto, após a contextualização das exigências do mercado de trabalho em resultado da inovação empresarial e da emergência das economias baseadas no conhecimento, apresentam-se alguns estudos recentemente concluídos em diversos países e regiões da OCDE, nomeadamente, Austrália, Irlanda, Reino Unido e Escócia – nos quais se foca a necessidade de incrementar o nível de qualificações para responder às necessidades do tecido produtivo por forma a manter a competitividade da indústria e serviços desses países e regiões à escala global; em particular realça-se a importância de se aumentar a percentagem de população activa com nível 4 de qualificação profissional. Aborda-se, ainda, a situação da formação pós secundária não superior em Portugal (nível 4). Conclui-se, formulando algumas recomendações em termos de estratégias e de trabalho futuro com vista a dinamizar as oportunidades de qualificação de nível 4, em estreita articulação com as empresas, como forma de o tecido produtivo nacional dispor de níveis de qualificação de recursos humanos que permitam a mobilidade para novas actividades com maior valor acrescentado e, por esta via, atingir níveis de rentabilidade semelhante à dos restantes estados membros da UE e de outros países da OCDE.

Building a knowledge and learning society in Portugal: adult students in technological schools and higher education institutions

Lifelong learning (LLL) has received increasing attention in recent years. It implies that learning should take place at all stages of the “life cycle and it should be life-wide, that is embedded in all life contexts from the school to the work place, the home and the community” (Green, 2002, p.613). The ‘learning society’, is the vision of a society where there are recognized opportunities for learning for every person, wherever they are and however old they happen to be. Globalization and the rise of new information technologies are some of the driving forces that cause depreciation of specialised competences. This happens very quickly in terms of economic value; consequently, workers of all skills levels, during their working life, must have the opportunity to update “their technical skills and enhance general skills to keep pace with continuous technological change and new job requirements” (Fahr, 2005, p. 75). It is in this context that LLL tops the policy agenda of international bodies, national governments and non-governmental organizations, in the field of education and training, to justify the need for LLL opportunities for the population as they face contemporary employability challenges. It is in this context that the requirement and interest to analyse the behaviour patterns of adult learners has developed over the last few years

Learning in higher education: the ISEGI case

Comunicação apresentada na IRMA Information Resources Management Association International Conference, San Diego, CA, 15 19 May

Learning to manage in knowledge based organizations: the role of portfolios

Paper presented at the 8th European Conference on Knowledge Management, Barcelona, 6-7 Sep. 2008 URL: http://www.academic-conferences.org/eckm/eckm2007/eckm07-home.htm

The role of Lifelong Learning in the creation of a knowledge-based society for Europe: european policies

Link do editor: http://www.igi-global.com/chapter/role-lifelong-learning-creation-european/13314