Dynamic equilibrium through reinforcement learning

Reinforcement Learning is an area of Machine Learning that deals with how an agent should take actions in an environment such as to maximize the notion of accumulated reward. This type of learning is inspired by the way humans learn and has led to the creation of various algorithms for reinforcement learning. These algorithms focus on the way in which an agent’s behaviour can be improved, assuming independence as to their surroundings. The current work studies the application of reinforcement learning methods to solve the inverted pendulum problem. The importance of the variability of the environment (factors that are external to the agent) on the execution of reinforcement learning agents is studied by using a model that seeks to obtain equilibrium (stability) through dynamism – a Cart-Pole system or inverted pendulum. We sought to improve the behaviour of the autonomous agents by changing the information passed to them, while maintaining the agent’s internal parameters constant (learning rate, discount factors, decay rate, etc.), instead of the classical approach of tuning the agent’s internal parameters. The influence of changes on the state set and the action set on an agent’s capability to solve the Cart-pole problem was studied. We have studied typical behaviour of reinforcement learning agents applied to the classic BOXES model and a new form of characterizing the environment was proposed using the notion of convergence towards a reference value. We demonstrate the gain in performance of this new method applied to a Q-Learning agent.

Sistema de apoio à decisão para a classificação de risco em projectos de tecnologias de informação

O trabalho que a seguir se apresenta tem como objectivo descrever a criação de um modelo que sirva de suporte a um sistema de apoio à decisão sobre o risco inerente à execução de projectos na área das Tecnologias de Informação (TI) recorrendo a técnicas de mineração de dados. Durante o ciclo de vida de um projecto, existem inúmeros factores que contribuem para o seu sucesso ou insucesso. A responsabilidade de monitorizar, antever e mitigar esses factores recai sobre o Gestor de Projecto. A gestão de projectos é uma tarefa difícil e dispendiosa, consome muitos recursos, depende de numerosas variáveis e, muitas vezes, até da própria experiência do Gestor de Projecto. Ao ser confrontado com as previsões de duração e de esforço para a execução de uma determinada tarefa, o Gestor de Projecto, exceptuando a sua percepção e intuição pessoal, não tem um modo objectivo de medir a plausibilidade dos valores que lhe são apresentados pelo eventual executor da tarefa. As referidas previsões são fundamentais para a organização, pois sobre elas são tomadas as decisões de planeamento global estratégico corporativo, de execução, de adiamento, de cancelamento, de adjudicação, de renegociação de âmbito, de adjudicação externa, entre outros. Esta propensão para o desvio, quando detectada numa fase inicial, pode ajudar a gerir melhor o risco associado à Gestão de Projectos. O sucesso de cada projecto terminado foi qualificado tendo em conta a ponderação de três factores: o desvio ao orçamentado, o desvio ao planeado e o desvio ao especificado. Analisando os projectos decorridos, e correlacionando alguns dos seus atributos com o seu grau de sucesso o modelo classifica, qualitativamente, um novo projecto quanto ao seu risco. Neste contexto o risco representa o grau de afastamento do projecto ao sucesso. Recorrendo a algoritmos de mineração de dados, tais como, árvores de classificação e redes neuronais, descreve-se o desenvolvimento de um modelo que suporta um sistema de apoio à decisão baseado na classificação de novos projectos. Os modelos são o resultado de um extensivo conjunto de testes de validação onde se procuram e refinam os indicadores que melhor caracterizam os atributos de um projecto e que mais influenciam o risco. Como suporte tecnológico para o desenvolvimento e teste foi utilizada a ferramenta Weka 3. Uma boa utilização do modelo proposto possibilitará a criação de planos de contingência mais detalhados e uma gestão mais próxima para projectos que apresentem uma maior propensão para o risco. Assim, o resultado final pretende constituir mais uma ferramenta à disposição do Gestor de Projecto.

Advanced side information creation techniques and framework for Wyner-Ziv video coding

Recently, several distributed video coding (DVC) solutions based on the distributed source coding (DSC) paradigm have appeared in the literature. Wyner-Ziv (WZ) video coding, a particular case of DVC where side information is made available at the decoder, enable to achieve a flexible distribution of the computational complexity between the encoder and decoder, promising to fulfill novel requirements from applications such as video surveillance, sensor networks and mobile camera phones. The quality of the side information at the decoder has a critical role in determining the WZ video coding rate-distortion (RD) performance, notably to raise it to a level as close as possible to the RD performance of standard predictive video coding schemes. Towards this target, efficient motion search algorithms for powerful frame interpolation are much needed at the decoder. In this paper, the RD performance of a Wyner-Ziv video codec is improved by using novel, advanced motion compensated frame interpolation techniques to generate the side information. The development of these type of side information estimators is a difficult problem in WZ video coding, especially because the decoder only has available some reference, decoded frames. Based on the regularization of the motion field, novel side information creation techniques are proposed in this paper along with a new frame interpolation framework able to generate higher quality side information at the decoder. To illustrate the RD performance improvements, this novel side information creation framework has been integrated in a transform domain turbo coding based Wyner-Ziv video codec. Experimental results show that the novel side information creation solution leads to better RD performance than available state-of-the-art side information estimators, with improvements up to 2 dB: moreover, it allows outperforming H.264/AVC Intra by up to 3 dB with a lower encoding complexity.

Shareholder wealth creation in response to announcements of acquisitions of unlisted firms: Evidence from Spain

We investigate shareholder value creation of Spanish listed firms in response to announcements of acquisitions of unlisted companies and compare this experience to the purchase of listed firms over the period 1991–2006. Similar to foreign markets, acquirers of listed targets earn insignificant average abnormal returns, whereas acquirers of unlisted targets gain significant positive average abnormal returns. When we relate these results to company and transaction characteristics our findings diverge from those reported in the literature for other foreign markets, as our evidence suggests that the listing status effect is mainly associated with the fact that unlisted firms tend to be smaller and lesser–known firms, and thus suffer from a lack of competition in the market for corporate control. Consequently, the payment of lower premiums and the possibility of diversifying shareholders’ portfolios lead to unlisted firm acquisitions being viewed as value–orientated transactions.

Innovation through virtual communities of Practice: motivation and constraints in the knowledge-creation process

Communities of Practice are places which provide a sound basis for organizational learning, enabling knowledge creation and acquisition thus improving organizational performance, leveraging innovation and consequently increasing competitively. Virtual Communities of Practice (VCoP‟s) can perform a central role in promoting communication and collaboration between members who are dispersed in both time and space. The ongoing case study, described here, aims to identify both the motivations and the constraints that members of an organization experience when taking part in the knowledge creating processes of the VCoP‟s to which they belong. Based on a literature review, we have identified several factors that influence such processes; they will be used to analyse the results of interviews carried out with the leaders of VCoP‟s in four multinationals. As future work, a questionnaire will be developed and administered to the other members of these VCoP‟s

Virtual communities of practice: investigating motivations and constraints in the processes of knowledge creation and transfer

With accelerated market volatility, faster response times and increased globalization, business environments are going through a major transformation and firms have intensified their search for strategies which can give them competitive advantage. This requires that companies continuously innovate, to think of new ideas that can be transformed or implemented as products, processes or services, generating value for the firm. Innovative solutions and processes are usually developed by a group of people, working together. A grouping of people that share and create new knowledge can be considered as a Community of Practice (CoP). CoP’s are places which provide a sound basis for organizational learning and encourage knowledge creation and acquisition. Virtual Communities of Practice (VCoP's) can perform a central role in promoting communication and collaboration between members who are dispersed in both time and space. Nevertheless, it is known that not all CoP's and VCoP's share the same levels of performance or produce the same results. This means that there are factors that enable or constrain the process of knowledge creation. With this in mind, we developed a case study in order to identify both the motivations and the constraints that members of an organization experience when taking part in the knowledge creating processes of VCoP's. Results show that organizational culture and professional and personal development play an important role in these processes. No interviewee referred to direct financial rewards as a motivation factor for participation in VCoPs. Most identified the difficulty in aligning objectives established by the management with justification for the time spent in the VCoP. The interviewees also said that technology is not a constraint.

The role of Lifelong Learning in the creation of a knowledge-based society for Europe: european policies

Link do editor: http://www.igi-global.com/chapter/role-lifelong-learning-creation-european/13314

Virtual communities of practice: examining the motivations and constraints in their knowledge creation and knowledge transfer preocesses

Paper accepted for the OKLC 2009 - International Conference on Organizational Learning, Knowledge and Capabilities (26-28th, April 2009, Amsterdam, the Netherlands).

The Role of lifelong learning in creation of a european knowledge-based society

The dominant discourse in education and training policies, at the turn of the millennium, was on lifelong learning (LLL) in the context of a knowledge-based society. As Green points (2002, pp. 611-612) several factors contribute to this global trend: The demographic change: In most advanced countries, the average age of the population is increasing, as people live longer; The effects of globalisation: Including both economic restructuring and cultural change which have impacts on the world of education; Global economic restructuring: Which causes, for example, a more intense demand for a higher order of skills; the intensified economic competition, forcing a wave of restructuring and creating enormous pressure to train and retrain the workforce In parallel, the “significance of the international division of labour cannot be underestimated for higher education”, as pointed out by Jarvis (1999, p. 250). This author goes on to argue that globalisation has exacerbated differentiation in the labour market, with the First World converting faster to a knowledge economy and a service society, while a great deal of the actual manufacturing is done elsewhere.

Intersubjectivity and poetic translation

O artigo está disponível em livre acesso no link da versão do editor

Plano de negócios para empresa de turismo de luxo

Dissertação de Mestrado em Finanças Empresariais

O teatro de marionetas e o desenvolvimento da oralidade no 2º ciclo do ensino básico

Dissertação apresentada à Escola Superior de Educação de Lisboa para a obtenção do grau de mestre em Educação Artística - Especialização em Teatro na Educação

The Greatest lover: a post-colonial rewriting of My Fair Lady

INTRODUCTION The popular Hong Kong comedy, The Greatest Lover, re-incarnates one of the most popular western musicals, My Fair Lady. OBJECTIVES 1. To find out in what major ways My Fair Lady was rewritten as the Hong Kong Cantonese movie, Gungzi Docing (The Greatest Lover). 2. To find out the socio-political, socio-linguistic, and gender ideology behind the rewriting. METHODOLOGY 1. To note the similarity of the themes for both works – a creator falling in love with his/her creation, and class prejudice and cross-class romance. 2. To note how the times of The Greatest Lover differ from that of My Fair Lady. 3. To note how the main characters in The Greatest Lover differ from My Fair Lady in terms of profession, gender, etc. 4. To note how the plot of The Greatest Lover differs from that of My Fair Lady. 5. To note how focus on language in The Greatest Lover compares with that in My Fair Lady. 6. To discuss the ideological implications of the differences noted above, e.g. women in Hong Kong today have much higher status than women in Victorian England; the conflict between local Hong Kong people and both legal and illegal immigrants from Mainland China is even more serious than that between the British upper middle class and the lower class during the Victorian period. 7. Andre Lefevere (1992) argues that translation and adaptation are rewriting informed and influenced by the rewriter’s ideology, among other things. 8. Both Aline Remael (1995) and Patrick Cattrysse (1992) think that film adaptation is a kind of translation. 9. Sirkkus Aaltonen (2000) argues that drama translation mirrors the ideologies of the target society. CONCLUSION 1. The Greatest Lover projects local cultural significance onto My Fair Lady by helping us to appreciate an important Western work of art through the Hong Kong Cantonese perspective. 2. Broader issues in translation and intercultural studies are also considered.

Literary translation and quality assessment analysis – its significance in translation training

This paper aims to highlight the role of translation quality assessment in translation training so as to develop students’ translation competence and skills to face translation problems. An analysis to assess literary translation quality is proposed before proceeding to discuss its pedagogical implementation.

Side information creation for efficient Wyner-Ziv video coding: Classifying and reviewing

Video coding technologies have played a major role in the explosion of large market digital video applications and services. In this context, the very popular MPEG-x and H-26x video coding standards adopted a predictive coding paradigm, where complex encoders exploit the data redundancy and irrelevancy to 'control' much simpler decoders. This codec paradigm fits well applications and services such as digital television and video storage where the decoder complexity is critical, but does not match well the requirements of emerging applications such as visual sensor networks where the encoder complexity is more critical. The Slepian Wolf and Wyner-Ziv theorems brought the possibility to develop the so-called Wyner-Ziv video codecs, following a different coding paradigm where it is the task of the decoder, and not anymore of the encoder, to (fully or partly) exploit the video redundancy. Theoretically, Wyner-Ziv video coding does not incur in any compression performance penalty regarding the more traditional predictive coding paradigm (at least for certain conditions). In the context of Wyner-Ziv video codecs, the so-called side information, which is a decoder estimate of the original frame to code, plays a critical role in the overall compression performance. For this reason, much research effort has been invested in the past decade to develop increasingly more efficient side information creation methods. This paper has the main objective to review and evaluate the available side information methods after proposing a classification taxonomy to guide this review, allowing to achieve more solid conclusions and better identify the next relevant research challenges. After classifying the side information creation methods into four classes, notably guess, try, hint and learn, the review of the most important techniques in each class and the evaluation of some of them leads to the important conclusion that the side information creation methods provide better rate-distortion (RD) performance depending on the amount of temporal correlation in each video sequence. It became also clear that the best available Wyner-Ziv video coding solutions are almost systematically based on the learn approach. The best solutions are already able to systematically outperform the H.264/AVC Intra, and also the H.264/AVC zero-motion standard solutions for specific types of content. (C) 2013 Elsevier B.V. All rights reserved.