Dynamic equilibrium through reinforcement learning

Reinforcement Learning is an area of Machine Learning that deals with how an agent should take actions in an environment such as to maximize the notion of accumulated reward. This type of learning is inspired by the way humans learn and has led to the creation of various algorithms for reinforcement learning. These algorithms focus on the way in which an agent’s behaviour can be improved, assuming independence as to their surroundings. The current work studies the application of reinforcement learning methods to solve the inverted pendulum problem. The importance of the variability of the environment (factors that are external to the agent) on the execution of reinforcement learning agents is studied by using a model that seeks to obtain equilibrium (stability) through dynamism – a Cart-Pole system or inverted pendulum. We sought to improve the behaviour of the autonomous agents by changing the information passed to them, while maintaining the agent’s internal parameters constant (learning rate, discount factors, decay rate, etc.), instead of the classical approach of tuning the agent’s internal parameters. The influence of changes on the state set and the action set on an agent’s capability to solve the Cart-pole problem was studied. We have studied typical behaviour of reinforcement learning agents applied to the classic BOXES model and a new form of characterizing the environment was proposed using the notion of convergence towards a reference value. We demonstrate the gain in performance of this new method applied to a Q-Learning agent.

Implementação de WDM com dispositivos semicondutores

Este trabalho utiliza uma estrutura pin empilhada, baseada numa liga de siliceto de carbono amorfo hidrogenado (a-Si:H e/ou a-SiC:H), que funciona como filtro óptico na zona visível do espectro electromagnético. Pretende-se utilizar este dispositivo para realizar a demultiplexagem de sinais ópticos e desenvolver um algoritmo que permita fazer o reconhecimento autónomo do sinal transmitido em cada canal. O objectivo desta tese visa implementar um algoritmo que permita o reconhecimento autónomo da informação transmitida por cada canal através da leitura da fotocorrente fornecida pelo dispositivo. O tema deste trabalho resulta das conclusões de trabalhos anteriores, em que este dispositivo e outros de configuração idêntica foram analisados, de forma a explorar a sua utilização na implementação da tecnologia WDM. Neste trabalho foram utilizados três canais de transmissão (Azul – 470 nm, Verde – 525 nm e Vermelho – 626 nm) e vários tipos de radiação de fundo. Foram realizadas medidas da resposta espectral e da resposta temporal da fotocorrente do dispositivo, em diferentes condições experimentais. Variou-se o comprimento de onda do canal e o comprimento de onda do fundo aplicado, mantendo-se constante a intensidade do canal e a frequência de transmissão. Os resultados obtidos permitiram aferir sobre a influência da presença da radiação de fundo e da tensão aplicada ao dispositivo, usando diferentes sequências de dados transmitidos nos vários canais. Verificou-se, que sob polarização inversa, a radiação de fundo vermelho amplifica os valores de fotocorrente do canal azul e a radiação de fundo azul amplifica o canal vermelho e verde. Para polarização directa, apenas a radiação de fundo azul amplifica os valores de fotocorrente do canal vermelho. Enquanto para ambas as polarizações, a radiação de fundo verde, não tem uma grande influência nos restantes canais. Foram implementados dois algoritmos para proceder ao reconhecimento da informação de cada canal. Na primeira abordagem usou-se a informação contida nas medidas de fotocorrente geradas pelo dispositivo sob polarização inversa e directa. Pela comparação das duas medidas desenvolveu-se e testou-se um algoritmo que permite o reconhecimento dos canais individuais. Numa segunda abordagem procedeu-se ao reconhecimento da informação de cada canal mas com aplicação de radiação de fundo, tendo-se usado a informação contida nas medidas de fotocorrente geradas pelo dispositivo sob polarização inversa sem aplicação de radiação de fundo com a informação contida nas medidas de fotocorrente geradas pelo dispositivo sob polarização inversa com aplicação de radiação de fundo. Pela comparação destas duas medidas desenvolveu-se e testou-se o segundo algoritmo que permite o reconhecimento dos canais individuais com base na aplicação de radiação de fundo.

Elements of a methodology to assess the alignment of core-values in collaborative networks

Collaborative networks are typically formed by heterogeneous and autonomous entities, and thus it is natural that each member has its own set of core-values. Since these values somehow drive the behaviour of the involved entities, the ability to quickly identify partners with compatible or common core-values represents an important element for the success of collaborative networks. However, tools to assess or measure the level of alignment of core-values are lacking. Since the concept of 'alignment' in this context is still ill-defined and shows a multifaceted nature, three perspectives are discussed. The first one uses a causal maps approach in order to capture, structure, and represent the influence relationships among core-values. This representation provides the basis to measure the alignment in terms of the structural similarity and influence among value systems. The second perspective considers the compatibility and incompatibility among core-values in order to define the alignment level. Under this perspective we propose a fuzzy inference system to estimate the alignment level, since this approach allows dealing with variables that are vaguely defined, and whose inter-relationships are difficult to define. Another advantage provided by this method is the possibility to incorporate expert human judgment in the definition of the alignment level. The last perspective uses a belief Bayesian network method, and was selected in order to assess the alignment level based on members' past behaviour. An example of application is presented where the details of each method are discussed.

Validation of a measurement scale for the relationship between the orientation to corporate social responsibility and other business strategic variables

The importance of Social Responsibility (SR) is higher if this business variable is related with other ones of strategic nature in business activity (competitive success that the company achieved, performance that the firms develop and innovations that they carries out). The hypothesis is that organizations that focus on SR are those who get higher outputs and innovate more, achieving greater competitive success. A scale for measuring the orientation to SR has defined in order to determine the degree of relationship between above elements. This instrument is original because previous scales do not exist in the literature which could measure, on the one hand, the three classics sub-constructs theoretically accepted that SR is made up and, on the other hand, the relationship between SR and the other variables. As a result of causal relationships analysis we conclude with a scale of 21 indicators, validated scale with a sample of firms belonging to the Autonomous Community of Extremadura and it is the first empirical validation of these dimensions we know so far, in this context.

Avaliação do risco associado a movimentos verticais de navios em manobra no porto da Praia da Vitória

O risco associado a um navio em manobra pode ser avaliado pela probabilidade do movimento vertical de um ponto do navio ultrapassar um determinado limiar pré-definido. Essa excedência pode originar danos tanto no próprio navio como nas estruturas portuárias envolventes. Este trabalho surge no seguimento de um estudo efectuado no Laboratório Nacional de Engenharia Civil (LNEC), no qual foi desenvolvido um conjunto de ferramentas de avaliação da função resposta do navio quando sujeito à agitação marítima e, partindo dessas ferramentas, foi obtido um procedimento para determinação do espectro dos movimentos verticais de um ponto de um navio parado sujeito àquele estado de agitação (Rodrigues, 2010). No presente estudo, estendeu-se esse procedimento de modo a avaliar a influência da velocidade de avanço do navio no espectro dos movimentos verticais do mesmo. O percurso de entrada do “N/M Fernão Gomes” no porto da Praia da Vitória foi o caso de estudo considerado. A agitação marítima incidente no navio cobriu o período de Janeiro de 2009 a Dezembro de 2010 e foi obtida com base no modelo previsão de escala regional (WAVEWATCH III) e posteriormente transferida para o interior do porto com o recurso a modelos numéricos de propagação de ondas (SWAN e DREAMS). Foi também assumido que a altura do movimento vertical do navio segue uma distribuição de Rayleigh, a qual possibilita a determinação da altura significativa desse movimento vertical, bem como a implementação de um procedimento para determinar a probabilidade de a altura do movimento vertical do navio não exceder um limiar pré-definido e consequentemente mostrar, através da análise dos resultados, a influência da velocidade de avanço do navio. Da análise dos resultados concluiu-se que a velocidade tem uma influência significativa nos resultados. No final avaliou-se a contribuição dos resultados anteriormente determinados, para a análise do risco associado aos movimentos verticais do navio quando em manobra no porto em estudo.

Strength, muscle quality and functional capacity in liver transplanted familial amyloidotic polineuropathy patients

Liver transplantation is the unique treatment for several end stage diseases. Familial Amiloidotic Polineuropathy (FAP) is a neurodegenerative disease related with systemic deposition of amyloidal fibre mainly on peripheral nervous system, clinically translated by an autonomous sensitive-motor neuropathy with severe functional limitations in some cases. The unique treatment for FAP disease is a liver transplant with a very aggressive medication to muscle metabolism and force production. To our knowledge there are no quantitative characterizations of body composition, strength or functional capacity in this population. The purpose of this study was to compare levels of specific strength (isometric strength adjusted by lean mass or muscle quality) and functional capacity (meters in 6 minutes walk test) between FAP patients after a liver transplant (4.1±2 months after transplant surgery) (FAPT) and a healthy group (HG).

Educational characteristics of adult students in portuguese technological schools

Despite a massive expansion of education in Portugal, since the 1970’s, educational attainment of the adult population in the country remains low. The numbers of working-age people in some form of continuing education are among the lowest, according to the OECD and EU-27 statistics. Technological Schools(TS), initially created in the 1990’s, under the umbrella of the Ministry of Economy in partnership with industry and industrial associations, aimed to prepare qualified staff for industries and services in the country, particularly in the engineering sector, through the provision of post secondary non-university programmes of studies, the CET (Technological Specialization Courses). Successful CET students are awarded a DET(Diploma of Technological Specialization), which corresponds to Vocational Qualification level IV of the EU, according to the latest alteration (2005) of the Education Systems Act (introduced in 1986). In this, CET’s are also clearly defined as one of the routes for access to Higher Education (HE), in Portugal. The PRILHE (Promoting Reflective and Independent Learning in Higher Education) multinational project, funded by the European Socrates Grundtvig Programme, aimed to identify the learning processes which enable adult students in higher education to become autonomous reflective learners and search best practices to support these learning processes. During this research, both quantitative and qualitative methods were used to determine how students organise their studies and develop their learning skills. The Portuguese partner in the project’ consortium used a two case studies approach, one with students of Higher Education Institutions and other with students of TS. This paper only applies to students of TS, as these have a predominant bias towards engineering. Results show that student motivation and professional teaching support contribute equally to the development of an autonomous and reflective approach to learning in adult students; this is essential for success in a knowledge economy, where lifelong learning is the key to continuous employment.

Knowledge sharing and learning processes: case study of portuguese technological schools and higher education institutions

Paper to be presented at the ESREA Conference Learning to Change? The Role of Identity and Learning Careers in Adult Education, 7-8 December, 2006, Université Catholique Louvain, Louvain–la-Neuve, Belgium

Estudo sobre as representações sociais face à deficiência em contexto escolar

A descriminação e a ausência de igualdade de oportunidades no acesso a direitos fundamentais inscritos na constituição portuguesa continuam a ser para as pessoas com deficiência um tema bastante actual e uma das preocupações nucleares de todos aqueles que directa ou indirectamente se interessam por estas questões. O acesso a educação e ao emprego, ainda que incentivado por políticas sociais inclusivas, continua a ser extremamente dificultado pela existência de barreiras, com configurações diversas, mas quase sempre organizadas em torno de representações acerca da deficiência pouco coerentes e coincidentes com o entendimento actual deste fenómeno. O trabalho por nós realizado teve como objectivo contribuir para o estudo das representações sociais relativamente à deficiência em Portugal, perspectivada a análise a partir dos agentes educativos do agrupamento de escolas do distrito de Viana do Castelo, uma das zonas do país com maior número de pessoas com deficiência, de acordo com o Censo de 2001. O inquérito por questionário de auto-administração realizado a uma amostra de 56 agentes educativos foi concordante com muitas das crenças e estereótipos face às pessoas com deficiência encontrados em estudos similares, nomeadamente no que reporta às atitudes negativas de pena e de culpa e à visualização da pessoa com deficiência como incapaz e pouco autónoma. Esta situação sugere a necessidade de se continuar a desenvolver estudos de caracterização destes traços em diferentes micro-culturas, no sentido de se desenvolverem estratégias personalizadas que permitam a sua remissão e o desmantelar das barreiras ainda existentes para a inclusão destes cidadãos na sociedade.

A Service Integration Platform for Collaborative Networks

Integrated manufacturing constitutes a complex system made of heterogeneous information and control subsystems. Those subsystems are not designed to the cooperation. Typically each subsystem automates specific processes, and establishes closed application domains, therefore it is very difficult to integrate it with other subsystems in order to respond to the needed process dynamics. Furthermore, to cope with ever growing marketcompetition and demands, it is necessary for manufacturing/enterprise systems to increase their responsiveness based on up-to-date knowledge and in-time data gathered from the diverse information and control systems. These have created new challenges for manufacturing sector, and even bigger challenges for collaborative manufacturing. The growing complexity of the information and communication technologies when coping with innovative business services based on collaborative contributions from multiple stakeholders, requires novel and multidisciplinary approaches. Service orientation is a strategic approach to deal with such complexity, and various stakeholders' information systems. Services or more precisely the autonomous computational agents implementing the services, provide an architectural pattern able to cope with the needs of integrated and distributed collaborative solutions. This paper proposes a service-oriented framework, aiming to support a virtual organizations breeding environment that is the basis for establishing short or long term goal-oriented virtual organizations. The notion of integrated business services, where customers receive some value developed through the contribution from a network of companies is a key element.

IOPT Petri Net State Space Generation Algorithm with Maximal-Step Execution Semantics

This paper presents an algorithm to efficiently generate the state-space of systems specified using the IOPT Petri-net modeling formalism. IOPT nets are a non-autonomous Petri-net class, based on Place-Transition nets with an extended set of features designed to allow the rapid prototyping and synthesis of system controllers through an existing hardware-software co-design framework. To obtain coherent and deterministic operation, IOPT nets use a maximal-step execution semantics where, in a single execution step, all enabled transitions will fire simultaneously. This fact increases the resulting state-space complexity and can cause an arc "explosion" effect. Real-world applications, with several million states, will reach a higher order of magnitude number of arcs, leading to the need for high performance state-space generator algorithms. The proposed algorithm applies a compilation approach to read a PNML file containing one IOPT model and automatically generate an optimized C program to calculate the corresponding state-space.

Self-optimization module for scheduling using case-based reasoning

Metaheuristics performance is highly dependent of the respective parameters which need to be tuned. Parameter tuning may allow a larger flexibility and robustness but requires a careful initialization. The process of defining which parameters setting should be used is not obvious. The values for parameters depend mainly on the problem, the instance to be solved, the search time available to spend in solving the problem, and the required quality of solution. This paper presents a learning module proposal for an autonomous parameterization of Metaheuristics, integrated on a Multi-Agent System for the resolution of Dynamic Scheduling problems. The proposed learning module is inspired on Autonomic Computing Self-Optimization concept, defining that systems must continuously and proactively improve their performance. For the learning implementation it is used Case-based Reasoning, which uses previous similar data to solve new cases. In the use of Case-based Reasoning it is assumed that similar cases have similar solutions. After a literature review on topics used, both AutoDynAgents system and Self-Optimization module are described. Finally, a computational study is presented where the proposed module is evaluated, obtained results are compared with previous ones, some conclusions are reached, and some future work is referred. It is expected that this proposal can be a great contribution for the self-parameterization of Metaheuristics and for the resolution of scheduling problems on dynamic environments.

Cooperative scheduling system with emergent swarm based behavior

This paper presents a Swarm based Cooperation Mechanism for scheduling optimization. We intend to conceptualize real manufacturing systems as interacting autonomous entities in order to support decision making in agile manufacturing environments. Agents coordinate their actions automatically without human supervision considering a common objective – global scheduling solution taking advantages from collective behavior of species through implicit and explicit cooperation. The performance of the cooperation mechanism will be evaluated consider implicit cooperation at first stage through ACS, PSO and ABC algorithms and explicit through cooperation mechanism application.

As relações intergeracionais e as sociedades envelhecidas : Envelhecer numa sociedade não Stop – O território multigeracional de Lisboa Oriental

A dissertação de mestrado subordinada ao tema das Relações Intergeracionais e as Sociedades Envelhecidas surgiu, no âmbito do Mestrado em Educação Social e Intervenção Comunitária, da Escola Superior de Educação de Lisboa e teve como ponto de partida saber se a participação em actividades intergeracionais promove o envelhecimento ativo de 8 mulheres com 65 e mais anos, residentes num território multigeracional de Lisboa Oriental. A abordagem concetual do envelhecimento social, do envelhecimento ativo, das relações intergeracionais e da participação conduziu o estudo, através da triangulação dos instrumentos de análise qualitativa de entrevistas de histórias de vida e de focus group. As mulheres entrevistadas têm entre 65 e 85 anos de idade cronológica, mas em média dizem sentir que têm menos 34 anos. Afirmam, ser jovens de espirito e por isso preferem ser chamadas de seniores. Manifestam que sempre foram e são, mulheres autónomas, livres, independentes, com poder de decisão, com auto-estima elevada e com qualidade de vida. Mulheres que ocupam o tempo em actividades da vida diária, em actividades de tempos livres, e voluntariado. Mulheres reivindicativas, proativas, frontais e determinadas que assumem um papel social ativo envolvendo-se socialmente em todas as actividades produtivas ou orientadas para a performance e em actividades colectivas e ou orientadas para a união, com vista alcançar objetivos comuns. Mulheres, que ganham prestígio e estatuto na comunidade por se envolverem socialmente no processo de tomadas de decisão, organização, execução e avaliação, com as gerações mais novas. São visionárias ancestrais de espirito jovem que abrem novas portas para a construção social da velhice nas sociedades neoliberais e desafiam os humanistas quando afirmam que as atividades produtivas na velhice dão sentido à própria existência. São histórias de mulheres que nos fazem acreditar que a participação social contribui espontaneamente para o diálogo entre as gerações, em todas as fases da vida. - Abstract A dissertation on the subject of Intergenerational Relationships and Societies Aged emerged within the Master of Education Social and Community Intervention, School of Education and Lisbon had as starting point whether participation promotes intergenerational activities on aging 8 active women aged 65 years and older, residing in the territory of Eastern Lisbon multigenerational. The conceptual approach of social aging, active aging, intergenerational relations and participation conducted the study through triangulation of instruments qualitative analysis of interviews and life stories focus group. The women interviewed are between 65 and 85 years of chronological age, but on average say they feel they are under 34 years old. They claim to be young in spirit and so they prefer to be called seniors. Demonstrate that have always been and are women autonomous, free, independent, decision-making, self-esteem and quality of life. Women who occupy the time in activities of daily life, in leisure activities, and volunteering. Women reivindicativas, proactive, front and determined to play an active social role by engaging in socially productive activities or any performance-oriented and collective activities and or targeted at the union in order to achieve common objectives. Women who gain prestige and status in the community by becoming involved socially in the process of decision making, organization, implementation and evaluation with the younger generations. They are young visionary spirit of ancestors that open new doors to the social construction of old age in neoliberal societies and challenge humanists say when productive activities in old age give meaning to their own existence. These are stories of women who have us believe that social participation contributes to spontaneous dialogue between generations, in all stages of life.

Indicadores de resiliência na criança e sua relação com perceção de risco e qualidade de vinculação nos prestadores de cuidados, em crianças com ou sem intervênção precoce

Dissertação apresentada à Escola Superior de Educação de Lisboa para obtenção do grau de mestre em Ciências da Educação - Especialidade Intervenção Precoce