Cost dependent strategy for electricity markets bidding based on adaptive reinforcement learning

Electricity markets are complex environments, involving a large number of different entities, playing in a dynamic scene to obtain the best advantages and profits. MASCEM is a multi-agent electricity market simulator to model market players and simulate their operation in the market. Market players are entities with specific characteristics and objectives, making their decisions and interacting with other players. MASCEM provides several dynamic strategies for agents’ behavior. This paper presents a method that aims to provide market players with strategic bidding capabilities, allowing them to obtain the higher possible gains out of the market. This method uses a reinforcement learning algorithm to learn from experience how to choose the best from a set of possible bids. These bids are defined accordingly to the cost function that each producer presents.

Optimising and adapting the QoS of a dynamic set of inter-dependent tasks

Due to the growing complexity and adaptability requirements of real-time systems, which often exhibit unrestricted Quality of Service (QoS) inter-dependencies among supported services and user-imposed quality constraints, it is increasingly difficult to optimise the level of service of a dynamic task set within an useful and bounded time. This is even more difficult when intending to benefit from the full potential of an open distributed cooperating environment, where service characteristics are not known beforehand and tasks may be inter-dependent. This paper focuses on optimising a dynamic local set of inter-dependent tasks that can be executed at varying levels of QoS to achieve an efficient resource usage that is constantly adapted to the specific constraints of devices and users, nature of executing tasks and dynamically changing system conditions. Extensive simulations demonstrate that the proposed anytime algorithms are able to quickly find a good initial solution and effectively optimise the rate at which the quality of the current solution improves as the algorithms are given more time to run, with a minimum overhead when compared against their traditional versions.

Dynamic QoS adaptation of inter- dependent task sets in cooperative embedded systems

Due to the growing complexity and dynamism of many embedded application domains (including consumer electronics, robotics, automotive and telecommunications), it is increasingly difficult to react to load variations and adapt the system's performance in a controlled fashion within an useful and bounded time. This is particularly noticeable when intending to benefit from the full potential of an open distributed cooperating environment, where service characteristics are not known beforehand and tasks may exhibit unrestricted QoS inter-dependencies. This paper proposes a novel anytime adaptive QoS control policy in which the online search for the best set of QoS levels is combined with each user's personal preferences on their services' adaptation behaviour. Extensive simulations demonstrate that the proposed anytime algorithms are able to quickly find a good initial solution and effectively optimise the rate at which the quality of the current solution improves as the algorithms are given more time to run, with a minimum overhead when compared against their traditional versions.

An uncertainty and sensitivity analysis applied to the prioritisation of pharmaceuticals as surface water contaminants from wastewater treatment plant direct emissions

In this study, the concentration probability distributions of 82 pharmaceutical compounds detected in the effluents of 179 European wastewater treatment plants were computed and inserted into a multimedia fate model. The comparative ecotoxicological impact of the direct emission of these compounds from wastewater treatment plants on freshwater ecosystems, based on a potentially affected fraction (PAF) of species approach, was assessed to rank compounds based on priority. As many pharmaceuticals are acids or bases, the multimedia fate model accounts for regressions to estimate pH-dependent fate parameters. An uncertainty analysis was performed by means of Monte Carlo analysis, which included the uncertainty of fate and ecotoxicity model input variables, as well as the spatial variability of landscape characteristics on the European continental scale. Several pharmaceutical compounds were identified as being of greatest concern, including 7 analgesics/anti-inflammatories, 3 β-blockers, 3 psychiatric drugs, and 1 each of 6 other therapeutic classes. The fate and impact modelling relied extensively on estimated data, given that most of these compounds have little or no experimental fate or ecotoxicity data available, as well as a limited reported occurrence in effluents. The contribution of estimated model input variables to the variance of freshwater ecotoxicity impact, as well as the lack of experimental abiotic degradation data for most compounds, helped in establishing priorities for further testing. Generally, the effluent concentration and the ecotoxicity effect factor were the model input variables with the most significant effect on the uncertainty of output results.

Educational characteristics of adult students in portuguese technological schools

Despite a massive expansion of education in Portugal, since the 1970’s, educational attainment of the adult population in the country remains low. The numbers of working-age people in some form of continuing education are among the lowest, according to the OECD and EU-27 statistics. Technological Schools(TS), initially created in the 1990’s, under the umbrella of the Ministry of Economy in partnership with industry and industrial associations, aimed to prepare qualified staff for industries and services in the country, particularly in the engineering sector, through the provision of post secondary non-university programmes of studies, the CET (Technological Specialization Courses). Successful CET students are awarded a DET(Diploma of Technological Specialization), which corresponds to Vocational Qualification level IV of the EU, according to the latest alteration (2005) of the Education Systems Act (introduced in 1986). In this, CET’s are also clearly defined as one of the routes for access to Higher Education (HE), in Portugal. The PRILHE (Promoting Reflective and Independent Learning in Higher Education) multinational project, funded by the European Socrates Grundtvig Programme, aimed to identify the learning processes which enable adult students in higher education to become autonomous reflective learners and search best practices to support these learning processes. During this research, both quantitative and qualitative methods were used to determine how students organise their studies and develop their learning skills. The Portuguese partner in the project’ consortium used a two case studies approach, one with students of Higher Education Institutions and other with students of TS. This paper only applies to students of TS, as these have a predominant bias towards engineering. Results show that student motivation and professional teaching support contribute equally to the development of an autonomous and reflective approach to learning in adult students; this is essential for success in a knowledge economy, where lifelong learning is the key to continuous employment.

Importance of technologies characteristics for VPPs

The large increase of renewable energy sources and Distributed Generation (DG) of electricity gives place to the Virtual Power Producer (VPP) concept. VPPs can reinforce the importance of these generation technologies making them valuable in electricity markets. One of the most important tasks of a VPP is the conjugation of technologies to obtain a consistent set of associated producers and allow them to operate in the electric market. This paper presents some characteristics regarding already existent technologies and relevant aspects for producers and for VPP.

Removal of sulfamethoxazole from solution by raw and chemically treated walnut shells

Purpose: The sorption of sulfamethoxazole, a frequently detected pharmaceutical compound in the environment, onto walnut shells was evaluated. Methods: The sorption proprieties of the raw sorbent were chemically modified and two additional samples were obtained, respectively HCl and NaOH treated. Scanning electron microscopy, Fourier transform infrared spectroscopy, X-ray photoelectron spectroscopy, and thermogravimetric (TG/DTG) techniques were applied to investigate the effect of the chemical treatments on the shell surface morphology and chemistry. Sorption experiments to investigate the pH effect on the process were carried out between pH 2 and 8. Results: The chemical treatment did not substantially alter the structure of the sorbent (physical and textural characteristics) but modified the surface chemistry of the sorbent (acid–base properties, point of zero charge—pHpzc). The solution pH influences both the sorbent’s surface charge and sulfamethoxazole speciation. The best removal efficiencies were obtained for lower pH values where the neutral and cationic sulfamethoxazole forms are present in the solution. Langmuir and Freundlich isotherms were applied to the experimental adsorption data for sulfamethoxazole sorption at pH 2, 4, and 7 onto raw walnut shell. No statistical difference was found between the two models except for the pH 2 experimental data to which the Freundlich model fitted better. Conclusion: Sorption of sulfamethoxazole was found to be highly pH dependent in the entire pH range studied and for both raw and treated sorbent.

Sistema de correlação de eventos e notificações - SCEN

Mestrado em Engenharia Electrotécnica e de Computadores

Supervisão, comando e controlo para sistemas robóticos

Mestrado em Engenharia Electrotécnica e de Computadores. Área de Especialização em Sistemas Autónomos

Simulação e programação offline de robôs industriais afectos a tarefas de lixagem

Este trabalho teve o intuito de testar a viabilidade da programação offline para tarefas de lixamento na empresa Grohe Portugal. Para tal era necessário perceber o que é a programação offline e para isso foi efectuada uma pesquisa referente a essa temática, onde ficou evidente que a programação offline é em tudo semelhante à programação online, tendo apenas como principal diferença o facto de não usar o robô propriamente dito durante o desenvolvimento do programa. Devido à ausência do robô, a programação offline exige que se conheça detalhadamente a célula de trabalho, bem como todas as entradas e saídas associadas à célula, sendo que o conhecimento das entradas e saídas pode ser contornada carregando um backup do robô ou carregando os módulos de sistema. No entanto os fabricantes habitualmente não fornecem informação detalhada sobre as células de trabalho, o que dificulta o processo de implementação da unidade no modelo 3D para a programação offline. Após este estudo inicial, foi efectuado um estudo das características inerentes a cada uma das células existentes, com o objectivo de se obter uma melhor percepção de toda a envolvente relacionada com as tarefas de lixamento. Ao longo desse estudo efectuaram-se vários testes para validar os diversos programas desenvolvidos, bem como para testar a modelação 3D efectuada. O projecto propriamente dito consistiu no desenvolvimento de programas offline de forma a minimizar o impacto (em especial o tempo de paragem) da programação de novos produtos. Todo o trabalho de programação era até então feito utilizando o robô, o que implicava tempos de paragem que podiam ser superiores a três dias. Com o desenvolvimento dos programas em modo offline conseguiu-se reduzir esse tempo de paragem dos robôs para pouco mais de um turno (8h), existindo apenas a necessidade de efectuar algumas afinações e correcções nos movimentos de entrada, saída e movimentações entre rotinas e unidades, uma vez que estes movimentos são essenciais ao bom acabamento da peça e convém que seja suaves. Para a realização e conclusão deste projecto foram superadas diversas etapas, sendo que as mais relevantes foram: - A correcta modelação 3D da célula, tendo em conta todo o cenário envolvente, para evitar colisões do robô com a célula; - A adaptação da programação offline para uma linguagem mais usual aos afinadores, ou seja, efectuar a programação com targets inline e criar diferentes rotinas para cada uma das partes da peça, facilitando assim a afinação; - A habituação à programação recorrendo apenas ao uso de módulos para transferir os programas para a célula, bem como a utilização de entradas, saídas e algumas rotinas e funcionalidades já existentes.

Bisphenol A migration from plastic materials: direct insight of ecotoxicity in Daphnia magna

Bisphenol A (BPA) is an endocrine disrupting chemical (EDC) whose migration from food packaging is recognized worldwide. However, the real overall food contamination and related consequences are yet largely unknown. Among humans, children’s exposure to BPA has been emphasized because of the immaturity of their biological systems. The main aim of this study was to assess the reproductive impact of BPA leached from commercially available plastic containers used or related to child nutrition, performing ecotoxicological tests using the biomonitoring species Daphnia magna. Acute and chronic tests, as well as single and multigenerational tests were done. Migration of BPA from several baby bottles and other plastic containers evaluated by GC-MS indicated that a broader range of foodstuff may be contaminated when packed in plastics. Ecotoxicological test results performed using defined concentrations of BPA were in agreement with literature, although a precocious maturity of daphnids was detected at 3.0 mg/L. Curiously, an increased reproductive output (neonates per female) was observed when daphnids were bred in the polycarbonate (PC) containers (145.1±4.3 % to 264.7±3.8 %), both in single as in multigenerational tests, in comparison with the negative control group (100.3±1.6 %). A strong correlated dose-dependent ecotoxicological effect was observed, providing evidence that BPA leached from plastic food packaging materials act as functional estrogen in vivo at very low concentrations. In contrast, neonate production by daphnids cultured in polypropylene and non-PC bottles was slightly but not significantly enhanced (92.5±2.0 % to 118.8±1.8 %). Multigenerational tests also revealed magnification of the adverse effects, not only on fecundity but also on mortality, which represents a worrying trend for organisms that are chronically exposed to xenoestrogens for many generations. Two plausible explanations for the observed results could be given: a non-monotonic dose–response relationship or a mixture toxicity effect.

Geostatistical Prediction of Ocean Outfall Plume Characteristics Based on an Autonomous Underwater Vehicle

Geostatistics has been successfully used to analyze and characterize the spatial variability of environmental properties. Besides giving estimated values at unsampled locations, it provides a measure of the accuracy of the estimate, which is a significant advantage over traditional methods used to assess pollution. In this work universal block kriging is novelty used to model and map the spatial distribution of salinity measurements gathered by an Autonomous Underwater Vehicle in a sea outfall monitoring campaign, with the aim of distinguishing the effluent plume from the receiving waters, characterizing its spatial variability in the vicinity of the discharge and estimating dilution. The results demonstrate that geostatistical methodology can provide good estimates of the dispersion of effluents that are very valuable in assessing the environmental impact and managing sea outfalls. Moreover, since accurate measurements of the plume’s dilution are rare, these studies might be very helpful in the future to validate dispersion models.

Laxity dynamics and LLF schedulability analysis on multiprocessor platforms

LLF (Least Laxity First) scheduling, which assigns a higher priority to a task with a smaller laxity, has been known as an optimal preemptive scheduling algorithm on a single processor platform. However, little work has been made to illuminate its characteristics upon multiprocessor platforms. In this paper, we identify the dynamics of laxity from the system’s viewpoint and translate the dynamics into LLF multiprocessor schedulability analysis. More specifically, we first characterize laxity properties under LLF scheduling, focusing on laxity dynamics associated with a deadline miss. These laxity dynamics describe a lower bound, which leads to the deadline miss, on the number of tasks of certain laxity values at certain time instants. This lower bound is significant because it represents invariants for highly dynamic system parameters (laxity values). Since the laxity of a task is dependent of the amount of interference of higher-priority tasks, we can then derive a set of conditions to check whether a given task system can go into the laxity dynamics towards a deadline miss. This way, to the author’s best knowledge, we propose the first LLF multiprocessor schedulability test based on its own laxity properties. We also develop an improved schedulability test that exploits slack values. We mathematically prove that the proposed LLF tests dominate the state-of-the-art EDZL tests. We also present simulation results to evaluate schedulability performance of both the original and improved LLF tests in a quantitative manner.

Tools for simulation output analysis

This technical report presents a description of the output data files and the tools used to validate and to extract information from the output data files generated by the Repeater-Based Hybrid Wired/Wireless Network Simulator and the Bridge-Based Hybrid Wired/Wireless Network Simulator.

Building adaptable, QoS-aware dependable embedded systems

Most of today’s embedded systems are required to work in dynamic environments, where the characteristics of the computational load cannot always be predicted in advance. Furthermore, resource needs are usually data dependent and vary over time. Resource constrained devices may need to cooperate with neighbour nodes in order to fulfil those requirements and handle stringent non-functional constraints. This paper describes a framework that facilitates the distribution of resource intensive services across a community of nodes, forming temporary coalitions for a cooperative QoSaware execution. The increasing need to tailor provided service to each application’s specific needs determines the dynamic selection of peers to form such a coalition. The system is able to react to load variations, degrading its performance in a controlled fashion if needed. Isolation between different services is achieved by guaranteeing a minimal service quality to accepted services and by an efficient overload control that considers the challenges and opportunities of dynamic distributed embedded systems.