Intelligent decision making in electricity markets: simulated annealing Q-Learning

Electricity markets are complex environments, involving a large number of different entities, playing in a dynamic scene to obtain the best advantages and profits. MASCEM is a multi-agent electricity market simulator to model market players and simulate their operation in the market. Market players are entities with specific characteristics and objectives, making their decisions and interacting with other players. MASCEM is integrated with ALBidS, a system that provides several dynamic strategies for agents’ behavior. This paper presents a method that aims at enhancing ALBidS competence in endowing market players with adequate strategic bidding capabilities, allowing them to obtain the higher possible gains out of the market. This method uses a reinforcement learning algorithm to learn from experience how to choose the best from a set of possible actions. These actions are defined accordingly to the most probable points of bidding success. With the purpose of accelerating the convergence process, a simulated annealing based algorithm is included.

Cost dependent strategy for electricity markets bidding based on adaptive reinforcement learning

Electricity markets are complex environments, involving a large number of different entities, playing in a dynamic scene to obtain the best advantages and profits. MASCEM is a multi-agent electricity market simulator to model market players and simulate their operation in the market. Market players are entities with specific characteristics and objectives, making their decisions and interacting with other players. MASCEM provides several dynamic strategies for agents’ behavior. This paper presents a method that aims to provide market players with strategic bidding capabilities, allowing them to obtain the higher possible gains out of the market. This method uses a reinforcement learning algorithm to learn from experience how to choose the best from a set of possible bids. These bids are defined accordingly to the cost function that each producer presents.

A new approach for multi-agent coalition formation and management in the scope of electricity markets

This paper presents a new methodology for the creation and management of coalitions in Electricity Markets. This approach is tested using the multi-agent market simulator MASCEM, taking advantage of its ability to provide the means to model and simulate VPP (Virtual Power Producers). VPPs are represented as coalitions of agents, with the capability of negotiating both in the market, and internally, with their members, in order to combine and manage their individual specific characteristics and goals, with the strategy and objectives of the VPP itself. The new features include the development of particular individual facilitators to manage the communications amongst the members of each coalition independently from the rest of the simulation, and also the mechanisms for the classification of the agents that are candidates to join the coalition. In addition, a global study on the results of the Iberian Electricity Market is performed, to compare and analyze different approaches for defining consistent and adequate strategies to integrate into the agents of MASCEM. This, combined with the application of learning and prediction techniques provide the agents with the ability to learn and adapt themselves, by adjusting their actions to the continued evolving states of the world they are playing in.

Seller, buyer and VPP agents behavior on a simulated electricity market

Competitive electricity markets are complex environments, involving a large number of different entities, playing in a dynamic scene to obtain the best advantages and profits. MASCEM is an electricity market simulator able to model market players and simulate their operation in the market. As market players are complex entities, having their characteristics and objectives, making their decisions and interacting with other players, a multi-agent architecture is used and proved to be adequate. MASCEM players have learning capabilities and different risk preferences. They are able to refine their strategies according to their past experience (both real and simulated) and considering other agents’ behavior. Agents’ behavior is also subject to its risk preferences.

Work in progress - learning through role play games

It is commonly accepted that the educational environment has been undergoing considerable change due to the use of the Information and Communication tools. But learning depends upon actions such as experimenting, visualizing and demonstrating through which the learner succeeds in constructing his own knowledge. Although it is not easy to achieve these actions through current ICT supported learning approaches, Role Playing Games (RPG) may well develop such capacities. The creation of an interactive computer game with RPG characteristics, about the 500th anniversary of the city of Funchal, the capital of Madeira Island, is invested with compelling educational/pedagogical implications, aiming clearly at teaching history and social relations through playing. Players interpret different characters in different settings/scenarios, experiencing adventures, meeting challenges and trying to reach multiple and simultaneous goals in the areas of education, entertainment and social integration along the first 150 years of the history of Funchal. Through this process they will live and understand all the social and historical factors of that epoch.

Development of a platform for lean manufacturing simulation games

More than ever, the economic globalization is creating the need to increase business competitiveness. Lean manufacturing is a management philosophy oriented to the elimination of activities that do not create any type of value and are thus considered a waste. One of the main differences from other management philosophies is the shop-floor focus and the operators' involvement. Therefore, the training of all organization levels is crucial for the success of lean manufacturing. Universities should also participate actively in this process by developing students' lean management skills and promoting a better and faster integration of students into their future organizations. This paper proposes a single realistic manufacturing platform, involving production and assembly operations, to learn by playing many of the lean tools such as VSM, 5S, SMED, poke-yoke, line balance, TPM, Mizusumashi, plant layout, and JIT/kanban. This simulation game was built in tight cooperation with experienced lean companies under the international program “Lean Learning Academy,”http://www.leanlearningacademy.eu/ and its main aim is to make bachelor and master courses in applied sciences more attractive by integrating classic lectures with a simulated production environment that could result in more motivated students and higher study yields. The simulation game results show that our approach is efficient in providing a realistic platform for the effective learning of lean principles, tools, and mindset, which can be easily included in course classes of less than two hours.

Digital serious games and simulation games - comparison of two approaches to lean training

In an increasingly competitive and globalized world, companies need effective training methodologies and tools for their employees. However, selecting the most suitable ones is not an easy task. It depends on the requirements of the target group (namely time restrictions), on the specificities of the contents, etc. This is typically the case for training in Lean, the waste elimination manufacturing philosophy. This paper presents and compares two different approaches to lean training methodologies and tools: a simulation game based on a single realistic manufacturing platform, involving production and assembly operations that allows learning by playing; and a digital game that helps understand lean tools. This paper shows that both tools have advantages in terms of trainee motivation and knowledge acquisition. Furthermore, they can be used in a complementary way, reinforcing the acquired knowledge.

Adaptive learning in agents behaviour: A framework for electricity markets simulation

Electricity markets are complex environments, involving a large number of different entities, playing in a dynamic scene to obtain the best advantages and profits. MASCEM (Multi-Agent System for Competitive Electricity Markets) is a multi-agent electricity market simulator that models market players and simulates their operation in the market. Market players are entities with specific characteristics and objectives, making their decisions and interacting with other players. This paper presents a methodology to provide decision support to electricity market negotiating players. This model allows integrating different strategic approaches for electricity market negotiations, and choosing the most appropriate one at each time, for each different negotiation context. This methodology is integrated in ALBidS (Adaptive Learning strategic Bidding System) – a multiagent system that provides decision support to MASCEM's negotiating agents so that they can properly achieve their goals. ALBidS uses artificial intelligence methodologies and data analysis algorithms to provide effective adaptive learning capabilities to such negotiating entities. The main contribution is provided by a methodology that combines several distinct strategies to build actions proposals, so that the best can be chosen at each time, depending on the context and simulation circumstances. The choosing process includes reinforcement learning algorithms, a mechanism for negotiating contexts analysis, a mechanism for the management of the efficiency/effectiveness balance of the system, and a mechanism for competitor players' profiles definition.

Metalearner based on Dynamic Neural Network for Strategic Bidding in electricity Markets

The restructuring of electricity markets, conducted to increase the competition in this sector, and decrease the electricity prices, brought with it an enormous increase in the complexity of the considered mechanisms. The electricity market became a complex and unpredictable environment, involving a large number of different entities, playing in a dynamic scene to obtain the best advantages and profits. Software tools became, therefore, essential to provide simulation and decision support capabilities, in order to potentiate the involved players’ actions. This paper presents the development of a metalearner, applied to the decision support of electricity markets’ negotiation entities. The proposed metalearner executes a dynamic artificial neural network to create its own output, taking advantage on several learning algorithms implemented in ALBidS, an adaptive learning system that provides decision support to electricity markets’ players. The proposed metalearner considers different weights for each strategy, depending on its individual quality of performance. The results of the proposed method are studied and analyzed in scenarios based on real electricity markets’ data, using MASCEM - a multi-agent electricity market simulator that simulates market players’ operation in the market.

Sound levels and risk perceptions of music students during classes

It is well recognized that professional musicians are at risk of hearing damage due to the exposure to high sound pressure levels during music playing. However, it is important to recognize that the musicians’ exposure may start early in the course of their training as students in the classroom and at home. Studies regarding sound exposure of music students and their hearing disorders are scarce and do not take into account important influencing variables. Therefore, this study aimed to describe sound level exposures of music students at different music styles, classes, and according to the instrument played. Further, this investigation attempted to analyze the perceptions of students in relation to exposure to loud music and consequent health risks, as well as to characterize preventive behaviors. The results showed that music students are exposed to high sound levels in the course of their academic activity. This exposure is potentiated by practice outside the school and other external activities. Differences were found between music style, instruments, and classes. Tinnitus, hyperacusis, diplacusis, and sound distortion were reported by the students. However, students were not entirely aware of the health risks related to exposure to high sound pressure levels. These findings reflect the importance of starting intervention in relation to noise risk reduction at an early stage, when musicians are commencing their activity as students.

Myoglobin-biomimetic electroactive materials made by surface molecular imprinting on silica beads and their use as ionophores in polymeric membranes for potentiometric transduction

Myoglobin (Mb) is among the cardiac biomarkers playing a major role in urgent diagnosis of cardiovascular diseases. Its monitoring in point-of-care is therefore fundamental. Pursuing this goal, a novel biomimetic ionophore for the potentiometric transduction of Mb is presented. It was synthesized by surface molecular imprinting (SMI) with the purpose of developing highly efficient sensor layers for near-stereochemical recognition of Mb. The template (Mb) was imprinted on a silane surface that was covalently attached to silica beads by means of self-assembled monolayers. First the silica was modified with an external layer of aldehyde groups. Then, Mb was attached by reaction with its amine groups (on the external surface) and subsequent formation of imine bonds. The vacant places surrounding Mb were filled by polymerization of the silane monomers 3-aminopropyltrimethoxysilane (APTMS) and propyltrimethoxysilane (PTMS). Finally, the template was removed by imine cleavage after treatment with oxalic acid. The results materials were finely dispersed in plasticized PVC selective membranes and used as ionophores in potentiometric transduction. The best analytical features were found in HEPES buffer of pH 4. Under this condition, the limits of detection were of 1.3 × 10−6 mol/L for a linear response after 8.0 × 10−7 mol/L with an anionic slope of −65.9 mV/decade. The imprinting effect was tested by preparing non-imprinted (NI) particles and employing these materials as ionophores. The resulting membranes showed no ability to detect Mb. Good selectivity was observed towards creatinine, sacarose, fructose, galactose, sodium glutamate, and alanine. The analytical application was conducted successfully and showed accurate and precise results.

Aumentar as oportunidades de comunicação nos momentos de brincadeira - descrição de um programa de intervenção

Objetivo: Partindo da análise da literatura realizada, em que é salientada a ideia de que o desenvolvimento e aprendizagem ocorrem a partir das experiências e influência dos contextos em que as crianças estão incluídas e a partir das interações que estabelecem nesses mesmos contextos, pretende-se compreender, neste estudo, se partindo do contexto natural, com diferentes materiais e atores, é possível aumentar as oportunidades de comunicação e participação de uma criança com restrições ao nível da linguagem, nos momentos de jogo. Método: Foi delineado e implementado um programa de intervenção, num estabelecimento de ensino, na valência de pré-escolar, onde estiveram envolvidas uma criança de 4 anos com restrições ao nível da linguagem oral, o grupo de crianças em que estava incluída e a educadora do grupo. Para monitorização do programa e avaliação da sua eficácia realizou-se um pré e pós teste, onde foi definida a linha de base da criança. Ao longo do programa foram registados, a partir de uma grelha de observação da frequência dos atos comunicativos da criança, nas situações de jogo planificadas. Os comportamentos e modelagem realizada por parte educador, foram igualmente registados e analisados. Recorreu-se a realização de entrevistas semiestruturadas para a recolha de dados relativos à criança e perceção do educador. Resultados/Discussão: Os dados recolhidos demonstram um aumento significativo das tomadas de iniciativa verbal e alternância entre turnos, ao longo da intervenção por parte da criança alvo. A presença do adulto e dos pares parecem revelar-se como facilitador dos atos comunicativos da criança com restrições ao nível da linguagem

Intervenção centrada no brincar: um estudo de caso em criança institucionalizada

Dentro dos vários processos de Intervenção Precoce, elegemos o brincar, enquanto ato sempre presente na criança. Na revisão de literatura verifica-se uma quase inexistência de estudos de Intervenções centradas no jogo em crianças institucionalizadas desde os 0 anos. Assim, partimos de duas questões fulcrais: quais os riscos associados à institucionalização prolongada e precoce, e de que modo o jogo e o brincar potenciam o desenvolvimento e a aprendizagem da criança em risco biológico e sociocultural. O presente estudo tem como objetivo promover, através de um estudo de caso, a relação do lúdico com o desenvolvimento e a aprendizagem, imprescindíveis numa criança em situação de institucionalização. Partimos da problemática da institucionalização infantil, expondo os diversos trabalhos apresentados pela revisão bibliográfica relativamente aos riscos associados à condição de institucionalização. Os diversos estudos sublinham que, efetivamente, não será a única solução para as crianças em risco, apontando para a legislação atual que prevê o acolhimento familiar como solução viável e mais ajustada às necessidades das crianças. Apresentamos ainda a teoria do desenvolvimento de Vygotsky como fundamento teórico-prático deste trabalho de intervenção centrada no brincar.

Heróis de palmo e meio: a intervenção psicossocial e a relação de ajuda no acolhimento institucional

Os Lares de Infância e Juventude têm como objetivo defender o superior interesse das crianças, desempenhando um papel fundamental no acompanhamento do seu desenvolvimento. Este dever concretiza-se substancialmente na definição e acompanhamento dos seus projetos de vida. Neste sentido, as práticas dos profissionais devem ir ao encontro das reais necessidades dos seus atores, numa ação adequada, desenhada e concertada, tendo sempre como principio básico o respeito pelas idiossincrasias de cada criança e jovem. O presente Relatório tem como objetivo apresentar o desenho e desenvolvimento de um projeto de intervenção psicossocial e relação de ajuda com crianças em acolhimento institucional, intitulado “Heróis de Palmo e Meio. A intervenção psicossocial e a relação de ajuda no acolhimento institucional”. Este projeto teve como grande finalidade a “Participação das crianças e das suas famílias na construção dos seus projetos de vida com base na compreensão da institucionalização”. Priorizando as necessidades e respeitando o critério de urgência, foram desenhados dois subprojectos com duas crianças e suas famílias, tentando sempre responder às suas necessidades individuais. Foram definidos alguns objetivos gerais comuns, assim como objetivos específicos, estratégias e ações adequadas a cada um dos subprojectos. Os resultados deste projeto revelam-se significativos, já que permitiram, quer às crianças, quer às famílias, desenvolver um processo de reflexão e consciencialização em torno da sua história de vida, compreensão da sua realidade e participação ativa no projeto de vida dos filhos, o que veio facilitar o caminho inicial do processo da mudança.

Isoflavones in food supplements: chemical profile, label accordance and permeability study in Caco-2 cells

Consumers nowadays are playing an active role in their health-care. A special case is the increasing number of women, who are reluctant to use exogenous hormone therapy for the treatment of menopausal symptoms and are looking for complementary therapies. However, food supplements are not clearly regulated in Europe. The EFSA has only recently begun to address the issues of botanical safety and purity regulation, leading to a variability of content, standardization, dosage, and purity of available products. In this study, isoflavones (puerarin, daidzin, genistin, daidzein, glycitein, genistein, formononetin, prunetin, and biochanin A) from food supplements (n = 15) for menopausal symptoms relief are evaluated and compared with the labelled information. Only four supplements complied with the recommendations made by the EC on the tolerable thresholds. The intestinal bioavailability of these compounds was investigated using Caco-2 cells. The apparent permeability coefficients of the selected isoflavonoids across the Caco-2 cells were affected by the isoflavone concentration and product matrix.