An automatic tool to Extract, Transform and Load data from real electricity markets

The study of Electricity Markets operation has been gaining an increasing importance in the last years, as result of the new challenges that the restructuring produced. Currently, lots of information concerning Electricity Markets is available, as market operators provide, after a period of confidentiality, data regarding market proposals and transactions. These data can be used as source of knowledge, to define realistic scenarios, essential for understanding and forecast Electricity Markets behaviour. The development of tools able to extract, transform, store and dynamically update data, is of great importance to go a step further into the comprehension of Electricity Markets and the behaviour of the involved entities. In this paper we present an adaptable tool capable of downloading, parsing and storing data from market operators’ websites, assuring actualization and reliability of stored data.

Analysis of Consumption Data to Detect Commercial Losses Using Performance Evaluation Methods in a Smart Grid

Electric power networks, namely distribution networks, have been suffering several changes during the last years due to changes in the power systems operation, towards the implementation of smart grids. Several approaches to the operation of the resources have been introduced, as the case of demand response, making use of the new capabilities of the smart grids. In the initial levels of the smart grids implementation reduced amounts of data are generated, namely consumption data. The methodology proposed in the present paper makes use of demand response consumers’ performance evaluation methods to determine the expected consumption for a given consumer. Then, potential commercial losses are identified using monthly historic consumption data. Real consumption data is used in the case study to demonstrate the application of the proposed method.

Multi-scale vegetation classification using earth observation data of the Sundarban mangrove forest, Bangladesh.

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial Technologies.

Towards a unified European electricity market: The contribution of data-mining to support realistic simulation studies

Worldwide electricity markets have been evolving into regional and even continental scales. The aim at an efficient use of renewable based generation in places where it exceeds the local needs is one of the main reasons. A reference case of this evolution is the European Electricity Market, where countries are connected, and several regional markets were created, each one grouping several countries, and supporting transactions of huge amounts of electrical energy. The continuous transformations electricity markets have been experiencing over the years create the need to use simulation platforms to support operators, regulators, and involved players for understanding and dealing with this complex environment. This paper focuses on demonstrating the advantage that real electricity markets data has for the creation of realistic simulation scenarios, which allow the study of the impacts and implications that electricity markets transformations will bring to the participant countries. A case study using MASCEM (Multi-Agent System for Competitive Electricity Markets) is presented, with a scenario based on real data, simulating the European Electricity Market environment, and comparing its performance when using several different market mechanisms.

Data Mining Approach to support the Generation of Realistic Scenarios for Multi-Agent simulation of Electricity Markets

This paper presents the Realistic Scenarios Generator (RealScen), a tool that processes data from real electricity markets to generate realistic scenarios that enable the modeling of electricity market players’ characteristics and strategic behavior. The proposed tool provides significant advantages to the decision making process in an electricity market environment, especially when coupled with a multi-agent electricity markets simulator. The generation of realistic scenarios is performed using mechanisms for intelligent data analysis, which are based on artificial intelligence and data mining algorithms. These techniques allow the study of realistic scenarios, adapted to the existing markets, and improve the representation of market entities as software agents, enabling a detailed modeling of their profiles and strategies. This work contributes significantly to the understanding of the interactions between the entities acting in electricity markets by increasing the capability and realism of market simulations.

Aplicação de um modelo de programação linear inteira mista (PLIM) na expansão da rede de distribuição de energia elétrica em Angola

Em Angola, apenas cerca de 30% da população tem acesso à energia elétrica, nível que decresce para valores inferiores a 10% em zonas rurais mais remotas. Este problema é agravado pelo facto de, na maioria dos casos, as infraestruturas existentes se encontrarem danificadas ou não acompanharem o desenvolvimento da região. Em particular na capital angolana, Luanda que, sendo a menor província de Angola, é a que regista atualmente a maior densidade populacional. Com uma população de cerca de 5 milhões de habitantes, não só há frequentemente problemas relacionados com a falha do fornecimento de energia elétrica como há ainda uma percentagem considerável de municípios onde a rede elétrica ainda nem sequer chegou. O governo de Angola, no seu esforço de crescimento e aproveitamento das suas enormes potencialidades, definiu o setor energético como um dos fatores críticos para o desenvolvimento sustentável do país, tendo assumido que este é um dos eixos prioritários até 2016. Existem objetivos claros quanto à reabilitação e expansão das infraestruturas do setor elétrico, aumentando a capacidade instalada do país e criando uma rede nacional adequada, com o intuito não só de melhorar a qualidade e fiabilidade da rede já existente como de a aumentar. Este trabalho de dissertação consistiu no levantamento de dados reais relativamente à rede de distribuição de energia elétrica de Luanda, na análise e planeamento do que é mais premente fazer relativamente à sua expansão, na escolha dos locais onde é viável localizar novas subestações, na modelação adequada do problema real e na proposta de uma solução ótima para a expansão da rede existente. Depois de analisados diferentes modelos matemáticos aplicados ao problema de expansão de redes de distribuição de energia elétrica encontrados na literatura, optou-se por um modelo de programação linear inteira mista (PLIM) que se mostrou adequado. Desenvolvido o modelo do problema, o mesmo foi resolvido por recurso a software de otimização Analytic Solver e CPLEX. Como forma de validação dos resultados obtidos, foi implementada a solução de rede no simulador PowerWorld 8.0 OPF, software este que permite a simulação da operação do sistema de trânsito de potências.

Improving discovery in the life sciences using semantic Web technologies and linked data: design principles for life sciences knowledge organization systems

Dissertation presented to obtain the Ph.D degree in Bioinformatics

O imperativo das tecnologias do estado. Estratégias de e-government para empresas em Portugal

Dissertação apresentada para cumprimento dos requisitos necessários à obtenção do grau de Mestre em Ciência Política e Relações Internacionais, área de especialização em Ciência Política

Declarative approach to data extraction of web pages

Thesis submitted to Faculdade de Ciências e Tecnologia of the Universidade Nova de Lisboa, in partial fulfilment of the requirements for the degree of Master in Computer Science

The impact of pharmaceutical policy measures: a structural-break approach

Pharmaceutical spending in many other countries has had a steep increase in the last decade. The Portuguese Government has adopted several measures to reduce pharmaceutical expenditure growth, ranging from increased co-payments to price decreases determined administratively. Promotion of generic consumption has also ranked high in political priorities. We assess the overall impact of the several policy measures on total pharmaceutical spending, using monthly data over the period January 1995 – August 2008. Endogenous structural breaks (time-series) methods were employed. Our findings suggest that policy measures aimed at controlling pharmaceutical expenditure have been, in general, unsuccessful. Two breaks were identified. Both coincide with administratively determined price decreases. Measures aimed at increasing competition in the market had no visible effect on the dynamics of Government spending in pharmaceutical products. In particular, the introduction of reference pricing had only a transitory effect of less than one year, with historical growth resuming quickly. The consequence of it is a transfer of financial burden from the Government to the patients, with no apparent effect on the dynamics of pharmaceutical spending. This strongly suggests that pharmaceutical companies have been able to adjust to policy measures, in order to sustain their sales. It remains a challenge for the future to identify firms’ strategies that supported continued growth of sales, despite the several policy measures adop

Política fiscal e crescimento económico

Os recentes desenvolvimentos da teoria do crescimento económico sugerem que a política fiscal pode ter efeitos importantes no crescimento económico de longo prazo. O objectivo deste artigo é investigar o impacto da política fiscal no crescimento económico de longo prazo, utilizando dados em painel para os Estados-membros da UE15 (com excepção de Luxemburgo), no período 1965-2000. Partindo do enquadramento teórico de Barro (1990), formula-se um modelo onde a taxa de crescimento real é determinada por variáveis das finanças públicas, esperando que a redução de impostos distorcionários e o aumento de despesas públicas produtivas fomentem o crescimento económico. No caso da UE15, os resultados sugerem que o aumento da dimensão do sector público (despesas ou impostos) retarda o crescimento e, em particular, uma redução dos impostos sobre o trabalho e o capital podem acelerar o crescimento económico de longo prazo.

Exploring distributed computing tools through data mining tasks

Harnessing idle PCs CPU cycles, storage space and other resources of networked computers to collaborative are mainly fixated on for all major grid computing research projects. Most of the university computers labs are occupied with the high puissant desktop PC nowadays. It is plausible to notice that most of the time machines are lying idle or wasting their computing power without utilizing in felicitous ways. However, for intricate quandaries and for analyzing astronomically immense amounts of data, sizably voluminous computational resources are required. For such quandaries, one may run the analysis algorithms in very puissant and expensive computers, which reduces the number of users that can afford such data analysis tasks. Instead of utilizing single expensive machines, distributed computing systems, offers the possibility of utilizing a set of much less expensive machines to do the same task. BOINC and Condor projects have been prosperously utilized for solving authentic scientific research works around the world at a low cost. In this work the main goal is to explore both distributed computing to implement, Condor and BOINC, and utilize their potency to harness the ideal PCs resources for the academic researchers to utilize in their research work. In this thesis, Data mining tasks have been performed in implementation of several machine learning algorithms on the distributed computing environment.

Prevalence of Trypanosoma cruzi and Leishmania chagasi infection and risk factors in a Colombian indigenous population

This study was carried out in order to obtain base-line data concerning the epidemiology of American Visceral Leishmaniasis and Chagas’ Disease in an indigenous population with whom the government is starting a dwelling improvement programme. Information was collected from 242 dwellings (1,440 people), by means of house to house interviews about socio-economic and environmental factors associated with Leishmania chagasi and Trypanosoma cruzi transmission risk. A leishmanin skin test was applied to 385 people and 454 blood samples were collected on filter paper in order to detect L. chagasi antibodies by ELISA and IFAT and T. cruzi antibodies by ELISA. T. cruzi seroprevalence was 8.7% by ELISA, L. chagasi was 4.6% and 5.1% by IFAT and ELISA, respectively. ELISA sensitivity and specificity for L. chagasi antibodies were 57% and 97.5% respectively, as compared to the IFAT. Leishmanin skin test positivity was 19%. L. chagasi infection prevalence, being defined as a positive result in the three-immunodiagnostic tests, was 17.1%. Additionally, 2.7% of the population studied was positive to both L. chagasi and T. cruzi, showing a possible cross-reaction. L. chagasi and T. cruzi seropositivity increased with age, while no association with gender was observed. Age (p<0.007), number of inhabitants (p<0.05), floor material (p<0.03) and recognition of vector (p<0.01) were associated with T. cruzi infection, whilst age ( p<0.007) and dwelling improvement (p<0.02) were associated with L. chagasi infection. It is necessary to evaluate the long-term impact of the dwelling improvement programme on these parasitic infections in this community.

Investigating habitat association of breeding birds using public domain satellite imagery and land cover data.

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial Technologies