An automatic tool to Extract, Transform and Load data from real electricity markets

The study of Electricity Markets operation has been gaining an increasing importance in the last years, as result of the new challenges that the restructuring produced. Currently, lots of information concerning Electricity Markets is available, as market operators provide, after a period of confidentiality, data regarding market proposals and transactions. These data can be used as source of knowledge, to define realistic scenarios, essential for understanding and forecast Electricity Markets behaviour. The development of tools able to extract, transform, store and dynamically update data, is of great importance to go a step further into the comprehension of Electricity Markets and the behaviour of the involved entities. In this paper we present an adaptable tool capable of downloading, parsing and storing data from market operators’ websites, assuring actualization and reliability of stored data.

Analysis of Consumption Data to Detect Commercial Losses Using Performance Evaluation Methods in a Smart Grid

Electric power networks, namely distribution networks, have been suffering several changes during the last years due to changes in the power systems operation, towards the implementation of smart grids. Several approaches to the operation of the resources have been introduced, as the case of demand response, making use of the new capabilities of the smart grids. In the initial levels of the smart grids implementation reduced amounts of data are generated, namely consumption data. The methodology proposed in the present paper makes use of demand response consumers’ performance evaluation methods to determine the expected consumption for a given consumer. Then, potential commercial losses are identified using monthly historic consumption data. Real consumption data is used in the case study to demonstrate the application of the proposed method.

Multi-scale vegetation classification using earth observation data of the Sundarban mangrove forest, Bangladesh.

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial Technologies.

Towards a unified European electricity market: The contribution of data-mining to support realistic simulation studies

Worldwide electricity markets have been evolving into regional and even continental scales. The aim at an efficient use of renewable based generation in places where it exceeds the local needs is one of the main reasons. A reference case of this evolution is the European Electricity Market, where countries are connected, and several regional markets were created, each one grouping several countries, and supporting transactions of huge amounts of electrical energy. The continuous transformations electricity markets have been experiencing over the years create the need to use simulation platforms to support operators, regulators, and involved players for understanding and dealing with this complex environment. This paper focuses on demonstrating the advantage that real electricity markets data has for the creation of realistic simulation scenarios, which allow the study of the impacts and implications that electricity markets transformations will bring to the participant countries. A case study using MASCEM (Multi-Agent System for Competitive Electricity Markets) is presented, with a scenario based on real data, simulating the European Electricity Market environment, and comparing its performance when using several different market mechanisms.

Data Mining Approach to support the Generation of Realistic Scenarios for Multi-Agent simulation of Electricity Markets

This paper presents the Realistic Scenarios Generator (RealScen), a tool that processes data from real electricity markets to generate realistic scenarios that enable the modeling of electricity market players’ characteristics and strategic behavior. The proposed tool provides significant advantages to the decision making process in an electricity market environment, especially when coupled with a multi-agent electricity markets simulator. The generation of realistic scenarios is performed using mechanisms for intelligent data analysis, which are based on artificial intelligence and data mining algorithms. These techniques allow the study of realistic scenarios, adapted to the existing markets, and improve the representation of market entities as software agents, enabling a detailed modeling of their profiles and strategies. This work contributes significantly to the understanding of the interactions between the entities acting in electricity markets by increasing the capability and realism of market simulations.

Improving discovery in the life sciences using semantic Web technologies and linked data: design principles for life sciences knowledge organization systems

Dissertation presented to obtain the Ph.D degree in Bioinformatics

Osteoporotic hip fractures: Bisphosphonates sales and observed turning point in trend. A population-based retrospective study

The aim is to examine the temporal trends of hip fracture incidence in Portugal by sex and age groups, and explore the relation with anti-osteoporotic medication. From the National Hospital Discharge Database, we selected from 1st January 2000 to 31st December 2008, 77,083 hospital admissions (77.4% women) caused by osteoporotic hip fractures (low energy, patients over 49 years-age), with diagnosis codes 820.x of ICD 9-CM. The 2001 Portuguese population was used as standard to calculate direct age-standardized incidence rates (ASIR) (100,000 inhabitants). Generalized additive and linear models were used to evaluate and quantify temporal trends of age specific rates (AR), by sex. We identified 2003 as a turning point in the trend of ASIR of hip fractures in women. After 2003, the ASIR in women decreased on average by 10.3 cases/100,000 inhabitants, 95% CI (− 15.7 to − 4.8), per 100,000 anti-osteoporotic medication packages sold. For women aged 65–69 and 75–79 we identified the same turning point. However, for women aged over 80, the year 2004 marked a change in the trend, from an increase to a decrease. Among the population aged 70–74 a linear decrease of incidence rate (95% CI) was observed in both sexes, higher for women: − 28.0% (− 36.2 to − 19.5) change vs − 18.8%, (− 32.6 to − 2.3). The abrupt turning point in the trend of ASIR of hip fractures in women is compatible with an intervention, such as a medication. The trends were different according to gender and age group, but compatible with the pattern of bisphosphonates sales.

Declarative approach to data extraction of web pages

Thesis submitted to Faculdade de Ciências e Tecnologia of the Universidade Nova de Lisboa, in partial fulfilment of the requirements for the degree of Master in Computer Science

Exploring distributed computing tools through data mining tasks

Harnessing idle PCs CPU cycles, storage space and other resources of networked computers to collaborative are mainly fixated on for all major grid computing research projects. Most of the university computers labs are occupied with the high puissant desktop PC nowadays. It is plausible to notice that most of the time machines are lying idle or wasting their computing power without utilizing in felicitous ways. However, for intricate quandaries and for analyzing astronomically immense amounts of data, sizably voluminous computational resources are required. For such quandaries, one may run the analysis algorithms in very puissant and expensive computers, which reduces the number of users that can afford such data analysis tasks. Instead of utilizing single expensive machines, distributed computing systems, offers the possibility of utilizing a set of much less expensive machines to do the same task. BOINC and Condor projects have been prosperously utilized for solving authentic scientific research works around the world at a low cost. In this work the main goal is to explore both distributed computing to implement, Condor and BOINC, and utilize their potency to harness the ideal PCs resources for the academic researchers to utilize in their research work. In this thesis, Data mining tasks have been performed in implementation of several machine learning algorithms on the distributed computing environment.

Paracoccidioidomycosis of the male genital tract. Report of eleven cases and a review of Brazilian literature

Eleven cases of involvement of the genital tract in paracoccidioidomycosis were collected in a retrospective study of the clinical records of 683 patients seen in Porto Alegre, Rio Grande do Sul, Brazil. These cases are herein summarily reported. Eighteen similar cases were gathered in review of the Brazilian literature. Obtained data are discussed.

Investigating habitat association of breeding birds using public domain satellite imagery and land cover data.

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial Technologies

Endemic Pemphigus foliaceus ("Fogo selvagem"): a series from the Northeastern region of the State of São Paulo, Brazil, 1973-1998

Endemic Pemphigus Foliaceus (EPF) is a bullous autoimmune skin disease whose incidence used to be high in the State of São Paulo (SP), Brazil, during the forties, but has declined thereafter. OBJECTIVES: to report a series of EPF patients from the northeastern region of SP. METHODS: a retrospective study concerning demographic and epidemiological data of patients seen from 1973 to 1998 was conducted at the University Hospital, Faculty of Medicine of Ribeirão Preto, SP. RESULTS: bullous disease was diagnosed in 340 patients, 245 with EPF (72.1%), 9.4 cases per year, 60.4% females, and 70.2% white, 7 to 82 year-old (29.4% in their teens); 46.9% lived in the rural zone. Concerning profession, housewives predominated among women (67.6%) and agricultural workers among men (40.2%). The time of disease was less than 1 year in 62.0% of cases, followed by 1 and 5 years (27%), and more than 5 years for the remaining patients (11%). 36.7% of patients were referred by the Direção Regional de Saúde (DIR) XVIII of Ribeirão Preto, with the largest number of cases being from Ribeirão Preto and Batatais: 33.3% and 23.3%, respectively; 22% from DIR XIII (Franca); 13.5% from DIR VII (Araraquara); 2.9% from DIR IX (Barretos); 4.1% from other DIRs of SP, and 20.8% from other States (16.7% from Minas Gerais). Thirteen (5.3%) patients reported occurrence of the disease in some relative, and 4 (1.6%) in neighbors. CONCLUSIONS: the present data characterize the northeastern region of the state of São Paulo as a remaining endemic focus of EPF.

Deteção e extinção de incêndio em Data Center

O presente trabalho enquadra-se na temática de segurança contra incêndio em edifícios e consiste num estudo de caso de projeto de deteção e extinção de incêndio num Data Center. Os objetivos deste trabalho resumem-se à realização de um estudo sobre o estado da arte da extinção e deteção automática de incêndio, ao desenvolvimento de uma ferramenta de software de apoio a projetos de extinção por agentes gasosos, como também à realização de um estudo e uma análise da proteção contra incêndios em Data Centers. Por último foi efetuado um estudo de caso. São abordados os conceitos de fogo e de incêndio, em que um estudo teórico à temática foi desenvolvido, descrevendo de que forma pode o fogo ser originado e respetivas consequências. Os regulamentos nacionais relativos à Segurança Contra Incêndios em Edifícios (SCIE) são igualmente abordados, com especial foco nos Sistemas Automáticos de Deteção de Incêndio (SADI) e nos Sistemas Automáticos de Extinção de Incêndio (SAEI), as normas nacionais e internacionais relativas a esta temática também são mencionadas. Pelo facto de serem muito relevantes para o desenvolvimento deste trabalho, os sistemas de deteção de incêndio são exaustivamente abordados, mencionando características de equipamentos de deteção, técnicas mais utilizadas como também quais os aspetos a ter em consideração no dimensionamento de um SADI. Quanto aos meios de extinção de incêndio foram mencionados quais os mais utilizados atualmente, as suas vantagens e a que tipo de fogo se aplicam, com especial destaque para os SAEI com utilização de gases inertes, em que foi descrito como deve ser dimensionado um sistema deste tipo. Foi também efetuada a caracterização dos Data Centers para que seja possível entender quais as suas funcionalidades, a importância da sua existência e os aspetos gerais de uma proteção contra incêndio nestas instalações. Por último, um estudo de caso foi desenvolvido, um SADI foi projetado juntamente com um SAEI que utiliza azoto como gás de extinção. As escolhas e os sistemas escolhidos foram devidamente justificados, tendo em conta os regulamentos e normas em vigor.

Protocolo de fisioterapia, com auxílio de biofeedback electromiográfico, em utentes com disfunções do ombro: efeitos na dor, funcionalidade e estabilidade dinâmica

RESUMO: Introdução: A dor e disfunções do movimento no complexo articular do ombro (CAO) são comuns e debilitantes. O uso de exercícios segundo os pressupostos de estabilidade dinâmica (ED), com auxílio de Biofeedback electromiográfico (BEMG) tem vindo a ser referido, como uma forma de aumentar a efectividade da intervenção nas disfunções do complexo articular do ombro (DCAO)Objectivo Principal: Estudar os efeitos de um protocolo de intervenção, com BEMG, cujas finalidades foram abolir a dor, aumentar a funcionalidade e a ED da omoplata, em utentes com DCAO. Objectivos secundários: Comparar os subgrupos e quanto às características, resultados, tempos de intervenção total e até atingir critérios de alta; Comparar os resultados nos momentos inicial e final. Métodos: Foi realizado um coorte clínico, longitudinal, retrospectivo, observacional, analítico. A amostra foi constituída por 82 sujeitos, divididos em dois subgrupos (n=53 SCSA e n=29 IGU). Os instrumentos de medida utilizados foram a EVA, o DASH, o SPADI e o BEMG. Foi seguido o protocolo de ED proposto por Santos e Matias (2007), de acordo com as 3 fases de intervenção por eles descritas, realizando uma sessão semanal, monitorizando exercícios que seguem estes princípios, com BEMG. Foram avaliadas as variáveis dor, postura, padrão de recrutamento, controlo motor, posição inicial da omoplata (PIO), amplitudes articulares (AA’s), força muscular (FM) e postura. Para analisar os dados, recorreu-se a estatística descritiva e inferencial. Resultados: A intervenção foi efectiva na abolição da dor no momento (0,43 para 0,00/10EVA no subgrupo SCSA e 0,66 para 0,00/10EVA no subgrupo IGU) na pior dor (5,47/10EVA para 0,06/10EVA no subgrupo SCSA e 5,28/10 para 0,14/10 no subgrupo IGU), no aumento da função (28,57 para 0,66/100DASH e 39,00 para 0,63/100SAPDI no subgrupo SCSA e 25,80 para 0,38/100DASH e 28,19 para 0,39/100 no subgrupo IGU) e no aumento da ED da omoplata com normalização do padrão de recrutamento, controlo motor, PIO dentro do espectro de normalidade e boa capacidade de controlar a sua posição, ao longo do movimento do membro superior (MS). A intervenção proporcionou, ainda a normalização das AA’s, FM e autocorrecção postural. O tempo médio de intervenção foi de 6,45semanas no subgrupo SCSA e 5,83sem no subgrupo IGU. Estes resultados são semelhantes comparativamente a estudos que utilizaram uma intervenção baseada nos mesmos princípios (Matias e Cruz, 2004; Cunha e Matias, 2006; Santos e Matias, 2007; Rodrigues e Matias, 2009). Conclusão: O protocolo de intervenção aplicado, com uso de exercícios baseados nos princípios da ED e uso de BEMG, permitiu o alcance dos objectivos, junto de utentes com DCAO (SCSA e IGU). Verificou-se que, independentemente da condição, os resultados foram idênticos em ambos subgrupos, não apresentando diferenças significativas entre as variáveis de medida final, o tempo total de intervenção e os tempos até atingir os critérios de alta, expecto para a Dor, sendo este superior no subgrupo SCSA.---------------------------------------- ABSTRACT:Introduction: Movement disorders and pain in the shoulder joint complex (SJC) are common and debilitating. The use of exercises under the premises of dynamic stability (DS), with the aid of electromyographic biofeedback (EMGBF) has been mentioned as a way to increase the effectiveness of the intervention in disorders of the shoulder joint complex (DSJC) Main Objective: To evaluate the results of an intervention protocol, with EMGBF whose aims were to abolish the pain, increase functionality and DS of the scapula in patients with DSJC. Objectives: To compare the subgroups and the characteristics, outcomes, and total intervention times to reach discharge criteria; to compare the results at the beginning and at the end. Methods: We conducted a clinical cohort, longitudinal, retrospective, observational analysis. The sample consisted of 82 subjects, divided into two subgroups (n = 53 shoulder impingement syndrome SIS n = 29 shoulder joint instability SJI). The measurement instruments used were the VAS, DASH, SPADI, and EMGBF. It was followed the DS protocol proposed by Santos and Matias (2007), according to the three phases of intervention, described by performing a weekly session, monitoring exercises that follow these principles, with EMGBF. The variables were pain, posture, recruitment pattern, motor control, the initial position of the scapula (IPS), range of motion (ROM), muscular strength (MS) and posture. To analyze the data, we used the descriptive and inferential statistics. Results: The intervention was effective in abolishing the pain at the time (0.43 to 0.00/10 VAS in the SIS subgroup and 0.66 to 0.00/10 VAS in the SJI subgroup) in worst pain (5.47 to 0,06/10 VAS in the SIS subgroup and 5.28/ to 0.14/10 VAS in the SJI subgroup), increasing the function (28,57 to 0,66/100 DASH and 39,00 to 0,63/100 SAPDI in the SIS subgroup and 25,80 to 0,38/100 DASH and 28,19 to 0,39/100 SPADI in the SJI subgroup) and the increase in DS of the scapula with normalization of the pattern recruitment, motor control, IPS within the spectrum of normalcy and good ability to control its position along the movement of the upper limb (UL). The intervention provided, although the normalization of ROM, MS and self-correcting posture. The average length of intervention was 6.45 weeks in the SIS subgroup and 5.83 in the IS subgroup. These results are comparable with similar studies that used an intervention based on the same principles (Matias e Cruz, 2004; Cunha e Matias, 2006; Santos e Matias, 2007; Rodrigues e Matias, 2009). Conclusion: The intervention protocol implemented with the use of exercises based on the principles of DS and the use of EMGBF was effective, allowing the accomplishment of goals, in patients with DSJC (SIS and SJI). It was found that, regardless of condition, the results were identical in both groups, showing no significant differences between the variables of the final measure, the total time of intervention and the times to reach discharge criteria, except for pain, which was higher in the SIS subgroup.