Armazéns de dados em bases de dados NoSQL

Na atualidade, existe uma quantidade de dados criados diariamente que ultrapassam em muito as mais otimistas espectativas estabelecidas na década anterior. Estes dados têm origens bastante diversas e apresentam-se sobre várias formas. Este novo conceito que dá pelo nome de Big Data está a colocar novos e rebuscados desafios ao seu armazenamento, tratamento e manipulação. Os tradicionais sistemas de armazenamento não se apresentam como a solução indicada para este problema. Estes desafios são alguns dos mais analisados e dissertados temas informáticos do momento. Várias tecnologias têm emergido com esta nova era, das quais se salienta um novo paradigma de armazenamento, o movimento NoSQL. Esta nova filosofia de armazenamento visa responder às necessidades de armazenamento e processamento destes volumosos e heterogéneos dados. Os armazéns de dados são um dos componentes mais importantes do âmbito Business Intelligence e são, maioritariamente, utilizados como uma ferramenta de apoio aos processos de tomada decisão, levados a cabo no dia-a-dia de uma organização. A sua componente histórica implica que grandes volumes de dados sejam armazenados, tratados e analisados tendo por base os seus repositórios. Algumas organizações começam a ter problemas para gerir e armazenar estes grandes volumes de informação. Esse facto deve-se, em grande parte, à estrutura de armazenamento que lhes serve de base. Os sistemas de gestão de bases de dados relacionais são, há algumas décadas, considerados como o método primordial de armazenamento de informação num armazém de dados. De facto, estes sistemas começam a não se mostrar capazes de armazenar e gerir os dados operacionais das organizações, sendo consequentemente cada vez menos recomendada a sua utilização em armazéns de dados. É intrinsecamente interessante o pensamento de que as bases de dados relacionais começam a perder a luta contra o volume de dados, numa altura em que um novo paradigma de armazenamento surge, exatamente com o intuito de dominar o grande volume inerente aos dados Big Data. Ainda é mais interessante o pensamento de que, possivelmente, estes novos sistemas NoSQL podem trazer vantagens para o mundo dos armazéns de dados. Assim, neste trabalho de mestrado, irá ser estudada a viabilidade e as implicações da adoção de bases de dados NoSQL, no contexto de armazéns de dados, em comparação com a abordagem tradicional, implementada sobre sistemas relacionais. Para alcançar esta tarefa, vários estudos foram operados tendo por base o sistema relacional SQL Server 2014 e os sistemas NoSQL, MongoDB e Cassandra. Várias etapas do processo de desenho e implementação de um armazém de dados foram comparadas entre os três sistemas, sendo que três armazéns de dados distintos foram criados tendo por base cada um dos sistemas. Toda a investigação realizada neste trabalho culmina no confronto da performance de consultas, realizadas nos três sistemas.

A importância das consultoras no processo de internacionalização das micro, pequenas e médias empresas em Portugal

Relatório de Estágio Apresentado ao Instituto de Contabilidade e Administração do Porto para a obtenção do grau de Mestre em Empreendedorismo e Internacionalização, sob orientação da Mestre Inês Veiga Pereira

Resistência ao fogo de alvenarias sem função estrutural

Um incêndio é algo difícil de prever, assim como a sua consequência nos elementos de construção. Dessa forma, ao longo das últimas décadas, os elementos de construção têm sido alvo de diversos estudos a fim de avaliar os seus comportamentos quando solicitados em situação de incêndio. O International Building Code (IBC) descreve um método de cálculo analítico para a determinação da resistência ao fogo dos elementos da construção de acordo com os procedimentos de teste estabelecidos na ASTM E119 (Standard Test Methods for Fire Tests of Building Construction and Materials). Nesta dissertação foi feita uma análise desse método, que se mostrou inadequado para estimar a resistência ao fogo das alvenarias, sem função estrutural, de blocos cerâmicos e blocos de betão, uma vez que despreza qualquer efeito do ar no interior das mesmas. No seguimento desta análise, é apresentado um desenvolvimento do método descrito tendo em conta o efeito do ar. Depois de uma análise aos vários tipos de blocos cerâmicos e de betão com diferentes dimensões e geometrias foi possível obter uma relação entre a espessura equivalente de ar existente num bloco e a sua respectiva resistência ao fogo, de modo a serem obtidos os valores descritos na normalização existente. O efeito do ar mostrou ter uma maior influência na resistência ao fogo nas alvenarias constituídas por blocos cerâmicos de furação vertical, já que a sua geometria caracterizada por um elevado número de pequenos alvéolos contribui para o aumento do isolamento térmico, e consequentemente da sua resistência ao fogo. Nas alvenarias rebocadas os valores da resistência ao fogo aumentam cerca de 50%, quando revestidos com argamassa de cimento, e 70% quando revestidos com gesso, logo, o emprego de revestimentos representam uma boa alternativa para aumentar a resistência ao fogo.

Desenvolvimento de um método potenciométrico para deteção de salmonella typhimurium

A Salmonella é um microrganismo responsável por grande parte das doenças alimentares, podendo por em causa a saúde pública da área contaminada. Uma deteção rápida, eficiente e altamente sensível e extremamente importante, sendo um campo em franco desenvolvimento e alvo de variados e múltiplos estudos na comunidade cientifica atual. Foi desenvolvido um método potenciométrico para a deteção de Salmonellas, com elétrodos seletivos de iões, construídos em laboratório com pontas de micropipetas, fios de prata e sensores com composição otimizada. O elétrodo indicador escolhido foi um ESI seletivo a cadmio, para redução da probabilidade de interferências no método, devido a pouca abundancia do cadmio em amostras alimentares. Elétrodos seletivos a sódio, elétrodos de Ag/AgCl de simples e de dupla juncão foram também construídos e caracterizados para serem aplicados como elétrodos de referência. Adicionalmente otimizaram-se as condições operacionais para a analise potenciométrica, nomeadamente o elétrodo de referencia utilizado, condicionamento dos elétrodos, efeito do pH e volume da solução amostra. A capacidade de realizar leituras em volumes muito pequenos com limites de deteção na ordem dos micromolares por parte dos ESI de membrana polimérica, foi integrada num ensaio com um formato nao competitivo ELISA tipo sanduiche, utilizando um anticorpo primário ligado a nanopartículas de Fe@Au, permitindo a separação dos complexos anticorpo-antigénio formados dos restantes componentes em cada etapa do ensaio, pela simples aplicação de um campo magnético. O anticorpo secundário foi marcado com nanocristais de CdS, que são bastante estáveis e é fácil a transformação em Cd2+ livre, permitindo a leitura potenciométrica. Foram testadas várias concentrações de peroxido de hidrogénio e o efeito da luz para otimizar a dissolução de CdS. O método desenvolvido permitiu traçar curvas de calibração com soluções de Salmonellas incubadas em PBS (pH 4,4) em que o limite de deteção foi de 1100 CFU/mL e de 20 CFU/mL, utilizando volumes de amostra de 10 ƒÊL e 100 ƒÊL, respetivamente para o intervalo de linearidade de 10 a 108 CFU/mL. O método foi aplicado a uma amostra de leite bovino. A taxa de recuperação media obtida foi de 93,7% } 2,8 (media } desvio padrão), tendo em conta dois ensaios de recuperação efetuados (com duas replicas cada), utilizando um volume de amostra de 100 ƒÊL e concentrações de 100 e 1000 CFU/mL de Salmonella incubada.

Desenvolvimento de um procedimento de Numerical Site Calibration para um Parque Eólico usando Dinâmica de Fluidos Computacional

Esta dissertação descreve o desenvolvimento e avaliação de um procedimento de \Numerical Site Calibration" (NSC) para um Parque Eólico, situado a sul de Portugal, usando Dinâmica de Fluídos Computacional (CFD). O NSC encontra-se baseado no \Site Calibration" (SC), sendo este um método de medição padronizado pela Comissão Electrónica Internacional através da norma IEC 61400. Este método tem a finalidade de quantificar e reduzir os efeitos provocados pelo terreno e por possíveis obstáculos, na medição do desempenho energético das turbinas eólicas. Assim, no SC são realizadas medições em dois pontos, no mastro referência e no local da turbina (mastro temporário). No entanto, em Parques Eólicos já construídos, este método não é aplicável visto ser necessária a instalação de um mastro de medição no local da turbina e, por conseguinte, o procedimento adequado para estas circunstâncias é o NSC. O desenvolvimento deste método é feito por um código CFD, desenvolvido por uma equipa de investigação do Instituto Superior de Engenharia do Porto, designado de WINDIETM, usado extensivamente pela empresa Megajoule Inovação, Lda em aplicações de energia eólica em todo mundo. Este código é uma ferramenta para simulação de escoamentos tridimensionais em terrenos complexos. As simulações do escoamento são realizadas no regime transiente utilizando as equações de Navier-Stokes médias de Reynolds com aproximação de Bussinesq e o modelo de turbulência TKE 1.5. As condições fronteira são provenientes dos resultados de uma simulação realizada com Weather Research and Forecasting, WRF. Estas simulações dividem-se em dois grupos, um dos conjuntos de simulações utiliza o esquema convectivo Upwind e o outro utiliza o esquema convectivo de 4aordem. A análise deste método é realizada a partir da comparação dos dados obtidos nas simulações realizadas no código WINDIETM e a coleta de dados medidos durante o processo SC. Em suma, conclui-se que o WINDIETM e as suas configurações reproduzem bons resultados de calibração, ja que produzem erros globais na ordem de dois pontos percentuais em relação ao SC realizado para o mesmo local em estudo.

Electricity markets modeling considering complex contracts and aggregators

All over the world, the liberalization of electricity markets, which follows different paradigms, has created new challenges for those involved in this sector. In order to respond to these challenges, electric power systems suffered a significant restructuring in its mode of operation and planning. This restructuring resulted in a considerable increase of the electric sector competitiveness. Particularly, the Ancillary Services (AS) market has been target of constant renovations in its operation mode as it is a targeted market for the trading of services, which have as main objective to ensure the operation of electric power systems with appropriate levels of stability, safety, quality, equity and competitiveness. In this way, with the increasing penetration of distributed energy resources including distributed generation, demand response, storage units and electric vehicles, it is essential to develop new smarter and hierarchical methods of operation of electric power systems. As these resources are mostly connected to the distribution network, it is important to consider the introduction of this kind of resources in AS delivery in order to achieve greater reliability and cost efficiency of electrical power systems operation. The main contribution of this work is the design and development of mechanisms and methodologies of AS market and for energy and AS joint market, considering different management entities of transmission and distribution networks. Several models developed in this work consider the most common AS in the liberalized market environment: Regulation Down; Regulation Up; Spinning Reserve and Non-Spinning Reserve. The presented models consider different rules and ways of operation, such as the division of market by network areas, which allows the congestion management of interconnections between areas; or the ancillary service cascading process, which allows the replacement of AS of superior quality by lower quality of AS, ensuring a better economic performance of the market. A major contribution of this work is the development an innovative methodology of market clearing process to be used in the energy and AS joint market, able to ensure viable and feasible solutions in markets, where there are technical constraints in the transmission network involving its division into areas or regions. The proposed method is based on the determination of Bialek topological factors and considers the contribution of the dispatch for all services of increase of generation (energy, Regulation Up, Spinning and Non-Spinning reserves) in network congestion. The use of Bialek factors in each iteration of the proposed methodology allows limiting the bids in the market while ensuring that the solution is feasible in any context of system operation. Another important contribution of this work is the model of the contribution of distributed energy resources in the ancillary services. In this way, a Virtual Power Player (VPP) is considered in order to aggregate, manage and interact with distributed energy resources. The VPP manages all the agents aggregated, being able to supply AS to the system operator, with the main purpose of participation in electricity market. In order to ensure their participation in the AS, the VPP should have a set of contracts with the agents that include a set of diversified and adapted rules to each kind of distributed resource. All methodologies developed and implemented in this work have been integrated into the MASCEM simulator, which is a simulator based on a multi-agent system that allows to study complex operation of electricity markets. In this way, the developed methodologies allow the simulator to cover more operation contexts of the present and future of the electricity market. In this way, this dissertation offers a huge contribution to the AS market simulation, based on models and mechanisms currently used in several real markets, as well as the introduction of innovative methodologies of market clearing process on the energy and AS joint market. This dissertation presents five case studies; each one consists of multiple scenarios. The first case study illustrates the application of AS market simulation considering several bids of market players. The energy and ancillary services joint market simulation is exposed in the second case study. In the third case study it is developed a comparison between the simulation of the joint market methodology, in which the player bids to the ancillary services is considered by network areas and a reference methodology. The fourth case study presents the simulation of joint market methodology based on Bialek topological distribution factors applied to transmission network with 7 buses managed by a TSO. The last case study presents a joint market model simulation which considers the aggregation of small players to a VPP, as well as complex contracts related to these entities. The case study comprises a distribution network with 33 buses managed by VPP, which comprises several kinds of distributed resources, such as photovoltaic, CHP, fuel cells, wind turbines, biomass, small hydro, municipal solid waste, demand response, and storage units.

Disposable immunosensor using a simple method for oriented antibody immobilization for label-free real-time detection of an oxidative stress biomarker implicated in cancer diseases

This work proposes a novel approach for a suitable orientation of antibodies (Ab) on an immunosensing platform, applied here to the determination of 8-hydroxy-2′-deoxyguanosine (8OHdG), a biomarker of oxidative stress that has been associated to chronic diseases, such as cancer. The anti-8OHdG was bound to an amine modified gold support through its Fc region after activation of its carboxylic functions. Non-oriented approaches of Ab binding to the platform were tested in parallel, in order to show that the presented methodology favored Ab/Ag affinity and immunodetection of the antigen. The immunosensor design was evaluated by quartz-crystal microbalance with dissipation, atomic force microscopy, electrochemical impedance spectroscopy (EIS) and square-wave voltammetry. EIS was also a suitable technique to follow the analytical behavior of the device against 8OHdG. The affinity binding between 8OHdG and the antibody immobilized in the gold modified platform increased the charge transfer resistance across the electrochemical set-up. The observed behavior was linear from 0.02 to 7.0 ng/mL of 8OHdG concentrations. The interference from glucose, urea and creatinine was found negligible. An attempt of application to synthetic samples was also successfully conducted. Overall, the presented approach enabled the production of suitably oriented Abs over a gold platform by means of a much simpler process than other oriented-Ab binding approaches described in the literature, as far as we know, and was successful in terms of analytical features and sample application.

The effect of method, standard and sample components on the total antioxidant capacity of commercial waters assessed by optical conventional assays

The total antioxidant capacity (TAC) of 28 flavoured water samples was assessed by ferric reducing antioxidant potential (FRAP), oxygen radical absorbance capacity (ORAC), trolox equivalent antioxidant capacity (TEAC) and total reactive antioxidant potential (TRAP) methods. It was observed that flavoured waters had higher antioxidant activity than the corresponding natural ones. The observed differences were attributed to flavours, juice and vitamins. Generally, higher TAC contents were obtained on lemon waters and lower values on guava and raspberry flavoured waters. Lower and higher TACs were obtained by TRAP and ORAC method, respectively. Statistical analysis suggested that vitamins and flavours increased the antioxidant content of the commercial waters.

Optimizing potentiometric ionophore and electrode design for environmental on-site control of antibiotic drugs: Application to sulfamethoxazole

Potentiometric sensors are typically unable to carry out on-site monitoring of environmental drug contaminants because of their high limits of detection (LODs). Designing a novel ligand material for the target analyte and managing the composition of the internal reference solution have been the strategies employed here to produce for the first time a potentiometric-based direct reading method for an environmental drug contaminant. This concept has been applied to sulfamethoxazole (SMX), one of the many antibiotics used in aquaculture practices that may occur in environmental waters. The novel ligand has been produced by imprinting SMX on the surface of graphitic carbon nanostructures (CN) < 500 nm. The imprinted carbon nanostructures (ICN) were dispersed in plasticizer and entrapped in a PVC matrix that included (or not) a small amount of a lipophilic additive. The membrane composition was optimized on solid-contact electrodes, allowing near-Nernstian responses down to 5.2 μg/mL and detecting 1.6 μg/mL. The membranes offered good selectivity against most of the ionic compounds in environmental water. The best membrane cocktail was applied on the smaller end of a 1000 μL micropipette tip made of polypropylene. The tip was then filled with inner reference solution containing SMX and chlorate (as interfering compound). The corresponding concentrations were studied for 1 × 10−5 to 1 × 10−10 and 1 × 10−3 to 1 × 10−8 mol/L. The best condition allowed the detection of 5.92 ng/L (or 2.3 × 10−8 mol/L) SMX for a sub-Nernstian slope of −40.3 mV/decade from 5.0 × 10−8 to 2.4 × 10−5 mol/L.

Rapid automated method for on-site determination of sulfadiazine in fish farming: a stainless steel veterinary syringe coated with a selective membrane of PVC serving as a potentiometric detector in a flow-injection-analysis system

Sulfadiazine is an antibiotic of the sulfonamide group and is used as a veterinary drug in fish farming. Monitoring it in the tanks is fundamental to control the applied doses and avoid environmental dissemination. Pursuing this goal, we included a novel potentiometric design in a flow-injection assembly. The electrode body was a stainless steel needle veterinary syringe of 0.8-mm inner diameter. A selective membrane of PVC acted as a sensory surface. Its composition, the length of the electrode, and other flow variables were optimized. The best performance was obtained for sensors of 1.5-cm length and a membrane composition of 33% PVC, 66% onitrophenyloctyl ether, 1% ion exchanger, and a small amount of a cationic additive. It exhibited Nernstian slopes of 61.0 mV decade-1 down to 1.0×10-5 mol L-1, with a limit of detection of 3.1×10-6 mol L-1 in flowing media. All necessary pH/ionic strength adjustments were performed online by merging the sample plug with a buffer carrier of 4-(2-hydroxyethyl)-1-piperazineethanesulfonic acid, pH 4.9. The sensor exhibited the advantages of a fast response time (less than 15 s), long operational lifetime (60 days), and good selectivity for chloride, nitrite, acetate, tartrate, citrate, and ascorbate. The flow setup was successfully applied to the analysis of aquaculture waters. The analytical results were validated against those obtained with liquid chromatography–tandem mass spectrometry procedures. The sampling rate was about 84 samples per hour and recoveries ranged from 95.9 to 106.9%.

Local Fractional Variational Iteration Method for Local Fractional Poisson Equations in Two Independent Variables

The local fractional Poisson equations in two independent variables that appear in mathematical physics involving the local fractional derivatives are investigated in this paper. The approximate solutions with the nondifferentiable functions are obtained by using the local fractional variational iteration method.

Field experiments for marine casualty detection with autonomous surface vehicles

In this paper we present a set of field tests for detection of human in the water with an unmanned surface vehicle using infrared and color cameras. These experiments aimed to contribute in the development of victim target tracking and obstacle avoidance for unmanned surface vehicles operating in marine search and rescue missions. This research is integrated in the work conducted in the European FP7 research project Icarus aiming to develop robotic tools for large scale rescue operations. The tests consisted in the use of the ROAZ unmanned surface vehicle equipped with a precision GPS system for localization and both visible spectrum and IR cameras to detect the target. In the experimental setup, the test human target was deployed in the water wearing a life vest and a diver suit (thus having lower temperature signature in the body except hands and head) and was equipped with a GPS logger. Multiple target approaches were performed in order to test the system with different sun incidence relative angles. The experimental setup, detection method and preliminary results from the field trials performed in the summer of 2013 in Sesimbra, Portugal and in La Spezia, Italy are also presented in this work.

Calibration Method for Underwater Visual Ground-Truth System

This work presents an automatic calibration method for a vision based external underwater ground-truth positioning system. These systems are a relevant tool in benchmarking and assessing the quality of research in underwater robotics applications. A stereo vision system can in suitable environments such as test tanks or in clear water conditions provide accurate position with low cost and flexible operation. In this work we present a two step extrinsic camera parameter calibration procedure in order to reduce the setup time and provide accurate results. The proposed method uses a planar homography decomposition in order to determine the relative camera poses and the determination of vanishing points of detected lines in the image to obtain the global pose of the stereo rig in the reference frame. This method was applied to our external vision based ground-truth at the INESC TEC/Robotics test tank. Results are presented in comparison with an precise calibration performed using points obtained from an accurate 3D LIDAR modelling of the environment.

Formation Control Driven by Cooperative Object Tracking

In this paper we introduce a formation control loop that maximizes the performance of the cooperative perception of a tracked target by a team of mobile robots, while maintaining the team in formation, with a dynamically adjustable geometry which is a function of the quality of the target perception by the team. In the formation control loop, the controller module is a distributed non-linear model predictive controller and the estimator module fuses local estimates of the target state, obtained by a particle filter at each robot. The two modules and their integration are described in detail, including a real-time database associated to a wireless communication protocol that facilitates the exchange of state data while reducing collisions among team members. Simulation and real robot results for indoor and outdoor teams of different robots are presented. The results highlight how our method successfully enables a team of homogeneous robots to minimize the total uncertainty of the tracked target cooperative estimate while complying with performance criteria such as keeping a pre-set distance between the teammates and the target, avoiding collisions with teammates and/or surrounding obstacles.