BUILDING EFFICIENT AND COST-EFFECTIVE CLOUD-BASED BIG DATA MANAGEMENT SYSTEMS

In today’s big data world, data is being produced in massive volumes, at great velocity and from a variety of different sources such as mobile devices, sensors, a plethora of small devices hooked to the internet (Internet of Things), social networks, communication networks and many others. Interactive querying and large-scale analytics are being increasingly used to derive value out of this big data. A large portion of this data is being stored and processed in the Cloud due the several advantages provided by the Cloud such as scalability, elasticity, availability, low cost of ownership and the overall economies of scale. There is thus, a growing need for large-scale cloud-based data management systems that can support real-time ingest, storage and processing of large volumes of heterogeneous data. However, in the pay-as-you-go Cloud environment, the cost of analytics can grow linearly with the time and resources required. Reducing the cost of data analytics in the Cloud thus remains a primary challenge. In my dissertation research, I have focused on building efficient and cost-effective cloud-based data management systems for different application domains that are predominant in cloud computing environments. In the first part of my dissertation, I address the problem of reducing the cost of transactional workloads on relational databases to support database-as-a-service in the Cloud. The primary challenges in supporting such workloads include choosing how to partition the data across a large number of machines, minimizing the number of distributed transactions, providing high data availability, and tolerating failures gracefully. I have designed, built and evaluated SWORD, an end-to-end scalable online transaction processing system, that utilizes workload-aware data placement and replication to minimize the number of distributed transactions that incorporates a suite of novel techniques to significantly reduce the overheads incurred both during the initial placement of data, and during query execution at runtime. In the second part of my dissertation, I focus on sampling-based progressive analytics as a means to reduce the cost of data analytics in the relational domain. Sampling has been traditionally used by data scientists to get progressive answers to complex analytical tasks over large volumes of data. Typically, this involves manually extracting samples of increasing data size (progressive samples) for exploratory querying. This provides the data scientists with user control, repeatable semantics, and result provenance. However, such solutions result in tedious workflows that preclude the reuse of work across samples. On the other hand, existing approximate query processing systems report early results, but do not offer the above benefits for complex ad-hoc queries. I propose a new progressive data-parallel computation framework, NOW!, that provides support for progressive analytics over big data. In particular, NOW! enables progressive relational (SQL) query support in the Cloud using unique progress semantics that allow efficient and deterministic query processing over samples providing meaningful early results and provenance to data scientists. NOW! enables the provision of early results using significantly fewer resources thereby enabling a substantial reduction in the cost incurred during such analytics. Finally, I propose NSCALE, a system for efficient and cost-effective complex analytics on large-scale graph-structured data in the Cloud. The system is based on the key observation that a wide range of complex analysis tasks over graph data require processing and reasoning about a large number of multi-hop neighborhoods or subgraphs in the graph; examples include ego network analysis, motif counting in biological networks, finding social circles in social networks, personalized recommendations, link prediction, etc. These tasks are not well served by existing vertex-centric graph processing frameworks whose computation and execution models limit the user program to directly access the state of a single vertex, resulting in high execution overheads. Further, the lack of support for extracting the relevant portions of the graph that are of interest to an analysis task and loading it onto distributed memory leads to poor scalability. NSCALE allows users to write programs at the level of neighborhoods or subgraphs rather than at the level of vertices, and to declaratively specify the subgraphs of interest. It enables the efficient distributed execution of these neighborhood-centric complex analysis tasks over largescale graphs, while minimizing resource consumption and communication cost, thereby substantially reducing the overall cost of graph data analytics in the Cloud. The results of our extensive experimental evaluation of these prototypes with several real-world data sets and applications validate the effectiveness of our techniques which provide orders-of-magnitude reductions in the overheads of distributed data querying and analysis in the Cloud.

Reasoning over knowledge-based generation of situations in context spaces to reduce food waste

With the ever-growing amount of connected sensors (IoT), making sense of sensed data becomes even more important. Pervasive computing is a key enabler for sustainable solutions, prominent examples are smart energy systems and decision support systems. A key feature of pervasive systems is situation awareness which allows a system to thoroughly understand its environment. It is based on external interpretation of data and thus relies on expert knowledge. Due to the distinct nature of situations in different domains and applications, the development of situation aware applications remains a complex process. This thesis is concerned with a general framework for situation awareness which simplifies the development of applications. It is based on the Situation Theory Ontology to provide a foundation for situation modelling which allows knowledge reuse. Concepts of the Situation Theory are mapped to the Context Space Theory which is used for situation reasoning. Situation Spaces in the Context Space are automatically generated with the defined knowledge. For the acquisition of sensor data, the IoT standards O-MI/O-DF are integrated into the framework. These allow a peer-to-peer data exchange between data publisher and the proposed framework and thus a platform independent subscription to sensed data. The framework is then applied for a use case to reduce food waste. The use case validates the applicability of the framework and furthermore serves as a showcase for a pervasive system contributing to the sustainability goals. Leading institutions, e.g. the United Nations, stress the need for a more resource efficient society and acknowledge the capability of ICT systems. The use case scenario is based on a smart neighbourhood in which the system recommends the most efficient use of food items through situation awareness to reduce food waste at consumption stage.

DYNAMIC MODEL BASED STATE ESTIMATION IN A HEAVY DUTY DIESEL AFTERTREATMENT SYSTEM FOR ONBOARD DIAGNOSTICS AND CONTROLS

Estimating un-measurable states is an important component for onboard diagnostics (OBD) and control strategy development in diesel exhaust aftertreatment systems. This research focuses on the development of an Extended Kalman Filter (EKF) based state estimator for two of the main components in a diesel engine aftertreatment system: the Diesel Oxidation Catalyst (DOC) and the Selective Catalytic Reduction (SCR) catalyst. One of the key areas of interest is the performance of these estimators when the catalyzed particulate filter (CPF) is being actively regenerated. In this study, model reduction techniques were developed and used to develop reduced order models from the 1D models used to simulate the DOC and SCR. As a result of order reduction, the number of states in the estimator is reduced from 12 to 1 per element for the DOC and 12 to 2 per element for the SCR. The reduced order models were simulated on the experimental data and compared to the high fidelity model and the experimental data. The results show that the effect of eliminating the heat transfer and mass transfer coefficients are not significant on the performance of the reduced order models. This is shown by an insignificant change in the kinetic parameters between the reduced order and 1D model for simulating the experimental data. An EKF based estimator to estimate the internal states of the DOC and SCR was developed. The DOC and SCR estimators were simulated on the experimental data to show that the estimator provides improved estimation of states compared to a reduced order model. The results showed that using the temperature measurement at the DOC outlet improved the estimates of the CO , NO , NO2 and HC concentrations from the DOC. The SCR estimator was used to evaluate the effect of NH3 and NOX sensors on state estimation quality. Three sensor combinations of NOX sensor only, NH3 sensor only and both NOX and NH3 sensors were evaluated. The NOX only configuration had the worst performance, the NH3 sensor only configuration was in the middle and both the NOX and NH3 sensor combination provided the best performance.

Site Specific Spin Dynamics In Bafe2as2: Tuning The Ground State By Orbital Differentiation.

The role of orbital differentiation on the emergence of superconductivity in the Fe-based superconductors remains an open question to the scientific community. In this investigation, we employ a suitable microscopic spin probe technique, namely Electron Spin Resonance (ESR), to investigate this issue on selected chemically substituted BaFe2As2 single crystals. As the spin-density wave (SDW) phase is suppressed, we observe a clear increase of the Fe 3d bands anisotropy along with their localization at the FeAs plane. Such an increase of the planar orbital content is interestingly independent of the chemical substitution responsible for suppressing the SDW phase. As a consequence, the magnetic fluctuations in combination with this particular symmetry of the Fe 3d bands are propitious ingredients for the emergence of superconductivity in this class of materials.

Equity Of Access To Pap Smears: Population-based Study In Campinas, São Paulo, Brazil.

To determine the prevalence of the Papanicolaou exam among women aged 20 to 59 years in the city of Campinas (state of São Paulo, Brazil) and to analyze associations between this test and affiliation to private health insurance plans as well as socioeconomic/demographic variables and health-related behavior. To do so, a population-based, cross-sectional study was carried out. Statistical analyses took the study design into account. Despite the significant socioeconomic differences between women with and without private health plans, no differences between these groups were found regarding having been submitted to the Papanicolaou test. In fact no differences were found as to socioeconomic and health variables analyzed. Among all variables analyzed, only marital status was significantly associated with having undergone the test. The Brazilian public health system accounted for 55.7% of the exams. The present findings indicate social equity in the city of Campinas regarding the preventive exam for cervical cancer in the age group studied.

Distribution Of Lutzomyia Longipalpis Chemotype Populations In São Paulo State, Brazil.

American visceral leishmaniasis (AVL) is an emerging disease in the state of São Paulo, Brazil. Its geographical expansion and the increase in the number of human cases has been linked to dispersion of Lutzomyia longipalpis into urban areas. To produce more accurate risk maps we investigated the geographic distribution and routes of expansion of the disease as well as chemotype populations of the vector. A database, containing the annual records of municipalities which had notified human and canine AVL cases as well as the presence of the vector, was compiled. The chemotypes of L. longipalpis populations from municipalities in different regions of São Paulo State were determined by Coupled Gas Chromatography - Mass Spectrometry. From 1997 to June 2014, L. longipalpis has been reported in 166 municipalities, 148 of them in the Western region. A total of 106 municipalities were identified with transmission and 99 were located in the Western region, where all 2,204 autochthonous human cases occurred. Both the vector and the occurrence of human cases have expanded in a South-easterly direction, from the Western to central region, and from there, a further expansion to the North and the South. The (S)-9-methylgermacrene-B population of L. longipalpis is widely distributed in the Western region and the cembrene-1 population is restricted to the Eastern region. The maps in the present study show that there are two distinct epidemiological patterns of AVL in São Paulo State and that the expansion of human and canine AVL cases through the Western region has followed the same dispersion route of only one of the two species of the L. longipalpis complex, (S)-9-methylgermacrene-B. Entomological vigilance based on the routes of dispersion and identification of the chemotype population could be used to identify at-risk areas and consequently define the priorities for control measures.

Oral health conditions among the elderly in Southeastern São Paulo State

OBJECTIVE: This study aimed to asses oral health conditions in a population aged 60 years and over living in Botucatu, Southeastern Brazil. A cross-sectional population-based study was carried out using a random sample (N=372) of the urban population aged 60 years and over from the city of Botucatu, in 2005. World Health Organization criteria and codes for oral health epidemiological surveys were used. Re-examination was carried out in 10% of individuals aiming to evaluate intra-examiner agreement. Statistical analysis was performed by one-way ANOVA or Kruskal-Wallis ANOVA, as applicable. Also, the t-test was used in the absence of homoscedasticity. Fisher's exact test was used for situations where the categories with less than five units were observed. Adjusted residuals and multiple-comparison analysis were conducted to identify associations between variable categories and subgroups. The intra-examiner agreement was 98% and Kappa statistics result was 0.95. Loss component represented 90.68% of DMF-T index, which was 29.85. The prevalence of edentulism was 63.17%. Upper and lower dentures were found in 80% and 58% respectively, with complete denture as the most commonly used. In those studied, 15% required upper and 38% lower dentures. There was more need for complete denture in both jaws. Approximately 20% had soft tissue alterations. For periodontal conditions, most sextants were excluded (81.81%). Periodontal pockets (4 - 5 mm) were seen in 11.29% of the examined individuals. The oral health status of the elderly population in Botucatu is poor, as well as in other Brazilian cities. The results of this study may help planning collective health actions, giving an accurate description of the oral problems among the elderly.

Avaliação da memória de trabalho em crianças com transtorno do déficit de atenção e hiperatividade

Esse projeto investigou as habilidades cognitivas da Memória de Trabalho de crianças e adolescentes com o “Transtorno do Déficit de Atenção e Hiperatividade” (TDAH). Foi aplicado teste TIHC - Teste Infantil de Habilidades Cognitivas informatizado, avaliando principalmente cinco habilidades cognitivas Raciocínio Indutivas (RI), Memória de Armazenamento Auditiva (MAA) e Visual e Memória de Trabalho Auditiva (MTA) e Visual (MTV) usando o modelo de Cattell-Horn-Carroll. O teste foi aplicado em 62 sujeitos sendo 32 com TDAH do Hospital das Clínicas-SEPIA-USP e 30 sujeitos controle “normal” do Ensino Fundamental da rede municipal de 1ª à 8ª séries com idades entre 7 e 15 anos, de ambos os sexos. As análises executadas indicaram a existência de diferenças em diversos aspectos relacionados à memória nos tipos peculiares de crianças com TDAH. Verificou-se que as crianças com TDAH obtiveram bom desempenho nas provas de memória visual em detrimento as provas de memória auditiva. A correlação dos resultados do TIHC verificara que o tempo de reação da prova de memória de armazenamento visual manteve uma correlação significativa com a prova de cálculo.

Ichthyoplankton distribution and abundance in the northern Todos os Santos and Camamu Bays, Bahia State - Brazil

The occurrence, distribution and abundance of ichthyoplankton in Todos os Santos and Camamu Bays were analyzed based on four samplings (winter 2003, summer 2003, winter 2004 and summer 2005). Samples were obtained by surface horizontal hauls, using a 200-µm mesh conical-cylinder plankton net. The distribution and abundance of eggs indicate a remarkable seasonal and annual variation of spawning activity in the region, especially when the two summer campaigns are compared. In summer 2003 the highest quantitative values were recorded, especially for Camamu, where the maximum reached 106.56 eggs.m-3, with an overall average of 43.46 eggs.m-3 for the two areas. In summer 2005 values were relatively low, the overall average being 3.49 eggs.m-3. The larval taxonomic composition is characterized by the predominance of gobiids, with small variation from summer to winter. Considering all the campaigns and samplings undertaken in both areas, larvae of 11 families were identified: Engraulidae, Clupeidae, Mugilidae, Atherinopsidae, Hemiramphidae, Syngnathidae, Blenniidae, Carangidae, Gobiidae, Achiridae and Tetraodontidae.

Headland-bay beach planform stability of Santa Catarina State and of the Northern Coast of São Paulo State

This paper presents the results of the planform stability classification for the headland-bay beaches of the State of Santa Catarina and of the Northern Coast of São Paulo, based on the application of the Parabolic Bay-Shape Equation (PBSE) to aerial images of the beaches, using the software MEPBAY®. For this purpose, georeferenced mosaics of the QuickBird2® satellite imagery (for the State of Santa Catarina) and vertical aerial photographs (for the northern coast of São Paulo State) were used. Headland-bay beach planform stability can be classified as: (1) in static equilibrium, (2) in dynamic equilibrium, (3) unstable or (4) in a state of natural beach reshaping. Static equilibrium beaches are the most frequent along the coast of the State of Santa Catarina and the Northern Shore of São Paulo, notably along the most rugged sectors of the coast and those with experiencing lower fluvial discharge. By comparison, dynamic equilibrium beaches occur primarily on the less rugged sectors of the coast and along regions with higher fluvial discharge. Beaches in a state of natural beach reshaping have only been found in SC, associated with stabilized estuarine inlets or port breakwaters. However, it is not possible to classify any of these beaches as unstable because only one set of images was used. No clear relation was observed between a beach's planform stability and other classification factors, such as morphodynamics or orientation.

Brazilian offshore wave climate based on NWW3 reanalysis

This paper provides a description of the wave climate off the Brazilian coast based on an eleven-year time series (Jan/1997-Dec/2007) obtained from the NWW3 operational model hindcast reanalysis. Information about wave climate in Brazilian waters is very scarce and mainly based on occasional short-term observations, the present analysis being the first covering such temporal and spatial scales. To define the wave climate, six sectors were defined and analyzed along the Brazilian shelf-break: South (W1), Southeast (W2), Central (W3), East (W4), Northeast (W5) and North (W6). W1, W2 and W3 wave regimes are determined by the South Atlantic High (SAH) and the passage of synoptic cold fronts; W4, W5 and W6 are controlled by the Intertropical Convergence Zone (ITCZ) and its meridional oscillation. The most energetic waves are from the S, generated by the strong winds associated to the passage of cold fronts, which mainly affect the southern region. Wave power presents a decrease in energy levels from south to north, with its annual variation showing that the winter months are the most energetic in W1 to W4, while in W5 and W6 the most energetic conditions occur during the austral summer. The information presented here provides boundary conditions for studies related to coastal processes, fundamental for a better understanding of the Brazilian coastal zone.

The ichthyofauna of upper rio Capivari: defining conservation strategies based on the composition and distribution of fish species

Although the rio Capivari basin is recognized as an area of great importance for the ichthyofauna, it lacks virtually every basic requirement for the definition of appropriate conservation strategies, since not even its species composition is known. The objective of this work is to determine the composition and distribution of fish species in the upper rio Capivari basin, relating them to the local physical features, and to evaluate the effectiveness of proposed conservations units, delimited based on areas of native vegetation remains, on the conservation of local ichthyofauna. During 2007, 50 different watercourses were sampled with gillnets, cast nets and kick nets. A total of 1308 individuals belonging to 41 species were captured. Degree of conservation, altitude and width were the parameters that best explained fish species richness. Considering the recently proposed boundaries for potential conservation units in the region only 15 or 20 out of 41 species would be found in the State Park and Environmental Protection Area respectively. In practice, the proposed conservation units would not be effective tools for fish conservation, since it would be located in mountainous areas of high altitude, of headwaters streams and where few species are found. In such context, the conservation of specific stretches of larger rivers is critical.

Navicordulia aemulatrix sp. nov. (Odonata, Corduliidae) from northeastern Santa Catarina State, Brazil

Navicordulia aemulatrix sp. nov. (holotype male deposited in MZSP: Brazil, Santa Catarina State, [São Bento do Sul municipality, 26°14'58"S, 49°22'59"W], [railroad station] Rio Vermelho, II.1952) is described and illustrated based on three males. The long cercus (2.9-3.2 mm) places this species in the longistyla-group together with N. kiautai, N. longistyla and N. nitens but it differs from them mainly by the shape of cercus, with carinated part occupying 0.33 of cercus total length, and also by dorsal, ventro-medial and ventro-lateral tubercles developed. An unusual process on tergal portion of prothorax is reported for the first time in Navicordulia. The rate of description of new species of South American 'Corduliidae' is discussed. A map with records of Atlantic Forest Navicordulia species and a list of Brazilian corduliids by state are also presented.