Fuzzy Modeling and Control Based Virtual Machine Resource Management

Virtual machines (VMs) are powerful platforms for building agile datacenters and emerging cloud systems. However, resource management for a VM-based system is still a challenging task. First, the complexity of application workloads as well as the interference among competing workloads makes it difficult to understand their VMs’ resource demands for meeting their Quality of Service (QoS) targets; Second, the dynamics in the applications and system makes it also difficult to maintain the desired QoS target while the environment changes; Third, the transparency of virtualization presents a hurdle for guest-layer application and host-layer VM scheduler to cooperate and improve application QoS and system efficiency. This dissertation proposes to address the above challenges through fuzzy modeling and control theory based VM resource management. First, a fuzzy-logic-based nonlinear modeling approach is proposed to accurately capture a VM’s complex demands of multiple types of resources automatically online based on the observed workload and resource usages. Second, to enable fast adaption for resource management, the fuzzy modeling approach is integrated with a predictive-control-based controller to form a new Fuzzy Modeling Predictive Control (FMPC) approach which can quickly track the applications’ QoS targets and optimize the resource allocations under dynamic changes in the system. Finally, to address the limitations of black-box-based resource management solutions, a cross-layer optimization approach is proposed to enable cooperation between a VM’s host and guest layers and further improve the application QoS and resource usage efficiency. The above proposed approaches are prototyped and evaluated on a Xen-based virtualized system and evaluated with representative benchmarks including TPC-H, RUBiS, and TerraFly. The results demonstrate that the fuzzy-modeling-based approach improves the accuracy in resource prediction by up to 31.4% compared to conventional regression approaches. The FMPC approach substantially outperforms the traditional linear-model-based predictive control approach in meeting application QoS targets for an oversubscribed system. It is able to manage dynamic VM resource allocations and migrations for over 100 concurrent VMs across multiple hosts with good efficiency. Finally, the cross-layer optimization approach further improves the performance of a virtualized application by up to 40% when the resources are contended by dynamic workloads.

Synthesis and Properties of a Series of 1,1,n,n-Tetramethyl[n](2,11)teropyrenophanes

The work described in this thesis revolves around the 1,1,n,ntetramethyl[n](2,11)teropyrenophanes, which are a series of [n]cyclophanes with a severely bent, board-shaped polynuclear aromatic hydrocarbons (PAH). The thesis is divided into seven Chapters. The first Chapter conatins an overview of the seminal work on [n]cyclophanes of the first two members of the “capped rylene” series of PAHs: benzene and pyrene. Three different general strategies for the synthesis of [n]cyclophanes are discussed and this leads in to a discussion of some slected syntheses of [n]paracyclopahnes and [n](2,7)pyrenophanes. The chemical, structural, spectroscopic and photophysical properties of these benzene and pyrene-derived cyclophanes are discussed with emphasis on the changes that occur with changes in the structure of the aromatic system. Chapter 1 concludes with a brief introduction to [n]cyclophanes of the fourth member of the capped rylene series of PAHs: teropyrene. The focus of the work described in Chapter 2 is the synthesis of of 1,1,n,ntetramethyl[n](2,11)teropyrenophane (n = 6 and 7) using a double-McMurry strategy. While the synthesis 1,1,7,7-tetramethyl[7](2,11)teropyrenophane was successful, the synthesis of the lower homologue 1,1,6,6-tetramethyl[6](2,11)teropyrenophane was not. The conformational behaviour of [n.2]pyrenophanes was also studied by 1H NMR spectroscopy and this provided a conformation-based rationale for the failure of the synthesis of 1,1,6,6-tetramethyl[6](2,11)teropyrenophane. Chapter 3 contains details of the synthesis of 1,1,n,n-tetramethyl[n](2,11)teropyrenophanes (n = 7-9) using a Wurtz / McMurry strategy, which proved to be more general than the double McMurry strategy. The three teropyrenophanes were obtained in ca. 10 milligram quantities. Trends in the spectroscopic properties that accompany changes in the structure of the teropyrene system are discussed. A violation of Kasha’s rule was observed when the teropyrenophanes were irradiated at 260 nm. The work described in the fourth Chapter concentrates on the development of gram-scale syntheses of 1,1,n,n-tetramethyl[n](2,11)teropyrenophanes (n = 7–10) using the Wurtz / McMurry strategy. Several major modifications to the orginal synthetic pathway had to be made to enable the first several steps to be performed comfortably on tens of grams of material. Solubility problems severely limited the amount of material that could be produced at a late stage of the synthetic pathways leading to the evennumbered members of the series (n = 8, 10). Ultimately, only 1,1,9,9- tetramethyl[9](2,11)teropyrenophane was synthesized on a multi-gram scale. In the final step in the synthesis, a valence isomerization / dehydrogenation (VID) reaction, the teropyrenophane was observed to become unstable under the conditions of its formation at n = 8. The synthesis of 1,1,10,10-tetramethyl[10](2,11)teropyrenophane was achieved for the first time, but only on a few hundred milligram scale. In Chapter 5, the results of an investigation of the electrophilic aromatic bromination of the 1,1,n,n-tetramethyl[n](2,11)teropyrenophanes (n = 7–10) are presented. Being the most abundant cyclophane, most of the work was performed on 1,1,9,9-tetramethyl[9](2,11)teropyrenophane. Reaction of this compound with varying amounts of of bromine revealed that bromination occurs most rapidly at the symmetryrelated 4, 9, 13 and 18 positions (teropyrene numbering) and that the 4,9,13,18- tetrabromide could be formed exclusively. Subsequent bromination occurs selectively on the symmetry-related 6, 7, 15 and 16 positions (teropyrene numbering), but considerably more slowly. Only mixtures of penta-, hexa-, hepta and octabromides could be formed. Bromination reactions of the higher and lower homologues (n = 7, 8 and 10) revealed that the reactivity of the teropyrene system increased with the degree of bend. Crystal structures of some tetra-, hexa-, hepta- and octa-brominated products were obtained. The goal of the work described in Chapter 6 is to use 1,1,9,9- tetramethyl[9](2,11)teropyrenophane as a starting material for the synthesis of warped nanographenophanes. A bromination, Suzuki-Miyaura, cyclodehydrogenation sequence was unsuccessful, as was a C–H arylation / cyclodehydrogenation approach. Itami’s recently-developed K-region-selective annulative -extension (APEX) reaction proved to be successful, affording a giant [n]cyclophane with a C84 PAH. Attempted bay-region Diels-Alder reactions and some cursory host-guest chemistry of teropyrenophanes are also discussed. In Chapter 7 a synthetic approach toward a planar model compound, 2,11-di-tbutylteropyrene, is described. The synthesis could not be completed owing to solubility problems at the end of the synthetic pathway.

An investigation of the molecular interactions between statins and bacterial pathogens, and their combined impact on the human immune system

Statins are a class of drug that inhibits cholesterol biosynthesis, and are used to treat patients with high serum cholesterol levels. They exert this function by competitively binding to the enzyme 3-hydroxy-3-methylglutaryl-CoenzymeA reductase (HMGR), which catalyses the formation of mevalonate, a rate-limiting step in cholesterol biosynthesis. In addition, statins have what are called “pleiotropic effects”, which include the reduction of inflammation, immunomodulation, and antimicrobial effects. Statins can also improve survival of patients with sepsis and pneumonia. Cystic fibrosis (CF) is the most common recessive inherited disease in the Caucasian population, which is characterised by factors including, but not limited to, excessive lung inflammation and increased susceptibility to infection. Therefore, the overall objective of this study was to examine the effects of statins on CFassociated bacterial pathogens and the host response. In this work, the prevalence of HMGR was examined in respiratory pathogens, and several CF-associated pathogens were found to possess homologues of this enzyme. HMGR homology was analysed in Staphylococcus aureus, Burkholderia cenocepacia and Streptococcus pneumoniae, and the HMGR of B. cenocepacia was found to have significant conservation to that of Pseudomonas mevalonii, which is the most widely-characterised bacterial HMGR. However, in silico analysis revealed that, unlike S. aureus and S. pneumoniae, B. cenocepacia did not possess homologues of other mevalonate pathway proteins, and that the HMGR of B. cenocepacia appeared to be involved in an alternative metabolic pathway. The effect of simvastatin was subsequently tested on the growth and virulence of S. aureus, B. cenocepacia and S. pneumoniae. Simvastatin inhibited the growth of all 3 species in a dose-dependent manner. In addition, statin treatment also attenuated biofilm formation of all 3 species, and reduced in vitro motility of S. aureus. Interestingly, simvastatin also increased the potency of the aminoglycoside antibiotic gentamicin against B. cenocepacia. The impact of statins was subsequently tested on the predominant CF-associated pathogen Pseudomonas aeruginosa, which does not possess a HMGR homologue. Mevastatin, lovastatin and simvastatin did not influence the growth of this species. However, sub-inhibitory statin concentrations reduced the swarming motility and biofilm formation of P. aeruginosa. The influence of statins was also examined on Type 3 toxin secretion, quorum sensing and chemotaxis, and no statin effect was observed on any of these phenotypes. Statins did not appear to have a characteristic effect on the P. aeruginosa transcriptome. However, a mutant library screen revealed that the effect of statins on P. aeruginosa biofilm was mediated through the PvrR regulator and the Cup fimbrial biosynthesis genes. Furthermore, proteomic analysis demonstrated that 6 proteins were reproducibly induced by simvastatin in the P. aeruginosa swarming cells. The effect of statins on the regulation of the host-P. aeruginosa immune response was also investigated. Statin treatment increased expression of the pro-inflammatory cytokines IL-8 and CCL20 in lung epithelial cells, but did not attenuate P. aeruginosa-mediated inflammatory gene induction. In fact, simvastatin and P. aeruginosa caused a synergistic effect on CCL20 expression. The expression of the transcriptional regulators KLF2 and KLF6 was also increased by statins and P. aeruginosa, with the induction of KLF6 by simvastatin proving to be a novel effect. Interestingly, both statins and P. aeruginosa were capable of inducing alternative splicing of KLF6. P. aeruginosa was found to induce KLF6 alternative splicing by way of the type 3 secreted toxin ExoS. In addition, a mechanistic role was elucidated for KLF6 in the lung, as it was determined that statin-mediated induction of this protein was responsible for the induction of the host response genes CCL20 and iNOS. Moreover, statin treatment caused a slight increase in infection-related cytotoxicity, and increased bacterial adhesion to cells. Taken together, these data demonstrate that statins can reduce the virulence of CFassociated bacterial pathogens and alter host response effectors. Furthermore, novel statin effectors were identified in both bacterial and host cells.

Fasciola hepatica surface tegument: glycoproteins at the interface of parasite and host

Fasciola hepatica, commonly known as liver fluke, is a trematode which causes Fasciolosis in ruminants and humans. The outer tegumental coat of F. hepatica (FhTeg) is a complex metabolically active biological matrix that is continually exposed to the host immune system and therefore makes a good vaccine target. F. hepatica tegumental coat is highly glycosylated and helminth-derived immunogenic oligosaccharide motifs and glycoproteins are currently being investigated as novel vaccine candidates. This report presents the first systematic characterisation of FhTeg glycosylation using lectin microarrays to characterise carbohydrates motifs present, and lectin histochemistry to localize these on the F. hepatica tegument. We discovered that FhTeg glycoproteins are predominantly oligomannose oligosaccharides that are expressed on the spines, suckers and tegumental coat of F. hepatica and lectin blot analysis confirmed the abundance of N- glycosylated proteins. While some oligosaccharides are widely distributed on the fluke surface other subsets are restricted to distinct anatomical regions. We selectively enriched for FhTeg mannosylated glycoprotein subsets using lectin affinity chromatography and identified 369 proteins by mass spectrometric analysis. Among these proteins are a number of potential vaccine candidates with known immune modulatory properties including proteases, protease inhibitors, paramyosin, Venom Allergen-like II, Enolase and two proteins, nardilysin and TRIL, that have not been previously associated with F. hepatica Furthermore, we provide a comprehensive insight regarding the putative glycosylation of FhTeg components which could highlight the importance of further studies examining glycoconjugates in host-parasite interactions in the context of F. hepatica infection and the development of an effective vaccine.

Implementation of Content Centric Networks Through Domain Name System

Content Centric Network (CCN) is a proposed future internet architecture that is based on the concept of contents name instead of the hosts name followed in the traditional internet architecture. CCN architecture might do changes in the existing internet architecture or might replace it completely. In this paper, we present modifications to the existing Domain Name System (DNS) based on the CCN architecture requirements without changing the existing routing architecture. Hence the proposed solution achieves the benefits of both CCN and existing network infrastructure (i.e. content based routing, independent of host location, caching and content delivery protocols).

EspZ of enteropathogenic and enterohemorrhagic Escherichia coli regulates type III secretion system protein translocation

UNLABELLED: Translocation of effector proteins via a type III secretion system (T3SS) is a widespread infection strategy among Gram-negative bacterial pathogens. Each pathogen translocates a particular set of effectors that subvert cell signaling in a way that suits its particular infection cycle. However, as effector unbalance might lead to cytotoxicity, the pathogens must employ mechanisms that regulate the intracellular effector concentration. We present evidence that the effector EspZ controls T3SS effector translocation from enteropathogenic (EPEC) and enterohemorrhagic (EHEC) Escherichia coli. Consistently, an EPEC espZ mutant is highly cytotoxic. Following ectopic expression, we found that EspZ inhibited the formation of actin pedestals as it blocked the translocation of Tir, as well as other effectors, including Map and EspF. Moreover, during infection EspZ inhibited effector translocation following superinfection. Importantly, while EspZ of EHEC O157:H7 had a universal "translocation stop" activity, EspZ of EPEC inhibited effector translocation from typical EPEC strains but not from EHEC O157:H7 or its progenitor, atypical EPEC O55:H7. We found that the N and C termini of EspZ, which contains two transmembrane domains, face the cytosolic leaflet of the plasma membrane at the site of bacterial attachment, while the extracellular loop of EspZ is responsible for its strain-specific activity. These results show that EPEC and EHEC acquired a sophisticated mechanism to regulate the effector translocation.

IMPORTANCE: Enteropathogenic Escherichia coli (EPEC) and enterohemorrhagic E. coli (EHEC) are important diarrheal pathogens responsible for significant morbidity and mortality in developing countries and the developed world, respectively. The virulence strategy of EPEC and EHEC revolves around a conserved type III secretion system (T3SS), which translocates bacterial proteins known as effectors directly into host cells. Previous studies have shown that when cells are infected in two waves with EPEC, the first wave inhibits effector translocation by the second wave in a T3SS-dependent manner, although the factor involved was not known. Importantly, we identified EspZ as the effector responsible for blocking protein translocation following a secondary EPEC infection. Interestingly, we found that while EspZ of EHEC can block protein translocation from both EPEC and EHEC strains, EPEC EspZ cannot block translocation from EHEC. These studies show that EPEC and EHEC employ a novel infection strategy to regulate T3SS translocation.

A survey of intrusion detection system technologies

This paper provides an overview of IDS types and how they work as well as configuration considerations and issues that affect them. Advanced methods of increasing the performance of an IDS are explored such as specification based IDS for protecting Supervisory Control And Data Acquisition (SCADA) and Cloud networks. Also by providing a review of varied studies ranging from issues in configuration and specific problems to custom techniques and cutting edge studies a reference can be provided to others interested in learning about and developing IDS solutions. Intrusion Detection is an area of much required study to provide solutions to satisfy evolving services and networks and systems that support them. This paper aims to be a reference for IDS technologies other researchers and developers interested in the field of intrusion detection.

O microbioma humano

O organismo humano encontra-se colonizado por uma complexa diversidade de microrganismos. O conjunto destes microrganismos, que incluem as bactérias, fungos, vírus e protozoários, no homem denomina- se microbioma humano. Estima-se que entre a superfície interna e externa, o microbioma humano seja composto por 100 triliões de microrganismos. O microbioma humano varia muito nas mais diversas regiões do nosso corpo, dependendo de condições ambientais. Sabe-se, por exemplo, que nas regiões mais húmidas e quentes encontram-se uma maior concentração de microrganismos, enquanto que nas regiões menos húmidas, existe uma quantidade menor de microrganismos. O microbioma é de vital importância para a saúde humana, e o seu estudo conduz a um melhor conhecimento da sua complexa dinâmica, podendo conduzir ao desenvolvimento de novas formas de diagnóstico e até mesmo de tratamento de certas patologias. Assim sendo, a compreensão da diversidade fisiológica humana, bem como a de outros animais, passa pelo conhecimento da distribuição destes microrganismos nos diferentes órgãos e seu papel biológico. O desenvolvimento de técnicas de genética permitiram o estudo metagenómico importante para descrever a diversidade do microbioma humano, que não seria possível através da cultura das espécies pois um grande número destas não é cultivável. Esta dissertação tem como principal objetivo descrever o microbioma humano e de que forma esta influência o sistema imunitário. E numa segunda parte dar uma visão sobre a importância da análise metagenómica na identificação e caraterização do microbioma Humano.

Spatiotemporal control over the co-conformational switching in pH-responsive flavylium-based multistate pseudorotaxanes

A multistate molecular dyad containing flavylium and viologen units was synthesized and the pH dependent thermodynamics of the network completely characterized by a variety of spectroscopic techniques such as NMR, UV-vis and stopped-flow. The flavylium cation is only stable at acidic pH values. Above pH ≈ 5 the hydration of the flavylium leads to the formation of the hemiketal followed by ring-opening tautomerization to give the cis-chalcone. Finally, this last species isomerizes to give the trans-chalcone. For the present system only the flavylium cation and the trans-chalcone species could be detected as being thermodynamically stable. The hemiketal and the cis-chalcone are kinetic intermediates with negligible concentrations at the equilibrium. All stable species of the network were found to form 1 : 1 and 2 : 1 host : guest complexes with cucurbit[7]uril (CB7) with association constants in the ranges 10(5)-10(8) M(-1) and 10(3)-10(4) M(-1), respectively. The 1 : 1 complexes were particularly interesting to devise pH responsive bistable pseudorotaxanes: at basic pH values (≈12) the flavylium cation interconverts into the deprotonated trans-chalcone in a few minutes and under these conditions the CB7 wheel was found to be located around the viologen unit. A decrease in pH to values around 1 regenerates the flavylium cation in seconds and the macrocycle is translocated to the middle of the axle. On the other hand, if the pH is decreased to 6, the deprotonated trans-chalcone is neutralized to give a metastable species that evolves to the thermodynamically stable flavylium cation in ca. 20 hours. By taking advantage of the pH-dependent kinetics of the trans-chalcone/flavylium interconversion, spatiotemporal control of the molecular organization in pseudorotaxane systems can be achieved.

Spiroacetals in the Colonization Behaviour of the Coffee Berry Borer: A 'Push-Pull' System

Coffee berries are known to release several volatile organic compounds, among which is the spiroacetal, conophthorin, an attractant for the coffee berry borer Hypothenemus hampei. Elucidating the effects of other spiroacetals released by coffee berries is critical to understanding their chemo-ecological roles in the host discrimination and colonization process of the coffee berry borer, and also for their potential use in the management of this pest. Here, we show that the coffee berry spiroacetals frontalin and 1,6-dioxaspiro [4.5] decane (referred thereafter as brocain), are also used as semiochemicals by the coffee berry borer for host colonization. Bioassays and chemical analyses showed that crowding coffee berry borers from 2 to 6 females per berry, reduced borer fecundity, which appeared to correlate with a decrease in the emission rates of conophthorin and frontalin over time. In contrast, the level of brocain did not vary significantly between borer-uninfested and infested berries. Brocain was attractive at lower doses, but repellent at higher doses while frontalin alone or in a blend was critical for avoidance. Field assays with a commercial attractant comprising a mixture of ethanol and methanol (1:1), combined with frontalin, confirmed the repellent effect of this compound by disrupting capture rates of H. hampei females by 77% in a coffee plantation. Overall, our results suggest that the levels of frontalin and conophthorin released by coffee berries determine the host colonization behaviour of H. hampei, possibly through a 'push-pull' system, whereby frontalin acts as the 'push' (repellent) and conophthorin acting as the 'pull' (attractant). Furthermore, our results reveal the potential use of frontalin as a repellent for management of this coffee pest.

The mating system of the true fruit flyBactrocera tryoniand its sister-species, Bactrocera neohumeralis

The frugivorous “true” fruit fly, Bactrocera tryoni (Queensland fruit fly), is presumed to have a nonresourced-based lek mating system. This is largely untested, and contrary data exists to suggest Bactrocera tryoni may have a resource-based mating system focused on fruiting host plants. We tested the mating system of Bactrocera tryoni, and its close sibling Bactrocera neohumeralis, in large field cages using laboratory reared flies. We used observational experiments that allowed us to determine if: (i) mating pairs were aggregated or nonaggregated; (ii) mating system was resource or nonresource based; (iii) flies utilized possible landmarks (tall trees over short) as mate-rendezvous sites; and (iv) males called females from male-dominated leks. We recorded nearly 250 Bactrocera tryoni mating pairs across all experiments, revealing that: (i) mating pairs were aggregated; (ii) mating nearly always occurred in tall trees over short; (iii) mating was nonresource based; and (iv) that males and females arrived at the mate-rendezvous site together with no evidence that males preceded females. Bactrocera neohumeralis copulations were much more infrequent (only 30 mating pairs in total), but for those pairs there was a similar preference for tall trees and no evidence of a resource-based mating system. Some aspects of Bactrocera tryoni mating behavior align with theoretical expectations of a lekking system, but others do not. Until evidence for unequivocal female choice can be provided (as predicted under a true lek), the mating system of Bactrocera tryoni is best described as a nonresource based, aggregation system for which we also have evidence that land-marking may be involved.

'Malicious Code Execution Detection and Response Immune System inspired by the Danger Theory'

The analysis of system calls is one method employed by anomaly detection systems to recognise malicious code execution. Similarities can be drawn between this process and the behaviour of certain cells belonging to the human immune system, and can be applied to construct an artificial immune system. A recently developed hypothesis in immunology, the Danger Theory, states that our immune system responds to the presence of intruders through sensing molecules belonging to those invaders, plus signals generated by the host indicating danger and damage. We propose the incorporation of this concept into a responsive intrusion detection system, where behavioural information of the system and running processes is combined with information regarding individual system calls.

Estudo da efetividade dos mecanismos de compartilhamento de memória em hipervisores

The growing demand for large-scale virtualization environments, such as the ones used in cloud computing, has led to a need for efficient management of computing resources. RAM memory is the one of the most required resources in these environments, and is usually the main factor limiting the number of virtual machines that can run on the physical host. Recently, hypervisors have brought mechanisms for transparent memory sharing between virtual machines in order to reduce the total demand for system memory. These mechanisms “merge” similar pages detected in multiple virtual machines into the same physical memory, using a copy-on-write mechanism in a manner that is transparent to the guest systems. The objective of this study is to present an overview of these mechanisms and also evaluate their performance and effectiveness. The results of two popular hypervisors (VMware and KVM) using different guest operating systems (Linux and Windows) and different workloads (synthetic and real) are presented herein. The results show significant performance differences between hypervisors according to the guest system workloads and execution time.

Investigating disease persistence in host vector systems: dengue as a case study

The investigation of pathogen persistence in vector-borne diseases is important in different ecological and epidemiological contexts. In this thesis, I have developed deterministic and stochastic models to help investigating the pathogen persistence in host-vector systems by using efficient modelling paradigms. A general introduction with aims and objectives of the studies conducted in the thesis are provided in Chapter 1. The mathematical treatment of models used in the thesis is provided in Chapter 2 where the models are found locally asymptotically stable. The models used in the rest of the thesis are based on either the same or similar mathematical structure studied in this chapter. After that, there are three different experiments that are conducted in this thesis to study the pathogen persistence. In Chapter 3, I characterize pathogen persistence in terms of the Critical Community Size (CCS) and find its relationship with the model parameters. In this study, the stochastic versions of two epidemiologically different host-vector models are used for estimating CCS. I note that the model parameters and their algebraic combination, in addition to the seroprevalence level of the host population, can be used to quantify CCS. The study undertaken in Chapter 4 is used to estimate pathogen persistence using both deterministic and stochastic versions of a model with seasonal birth rate of the vectors. Through stochastic simulations we investigate the pattern of epidemics after the introduction of an infectious individual at different times of the year. The results show that the disease dynamics are altered by the seasonal variation. The higher levels of pre-existing seroprevalence reduces the probability of invasion of dengue. In Chapter 5, I considered two alternate ways to represent the dynamics of a host-vector model. Both of the approximate models are investigated for the parameter regions where the approximation fails to hold. Moreover, three metrics are used to compare them with the Full model. In addition to the computational benefits, these approximations are used to investigate to what degree the inclusion of the vector population in the dynamics of the system is important. Finally, in Chapter 6, I present the summary of studies undertaken and possible extensions for the future work.

FluxEngine: A flexible processing system for calculating atmosphere-ocean carbon dioxide gas fluxes and climatologies

The air-sea flux of greenhouse gases (e.g. carbon dioxide, CO2) is a critical part of the climate system and a major factor in the biogeochemical development of the oceans. More accurate and higher resolution calculations of these gas fluxes are required if we are to fully understand and predict our future climate. Satellite Earth observation is able to provide large spatial scale datasets that can be used to study gas fluxes. However, the large storage requirements needed to host such data can restrict its use by the scientific community. Fortunately, the development of cloud-computing can provide a solution. Here we describe an open source air-sea CO2 flux processing toolbox called the ‘FluxEngine’, designed for use on a cloud-computing infrastructure. The toolbox allows users to easily generate global and regional air-sea CO2 flux data from model, in situ and Earth observation data, and its air-sea gas flux calculation is user configurable. Its current installation on the Nephalae cloud allows users to easily exploit more than 8 terabytes of climate-quality Earth observation data for the derivation of gas fluxes. The resultant NetCDF data output files contain >20 data layers containing the various stages of the flux calculation along with process indicator layers to aid interpretation of the data. This paper describes the toolbox design, the verification of the air-sea CO2 flux calculations, demonstrates the use of the tools for studying global and shelf-sea air-sea fluxes and describes future developments.