952 resultados para Data-stream balancing
Resumo:
Thesis (Ph.D.)--University of Washington, 2016-08
Resumo:
Summary of stream water quality data collected from 2000 through 2015
Resumo:
Summary of stream water quality data collected in 2015.
Resumo:
A parallel method for the dynamic partitioning of unstructured meshes is outlined. The method includes diffusive load-balancing techniques and an iterative optimisation technique known as relative gain optimisationwhich both balances theworkload and attempts to minimise the interprocessor communications overhead. It can also optionally include amultilevel strategy. Experiments on a series of adaptively refined meshes indicate that the algorithmprovides partitions of an equivalent or higher quality to static partitioners (which do not reuse the existing partition) and much more rapidly. Perhaps more importantly, the algorithm results in only a small fraction of the amount of data migration compared to the static partitioners.
Resumo:
This chapter describes a parallel optimization technique that incorporates a distributed load-balancing algorithm and provides an extremely fast solution to the problem of load-balancing adaptive unstructured meshes. Moreover, a parallel graph contraction technique can be employed to enhance the partition quality and the resulting strategy outperforms or matches results from existing state-of-the-art static mesh partitioning algorithms. The strategy can also be applied to static partitioning problems. Dynamic procedures have been found to be much faster than static techniques, to provide partitions of similar or higher quality and, in comparison, involve the migration of a fraction of the data. The method employs a new iterative optimization technique that balances the workload and attempts to minimize the interprocessor communications overhead. Experiments on a series of adaptively refined meshes indicate that the algorithm provides partitions of an equivalent or higher quality to static partitioners (which do not reuse the existing partition) and much more quickly. The dynamic evolution of load has three major influences on possible partitioning techniques; cost, reuse, and parallelism. The unstructured mesh may be modified every few time-steps and so the load-balancing must have a low cost relative to that of the solution algorithm in between remeshing.
Resumo:
A parallel method for dynamic partitioning of unstructured meshes is described. The method employs a new iterative optimisation technique which both balances the workload and attempts to minimise the interprocessor communications overhead. Experiments on a series of adaptively refined meshes indicate that the algorithm provides partitions of an equivalent or higher quality to static partitioners (which do not reuse the existing partition) and much more quickly. Perhaps more importantly, the algorithm results in only a small fraction of the amount of data migration compared to the static partitioners.
Resumo:
In parallel adaptive finite element simulations the work load on the individual processors may change frequently. To (re)distribute the load evenly over the processors a load balancing heuristic is needed. Common strategies try to minimise subdomain dependencies by optimising the cutsize of the partitioning. However for certain solvers cutsize only plays a minor role, and their convergence is highly dependent on the subdomain shapes. Degenerated subdomain shapes cause them to need significantly more iterations to converge. In this work a new parallel load balancing strategy is introduced which directly addresses the problem of generating and conserving reasonably good subdomain shapes in a dynamically changing Finite Element Simulation. Geometric data is used to formulate several cost functions to rate elements in terms of their suitability to be migrated. The well known diffusive method which calculates the necessary load flow is enhanced by weighting the subdomain edges with the help of these cost functions. The proposed methods have been tested and results are presented.
Resumo:
A method is outlined for optimising graph partitions which arise in mapping unstructured mesh calculations to parallel computers. The method employs a relative gain iterative technique to both evenly balance the workload and minimise the number and volume of interprocessor communications. A parallel graph reduction technique is also briefly described and can be used to give a global perspective to the optimisation. The algorithms work efficiently in parallel as well as sequentially and when combined with a fast direct partitioning technique (such as the Greedy algorithm) to give an initial partition, the resulting two-stage process proves itself to be both a powerful and flexible solution to the static graph-partitioning problem. Experiments indicate that the resulting parallel code can provide high quality partitions, independent of the initial partition, within a few seconds. The algorithms can also be used for dynamic load-balancing, reusing existing partitions and in this case the procedures are much faster than static techniques, provide partitions of similar or higher quality and, in comparison, involve the migration of a fraction of the data.
Resumo:
Observing system experiments (OSEs) are carried out over a 1-year period to quantify the impact of Argo observations on the Mercator Ocean 0.25° global ocean analysis and forecasting system. The reference simulation assimilates sea surface temperature (SST), SSALTO/DUACS (Segment Sol multi-missions dALTimetrie, d'orbitographie et de localisation précise/Data unification and Altimeter combination system) altimeter data and Argo and other in situ observations from the Coriolis data center. Two other simulations are carried out where all Argo and half of the Argo data are withheld. Assimilating Argo observations has a significant impact on analyzed and forecast temperature and salinity fields at different depths. Without Argo data assimilation, large errors occur in analyzed fields as estimated from the differences when compared with in situ observations. For example, in the 0–300 m layer RMS (root mean square) differences between analyzed fields and observations reach 0.25 psu and 1.25 °C in the western boundary currents and 0.1 psu and 0.75 °C in the open ocean. The impact of the Argo data in reducing observation–model forecast differences is also significant from the surface down to a depth of 2000 m. Differences between in situ observations and forecast fields are thus reduced by 20 % in the upper layers and by up to 40 % at a depth of 2000 m when Argo data are assimilated. At depth, the most impacted regions in the global ocean are the Mediterranean outflow, the Gulf Stream region and the Labrador Sea. A significant degradation can be observed when only half of the data are assimilated. Therefore, Argo observations matter to constrain the model solution, even for an eddy-permitting model configuration. The impact of the Argo floats' data assimilation on other model variables is briefly assessed: the improvement of the fit to Argo profiles do not lead globally to unphysical corrections on the sea surface temperature and sea surface height. The main conclusion is that the performance of the Mercator Ocean 0.25° global data assimilation system is heavily dependent on the availability of Argo data.
Resumo:
Multiple indices of biotic integrity and biological condition gradient models have been developed and validated to assess ecological integrity in the Laurentian Great Lakes Region. With multiple groups such as Tribal, Federal, and State agencies as well as scientists and local watershed management or river-focused volunteer groups collecting data for bioassessment it is important that we determine the comparability of data and the effectiveness of indices applied to these data for assessment of natural systems. We evaluated the applicability of macroinvertebrate and fish community indices for assessing site integrity. Site quality (i.e., habitat condition) could be classified differently depending on which index was applied. This highlights the need to better understand the metrics driving index variation as well as reference conditions for effective communication and use of indices of biotic integrity in the Upper Midwest. We found the macroinvertebrate benthic community index for the Northern Lakes and Forests Ecoregion and a coldwater fish index of biotic integrity for the Upper Midwest were most appropriate for use in the Big Manistee River watershed based on replicate sampling, ability to track trends over time and overall performance. We evaluated three sites where improper road stream crossings (culverts) were improved by replacing them with modern full-span structures using the most appropriate fish and macroinvertebrate IBIs. We used a before-after-control-impact paired series analytical design and found mixed results, with evidence of improvement in biotic integrity based on macroinvertebrate indices at some of the sites while most sites indicated no response in index score. Culvert replacements are often developed based on the potential, or the perception, that they will restore ecological integrity. As restoration practitioners, researchers and managers, we need to be transparent in our goals and objectives and monitor for those results specifically. The results of this research serve as an important model for the broader field of ecosystem restoration and support the argument that while biotic communities can respond to actions undertaken with the goal of overall restoration, practitioners should be realistic in their expectations and claims of predicted benefit, and then effectively evaluate the true impacts of the restoration activities.
Resumo:
Hardboard processing wastewater was evaluated as a feedstock in a bio refinery co-located with the hardboard facility for the production of fuel grade ethanol. A thorough characterization was conducted on the wastewater and the composition changes of which during the process in the bio refinery were tracked. It was determined that the wastewater had a low solid content (1.4%), and hemicellulose was the main component in the solid, accounting for up to 70%. Acid pretreatment alone can hydrolyze the majority of the hemicellulose as well as oligomers, and over 50% of the monomer sugars generated were xylose. The percentage of lignin remained in the liquid increased after acid pretreatment. The characterization results showed that hardboard processing wastewater is a feasible feedstock for the production of ethanol. The optimum conditions to hydrolyze hemicellulose into fermentable sugars were evaluated with a two-stage experiment, which includes acid pretreatment and enzymatic hydrolysis. The experimental data were fitted into second order regression models and Response Surface Methodology (RSM) was employed. The results of the experiment showed that for this type of feedstock enzymatic hydrolysis is not that necessary. In order to reach a comparatively high total sugar concentration (over 45g/l) and low furfural concentration (less than 0.5g/l), the optimum conditions were reached when acid concentration was between 1.41 to 1.81%, and reaction time was 48 to 76 minutes. The two products produced from the bio refinery were compared with traditional products, petroleum gasoline and traditional potassium acetate, in the perspective of sustainability, with greenhouse gas (GHG) emission as an indicator. Three allocation methods, system expansion, mass allocation and market value allocation methods were employed in this assessment. It was determined that the life cycle GHG emissions of ethanol were -27.1, 20.8 and 16 g CO2 eq/MJ, respectively, in the three allocation methods, whereas that of petroleum gasoline is 90 g CO2 eq/MJ. The life cycle GHG emissions of potassium acetate in mass allocation and market value allocation method were 555.7 and 716.0 g CO2 eq/kg, whereas that of traditional potassium acetate is 1020 g CO2/kg.
Resumo:
In recent years, the 380V DC and 48V DC distribution systems have been extensively studied for the latest data centers. It is widely believed that the 380V DC system is a very promising candidate because of its lower cable cost compared to the 48V DC system. However, previous studies have not adequately addressed the low reliability issue with the 380V DC systems due to large amount of series connected batteries. In this thesis, a quantitative comparison for the two systems has been presented in terms of efficiency, reliability and cost. A new multi-port DC UPS with both high voltage output and low voltage output is proposed. When utility ac is available, it delivers power to the load through its high voltage output and charges the battery through its low voltage output. When utility ac is off, it boosts the low battery voltage and delivers power to the load form the battery. Thus, the advantages of both systems are combined and the disadvantages of them are avoided. High efficiency is also achieved as only one converter is working in either situation. Details about the design and analysis of the new UPS are presented. For the main AC-DC part of the new UPS, a novel bridgeless three-level single-stage AC-DC converter is proposed. It eliminates the auxiliary circuit for balancing the capacitor voltages and the two bridge rectifier diodes in previous topology. Zero voltage switching, high power factor, and low component stresses are achieved with this topology. Compared to previous topologies, the proposed converter has a lower cost, higher reliability, and higher efficiency. The steady state operation of the converter is analyzed and a decoupled model is proposed for the converter. For the battery side converter as a part of the new UPS, a ZVS bidirectional DC-DC converter based on self-sustained oscillation control is proposed. Frequency control is used to ensure the ZVS operation of all four switches and phase shift control is employed to regulate the converter output power. Detailed analysis of the steady state operation and design of the converter are presented. Theoretical, simulation, and experimental results are presented to verify the effectiveness of the proposed concepts.
Resumo:
Monitoring of nitrogen and phosphorus in streams and rivers throughout Iowa is an essential element of the Iowa Nutrient Reduction Strategy (INRS). Sampling and analysis of surface water is necessary to develop periodic estimates of the amounts of nitrogen and phosphorus transported from Iowa. Surface and groundwater monitoring provides the scientific evidence needed to document the effectiveness of nutrient reduction practices and the impact they have on water quality. Lastly, monitoring data informs decisions about where and how best to implement nutrient reduction practices, by both point sources and nonpoint sources, to provide the greatest benefit at the least cost. The impetus for this report comes from the Water Resources Coordination Council (WRCC) which states in its 2014‐15 Annual Report “Efforts are underway to improve understanding of the multiple nutrient monitoring efforts that may be available and can be compared to the nutrient WQ monitoring framework to identify opportunities and potential data gaps to better coordinate and prioritize future nutrient monitoring efforts.” This report is the culmination of those efforts.
Resumo:
This study examines the long profiles of tributaries of the Tejo (Tagus) and Zêzere rivers in central eastern Portugal (West Iberia) in order to provide new insights into the patterns, timing and controls on drainage development during the Pleistocene to Holocene incision stage. The long profiles were extracted from lower order tributary streams associated with the trunk drainage of the Tejo River and one main tributary, the Zêzere River (Fig. 1). These streams flow through a landscape strongly influenced by variations in bedrock lithology (mainly granites and metasediments), fault structures delimiting crustal blocks with distinct uplift rates, and a base-level lowering history (tectonic uplift / eustatic). The long profiles of the tributaries of the Tejo and Zêzere rivers record a series of transient and permanent knickpoints. The permanent knickpoints have direct correlation with the bedrock strength, corresponding to the outcropping of very hard quartzites or to the transition from softer (slates/metagreywaques) to harder (granite) basement. The analyzed streams/rivers record also an older transient knickpoint/knickzone separating: a) an upstream relict graded profile, with lower steepness and higher concavity, that reflects a long period of quasi-equilibrium conditions reached after the beginning of the incision stage; and b) a downstream reach displaying a rejuvenated long profile, with steeper gradient and lower concavity, particularly for the final segment, which is often convex (Fig. 2). The rejuvenated reaches testify the upstream propagation of several incision waves that are the response of each stream to continuous or increasing crustal uplift and dominant periods of base-level lowering by the trunk drainages, coeval of low sea level conditions. The long profiles and their morphological configurations enabled spatial and relative temporal patterns of incision to be quantified for each individual tributary stream. The incision values of streams flowing in uplifted blocks of the Portuguese Central Range (PCR) (ca.380-280 m) indicate differential uplift and are higher than the incision values of streams flowing on the adjacent South Portugal planation surface – the Meseta (ca. 200 m). The normalized steepness index, calculated using the method of Wobus et al. (2006), proved to be sensitive to active tectonics, as lower ksn values were found in relict graded profiles of streams located in less uplifted blocks, (e.g. Sertã stream in the PCR), or in those flowing through tectonic depressions. Fig. 1 – Geological map of the study area. 1 – fluvial terraces (Pleistocene); 2 – sedimentary cover (Paleogene and Neogene); 3 – slates and metasandstones (Devonian); 4 – slates and quartzites (Silurian); 5 – quartzites (Ordovician); 6 – slates and metagreywackes (Precambrian to Cambrian); 7 – slates, metagreywackes and limestones (Precambrian); 8 – granites and ortogneisses; 9 – diorites and gabros; 10 - fault. SFf – Sobreira Formosa fault; Sf – Sertã fault; Pf – Ponsul fault; Gf – Grade fault. The differential uplift indicated by the distribution of the ksn values and by the fluvial incision was likely accumulated on a few major faults, as the Sobreira Formosa fault (SFf), thus corroborating the tectonic activity of these faults. Due to the fact that the relict graded profiles can be correlated with other geomorphic references documented in the study area, namely the T1 terrace of the Tagus River (with an age of ca. 1 Myr), the following incision rates can be estimated: a) for the studied streams located in uplifted blocks of the PCR, 0.38 m/kyr to 0.28 m/kyr; b) for the streams flowing on the South Portugal planation surface, 0.20 m/kyr. The differential uplift inferred between crustal blocks in the study area corroborates the neotectonic activity of the bordering faults, which has been proposed in previous studies based upon less robust data. Fig. 2 – Longitudinal profile of the Nisa stream a tributary of the Tejo River. Note the equilibrium relict profile upstream the older transient knickpoint (hatched line) and the downstream rejuvenated profile (continuous line). Legend: tKP – transient knickpoint; rKp – resistant knickpoint; Mt – schist and phyllite; Gr – granite; Hf – hornfels; Og – orthogneisse. In the inset Distance – Slope plots, fill circles correspond to the relict graded profile, crosses correspond to the rejuvenated profile located downstream the older transient knickpoint (tKP).
Resumo:
L’elaborazione di quantità di dati sempre crescente ed in tempi ragionevoli è una delle principali sfide tecnologiche del momento. La difficoltà non risiede esclusivamente nel disporre di motori di elaborazione efficienti e in grado di eseguire la computazione coordinata su un’enorme mole di dati, ma anche nel fornire agli sviluppatori di tali applicazioni strumenti di sviluppo che risultino intuitivi nell’utilizzo e facili nella messa in opera, con lo scopo di ridurre il tempo necessario a realizzare concretamente un’idea di applicazione e abbassare le barriere all’ingresso degli strumenti software disponibili. Questo lavoro di tesi prende in esame il progetto RAM3S, il cui intento è quello di semplificare la realizzazione di applicazioni di elaborazione dati basate su piattaforme di Stream Processing quali Spark, Storm, Flinke e Samza, e si occupa di esaudire il suo scopo originale fornendo un framework astratto ed estensibile per la definizione di applicazioni di stream processing, capaci di eseguire indistintamente sulle piattaforme disponibili sul mercato.