Grids with multiple batch systems for performance enhancement of multi-component and parameter sweep parallel applications

In this work, we evaluate the benefits of using Grids with multiple batch systems to improve the performance of multi-component and parameter sweep parallel applications by reduction in queue waiting times. Using different job traces of different loads, job distributions and queue waiting times corresponding to three different queuing policies(FCFS, conservative and EASY backfilling), we conducted a large number of experiments using simulators of two important classes of applications. The first simulator models Community Climate System Model (CCSM), a prominent multi-component application and the second simulator models parameter sweep applications. We compare the performance of the applications when executed on multiple batch systems and on a single batch system for different system and application configurations. We show that there are a large number of configurations for which application execution using multiple batch systems can give improved performance over execution on a single system.

Prediction of Queue Waiting Times for Metascheduling on Parallel Batch Systems

Prediction of queue waiting times of jobs submitted to production parallel batch systems is important to provide overall estimates to users and can also help meta-schedulers make scheduling decisions. In this work, we have developed a framework for predicting ranges of queue waiting times for jobs by employing multi-class classification of similar jobs in history. Our hierarchical prediction strategy first predicts the point wait time of a job using dynamic k-Nearest Neighbor (kNN) method. It then performs a multi-class classification using Support Vector Machines (SVMs) among all the classes of the jobs. The probabilities given by the SVM for the class predicted using k-NN and its neighboring classes are used to provide a set of ranges of predicted wait times with probabilities. We have used these predictions and probabilities in a meta-scheduling strategy that distributes jobs to different queues/sites in a multi-queue/grid environment for minimizing wait times of the jobs. Experiments with different production supercomputer job traces show that our prediction strategies can give correct predictions for about 77-87% of the jobs, and also result in about 12% improved accuracy when compared to the next best existing method. Experiments with our meta-scheduling strategy using different production and synthetic job traces for various system sizes, partitioning schemes and different workloads, show that the meta-scheduling strategy gives much improved performance when compared to existing scheduling policies by reducing the overall average queue waiting times of the jobs by about 47%.

Study of biosorption of rare earth metals (La, Nd, Eu, Gd) by Sargassum sp. biomass in batch systems: Physicochemical evaluation of kinetics and adsorption models

This work evaluated kinetic and adsorption physicochemical models for the biosorption process of lanthanum, neodymium, europium, and gadolinium by Sargassum sp. in batch systems. The results showed: (a) the pseudo-second order kinetic model was the best approximation for the experimental data with the metal adsorption initial velocity parameter in 0.042-0.055 mmol.g -1.min-1 (La < Nd < Gd < Eu); (b) the Langmuir adsorption model presented adequate correlation with maximum metal uptake at 0.60-0.70 mmol g-1 (Eu < La < Gd < Nd) and the metal-biomass affinity parameter showed distinct values (Gd < Nd < Eu < La: 183.1, 192.5, 678.3, and 837.3 L g-1, respectively); and (c) preliminarily, the kinetics and adsorption evaluation did not reveal a well-defined metal selectivity behavior for the RE biosorption in Sargassum sp., but they indicate a possible partition among RE studied. © (2009) Trans Tech Publications.

Performance comparison of batch and continuous flow surface aeration systems

The oxygen transfer rate and the corresponding power requirement to operate the rotor are vital for design and scale-up of surface aerators. The aeration process can be analyzed in two ways such as batch and continuous systems. The process behaviors of batch and continuous flow systems are different from each other. The experimental and numerical results obtained through the batch systems cannot be relied on and applied for the designing of the continuous aeration tank. Based on the experimentation on batch and continuous type systems, the present work compares the performance of both the batch and continuous surface aeration systems in terms of their oxygen transfer capacity and power consumption. A simulation equation developed through experimentation has shown that continuous flow surface aeration systems are taking more energy than the batch systems. It has been found that batch systems are economical and better for the field application but not feasible where large quantity of wastewater is produced.

Continuous-Flow Surface Aeration Systems

An aeration process in ail activated sludge plant is a continuous-flow system. In this system, there is a steady input flow (flow from the primary clarifier or settling tank with some part from the secondary clarifier or secondary settling tank) and output flow connection to the secondary clarifier or settling tank. The experimental and numerical results obtained through batch systems can not be relied on and applied for the designing of a continuous aeration tank. In order to scale up laboratory results for field application, it is imperative to know the geometric parameters of a continuous system. Geometric parameters have a greater influence on the mass transfer process of surface aeration systems. The present work establishes the optimal geometric configuration of a continuous-flow surface aeration system. It is found that the maintenance of these optimal geometric parameters systems result in maximum aeration efficiency. By maintaining the obtained optimal geometric parameters, further experiments are conducted in continuous-flow surface aerators with three different sizes in order to develop design curves correlating the oxygen transfer coefficient and power number with the rotor speed. The design methodology to implement the presently developed optimal geometric parameters and correlation equations for field application is discussed.

Executing Long-running Multi-component Applications on Batch Grids

Computational grids are increasingly being used for executing large multi-component scientific applications. The most widely reported advantages of application execution on grids are the performance benefits, in terms of speeds, problem sizes or quality of solutions, due to increased number of processors. We explore the possibility of improved performance on grids without increasing the application’s processor space. For this, we consider grids with multiple batch systems. We explore the challenges involved in and the advantages of executing long-running multi-component applications on multiple batch sites with a popular multi-component climate simulation application, CCSM, as the motivation.We have performed extensive simulation studies to estimate the single and multi-site execution rates of the applications for different system characteristics.Our experiments show that in many cases, multiple batch executions can have better execution rates than a single site execution.

Middleware for Long-running Applications on Batch Grids. Student Research Symposium poster

Computational grids with multiple batch systems (batch grids) can be powerful infrastructures for executing long-running multicomponent parallel applications. In this paper, we have constructed a middleware framework for executing such long-running applications spanning multiple submissions to the queues on multiple batch systems. We have used our framework for execution of a foremost long-running multi-component application for climate modeling, the Community Climate System Model (CCSM). Our framework coordinates the distribution, execution, migration and restart of the components of CCSM on the multiple queues where the component jobs of the different queues can have different queue waiting and startup times.

Adaptive Executions of Multi-Physics Coupled Applications on Batch Grids

Long running multi-physics coupled parallel applications have gained prominence in recent years. The high computational requirements and long durations of simulations of these applications necessitate the use of multiple systems of a Grid for execution. In this paper, we have built an adaptive middleware framework for execution of long running multi-physics coupled applications across multiple batch systems of a Grid. Our framework, apart from coordinating the executions of the component jobs of an application on different batch systems, also automatically resubmits the jobs multiple times to the batch queues to continue and sustain long running executions. As the set of active batch systems available for execution changes, our framework performs migration and rescheduling of components using a robust rescheduling decision algorithm. We have used our framework for improving the application throughput of a foremost long running multi-component application for climate modeling, the Community Climate System Model (CCSM). Our real multi-site experiments with CCSM indicate that Grid executions can lead to improved application throughput for climate models.

Large improvements in application throughput of long-running multi-component applications using batch grids

Computational grids with multiple batch systems (batch grids) can be powerful infrastructures for executing long-running multi-component parallel applications. In this paper, we evaluate the potential improvements in throughput of long-running multi-component applications when the different components of the applications are executed on multiple batch systems of batch grids. We compare the multiple batch executions with executions of the components on a single batch system without increasing the number of processors used for executions. We perform our analysis with a foremost long-running multi-component application for climate modeling, the Community Climate System Model (CCSM). We have built a robust simulator that models the characteristics of both the multi-component application and the batch systems. By conducting large number of simulations with different workload characteristics and queuing policies of the systems, processor allocations to components of the application, distributions of the components to the batch systems and inter-cluster bandwidths, we show that multiple batch executions lead to 55% average increase in throughput over single batch executions for long-running CCSM. We also conducted real experiments with a practical middleware infrastructure and showed that multi-site executions lead to effective utilization of batch systems for executions of CCSM and give higher simulation throughput than single-site executions. Copyright (c) 2011 John Wiley & Sons, Ltd.

Effect of agitation on the performance of an anaerobic sequencing batch biofilm reactor in the treatment of dairy effluents

Agitation rate is an important parameter in the operation of Anaerobic Sequencing Biofilm Batch Reactors (ASBBRs), and a proper agitation rate guarantees good mixing, improves mass transfer, and enhances the solubility of the particulate organic matter. Dairy effluents have a high amount of particulate organic matter, and their anaerobic digestion presents inhibitory intermediates (e. g., long-chain fatty acids). The importance of studying agitation in such batch systems is clear. The present study aimed to evaluate how agitation frequency influences the anaerobic treatment of dairy effluents. The ASBBR was fed with wastewater from milk pasteurisation process and cheese manufacture with no whey segregation. The organic matter concentration, measured as chemical oxygen demand (COD), was maintained at approximately 8,000 mg/L. The reactor was operated with four agitation frequencies: 500 rpm, 350 rpm, 200 rpm, and no agitation. In terms of COD removal efficiency, similar results were observed for 500 rpm and 350 rpm (around 90%) and for 200 rpm and no agitation (around 80%). Increasing the system`s agitation thus not only improved the global efficiency of organic matter removal but also influenced volatile acid production and consumption and clearly modified this balance in each experimental condition.

Mechanisms involved in Escherichia coli and Serratia marcescens removal during activated sludge wastewater treatment

Wastewater treatment reduces environmental contamination by removing gross solids and mitigating the effects of pollution. Treatment also reduces the number of indicator organisms and pathogens. In this work, the fates of two coliform bacteria, Escherichia coli and Serratia marcescens, were analyzed in an activated sludge process to determine the main mechanisms involved in the reduction of pathogenic microorganisms during wastewater treatment. These bacteria, modified to express green fluorescent protein, were inoculated in an activated sludge unit and in batch systems containing wastewater. The results suggested that, among the different biological factors implied in bacterial removal, bacterivorous protozoa play a key role. Moreover, a representative number of bacteria persisted in the system as free-living or embedded cells, but their distribution into liquid or solid fractions varied depending on the bacterium tested, questioning the real value of bacterial indicators for the control of wastewater treatment process. Additionally, viable but nonculturable cells constituted an important part of the bacterial population adhered to solid fractions, what can be derived from the competition relationships with native bacteria, present in high densities in this environment. These facts, taken together, emphasize the need for reliable quantitative and qualitative analysis tools for the evaluation of pathogenic microbial composition in sludge, which could represent an undefined risk to public health and ecosystem functions when considering its recycling.

Biodegradation and biosorption of acid anthraquinone dye

The acid anthraquinone dye Tectilon Blue (TB4R) is a major coloured component from the aqueous effluent of a carpet printing plant in Northern Ireland. The aerobic biodegradation of TB4R has been investigated experimentally in batch systems, using three strains of bacteria, namely, Bacillus gordonae (NCIMB 12553), Bacillus benzeovorans (NCIMB 12555) and Pseudomonas putida (NCIMB 9776). All three strains successfully decolourised the dye, and results were correlated using Michaelis-Menten kinetic theory. A recalculation of the reaction rate constants, to account for biosorption, gave an accurate simulation of the colour removal over a 24-h period. Up to 19% of the decolorisation was found to be caused by biosorption of the dye onto the biomass, with the majority of the decolorisation caused by utilisation of the dye by the bacteria. The reaction rate was found to be intermediate between zero and first order at dye concentrations of 200-1000 mg/l. (C) 2000 Elsevier Science Ltd. All rights reserved.

Phosphorus Adsorption onto an Industrial Acidified Laterite By‒Product: Equilibrium and Thermodynamic Investigation

The present research investigates the uptake of phosphate ions from aqueous solutions using acidified laterite (ALS), a by-product from the production of ferric aluminium sulfate using laterite. Phosphate adsorption experiments were performed in batch systems to determine the amount of phosphate adsorbed as a function of solution pH, adsorbent dosage and thermodynamic parameters per fixed P concentration. Kinetic studies were also carried out to study the effect of adsorbent particle sizes. The maximum removal capacity of ALS observed at pH 5 was 3.68 mg P g^-1. It was found that as the adsorbent dosage increases, the equilibrium pH decreases, so an adsorbent dosage of 1.0 g L^-1 of ALS was selected. Adsorption capacity (q_m) calculated from the Langmuir isotherm was found to be 2.73 mg g^-1. Kinetic experimental data were mathematically well described using the pseudo first-order model over the full range of the adsorbent particle size. The adsorption reactions were endothermic, and the process of adsorption was favoured at high temperature; the ΔG and ΔH values implied that the main adsorption mechanism of P onto ALS is physisorption. The desorption studies indicated the need to consider a NaOH 0.1M solution as an optimal solution for practical regeneration applications.

Cultivo de Haematococcus pluvialis sob condições de estresse e em consórcio microbiano visando obter maior rendimento de astaxantina

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Adsorção de cromo (VI) por carvão ativado granular de soluções diluídas utilizando um sistema batelada sob pH controlado

Na Amazônia o cromo é empregado principalmente na indústria de couro e de madeira, sendo responsável por vários problemas de saúde porque é tóxico para os seres vivos. A remoção de cromo de efluentes industriais é feita por meio de diversos processos como a adsorção. Este trabalho mostra os resultados da adsorção de Cr(VI) por carvão ativado granular comercial (CAG) como adsorvente de soluções diluídas empregando um sistema de adsorção batelada com controle de pH. Os grupos funcionais da superfície do CAG foram determinados pelo método de Boehm. Além disso, o efeito do pH na adsorção de Cr(VI), o equilíbrio e a cinética de adsorção foram estudados nas condições experimentais (pH = 6, MA = 6g, tempo de adsorção 90min.). Na superfície do CAG, os grupos carboxílicos foram determinados em maior concentração (MAS=0,43 mmol/gCAG), estes, presentes em concentrações elevadas aumentam a adsorção do metal, principalmente em valores de pH ácidos. A capacidade de adsorção é dependente do pH da solução, devido a sua influência nas propriedades de superfície do CAG e nas diferentes formas iônicas das soluções de Cr(VI). Os dados de equilíbrio da adsorção foram ajustados satisfatoriamente pela isoterma de Langmuir (R²=0,988), tipo favorável. A partir da cinética de adsorção a 5mg/L e 20mg/L, os resultados obtidos foram compatíveis com o valor limite preconizado na legislação nacional (Res. nº 357/05). Portanto, para o sistema experimental utilizando CAG foi eficiente na remoção de Cr(VI) a partir de correntes líquidas contendo baixas concentrações do metal.