The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.

Avoiding Divergence in the Shalvi-Weinstein Algorithm

The most popular algorithms for blind equalization are the constant-modulus algorithm (CMA) and the Shalvi-Weinstein algorithm (SWA). It is well-known that SWA presents a higher convergence rate than CMA. at the expense of higher computational complexity. If the forgetting factor is not sufficiently close to one, if the initialization is distant from the optimal solution, or if the signal-to-noise ratio is low, SWA can converge to undesirable local minima or even diverge. In this paper, we show that divergence can be caused by an inconsistency in the nonlinear estimate of the transmitted signal. or (when the algorithm is implemented in finite precision) by the loss of positiveness of the estimate of the autocorrelation matrix, or by a combination of both. In order to avoid the first cause of divergence, we propose a dual-mode SWA. In the first mode of operation. the new algorithm works as SWA; in the second mode, it rejects inconsistent estimates of the transmitted signal. Assuming the persistence of excitation condition, we present a deterministic stability analysis of the new algorithm. To avoid the second cause of divergence, we propose a dual-mode lattice SWA, which is stable even in finite-precision arithmetic, and has a computational complexity that increases linearly with the number of adjustable equalizer coefficients. The good performance of the proposed algorithms is confirmed through numerical simulations.

Jointly multi-user detection and channel estimation with genetic algorithm

This work aims at proposing the use of the evolutionary computation methodology in order to jointly solve the multiuser channel estimation (MuChE) and detection problems at its maximum-likelihood, both related to the direct sequence code division multiple access (DS/CDMA). The effectiveness of the proposed heuristic approach is proven by comparing performance and complexity merit figures with that obtained by traditional methods found in literature. Simulation results considering genetic algorithm (GA) applied to multipath, DS/CDMA and MuChE and multi-user detection (MuD) show that the proposed genetic algorithm multi-user channel estimation (GAMuChE) yields a normalized mean square error estimation (nMSE) inferior to 11%, under slowly varying multipath fading channels, large range of Doppler frequencies and medium system load, it exhibits lower complexity when compared to both maximum likelihood multi-user channel estimation (MLMuChE) and gradient descent method (GrdDsc). A near-optimum multi-user detector (MuD) based on the genetic algorithm (GAMuD), also proposed in this work, provides a significant reduction in the computational complexity when compared to the optimum multi-user detector (OMuD). In addition, the complexity of the GAMuChE and GAMuD algorithms were (jointly) analyzed in terms of number of operations necessary to reach the convergence, and compared to other jointly MuChE and MuD strategies. The joint GAMuChE-GAMuD scheme can be regarded as a promising alternative for implementing third-generation (3G) and fourth-generation (4G) wireless systems in the near future. Copyright (C) 2010 John Wiley & Sons, Ltd.

Hardware/firmware implementation of a soft sensor using an improved version of a fuzzy identification algorithm

This paper presents the design and implementation of an embedded soft sensor, i. e., a generic and autonomous hardware module, which can be applied to many complex plants, wherein a certain variable cannot be directly measured. It is implemented based on a fuzzy identification algorithm called ""Limited Rules"", employed to model continuous nonlinear processes. The fuzzy model has a Takagi-Sugeno-Kang structure and the premise parameters are defined based on the Fuzzy C-Means (FCM) clustering algorithm. The firmware contains the soft sensor and it runs online, estimating the target variable from other available variables. Tests have been performed using a simulated pH neutralization plant. The results of the embedded soft sensor have been considered satisfactory. A complete embedded inferential control system is also presented, including a soft sensor and a PID controller. (c) 2007, ISA. Published by Elsevier Ltd. All rights reserved.

The single machine earliness and tardiness scheduling problem: lower bounds and a branch-and-bound algorithm

This paper addresses the single machine scheduling problem with a common due date aiming to minimize earliness and tardiness penalties. Due to its complexity, most of the previous studies in the literature deal with this problem using heuristics and metaheuristics approaches. With the intention of contributing to the study of this problem, a branch-and-bound algorithm is proposed. Lower bounds and pruning rules that exploit properties of the problem are introduced. The proposed approach is examined through a computational comparative study with 280 problems involving different due date scenarios. In addition, the values of optimal solutions for small problems from a known benchmark are provided.

Interaction between forest fragments and adjacent coffee and pasture agroecosystems: responses of the ant communities (Hymenoptera, Formicidae)

The responses of the ant community to environmental change, from forest fragment to agroecosystems (coffee or pasture) were evaluated in the south of the state of Minas Gerais, Brazil. In this paper we analized the interactions between forest and the two most typical agroecosystem from southest Brazil: sun-growing coffee plantation and introduced pasture. We sampled the ant community from five of each agroecosystems, inside the adjacent forest fragment, and on the edge between them. In each site we removed the litter from fifteen 1m(2) plots and extracted the ants using a Winkler extractor. A total of 165 ant species, distributed in 48 genera and 10 subfamilies were recorded. The coffee plantation presented the lowest abundance and estimated species richness. The causes of the changes observed among the areas are discussed.

Malnourished mice display an impaired hematologic response to granulocyte colony-stimulating factor administration

The aim of this Study was to determine if protein-energy malnutrition Could affect the hematologic response to granulocyte colony-stimulating factor (G-CSF). Swiss mice were fled a low-protein diet containing 4% protein, whereas control mice were fed a 20% protein-containing diet. After the malnourished group lost 20% of their original body weight, the mice were subdivided in 2 treatment groups, and hematopoietic parameters were studied. Mice were injected with either 8 mu g/kg per day of G-CSF or saline twice daily for 4 days. Malnourished mice developed anemia with reticulopenia and leukopenia with depletion of granulocytes and lymphocytes. Both malnourished and control mice treated with G-CSF showed a significant increase in neutrophils; however, in the control group, this increase was more pronounced compared to the malnourished group (4.5-fold and 3.4-fold, respectively). Granulocyte colony-stimulating factor administration increased bone marrow blastic (P < .001) and granulocytic (P < .01) compartments in the controls bill had no significant effect oil these hematopoietic compartments in the Malnourished animals (P = .08 and P = .62, respectively). We report that malnourished mice display an impaired response to G-CSF, which contributes to the decreased production of leukocytes in protein-energy malnutrition. (C) 2008 Elsevier Inc. All rights reserved.

Impact of adenosine nucleotide translocase (ANT) proline isomerization on Ca(2+)-induced cysteine relative mobility/mitochondrial permeability transition pore

Mitochondrial membrane carriers containing proline and cysteine, such as adenine nucleotide translocase (ANT), are potential targets of cyclophilin D (CyP-D) and potential Ca(2+)-induced permeability transition pore (PTP) components or regulators; CyP-D, a mitochondrial peptidyl-prolyl cis-trans isomerase, is the probable target of the PTP inhibitor cyclosporine A (CsA). In the present study, the impact of proline isomerization (from trans to cis) on the mitochondrial membrane carriers containing proline and cysteine was addressed using ANT as model. For this purpose, two different approaches were used: (i) Molecular dynamic (MD) analysis of ANT-Cys(56) relative mobility and (ii) light scattering techniques employing rat liver isolated mitochondria to assess both Ca(2+)-induced ANT conformational change and mitochondrial swelling. ANT-Pro(61) isomerization increased ANT-Cys(56) relative mobility and, moreover, desensitized ANT to the prevention of this effect by ADP. In addition, Ca(2+) induced ANT ""c"" conformation and opened PTP; while the first effect was fully inhibited, the second was only attenuated by CsA or ADP. Atractyloside (ATR), in turn, stabilized Ca(2+)-induced ANT ""c"" conformation, rendering the ANT conformational change and PTP opening less sensitive to the inhibition by CsA or ADP. These results suggest that Ca(2+) induces the ANT ""c"" conformation, apparently associated with PTP opening, but requires the CyP-D peptidyl-prolyl cis-trans isomerase activity for sustaining both effects.

Chemical Signals in the Stingless Bee, Frieseomelitta varia, Indicate Caste, Gender, Age, and Reproductive Status

Chemical compounds on the cuticle are a rich source of information used during interactions among social insects. Despite the multitude of studies on these substances and their function in ants, wasps, and honeybees, little is known about this subject in stingless bees (Hymenoptera: Apidae, Meliponini). We studied the chemical composition of the cuticle of the stingless bee, Frieseomelitta varia, by gas chromatography-mass spectrometry (GC-MS), to investigate potential chemical variation among castes, gender, age, and reproductive status. We found differences in the cuticular hydrocarbon composition among workers, males, and queens, recording both qualitative and quantitative differences among individuals of different ages and gender. The cuticle of physogastric queens presented a chemical profile that was distinct from all other groups in the analysis, with high relative abundances of alkenes and alkadienes with 27, 29, and 31 carbon atoms. We discuss the possibility that these compounds signal a queen`s presence to the colony, thereby initiating all vital worker-queen interactions.

Ca(2+) binding to c-state of adenine nucleotide translocase (ANT)-surrounding cardiolipins enhances (ANT)-Cys(56) relative mobility: A computational-based mitochondrial permeability transition study

The oxidation of critical cysteines/related thiols of adenine nucleotide translocase (ANT) is believed to be an important event of the Ca(2+)-induced mitochondrial permeability transition (MPT), a process mediated by a cyclosporine A/ADP-sensitive permeability transition pores (PTP) opening. We addressed the ANT-Cys(56) relative mobility status resulting from the interaction of ANT/surrounding cardiolipins with Ca(2+) and/or ADP by means of computational chemistry analysis (Molecular Interaction Fields and Molecular Dynamics studies), supported by classic mitochondrial swelling assays. The following events were predicted: (i) Ca(2+) interacts preferentially with the ANT surrounding cardiolipins bound to the H4 helix of translocase, (ii) weakens the cardiolipins/ANT interactions and (iii) destabilizes the initial ANT-Cys(56) residue increasing its relative mobility. The binding of ADP that stabilizes the conformation ""m"" of ANT and/or cardiolipin, respectively to H5 and H4 helices, could stabilize their contacts with the short helix h56 that includes Cys(56), accounting for reducing its relative mobility. The results suggest that Ca(2+) binding to adenine nucleotide translocase (ANT)-surrounding cardiolipins in c-state of the translocase enhances (ANT)-Cys(56) relative mobility and that this may constitute a potential critical step of Ca(2+)-induced PTP opening. (C) 2009 Elsevier B.V. All rights reserved.

A spectral clustering algorithm for manufacturing cell formation

A graph clustering algorithm constructs groups of closely related parts and machines separately. After they are matched for the least intercell moves, a refining process runs on the initial cell formation to decrease the number of intercell moves. A simple modification of this main approach can deal with some practical constraints, such as the popular constraint of bounding the maximum number of machines in a cell. Our approach makes a big improvement in the computational time. More importantly, improvement is seen in the number of intercell moves when the computational results were compared with best known solutions from the literature. (C) 2009 Elsevier Ltd. All rights reserved.

Co-occurrence of three types of egg policing in the Norwegian wasp Dolichovespula norwegica

In insect societies, workers often try to challenge the reproductive monopoly of the queen by laying their own eggs. Successful worker reproduction, however, is frequently prevented by queen policing or worker policing, whereby either the mother queen or non-reproductive workers selectively kill worker-laid eggs. Recently, a third mechanism-""selfish"" worker policing-has also been described in which the workers selectively police worker-laid eggs but also lay eggs themselves. Here, we present results from the monogynous wasp Dolichovespula norwegica, which show that all three kinds of policing-queen policing, worker policing and ""selfish"" worker policing-co-occur. The net effect of these three kinds of policing collectively favoured the queen`s reproduction, as within 1 day 44% of the worker-laid eggs versus only 8% of the queen-laid eggs were eaten. Of the worker-laid eggs that were killed by workers, approximately two thirds were eaten by the reproductive workers even though these made up only a small proportion, 8%, of the work force. This means that policing workers obtained both direct fitness benefits as well as indirect (inclusive) fitness. In addition, we show that worker policing was carried out by a limited, specialised set of workers that was estimated to constitute approximately one quarter of the whole colony and of which 66% were non-reproductive.

Worker demography in a large-colony, swarm-founding wasp

Neotropical swarm-founding wasps build nests enclosed in a covering envelope, which makes it difficult to count individual births and deaths. Thus, knowledge of worker demography is very limited for swarm-founding species compared with that for independent-founding species. In this study, we explored the worker demography of the swarm-founding wasp Polybia paulista, the colony size of which usually exceeds several thousand adults. We considered each wasp colony as an open-population and estimated the survival probability, recruitment rate, and population size of workers using the developments of the Cormack-Jolly-Seber model. We found that capture probability varied considerably among the workers, probably due to age polyethism and/or task specialization. The daily survival rate of workers was high (around 0.97) throughout the season and was not related to the phase of colony development. On the other hand, the recruitment rate ranged from 0 to 0.37, suggesting that worker production was substantially less important than worker survival in determining worker population fluctuations. When we compared survival rates among worker groups of one colony, the mean daily survival rate was lower for founding workers than for progeny workers and tended to be higher in progeny workers that emerged in winter. These differences in survivorship patterns among worker cohorts would be related to worker foraging activity and/or level of parasitism.

How does a colony of Apoica flavissima (Hymenoptera: Vespidae, Epiponini) maintain a constant temperature?

The thermal characteristics of a colony of Apoica flavissima, an epiponine wasp, were examined. The nest, with a diameter of slightly less than 30 cm, was built on a twig of an orange tree. The temperature of the roof surface fluctuated greatly, ranging between 19.1 and 41.5 degrees C. However, the temperature in the central cell was kept constant at around 27 degrees C throughout a day. Although heavy rain pelted the nest roof in the morning, the central cell maintained temperatures higher than 25 degrees C. On the contrary, after all immature and adult wasps were removed the temperature in the nest fluctuated considerably. The presence of immature individuals and adult wasps densely covering the under surface of the comb seemed to function as an effective insulator. The smaller temperature fluctuation in the central cell than on the roof surface, when the nest was in the empty state, suggests that the thick spongy tissue of the roof made from curled plant leaf hairs serves as an insulator to prevent the conduction of solar heat into the cells and the outward flow of heat generated in cells, especially at night.

Ant visitation to extrafloral nectaries decreases herbivory and increases fruit set in Chamaecrista debilis (Fabaceae) in a Neotropical savanna

Studies of ant-plant relationships elucidate how top-down effects of the third trophic level can affect the biomass, richness, and/or species composition of plants. Although widespread in the neotropics, few studies have so far examined the direct effects of ants on plant fitness. Here, through experimental manipulation (ant-exclusion) under natural conditions, we examined the effect of ant visitation to extrafloral nectaries on leaf herbivory and fruit set in Chamaecrista debilis in the Brazilian savanna. As opposed to other Chamaecrista species, our results showed that visiting ants (15 species) significantly reduce herbivory and increase fruit set by more than 50% compared to plants from which ants were excluded. This mutualistic system is facultative in nature, and corroborates the potential beneficial role of exudate-feeding ants as anti-herbivore agents of tropical plants. (C) 2010 Elsevier GmbH. All rights reserved.