A unified framework for linear function approximation of value functions in stochastic control

This paper contributes with a unified formulation that merges previ- ous analysis on the prediction of the performance ( value function ) of certain sequence of actions ( policy ) when an agent operates a Markov decision process with large state-space. When the states are represented by features and the value function is linearly approxi- mated, our analysis reveals a new relationship between two common cost functions used to obtain the optimal approximation. In addition, this analysis allows us to propose an efficient adaptive algorithm that provides an unbiased linear estimate. The performance of the pro- posed algorithm is illustrated by simulation, showing competitive results when compared with the state-of-the-art solutions.

Quantification of impacts in artistic gymnastics with accelerometry: an approximation

Intensity and volume of training in Artisti Gymnastics are increasing as the sooner athlete's age of incorporation creating some disturbance in them.

Quasi-cylindrical approximation to the swirling flow in an atomizer chamber

A quasi-cylindrical approximation is used to analyse the axisymmetric swirling flow of a liquid with a hollow air core in the chamber of a pressure swirl atomizer. The liquid is injected into the chamber with an azimuthal velocity component through a number of slots at the periphery of one end of the chamber, and flows out as an anular sheet through a central orifice at the other end, following a conical convergence of the chamber wall. An effective inlet condition is used to model the effects of the slots and the boundary layer that develops at the nearby endwall of the chamber. An analysis is presented of the structure of the liquid sheet at the end of the exit orifice, where the flow becomes critical in the sense that upstream propagation of long-wave perturbations ceases to be possible. This nalysis leads to a boundary condition at the end of the orifice that is an extension of the condition of maximum flux used with irrotational models of the flow. As is well known, the radial pressure gradient induced by the swirling flow in the bulk of the chamber causes the overpressure that drives the liquid towards the exit orifice, and also leads to Ekman pumping in the boundary layers of reduced azimuthal velocity at the convergent wall of the chamber and at the wall opposite to the exit orifice. The numerical results confirm the important role played by the boundary layers. They make the thickness of the liquid sheet at the end of the orifice larger than predicted by rrotational models, and at the same time tend to decrease the overpressure required to pass a given flow rate through the chamber, because the large axial velocity in the boundary layers takes care of part of the flow rate. The thickness of the boundary layers increases when the atomizer constant (the inverse of a swirl number, proportional to the flow rate scaled with the radius of the exit orifice and the circulation around the air core) decreases. A minimum value of this parameter is found below which the layer of reduced azimuthal velocity around the air core prevents the pressure from increasing and steadily driving the flow through the exit orifice. The effects of other parameters not accounted for by irrotational models are also analysed in terms of their influence on the boundary layers.

Contribution to Load-Frequency Regulation of a Hydropower Plant with Long Tail-Race Tunnel

In this paper, a hydroelectric power plant with long tail-race tunnel has been modelled for assessing its contribution to secondary regulation reserve. Cavitation problems, caused by the discharge conduit length, are expected downstream the turbine where low pressure appears during regulation manoeuvres. Therefore, governor's gains should be selected taking into account these phenomena. On the other hand, regulation services bidden by the plant operator should fulfil TSO (Transmission System Operator) quality requirements. A methodology for tuning governor PI gains is proposed and applied to a Hydro power plant in pre-design phase in northwest area of Spain. The PI gains adjustment proposed provides a proper plant response, according to some established indexes, while avoiding cavitation phenomena.

Optimal Piecewise Linear Function Approximation for GPU-based Applications

Many computer vision and human-computer interaction applications developed in recent years need evaluating complex and continuous mathematical functions as an essential step toward proper operation. However, rigorous evaluation of this kind of functions often implies a very high computational cost, unacceptable in real-time applications. To alleviate this problem, functions are commonly approximated by simpler piecewise-polynomial representations. Following this idea, we propose a novel, efficient, and practical technique to evaluate complex and continuous functions using a nearly optimal design of two types of piecewise linear approximations in the case of a large budget of evaluation subintervals. To this end, we develop a thorough error analysis that yields asymptotically tight bounds to accurately quantify the approximation performance of both representations. It provides an improvement upon previous error estimates and allows the user to control the trade-off between the approximation error and the number of evaluation subintervals. To guarantee real-time operation, the method is suitable for, but not limited to, an efficient implementation in modern Graphics Processing Units (GPUs), where it outperforms previous alternative approaches by exploiting the fixed-function interpolation routines present in their texture units. The proposed technique is a perfect match for any application requiring the evaluation of continuous functions, we have measured in detail its quality and efficiency on several functions, and, in particular, the Gaussian function because it is extensively used in many areas of computer vision and cybernetics, and it is expensive to evaluate.

Frequency control support of a wind-solar isolated system by a hydropower plant with long tail-race tunnel

Pumped storage hydro plants (PSHP) can provide adequate energy storage and frequency regulation capacities in isolated power systems having significant renewable energy resources. Due to its high wind and solar potential, several plans have been developed for La Palma Island in the Canary archipelago, aimed at increasing the penetration of these energy sources. In this paper, the performance of the frequency control of La Palma power system is assessed, when the demand is supplied by the available wind and solar generation with the support of a PSHP which has been predesigned for this purpose. The frequency regulation is provided exclusively by the PSHP. Due to topographic and environmental constraints, this plant has a long tail-race tunnel without a surge tank. In this configuration, the effects of pressure waves cannot be neglected and, therefore, usual recommendations for PID governor tuning provide poor performance. A PI governor tuning criterion is proposed for the hydro plant and compared with other criteria according to several performance indices. Several scenarios considering solar and wind energy penetration have been simulated to check the plant response using the proposed criterion. This tuning of the PI governor maintains La Palma system frequency within grid code requirements.

The segmental approximation in multijunction solar cells

The segmental approach has been considered to analyze dark and light I-V curves. The photovoltaic (PV) dependence of the open-circuit voltage (Voc), the maximum power point voltage (Vm), the efficiency (?) on the photogenerated current (Jg), or on the sunlight concentration ratio (X), are analyzed, as well as other photovoltaic characteristics of multijunction solar cells. The characteristics being analyzed are split into monoexponential (linear in the semilogarithmic scale) portions, each of which is characterized by a definite value of the ideality factor A and preexponential current J0. The monoexponentiality ensures advantages, since at many steps of the analysis, one can use the analytical dependences instead of numerical methods. In this work, an experimental procedure for obtaining the necessary parameters has been proposed, and an analysis of GaInP/GaInAs/Ge triple-junction solar cell characteristics has been carried out. It has been shown that up to the sunlight concentration ratios, at which the efficiency maximum is achieved, the results of calculation of dark and light I-V curves by the segmental method fit well with the experimental data. An important consequence of this work is the feasibility of acquiring the resistanceless dark and light I-V curves, which can be used for obtaining the I-V curves characterizing the losses in the transport part of a solar cell.

A stochastic approximation algorithm with Markov chain Monte-Carlo method for incomplete data estimation problems

We propose a general procedure for solving incomplete data estimation problems. The procedure can be used to find the maximum likelihood estimate or to solve estimating equations in difficult cases such as estimation with the censored or truncated regression model, the nonlinear structural measurement error model, and the random effects model. The procedure is based on the general principle of stochastic approximation and the Markov chain Monte-Carlo method. Applying the theory on adaptive algorithms, we derive conditions under which the proposed procedure converges. Simulation studies also indicate that the proposed procedure consistently converges to the maximum likelihood estimate for the structural measurement error logistic regression model.

The N-terminal tail of histone H2A binds to two distinct sites within the nucleosome core

Each of the core histone proteins within the nucleosome has a central “structured” domain that comprises the spool onto which the DNA superhelix is wrapped and an N-terminal “tail” domain in which the structure and molecular interactions have not been rigorously defined. Recent studies have shown that the N-terminal domains of core histones probably contact both DNA and proteins within the nucleus and that these interactions play key roles in the regulation of nuclear processes (such as transcription and replication) and are critical in the formation of the chromatin fiber. An understanding of these complex mechanisms awaits identification of the DNA or protein sites within chromatin contacted by the tail domains. To this end, we have developed a site-specific histone protein–DNA photocross-linking method to identify the DNA binding sites of the N-terminal domains within chromatin complexes. With this approach, we demonstrate that the N-terminal tail of H2A binds DNA at two defined locations within isolated nucleosome cores centered around a position ≈40 bp from the nucleosomal dyad and that this tail probably adopts a defined structure when bound to DNA.

Translation initiation factor eIF4G mediates in vitro poly(A) tail-dependent translation

The yeast translation factor eIF4G associates with both the cap-binding protein eIF4E and the poly(A)-binding protein Pab1p. Here we report that the two yeast eIF4G homologs, Tif4631p and Tif4632p, share a conserved Pab1p-binding site. This site is required for Pab1p and poly(A) tails to stimulate the in vitro translation of uncapped polyadenylylated mRNA, and the region encompassing it is required for the cap and the poly(A) tail to synergistically stimulate translation. This region on Tif4631p becomes essential for cell growth when the eIF4E binding site on Tif4631p is mutated. Pab1p mutations also show synthetic lethal interactions with eIF4E mutations. These data suggest that eIF4G mediates poly(A) tail stimulated translation in vitro, and that Pab1p and the domain encompassing the Pab1p-binding site on eIF4G can compensate for partial loss of eIF4E function in vivo.

Domain-specific gene disruption reveals critical regulation of neuregulin signaling by its cytoplasmic tail

Neuregulins are a multi-isoform family of growth factors that activate members of the erbB family of receptor tyrosine kinases. The membrane-anchored isoforms contain the receptor-activating ligand in their extracellular domain, a single membrane-spanning region, and a long cytoplasmic tail. To evaluate the potential biological role of the intracellular domain of the membrane-anchored neuregulin isoforms, we used a domain-specific gene disruption approach to produce a mouse line in which only the region of the neuregulin gene encoding almost the entire intracellular domain was disrupted. Consistent with previous reports in which all neuregulin isoforms were disrupted, the resulting homozygous neuregulin mutants died at E10.5 of circulatory failure and displayed defects in neural and cardiac development. To further understand these in vivo observations, we evaluated a similarly truncated neuregulin construct after transient expression in COS-7 cells. This cytoplasmic tail-deleted mutant, unlike wild-type neuregulin isoforms, was resistant to proteolytic release of its extracellular-domain ligand, a process required for erbB receptor activation. Thus, proteolytic processing of the membrane-bound neuregulin isoforms involved in cranial ganglia and heart embryogenesis is likely developmentally regulated and is critically controlled by their intracellular domain. This observation indicates that erbB receptor activation by membrane-bound neuregulins most likely involves a unique temporally and spatially regulated “inside-out” signaling process that is critical for processing and release of the extracellular-domain ligand.

Ligation of intestinal epithelial CD1d induces bioactive IL-10: Critical role of the cytoplasmic tail in autocrine signaling

The intestinal epithelium is anatomically positioned to serve as the critical interface between the lumen and the mucosal immune system. In addition to MHC class I and II antigens, intestinal epithelia constitutively express the nonclassical MHC molecule CD1d, a transmembrane molecule with a short cytoplasmic tail expressed as a β2-microglobulin-associated 48-kDa glycoprotein and novel β2-microglobulin-independent 37-kDa nonglycosylated protein on intestinal epithelia. At present, it is not known whether extracellular ligands can signal intestinal epithelial CD1d. To define signaling of CD1d cytoplasmic tail, retrovirus-mediated gene transfer was used to generate stable cell lines expressing wild-type CD1d or a chimeric molecule (extracellular CD1d and cytoplasmic CD1a), and surface CD1d was triggered by antibody crosslinking. Although wild-type CD1d was readily activated (tyrosine phosphorylation), no demonstrable signal was evident in cell lines expressing the chimeric molecule. Subsequent studies revealed that anti-CD1d crosslinking specifically induces epithelial IL-10 mRNA and protein and is blocked by the tyrosine kinase inhibitor genistein. Further studies addressing epithelial-derived IL-10 revealed that anti-CD1d crosslinking attenuates IFN-γ signaling and that such attenuation is reversed by addition of functionally inhibitory IL-10 antibodies. These results define signaling through surface CD1d, and, importantly, they demonstrate that this pathway may serve to dampen epithelial proinflammatory signals.

The terminal tail region of a yeast myosin-V mediates its attachment to vacuole membranes and sites of polarized growth

The Saccharomyces cerevisiae myosin-V, Myo2p, has been implicated in the polarized movement of several organelles and is essential for yeast viability. We have shown previously that Myo2p is required for the movement of a portion of the lysosome (vacuole) into the bud and consequently for proper inheritance of this organelle during cell division. Class V myosins have a globular carboxyl terminal tail domain that is proposed to mediate localization of the myosin, possibly through interaction with organelle-specific receptors. Here we describe a myo2 allele whose phenotypes support this hypothesis. vac15–1/myo2–2 has a single mutation in this globular tail domain, causing defects in vacuole movement and inheritance. Although a portion of wild-type Myo2p fractionates with the vacuole, the myo2–2 gene product does not. In addition, the mutant protein does not concentrate at sites of active growth, the predominant location of wild-type Myo2p. Although deletion of the tail domain is lethal, the myo2–2 gene product retains the essential functions of Myo2p. Moreover, myo2–2 does not cause the growth defects and lethal genetic interactions seen in myo2–66, a mutant defective in the actin-binding domain. These observations suggest that the myo2–2 mutation specifically disrupts interactions with selected myosin receptors, namely those on the vacuole membrane and those at sites of polarized growth.

Proper sorting of the cation-dependent mannose 6-phosphate receptor in endosomes depends on a pair of aromatic amino acids in its cytoplasmic tail

The 67-amino acid cytoplasmic tail of the cation-dependent mannose 6-phosphate receptor (CD-MPR) contains a signal(s) that prevents the receptor from entering lysosomes where it would be degraded. To identify the key residues required for proper endosomal sorting, we analyzed the intracellular distribution of mutant forms of the receptor by Percoll density gradients. A receptor with a Trp19 → Ala substitution in the cytoplasmic tail was highly missorted to lysosomes whereas receptors with either Phe18 → Ala or Phe13 → Ala mutations were partially defective in avoiding transport to lysosomes. Analysis of double and triple mutants confirmed the key role of Trp19 for sorting of the CD-MPR in endosomes, with Phe18, Phe13, and several neighboring residues contributing to this function. The addition of the Phe18-Trp19 motif of the CD-MPR to the cytoplasmic tail of the lysosomal membrane protein Lamp1 was sufficient to partially impair its delivery to lysosomes. Replacing Phe18 and Trp19 with other aromatic amino acids did not impair endosomal sorting of the CD-MPR, indicating that two aromatic residues located at these positions are sufficient to prevent the receptor from trafficking to lysosomes. However, alterations in the spacing of the diaromatic amino acid sequence relative to the transmembrane domain resulted in receptor accumulation in lysosomes. These findings indicate that the endosomal sorting of the CD-MPR depends on the correct presentation of a diaromatic amino acid-containing motif in its cytoplasmic tail. Because a diaromatic amino acid sequence is also present in the cytoplasmic tail of other receptors known to be internalized from the plasma membrane, this feature may prove to be a general determinant for endosomal sorting.

Phosphorylation of Tyrosine 992, 1068, and 1086 Is Required for Conformational Change of the Human Epidermal Growth Factor Receptor C-Terminal Tail

We reported previously that a conformation-specific antibody, Ab P2, to a 16-amino acid peptide (Glu-Gly-Tyr-Lys-Lys-Lys-Tyr-Gln-Gln-Val-Asp-Glu-Glu-Phe-Leu-Arg) of the cytoplasmic domain of the β-type platelet-derived growth factor receptor also recognizes the epidermal growth factor (EGF) receptor. Although the antibody is not directed to phosphotyrosine, it recognizes in immunoprecipitation the activated and hence phosphorylated form of both receptors. In P2 peptide, there are two tripeptide sequences, Asp-Glu-Glu and Tyr-Gln-Gln, that are also present in the EGF receptor. Our present studies using either EGF receptor C-terminal deletion mutants or point mutations (Tyr→Phe) and our previous studies on antibody inhibition by P2-derived peptides suggest that Gln-Gln in combination with Asp-Glu-Glu forms a high-affinity complex with Ab P2 and that such complex formation is dependent on tyrosine phosphorylation. Of the five phosphate acceptor sites in the EGF receptor, clustered in the extreme C-terminal tail, phosphorylation of three tyrosine residues (992, 1068, and 1086) located between Asp-Glu-Glu and Gln-Gln is necessary for Ab P2 binding. In contrast, the acceptor sites Tyr 1173 and 1148 play no role in the conformation change. Asp-Glu-Glu and Gln-Gln are located 169 amino acids apart, and it is highly likely that the interactions among three negatively charged phosphotyrosine residues in the receptor C terminus may result in the bending of the peptide chain in such a way that these two peptides come close to each other to form an antibody-binding site. Such a possibility is also supported by our finding that receptor dephosphorylation results in complete loss of Ab P2–binding activity. In conclusion, we have identified a domain within the cytoplasmic part of the EGF receptor whose conformation is altered by receptor phosphorylation; furthermore, we have identified the tyrosine residues that positively regulate this conformation.