Automated wordlength optimization framework for multi-source statistical interval-based analysis of nonlinear systems with control-flow structures

El uso de aritmética de punto fijo es una opción de diseño muy extendida en sistemas con fuertes restricciones de área, consumo o rendimiento. Para producir implementaciones donde los costes se minimicen sin impactar negativamente en la precisión de los resultados debemos llevar a cabo una asignación cuidadosa de anchuras de palabra. Encontrar la combinación óptima de anchuras de palabra en coma fija para un sistema dado es un problema combinatorio NP-hard al que los diseñadores dedican entre el 25 y el 50 % del ciclo de diseño. Las plataformas hardware reconfigurables, como son las FPGAs, también se benefician de las ventajas que ofrece la aritmética de coma fija, ya que éstas compensan las frecuencias de reloj más bajas y el uso más ineficiente del hardware que hacen estas plataformas respecto a los ASICs. A medida que las FPGAs se popularizan para su uso en computación científica los diseños aumentan de tamaño y complejidad hasta llegar al punto en que no pueden ser manejados eficientemente por las técnicas actuales de modelado de señal y ruido de cuantificación y de optimización de anchura de palabra. En esta Tesis Doctoral exploramos distintos aspectos del problema de la cuantificación y presentamos nuevas metodologías para cada uno de ellos: Las técnicas basadas en extensiones de intervalos han permitido obtener modelos de propagación de señal y ruido de cuantificación muy precisos en sistemas con operaciones no lineales. Nosotros llevamos esta aproximación un paso más allá introduciendo elementos de Multi-Element Generalized Polynomial Chaos (ME-gPC) y combinándolos con una técnica moderna basada en Modified Affine Arithmetic (MAA) estadístico para así modelar sistemas que contienen estructuras de control de flujo. Nuestra metodología genera los distintos caminos de ejecución automáticamente, determina las regiones del dominio de entrada que ejercitarán cada uno de ellos y extrae los momentos estadísticos del sistema a partir de dichas soluciones parciales. Utilizamos esta técnica para estimar tanto el rango dinámico como el ruido de redondeo en sistemas con las ya mencionadas estructuras de control de flujo y mostramos la precisión de nuestra aproximación, que en determinados casos de uso con operadores no lineales llega a tener tan solo una desviación del 0.04% con respecto a los valores de referencia obtenidos mediante simulación. Un inconveniente conocido de las técnicas basadas en extensiones de intervalos es la explosión combinacional de términos a medida que el tamaño de los sistemas a estudiar crece, lo cual conlleva problemas de escalabilidad. Para afrontar este problema presen tamos una técnica de inyección de ruidos agrupados que hace grupos con las señales del sistema, introduce las fuentes de ruido para cada uno de los grupos por separado y finalmente combina los resultados de cada uno de ellos. De esta forma, el número de fuentes de ruido queda controlado en cada momento y, debido a ello, la explosión combinatoria se minimiza. También presentamos un algoritmo de particionado multi-vía destinado a minimizar la desviación de los resultados a causa de la pérdida de correlación entre términos de ruido con el objetivo de mantener los resultados tan precisos como sea posible. La presente Tesis Doctoral también aborda el desarrollo de metodologías de optimización de anchura de palabra basadas en simulaciones de Monte-Cario que se ejecuten en tiempos razonables. Para ello presentamos dos nuevas técnicas que exploran la reducción del tiempo de ejecución desde distintos ángulos: En primer lugar, el método interpolativo aplica un interpolador sencillo pero preciso para estimar la sensibilidad de cada señal, y que es usado después durante la etapa de optimización. En segundo lugar, el método incremental gira en torno al hecho de que, aunque es estrictamente necesario mantener un intervalo de confianza dado para los resultados finales de nuestra búsqueda, podemos emplear niveles de confianza más relajados, lo cual deriva en un menor número de pruebas por simulación, en las etapas iniciales de la búsqueda, cuando todavía estamos lejos de las soluciones optimizadas. Mediante estas dos aproximaciones demostramos que podemos acelerar el tiempo de ejecución de los algoritmos clásicos de búsqueda voraz en factores de hasta x240 para problemas de tamaño pequeño/mediano. Finalmente, este libro presenta HOPLITE, una infraestructura de cuantificación automatizada, flexible y modular que incluye la implementación de las técnicas anteriores y se proporciona de forma pública. Su objetivo es ofrecer a desabolladores e investigadores un entorno común para prototipar y verificar nuevas metodologías de cuantificación de forma sencilla. Describimos el flujo de trabajo, justificamos las decisiones de diseño tomadas, explicamos su API pública y hacemos una demostración paso a paso de su funcionamiento. Además mostramos, a través de un ejemplo sencillo, la forma en que conectar nuevas extensiones a la herramienta con las interfaces ya existentes para poder así expandir y mejorar las capacidades de HOPLITE. ABSTRACT Using fixed-point arithmetic is one of the most common design choices for systems where area, power or throughput are heavily constrained. In order to produce implementations where the cost is minimized without negatively impacting the accuracy of the results, a careful assignment of word-lengths is required. The problem of finding the optimal combination of fixed-point word-lengths for a given system is a combinatorial NP-hard problem to which developers devote between 25 and 50% of the design-cycle time. Reconfigurable hardware platforms such as FPGAs also benefit of the advantages of fixed-point arithmetic, as it compensates for the slower clock frequencies and less efficient area utilization of the hardware platform with respect to ASICs. As FPGAs become commonly used for scientific computation, designs constantly grow larger and more complex, up to the point where they cannot be handled efficiently by current signal and quantization noise modelling and word-length optimization methodologies. In this Ph.D. Thesis we explore different aspects of the quantization problem and we present new methodologies for each of them: The techniques based on extensions of intervals have allowed to obtain accurate models of the signal and quantization noise propagation in systems with non-linear operations. We take this approach a step further by introducing elements of MultiElement Generalized Polynomial Chaos (ME-gPC) and combining them with an stateof- the-art Statistical Modified Affine Arithmetic (MAA) based methodology in order to model systems that contain control-flow structures. Our methodology produces the different execution paths automatically, determines the regions of the input domain that will exercise them, and extracts the system statistical moments from the partial results. We use this technique to estimate both the dynamic range and the round-off noise in systems with the aforementioned control-flow structures. We show the good accuracy of our approach, which in some case studies with non-linear operators shows a 0.04 % deviation respect to the simulation-based reference values. A known drawback of the techniques based on extensions of intervals is the combinatorial explosion of terms as the size of the targeted systems grows, which leads to scalability problems. To address this issue we present a clustered noise injection technique that groups the signals in the system, introduces the noise terms in each group independently and then combines the results at the end. In this way, the number of noise sources in the system at a given time is controlled and, because of this, the combinato rial explosion is minimized. We also present a multi-way partitioning algorithm aimed at minimizing the deviation of the results due to the loss of correlation between noise terms, in order to keep the results as accurate as possible. This Ph.D. Thesis also covers the development of methodologies for word-length optimization based on Monte-Carlo simulations in reasonable times. We do so by presenting two novel techniques that explore the reduction of the execution times approaching the problem in two different ways: First, the interpolative method applies a simple but precise interpolator to estimate the sensitivity of each signal, which is later used to guide the optimization effort. Second, the incremental method revolves on the fact that, although we strictly need to guarantee a certain confidence level in the simulations for the final results of the optimization process, we can do it with more relaxed levels, which in turn implies using a considerably smaller amount of samples, in the initial stages of the process, when we are still far from the optimized solution. Through these two approaches we demonstrate that the execution time of classical greedy techniques can be accelerated by factors of up to ×240 for small/medium sized problems. Finally, this book introduces HOPLITE, an automated, flexible and modular framework for quantization that includes the implementation of the previous techniques and is provided for public access. The aim is to offer a common ground for developers and researches for prototyping and verifying new techniques for system modelling and word-length optimization easily. We describe its work flow, justifying the taken design decisions, explain its public API and we do a step-by-step demonstration of its execution. We also show, through an example, the way new extensions to the flow should be connected to the existing interfaces in order to expand and improve the capabilities of HOPLITE.

Transcription initiation is controlled by three core promoter elements in the hgl5 gene of the protozoan parasite Entamoeba histolytica

Entamoeba histolytica is a single cell eukaryote that is the etiologic agent of amoebic colitis. Core promoter elements of E. histolytica protein encoding genes include a TATA-like sequence (GTATTTAAAG/C) at −30, a novel element designated GAAC (GAACT) that has a variable location between TATA and the site of transcription initiation, and a putative initiator (Inr) element (AAAAATTCA) overlying the site of transcription initiation. The presence of three separate conserved sequences in a eukaryotic core promoter is unprecedented and prompted examination of their roles in regulating transcription initiation. Alterations of all three regions in the hgl5 gene decreased reporter gene activity with the greatest effect seen by mutation of the GAAC element. Positional analysis of the TATA box demonstrated that transcription initiated consistently 30–31 bases downstream of the TATA region. Mutation of either the TATA or GAAC elements resulted in the appearance of new transcription start sites upstream of +1 in the promoter of the hgl5 gene. Mutation of the Inr element resulted in no change in the site of transcription initiation; however, in the presence of a mutated TATA and GAAC regions, the Inr element controlled the site of transcription initiation. We conclude that all three elements play a role in determining the site of transcription initiation. The variable position of the GAAC element relative to the site of transcription initiation, and the multiple transcription initiations that resulted from its mutation, indicate that the GAAC element has an important and apparently novel role in transcriptional control in E. histolytica.

In silico detection of control signals: mRNA 3′-end-processing sequences in diverse species

We have investigated mRNA 3′-end-processing signals in each of six eukaryotic species (yeast, rice, arabidopsis, fruitfly, mouse, and human) through the analysis of more than 20,000 3′-expressed sequence tags. The use and conservation of the canonical AAUAAA element vary widely among the six species and are especially weak in plants and yeast. Even in the animal species, the AAUAAA signal does not appear to be as universal as indicated by previous studies. The abundance of single-base variants of AAUAAA correlates with their measured processing efficiencies. As found previously, the plant polyadenylation signals are more similar to those of yeast than to those of animals, with both common content and arrangement of the signal elements. In all species examined, the complete polyadenylation signal appears to consist of an aggregate of multiple elements. In light of these and previous results, we present a broadened concept of 3′-end-processing signals in which no single exact sequence element is universally required for processing. Rather, the total efficiency is a function of all elements and, importantly, an inefficient word in one element can be compensated for by strong words in other elements. These complex patterns indicate that effective tools to identify 3′-end-processing signals will require more than consensus sequence identification.

Control of alternative pre-mRNA splicing by distributed pentameric repeats

Multiple copies of the hexamer TGCATG have been shown to regulate fibronectin pre-mRNA alternative splicing. GCATG repeats also are clustered near the regulated calcitonin-specific 3′ splice site in the rat calcitonin/CGRP gene. Specific mutagenesis of these repeats in calcitonin/CGRP pre-mRNA resulted in the loss of calcitonin-specific splicing, suggesting that the native repeats act to enhance alternative exon inclusion. Mutation of subsets of these elements implies that alternative splicing requires a minimum of two repeats, and that the combination of one intronic and one exonic repeat is necessary for optimal cell-specific splicing. However, multimerized intronic repeats inhibited calcitonin-specific splicing in both the wild-type context and in a transcript lacking endogenous repeats. These results suggest that both the number and distribution of repeats may be important features for the regulation of tissue-specific alternative splicing. Further, RNA containing a single repeat bound cell-specific protein complexes, but tissue-specific differences in protein binding were not detected by using multimerized repeats. Together, these data support a novel model for alternative splicing regulation that requires the cell-specific recognition of multiple, distributed sequence elements.

Identification of Potential Regulatory Elements for the Transport of Emp24p

To examine the possibility of active recycling of Emp24p between the endoplasmic reticulum (ER) and the Golgi, we sought to identify transport signal(s) in the carboxyl-terminal region of Emp24p. Reporter molecules were constructed by replacing parts of a control invertase-Wbp1p chimera with those of Emp24p, and their transport rates were assessed. The transport of the reporter was found to be accelerated by the presence of the cytoplasmic domain of Emp24p. Mutational analyses revealed that the two carboxyl-terminal residues, leucine and valine (LV), were necessary and sufficient to accelerate the transport. The acceleration was sequence specific, and the terminal valine appeared to be more important. The LV residues accelerated not only the overall transport to the vacuole but also the ER to cis-Golgi transport, suggesting its function in the ER export. Hence the LV residues are a novel anterograde transport signal. The double-phenylalanine residues did not affect the transport by itself but attenuated the effect of the anterograde transport signal. On the other hand, the transmembrane domain significantly slowed down the ER to cis-Golgi transport and effectively counteracted the anterograde transport signal at this step. It may also take part in the retrieval of the protein, because the overall transport to the vacuole was more evidently slowed down. Consistently, the mutation of a conserved glutamine residue in the transmembrane domain further slowed down the transport in a step after arriving at the cis-Golgi. Taken together, the existence of the anterograde transport signal and the elements that regulate its function support the active recycling of Emp24p.

Conserved circadian elements in phylogenetically diverse algae

Circadian expression of the luciferin-binding protein (LBP) from the dinoflagellate Gonyaulax polyedra is regulated at the translational level. A small interval in the lbp 3′-untranslated region, which contains seven UG-repeats, serves as a cis-acting element to which a trans-acting factor (CCTR) binds in a circadian manner. Its binding activity correlates negatively with the circadian expression of LBP. Here I report the identification of a protein in the green alga Chlamydomonas reinhardtii that represents a CCTR analog. It binds both specifically and under control of the circadian clock to the UG-repeat region. The data show for the first time that circadian cis-elements implicated in translational regulation have been conserved during evolution.

Mouse cytoplasmic polyadenylylation element binding protein: An evolutionarily conserved protein that interacts with the cytoplasmic polyadenylylation elements of c-mos mRNA

Cytoplasmic polyadenylylation is an essential process that controls the translation of maternal mRNAs during early development and depends on two cis elements in the 3′ untranslated region: the polyadenylylation hexanucleotide AAUAAA and a U-rich cytoplasmic polyadenylylation element (CPE). In searching for factors that could mediate cytoplasmic polyadenylylation of mouse c-mos mRNA, which encodes a serine/threonine kinase necessary for oocyte maturation, we have isolated the mouse homolog of CPEB, a protein that binds to the CPEs of a number of mRNAs in Xenopus oocytes and is required for their polyadenylylation. Mouse CPEB (mCPEB) is a 62-kDa protein that binds to the CPEs of c-mos mRNA. mCPEB mRNA is present in the ovary, testis, and kidney; within the ovary, this RNA is restricted to oocytes. mCPEB shows 80% overall identity with its Xenopus counterpart, with a higher homology in the carboxyl-terminal portion, which contains two RNA recognition motifs and a cysteine/histidine repeat. Proteins from arthropods and nematodes are also similar to this region, suggesting an ancient and widely used mechanism to control polyadenylylation and translation.

Eight novel families of miniature inverted repeat transposable elements in the African malaria mosquito, Anopheles gambiae

Eight novel families of miniature inverted repeat transposable elements (MITEs) were discovered in the African malaria mosquito, Anopheles gambiae, by using new software designed to rapidly identify MITE-like sequences based on their structural characteristics. Divergent subfamilies have been found in two families. Past mobility was demonstrated by evidence of MITE insertions that resulted in the duplication of specific TA, TAA, or 8-bp targets. Some of these MITEs share the same target duplications and similar terminal sequences with MITEs and other DNA transposons in human and other organisms. MITEs in A. gambiae range from 40 to 1340 copies per genome, much less abundant than MITEs in the yellow fever mosquito, Aedes aegypti. Statistical analyses suggest that most A. gambiae MITEs are in highly AT-rich regions, many of which are closely associated with each other. The analyses of these novel MITEs underscored interesting questions regarding their diversity, origin, evolution, and relationships to the host genomes. The discovery of diverse families of MITEs in A. gambiae has important practical implications in light of current efforts to control malaria by replacing vector mosquitoes with genetically modified refractory mosquitoes. Finally, the systematic approach to rapidly identify novel MITEs should have broad applications for the analysis of the ever-growing sequence databases of a wide range of organisms.

Rac and Cdc42 GTPases control hematopoietic stem cell shape, adhesion, migration, and mobilization

Critical to homeostasis of blood cell production by hematopoietic stem/progenitor (HSC/P) cells is the regulation of HSC/P retention within the bone marrow microenvironment and migration between the bone marrow and the blood. Key extracellular regulatory elements for this process have been defined (cell–cell adhesion, growth factors, chemokines), but the mechanism by which HSC/P cells reconcile multiple external signals has not been elucidated. Rac and related small GTPases are candidates for this role and were studied in HSC/P deficient in Rac2, a hematopoietic cell-specific family member. Rac2 appears to be critical for HSC/P adhesion both in vitro and in vivo, whereas a compensatory increase in Cdc42 activation regulates HSC/P migration. This genetic analysis provides physiological evidence of cross-talk between GTPase proteins and suggests that a balance of these two GTPases controls HSC/P adhesion and mobilization in vivo.

Activation of the JC virus Tat-responsive transcriptional control element by association of the Tat protein of human immunodeficiency virus 1 with cellular protein Purα

JC virus is activated to replicate in glial cells of many AIDS patients with neurological disorders. In human glial cells, the human immunodeficiency virus 1 (HIV-1) Tat protein activates the major late promoter of JC virus through a Tat-responsive DNA element, termed upTAR, which is a recognition site for cellular Purα, a sequence-specific single-stranded DNA binding protein implicated in cell cycle control of DNA replication and transcription. Tat interacts with two leucine-rich repeats in Purα to form a complex that can be immunoprecipitated from cell extracts. Tat enhances the ability of purified glutathione S-transferase-Purα (GST-Purα) to bind the upTAR element. Tat acts synergistically with Purα, in a cell-cycle-dependent manner, to activate transcription at an upTAR element placed upstream of a heterologous promoter. Since Purα is ubiquitously expressed in human cells and since PUR elements are located near many promoters and origins of replication, the Tat-Purα interaction may be implicated in effects of HIV-1 throughout the full range of HIV-1-infected cells.

Spatial and temporal control of RNA stability

Maternally encoded RNAs and proteins program the early development of all animals. A subset of the maternal transcripts is eliminated from the embryo before the midblastula transition. In certain cases, transcripts are protected from degradation in a subregion of the embryonic cytoplasm, thus resulting in transcript localization. Maternal factors are sufficient for both the degradation and protection components of transcript localization. Cis-acting elements in the RNAs convert transcripts progressively (i) from inherently stable to unstable and (ii) from uniformly degraded to locally protected. Similar mechanisms are likely to act later in development to restrict certain classes of transcripts to particular cell types within somatic cell lineages. Functions of transcript degradation and protection are discussed.

Use of genetic suppressor elements to dissect distinct biological effects of separate p53 domains.

p53 is a multifunctional tumor suppressor protein involved in the negative control of cell growth. Mutations in p53 cause alterations in cellular phenotype, including immortalization, neoplastic transformation, and resistance to DNA-damaging drugs. To help dissect distinct functions of p53, a set of genetic suppressor elements (GSEs) capable of inducing different p53-related phenotypes in rodent embryo fibroblasts was isolated from a retroviral library of random rat p53 cDNA fragments. All the GSEs were 100-300 nucleotides long and were in the sense orientation. They fell into four classes, corresponding to the transactivator (class I), DNA-binding (class II), and C-terminal (class III) domains of the protein and the 3'-untranslated region of the mRNA (class IV). GSEs in all four classes promoted immortalization of primary cells, but only members of classes I and III cooperated with activated ras to transform cells, and only members of class III conferred resistance to etoposide and strongly inhibited transcriptional transactivation by p53. These observations suggest that processes related to control of senescence, response to DNA damage, and transformation involve different functions of the p53 protein and furthermore indicate a regulatory role for the 3'-untranslated region of p53 mRNA.

Evolutionary conservation of sequence elements controlling cytoplasmic polyadenylylation.

Cytoplasmic polyadenylylation is an evolutionarily conserved mechanism involved in the translational activation of a set of maternal messenger RNAs (mRNAs) during early development. In this report, we show by interspecies injections that Xenopus and mouse use the same regulatory sequences to control cytoplasmic poly(A) addition during meiotic maturation. Similarly, Xenopus and Drosophila embryos exploit functionally conserved signals to regulate polyadenylylation during early post-fertilization development. These experiments demonstrate that the sequence elements that govern cytoplasmic polyadenylylation, and hence one form of translational activation, function across species. We infer that the requisite regulatory sequence elements, and likely the trans-acting components with which they interact, have been conserved since the divergence of vertebrates and arthropods.

Molecular control of vertebrate iron metabolism: mRNA-based regulatory circuits operated by iron, nitric oxide, and oxidative stress.

As an essential nutrient and a potential toxin, iron poses an exquisite regulatory problem in biology and medicine. At the cellular level, the basic molecular framework for the regulation of iron uptake, storage, and utilization has been defined. Two cytoplasmic RNA-binding proteins, iron-regulatory protein-1 (IRP-1) and IRP-2, respond to changes in cellular iron availability and coordinate the expression of mRNAs that harbor IRP-binding sites, iron-responsive elements (IREs). Nitric oxide (NO) and oxidative stress in the form of H2O2 also signal to IRPs and thereby influence cellular iron metabolism. The recent discovery of two IRE-regulated mRNAs encoding enzymes of the mitochondrial citric acid cycle may represent the beginnings of elucidating regulatory coupling between iron and energy metabolism. In addition to providing insights into the regulation of iron metabolism and its connections with other cellular pathways, the IRE/IRP system has emerged as a prime example for the understanding of translational regulation and mRNA stability control. Finally, IRP-1 has highlighted an unexpected role for iron sulfur clusters as post-translational regulatory switches.

Effect of deletion of 5'HS3 or 5'HS2 of the human beta-globin locus control region on the developmental regulation of globin gene expression in beta-globin locus yeast artificial chromosome transgenic mice.

To analyze the function of the 5' DNase I hypersensitive sites (HSs) of the locus control region (LCR) on beta-like globin gene expression, a 2.3-kb deletion of 5'HS3 or a 1.9-kb deletion of 5'HS2 was recombined into a beta-globin locus yeast artificial chromosome, and transgenic mice were produced. Deletion of 5'HS3 resulted in a significant decrease of epsilon-globin gene expression and an increase of gamma-globin gene expression in embryonic cells. Deletion of 5'HS2 resulted in only a small decrease in expression of epsilon-, gamma-, and beta-globin mRNA at all stages of development. Neither deletion affected the temporal pattern of globin gene switching. These results suggest that the LCR contains functionally redundant elements and that LCR complex formation does not require the presence of all DNase I hypersensitive sites. The phenotype of the 5'HS3 deletion suggests that individual HSs may influence the interaction of the LCR with specific globin gene promoters during the course of ontogeny.