Contemporary ecotypic divergence during a recent range expansion was facilitated by adaptive introgression

Although rapid phenotypic evolution during range expansion associated with colonization of contrasting habitats has been documented in several taxa, the evolutionary mechanisms that underlie such phenotypic divergence have less often been investigated. A strong candidate for rapid ecotype formation within an invaded range is the three-spine stickleback in the Lake Geneva region of central Europe. Since its introduction only about 140 years ago, it has undergone a significant expansion of its range and its niche, now forming phenotypically differentiated parapatric ecotypes that occupy either the pelagic zone of the large lake or small inlet streams, respectively. By comparing museum collections from different times with contemporary population samples, we here reconstruct the evolution of parapatric phenotypic divergence through time. Using genetic data from modern samples, we infer the underlying invasion history. We find that parapatric habitat-dependent phenotypic divergence between the lake and stream was already present in the first half of the twentieth century, but the magnitude of differentiation increased through time, particularly in antipredator defence traits. This suggests that divergent selection between the habitats occurred and was stable through much of the time since colonization. Recently, increased phenotypic differentiation in antipredator defence traits likely results from habitat-dependent selection on alleles that arrived through introgression from a distantly related lineage from outside the Lake Geneva region. This illustrates how hybridization can quickly promote phenotypic divergence in a system where adaptation from standing genetic variation was constrained.

Adaptive, convergent origins of the pygmy phenotype in African rainforest hunter-gatherers

Tropical rainforest hunter-gatherer populations worldwide share the pygmy phenotype, or small human body size. The evolutionary history of this phenotype is largely unknown. Here we studied DNA from the Batwa, a rainforest hunter-gatherer population from east central Africa, to identify regions of the Batwa genome that underlie the pygmy phenotype. We then performed population genomic analyses to study the evolution of these regions, including comparisons with the Baka, a west central African rainforest hunter-gatherer population. We conclude that the pygmy phenotype likely arose due to positive natural selection and that it arose possibly multiple times within Africa. These results support longstanding anthropological hypotheses that small body size confers an important selective advantage for human rainforest hunter-gatherers.

Explosive speciation rates and unusual species richness in haplochromine cichlid fishes: Effects of sexual selection

Ancient lakes are often unusually species rich, mostly as a result of radiation and species-flock formation having taken place in only one or a few of many taxa present. Understanding why some taxa radiate and others do not is at the heart of understanding biodiversity. In this chapter I discuss possible explanations for disproportionally large species numbers in some cichlid fish lineages in East African Great Lakes: the halochromine cichlid fishes in Lakes Victoria and Malawi. I show that speciation rates in this group are higher than in any other lacustrine fish radiation. Against this background, I review hypotheses put forward to explain diversity in cichlid species flocks. The evolution of species diversity requires three processes: speciation, ecological radiation and anatomical diversification, and it is wrong to consider hypotheses that are relevant to different processes as alternatives to each other. The African cichlid species flocks show unusually high ecological species packing in several phylogenetic groups and unusually high speciation rates in haplochromines. Therefore, it maybe concluded that at least two evolutionary models are required to explain the difference between cichlid diversity and other fish diversity in East African Lakes: one for speciation in haplochromines and one for coexistence. Subsequently I review work on speciation in haplochromines, and in particular studies aimed at testing the hypothesis of speciation by sexual selection. Haplochromines have a polygynous mating system, conducive to sexual selection, but other polygynous cichlids are not particularly species rich. This suggests that more than just strong sexual selection is required to explain haplochromine species richness. Recent palaeoecological evidence undermines the previously popular hypotheses that explained the species richness of Lake Victoria in terms of speciation under varying natural or sexual selection regimes in satellite lakes or in isolated lake basins. I summarize experimental and comparative studies, which provide evidence for two mechanisms of sympatric speciation by disruptive sexual selection on polymorphic coloration. Such modes of speciation may explain (i) the high speciation rates in colour polymorphic lineages of haplochromine cichlids under conditions where colour variation is visible in clear water, and (ii) in combination with factors that affect population survival, the unusual species richness in haplochromine species flocks. I argue that sexual selection, if disruptive, can accelerate the pace of adaptive radiation because the resultant genetic population fragmentation allows a much increased rate of differential response to disruptive natural selection. Hence, the ecological pattern of diversity resembles that produced by disruptive natural selection, with the difference that disruptive sexual selection continues to cause (gross) speciation even after niche space is saturated. This may explain the unusually high numbers of very closely related and ecologically similar species in haplochromine species flocks. The role of disruptive sexual selection is twofold: it not only causes speciation, but also maintains reproductive isolation in sympatry between species that have evolved in sympatry or allopatry. Therefore, the maintenance of diversity in species flocks that originated through sexual selection depends on the persistence of the selection regime within the environmental signal space under which that diversity evolved.

Bayesian Adaptive Designs for Early Phase Clinical Trials

My dissertation focuses mainly on Bayesian adaptive designs for phase I and phase II clinical trials. It includes three specific topics: (1) proposing a novel two-dimensional dose-finding algorithm for biological agents, (2) developing Bayesian adaptive screening designs to provide more efficient and ethical clinical trials, and (3) incorporating missing late-onset responses to make an early stopping decision. Treating patients with novel biological agents is becoming a leading trend in oncology. Unlike cytotoxic agents, for which toxicity and efficacy monotonically increase with dose, biological agents may exhibit non-monotonic patterns in their dose-response relationships. Using a trial with two biological agents as an example, we propose a phase I/II trial design to identify the biologically optimal dose combination (BODC), which is defined as the dose combination of the two agents with the highest efficacy and tolerable toxicity. A change-point model is used to reflect the fact that the dose-toxicity surface of the combinational agents may plateau at higher dose levels, and a flexible logistic model is proposed to accommodate the possible non-monotonic pattern for the dose-efficacy relationship. During the trial, we continuously update the posterior estimates of toxicity and efficacy and assign patients to the most appropriate dose combination. We propose a novel dose-finding algorithm to encourage sufficient exploration of untried dose combinations in the two-dimensional space. Extensive simulation studies show that the proposed design has desirable operating characteristics in identifying the BODC under various patterns of dose-toxicity and dose-efficacy relationships. Trials of combination therapies for the treatment of cancer are playing an increasingly important role in the battle against this disease. To more efficiently handle the large number of combination therapies that must be tested, we propose a novel Bayesian phase II adaptive screening design to simultaneously select among possible treatment combinations involving multiple agents. Our design is based on formulating the selection procedure as a Bayesian hypothesis testing problem in which the superiority of each treatment combination is equated to a single hypothesis. During the trial conduct, we use the current values of the posterior probabilities of all hypotheses to adaptively allocate patients to treatment combinations. Simulation studies show that the proposed design substantially outperforms the conventional multi-arm balanced factorial trial design. The proposed design yields a significantly higher probability for selecting the best treatment while at the same time allocating substantially more patients to efficacious treatments. The proposed design is most appropriate for the trials combining multiple agents and screening out the efficacious combination to be further investigated. The proposed Bayesian adaptive phase II screening design substantially outperformed the conventional complete factorial design. Our design allocates more patients to better treatments while at the same time providing higher power to identify the best treatment at the end of the trial. Phase II trial studies usually are single-arm trials which are conducted to test the efficacy of experimental agents and decide whether agents are promising to be sent to phase III trials. Interim monitoring is employed to stop the trial early for futility to avoid assigning unacceptable number of patients to inferior treatments. We propose a Bayesian single-arm phase II design with continuous monitoring for estimating the response rate of the experimental drug. To address the issue of late-onset responses, we use a piece-wise exponential model to estimate the hazard function of time to response data and handle the missing responses using the multiple imputation approach. We evaluate the operating characteristics of the proposed method through extensive simulation studies. We show that the proposed method reduces the total length of the trial duration and yields desirable operating characteristics for different physician-specified lower bounds of response rate with different true response rates.

Adaptive clinical trial design for targeted therapy development

The development of targeted therapy involve many challenges. Our study will address some of the key issues involved in biomarker identification and clinical trial design. In our study, we propose two biomarker selection methods, and then apply them in two different clinical trial designs for targeted therapy development. In particular, we propose a Bayesian two-step lasso procedure for biomarker selection in the proportional hazards model in Chapter 2. In the first step of this strategy, we use the Bayesian group lasso to identify the important marker groups, wherein each group contains the main effect of a single marker and its interactions with treatments. In the second step, we zoom in to select each individual marker and the interactions between markers and treatments in order to identify prognostic or predictive markers using the Bayesian adaptive lasso. In Chapter 3, we propose a Bayesian two-stage adaptive design for targeted therapy development while implementing the variable selection method given in Chapter 2. In Chapter 4, we proposed an alternate frequentist adaptive randomization strategy for situations where a large number of biomarkers need to be incorporated in the study design. We also propose a new adaptive randomization rule, which takes into account the variations associated with the point estimates of survival times. In all of our designs, we seek to identify the key markers that are either prognostic or predictive with respect to treatment. We are going to use extensive simulation to evaluate the operating characteristics of our methods.^

Gene expression changes in the coccolithophore Emiliania huxleyi after 500 generations of selection to ocean acidification

Coccolithophores are unicellular marine algae that produce biogenic calcite scales and substantially contribute to marine primary production and carbon export to the deep ocean. Ongoing ocean acidification particularly impairs calcifying organisms, mostly resulting in decreased growth and calcification. Recent studies revealed that the immediate physiological response in the coccolithophore Emiliania huxleyi to ocean acidification may be partially compensated by evolutionary adaptation, yet the underlying molecular mechanisms are currently unknown. Here, we report on the expression levels of 10 candidate genes putatively relevant to pH regulation, carbon transport, calcification and photosynthesis in E. huxleyi populations short-term exposed to ocean acidification conditions after acclimation (physiological response) and after 500 generations of high CO2 adaptation (adaptive response). The physiological response revealed downregulation of candidate genes, well reflecting the concomitant decrease of growth and calcification. In the adaptive response, putative pH regulation and carbon transport genes were up-regulated, matching partial restoration of growth and calcification in high CO2-adapted populations. Adaptation to ocean acidification in E. huxleyi likely involved improved cellular pH regulation, presumably indirectly affecting calcification. Adaptive evolution may thus have the potential to partially restore cellular pH regulatory capacity and thereby mitigate adverse effects of ocean acidification.

Long-term dynamics of adaptive evolution in a globally important coccolithophore to ocean acidification

Recent evolution experiments have revealed that marine phytoplankton may adapt to global change, for example to ocean warming or acidification. Long-term adaptation to novel environments is a dynamic process and phenotypic change can take place thousands of generations after exposure to novel conditions. Using the longest evolution experiment performed in any marine species to date (4 yrs, = 2100 generations), we show that in the coccolithophore Emiliania huxleyi, long-term adaptation to ocean acidification is complex and initial phenotypic responses may revert for important traits. While fitness increased continuously, calcification was restored within the first 500 generations but later reduced in response to selection, enhancing physiological declines of calcification in response to ocean acidification. Interestingly, calcification was not constitutively reduced but revealed rates similar to control treatments when transferred back to present-day CO2 conditions. Growth rate increased with time in controls and adaptation treatments, although the effect size of adaptation assessed through reciprocal assay experiments varied. Several trait changes were associated with selection for higher cell division rates under laboratory conditions, such as reduced cell size and lower particulate organic carbon content per cell. Our results show that phytoplankton may evolve phenotypic plasticity that can affect biogeochemically important traits, such as calcification, in an unforeseen way under future ocean conditions.

Parametric and structural self-adaptation of embedded systems using evolvable hardware

Los sistemas empotrados han sido concebidos tradicionalmente como sistemas de procesamiento específicos que realizan una tarea fija durante toda su vida útil. Para cumplir con requisitos estrictos de coste, tamaño y peso, el equipo de diseño debe optimizar su funcionamiento para condiciones muy específicas. Sin embargo, la demanda de mayor versatilidad, un funcionamiento más inteligente y, en definitiva, una mayor capacidad de procesamiento comenzaron a chocar con estas limitaciones, agravado por la incertidumbre asociada a entornos de operación cada vez más dinámicos donde comenzaban a ser desplegados progresivamente. Esto trajo como resultado una necesidad creciente de que los sistemas pudieran responder por si solos a eventos inesperados en tiempo diseño tales como: cambios en las características de los datos de entrada y el entorno del sistema en general; cambios en la propia plataforma de cómputo, por ejemplo debido a fallos o defectos de fabricación; y cambios en las propias especificaciones funcionales causados por unos objetivos del sistema dinámicos y cambiantes. Como consecuencia, la complejidad del sistema aumenta, pero a cambio se habilita progresivamente una capacidad de adaptación autónoma sin intervención humana a lo largo de la vida útil, permitiendo que tomen sus propias decisiones en tiempo de ejecución. Éstos sistemas se conocen, en general, como sistemas auto-adaptativos y tienen, entre otras características, las de auto-configuración, auto-optimización y auto-reparación. Típicamente, la parte soft de un sistema es mayoritariamente la única utilizada para proporcionar algunas capacidades de adaptación a un sistema. Sin embargo, la proporción rendimiento/potencia en dispositivos software como microprocesadores en muchas ocasiones no es adecuada para sistemas empotrados. En este escenario, el aumento resultante en la complejidad de las aplicaciones está siendo abordado parcialmente mediante un aumento en la complejidad de los dispositivos en forma de multi/many-cores; pero desafortunadamente, esto hace que el consumo de potencia también aumente. Además, la mejora en metodologías de diseño no ha sido acorde como para poder utilizar toda la capacidad de cómputo disponible proporcionada por los núcleos. Por todo ello, no se están satisfaciendo adecuadamente las demandas de cómputo que imponen las nuevas aplicaciones. La solución tradicional para mejorar la proporción rendimiento/potencia ha sido el cambio a unas especificaciones hardware, principalmente usando ASICs. Sin embargo, los costes de un ASIC son altamente prohibitivos excepto en algunos casos de producción en masa y además la naturaleza estática de su estructura complica la solución a las necesidades de adaptación. Los avances en tecnologías de fabricación han hecho que la FPGA, una vez lenta y pequeña, usada como glue logic en sistemas mayores, haya crecido hasta convertirse en un dispositivo de cómputo reconfigurable de gran potencia, con una cantidad enorme de recursos lógicos computacionales y cores hardware empotrados de procesamiento de señal y de propósito general. Sus capacidades de reconfiguración han permitido combinar la flexibilidad propia del software con el rendimiento del procesamiento en hardware, lo que tiene la potencialidad de provocar un cambio de paradigma en arquitectura de computadores, pues el hardware no puede ya ser considerado más como estático. El motivo es que como en el caso de las FPGAs basadas en tecnología SRAM, la reconfiguración parcial dinámica (DPR, Dynamic Partial Reconfiguration) es posible. Esto significa que se puede modificar (reconfigurar) un subconjunto de los recursos computacionales en tiempo de ejecución mientras el resto permanecen activos. Además, este proceso de reconfiguración puede ser ejecutado internamente por el propio dispositivo. El avance tecnológico en dispositivos hardware reconfigurables se encuentra recogido bajo el campo conocido como Computación Reconfigurable (RC, Reconfigurable Computing). Uno de los campos de aplicación más exóticos y menos convencionales que ha posibilitado la computación reconfigurable es el conocido como Hardware Evolutivo (EHW, Evolvable Hardware), en el cual se encuentra enmarcada esta tesis. La idea principal del concepto consiste en convertir hardware que es adaptable a través de reconfiguración en una entidad evolutiva sujeta a las fuerzas de un proceso evolutivo inspirado en el de las especies biológicas naturales, que guía la dirección del cambio. Es una aplicación más del campo de la Computación Evolutiva (EC, Evolutionary Computation), que comprende una serie de algoritmos de optimización global conocidos como Algoritmos Evolutivos (EA, Evolutionary Algorithms), y que son considerados como algoritmos universales de resolución de problemas. En analogía al proceso biológico de la evolución, en el hardware evolutivo el sujeto de la evolución es una población de circuitos que intenta adaptarse a su entorno mediante una adecuación progresiva generación tras generación. Los individuos pasan a ser configuraciones de circuitos en forma de bitstreams caracterizados por descripciones de circuitos reconfigurables. Seleccionando aquellos que se comportan mejor, es decir, que tienen una mejor adecuación (o fitness) después de ser evaluados, y usándolos como padres de la siguiente generación, el algoritmo evolutivo crea una nueva población hija usando operadores genéticos como la mutación y la recombinación. Según se van sucediendo generaciones, se espera que la población en conjunto se aproxime a la solución óptima al problema de encontrar una configuración del circuito adecuada que satisfaga las especificaciones. El estado de la tecnología de reconfiguración después de que la familia de FPGAs XC6200 de Xilinx fuera retirada y reemplazada por las familias Virtex a finales de los 90, supuso un gran obstáculo para el avance en hardware evolutivo; formatos de bitstream cerrados (no conocidos públicamente); dependencia de herramientas del fabricante con soporte limitado de DPR; una velocidad de reconfiguración lenta; y el hecho de que modificaciones aleatorias del bitstream pudieran resultar peligrosas para la integridad del dispositivo, son algunas de estas razones. Sin embargo, una propuesta a principios de los años 2000 permitió mantener la investigación en el campo mientras la tecnología de DPR continuaba madurando, el Circuito Virtual Reconfigurable (VRC, Virtual Reconfigurable Circuit). En esencia, un VRC en una FPGA es una capa virtual que actúa como un circuito reconfigurable de aplicación específica sobre la estructura nativa de la FPGA que reduce la complejidad del proceso reconfiguración y aumenta su velocidad (comparada con la reconfiguración nativa). Es un array de nodos computacionales especificados usando descripciones HDL estándar que define recursos reconfigurables ad-hoc: multiplexores de rutado y un conjunto de elementos de procesamiento configurables, cada uno de los cuales tiene implementadas todas las funciones requeridas, que pueden seleccionarse a través de multiplexores tal y como ocurre en una ALU de un microprocesador. Un registro grande actúa como memoria de configuración, por lo que la reconfiguración del VRC es muy rápida ya que tan sólo implica la escritura de este registro, el cual controla las señales de selección del conjunto de multiplexores. Sin embargo, esta capa virtual provoca: un incremento de área debido a la implementación simultánea de cada función en cada nodo del array más los multiplexores y un aumento del retardo debido a los multiplexores, reduciendo la frecuencia de funcionamiento máxima. La naturaleza del hardware evolutivo, capaz de optimizar su propio comportamiento computacional, le convierten en un buen candidato para avanzar en la investigación sobre sistemas auto-adaptativos. Combinar un sustrato de cómputo auto-reconfigurable capaz de ser modificado dinámicamente en tiempo de ejecución con un algoritmo empotrado que proporcione una dirección de cambio, puede ayudar a satisfacer los requisitos de adaptación autónoma de sistemas empotrados basados en FPGA. La propuesta principal de esta tesis está por tanto dirigida a contribuir a la auto-adaptación del hardware de procesamiento de sistemas empotrados basados en FPGA mediante hardware evolutivo. Esto se ha abordado considerando que el comportamiento computacional de un sistema puede ser modificado cambiando cualquiera de sus dos partes constitutivas: una estructura hard subyacente y un conjunto de parámetros soft. De esta distinción, se derivan dos lineas de trabajo. Por un lado, auto-adaptación paramétrica, y por otro auto-adaptación estructural. El objetivo perseguido en el caso de la auto-adaptación paramétrica es la implementación de técnicas de optimización evolutiva complejas en sistemas empotrados con recursos limitados para la adaptación paramétrica online de circuitos de procesamiento de señal. La aplicación seleccionada como prueba de concepto es la optimización para tipos muy específicos de imágenes de los coeficientes de los filtros de transformadas wavelet discretas (DWT, DiscreteWavelet Transform), orientada a la compresión de imágenes. Por tanto, el objetivo requerido de la evolución es una compresión adaptativa y más eficiente comparada con los procedimientos estándar. El principal reto radica en reducir la necesidad de recursos de supercomputación para el proceso de optimización propuesto en trabajos previos, de modo que se adecúe para la ejecución en sistemas empotrados. En cuanto a la auto-adaptación estructural, el objetivo de la tesis es la implementación de circuitos auto-adaptativos en sistemas evolutivos basados en FPGA mediante un uso eficiente de sus capacidades de reconfiguración nativas. En este caso, la prueba de concepto es la evolución de tareas de procesamiento de imagen tales como el filtrado de tipos desconocidos y cambiantes de ruido y la detección de bordes en la imagen. En general, el objetivo es la evolución en tiempo de ejecución de tareas de procesamiento de imagen desconocidas en tiempo de diseño (dentro de un cierto grado de complejidad). En este caso, el objetivo de la propuesta es la incorporación de DPR en EHW para evolucionar la arquitectura de un array sistólico adaptable mediante reconfiguración cuya capacidad de evolución no había sido estudiada previamente. Para conseguir los dos objetivos mencionados, esta tesis propone originalmente una plataforma evolutiva que integra un motor de adaptación (AE, Adaptation Engine), un motor de reconfiguración (RE, Reconfiguration Engine) y un motor computacional (CE, Computing Engine) adaptable. El el caso de adaptación paramétrica, la plataforma propuesta está caracterizada por: • un CE caracterizado por un núcleo de procesamiento hardware de DWT adaptable mediante registros reconfigurables que contienen los coeficientes de los filtros wavelet • un algoritmo evolutivo como AE que busca filtros wavelet candidatos a través de un proceso de optimización paramétrica desarrollado específicamente para sistemas caracterizados por recursos de procesamiento limitados • un nuevo operador de mutación simplificado para el algoritmo evolutivo utilizado, que junto con un mecanismo de evaluación rápida de filtros wavelet candidatos derivado de la literatura actual, asegura la viabilidad de la búsqueda evolutiva asociada a la adaptación de wavelets. En el caso de adaptación estructural, la plataforma propuesta toma la forma de: • un CE basado en una plantilla de array sistólico reconfigurable de 2 dimensiones compuesto de nodos de procesamiento reconfigurables • un algoritmo evolutivo como AE que busca configuraciones candidatas del array usando un conjunto de funcionalidades de procesamiento para los nodos disponible en una biblioteca accesible en tiempo de ejecución • un RE hardware que explota la capacidad de reconfiguración nativa de las FPGAs haciendo un uso eficiente de los recursos reconfigurables del dispositivo para cambiar el comportamiento del CE en tiempo de ejecución • una biblioteca de elementos de procesamiento reconfigurables caracterizada por bitstreams parciales independientes de la posición, usados como el conjunto de configuraciones disponibles para los nodos de procesamiento del array Las contribuciones principales de esta tesis se pueden resumir en la siguiente lista: • Una plataforma evolutiva basada en FPGA para la auto-adaptación paramétrica y estructural de sistemas empotrados compuesta por un motor computacional (CE), un motor de adaptación (AE) evolutivo y un motor de reconfiguración (RE). Esta plataforma se ha desarrollado y particularizado para los casos de auto-adaptación paramétrica y estructural. • En cuanto a la auto-adaptación paramétrica, las contribuciones principales son: – Un motor computacional adaptable mediante registros que permite la adaptación paramétrica de los coeficientes de una implementación hardware adaptativa de un núcleo de DWT. – Un motor de adaptación basado en un algoritmo evolutivo desarrollado específicamente para optimización numérica, aplicada a los coeficientes de filtros wavelet en sistemas empotrados con recursos limitados. – Un núcleo IP de DWT auto-adaptativo en tiempo de ejecución para sistemas empotrados que permite la optimización online del rendimiento de la transformada para compresión de imágenes en entornos específicos de despliegue, caracterizados por tipos diferentes de señal de entrada. – Un modelo software y una implementación hardware de una herramienta para la construcción evolutiva automática de transformadas wavelet específicas. • Por último, en cuanto a la auto-adaptación estructural, las contribuciones principales son: – Un motor computacional adaptable mediante reconfiguración nativa de FPGAs caracterizado por una plantilla de array sistólico en dos dimensiones de nodos de procesamiento reconfigurables. Es posible mapear diferentes tareas de cómputo en el array usando una biblioteca de elementos sencillos de procesamiento reconfigurables. – Definición de una biblioteca de elementos de procesamiento apropiada para la síntesis autónoma en tiempo de ejecución de diferentes tareas de procesamiento de imagen. – Incorporación eficiente de la reconfiguración parcial dinámica (DPR) en sistemas de hardware evolutivo, superando los principales inconvenientes de propuestas previas como los circuitos reconfigurables virtuales (VRCs). En este trabajo también se comparan originalmente los detalles de implementación de ambas propuestas. – Una plataforma tolerante a fallos, auto-curativa, que permite la recuperación funcional online en entornos peligrosos. La plataforma ha sido caracterizada desde una perspectiva de tolerancia a fallos: se proponen modelos de fallo a nivel de CLB y de elemento de procesamiento, y usando el motor de reconfiguración, se hace un análisis sistemático de fallos para un fallo en cada elemento de procesamiento y para dos fallos acumulados. – Una plataforma con calidad de filtrado dinámica que permite la adaptación online a tipos de ruido diferentes y diferentes comportamientos computacionales teniendo en cuenta los recursos de procesamiento disponibles. Por un lado, se evolucionan filtros con comportamientos no destructivos, que permiten esquemas de filtrado en cascada escalables; y por otro, también se evolucionan filtros escalables teniendo en cuenta requisitos computacionales de filtrado cambiantes dinámicamente. Este documento está organizado en cuatro partes y nueve capítulos. La primera parte contiene el capítulo 1, una introducción y motivación sobre este trabajo de tesis. A continuación, el marco de referencia en el que se enmarca esta tesis se analiza en la segunda parte: el capítulo 2 contiene una introducción a los conceptos de auto-adaptación y computación autonómica (autonomic computing) como un campo de investigación más general que el muy específico de este trabajo; el capítulo 3 introduce la computación evolutiva como la técnica para dirigir la adaptación; el capítulo 4 analiza las plataformas de computación reconfigurables como la tecnología para albergar hardware auto-adaptativo; y finalmente, el capítulo 5 define, clasifica y hace un sondeo del campo del hardware evolutivo. Seguidamente, la tercera parte de este trabajo contiene la propuesta, desarrollo y resultados obtenidos: mientras que el capítulo 6 contiene una declaración de los objetivos de la tesis y la descripción de la propuesta en su conjunto, los capítulos 7 y 8 abordan la auto-adaptación paramétrica y estructural, respectivamente. Finalmente, el capítulo 9 de la parte 4 concluye el trabajo y describe caminos de investigación futuros. ABSTRACT Embedded systems have traditionally been conceived to be specific-purpose computers with one, fixed computational task for their whole lifetime. Stringent requirements in terms of cost, size and weight forced designers to highly optimise their operation for very specific conditions. However, demands for versatility, more intelligent behaviour and, in summary, an increased computing capability began to clash with these limitations, intensified by the uncertainty associated to the more dynamic operating environments where they were progressively being deployed. This brought as a result an increasing need for systems to respond by themselves to unexpected events at design time, such as: changes in input data characteristics and system environment in general; changes in the computing platform itself, e.g., due to faults and fabrication defects; and changes in functional specifications caused by dynamically changing system objectives. As a consequence, systems complexity is increasing, but in turn, autonomous lifetime adaptation without human intervention is being progressively enabled, allowing them to take their own decisions at run-time. This type of systems is known, in general, as selfadaptive, and are able, among others, of self-configuration, self-optimisation and self-repair. Traditionally, the soft part of a system has mostly been so far the only place to provide systems with some degree of adaptation capabilities. However, the performance to power ratios of software driven devices like microprocessors are not adequate for embedded systems in many situations. In this scenario, the resulting rise in applications complexity is being partly addressed by rising devices complexity in the form of multi and many core devices; but sadly, this keeps on increasing power consumption. Besides, design methodologies have not been improved accordingly to completely leverage the available computational power from all these cores. Altogether, these factors make that the computing demands new applications pose are not being wholly satisfied. The traditional solution to improve performance to power ratios has been the switch to hardware driven specifications, mainly using ASICs. However, their costs are highly prohibitive except for some mass production cases and besidesthe static nature of its structure complicates the solution to the adaptation needs. The advancements in fabrication technologies have made that the once slow, small FPGA used as glue logic in bigger systems, had grown to be a very powerful, reconfigurable computing device with a vast amount of computational logic resources and embedded, hardened signal and general purpose processing cores. Its reconfiguration capabilities have enabled software-like flexibility to be combined with hardware-like computing performance, which has the potential to cause a paradigm shift in computer architecture since hardware cannot be considered as static anymore. This is so, since, as is the case with SRAMbased FPGAs, Dynamic Partial Reconfiguration (DPR) is possible. This means that subsets of the FPGA computational resources can now be changed (reconfigured) at run-time while the rest remains active. Besides, this reconfiguration process can be triggered internally by the device itself. This technological boost in reconfigurable hardware devices is actually covered under the field known as Reconfigurable Computing. One of the most exotic fields of application that Reconfigurable Computing has enabled is the known as Evolvable Hardware (EHW), in which this dissertation is framed. The main idea behind the concept is turning hardware that is adaptable through reconfiguration into an evolvable entity subject to the forces of an evolutionary process, inspired by that of natural, biological species, that guides the direction of change. It is yet another application of the field of Evolutionary Computation (EC), which comprises a set of global optimisation algorithms known as Evolutionary Algorithms (EAs), considered as universal problem solvers. In analogy to the biological process of evolution, in EHW the subject of evolution is a population of circuits that tries to get adapted to its surrounding environment by progressively getting better fitted to it generation after generation. Individuals become circuit configurations representing bitstreams that feature reconfigurable circuit descriptions. By selecting those that behave better, i.e., with a higher fitness value after being evaluated, and using them as parents of the following generation, the EA creates a new offspring population by using so called genetic operators like mutation and recombination. As generations succeed one another, the whole population is expected to approach to the optimum solution to the problem of finding an adequate circuit configuration that fulfils system objectives. The state of reconfiguration technology after Xilinx XC6200 FPGA family was discontinued and replaced by Virtex families in the late 90s, was a major obstacle for advancements in EHW; closed (non publicly known) bitstream formats; dependence on manufacturer tools with highly limiting support of DPR; slow speed of reconfiguration; and random bitstream modifications being potentially hazardous for device integrity, are some of these reasons. However, a proposal in the first 2000s allowed to keep investigating in this field while DPR technology kept maturing, the Virtual Reconfigurable Circuit (VRC). In essence, a VRC in an FPGA is a virtual layer acting as an application specific reconfigurable circuit on top of an FPGA fabric that reduces the complexity of the reconfiguration process and increases its speed (compared to native reconfiguration). It is an array of computational nodes specified using standard HDL descriptions that define ad-hoc reconfigurable resources; routing multiplexers and a set of configurable processing elements, each one containing all the required functions, which are selectable through functionality multiplexers as in microprocessor ALUs. A large register acts as configuration memory, so VRC reconfiguration is very fast given it only involves writing this register, which drives the selection signals of the set of multiplexers. However, large overheads are introduced by this virtual layer; an area overhead due to the simultaneous implementation of every function in every node of the array plus the multiplexers, and a delay overhead due to the multiplexers, which also reduces maximum frequency of operation. The very nature of Evolvable Hardware, able to optimise its own computational behaviour, makes it a good candidate to advance research in self-adaptive systems. Combining a selfreconfigurable computing substrate able to be dynamically changed at run-time with an embedded algorithm that provides a direction for change, can help fulfilling requirements for autonomous lifetime adaptation of FPGA-based embedded systems. The main proposal of this thesis is hence directed to contribute to autonomous self-adaptation of the underlying computational hardware of FPGA-based embedded systems by means of Evolvable Hardware. This is tackled by considering that the computational behaviour of a system can be modified by changing any of its two constituent parts: an underlying hard structure and a set of soft parameters. Two main lines of work derive from this distinction. On one side, parametric self-adaptation and, on the other side, structural self-adaptation. The goal pursued in the case of parametric self-adaptation is the implementation of complex evolutionary optimisation techniques in resource constrained embedded systems for online parameter adaptation of signal processing circuits. The application selected as proof of concept is the optimisation of Discrete Wavelet Transforms (DWT) filters coefficients for very specific types of images, oriented to image compression. Hence, adaptive and improved compression efficiency, as compared to standard techniques, is the required goal of evolution. The main quest lies in reducing the supercomputing resources reported in previous works for the optimisation process in order to make it suitable for embedded systems. Regarding structural self-adaptation, the thesis goal is the implementation of self-adaptive circuits in FPGA-based evolvable systems through an efficient use of native reconfiguration capabilities. In this case, evolution of image processing tasks such as filtering of unknown and changing types of noise and edge detection are the selected proofs of concept. In general, evolving unknown image processing behaviours (within a certain complexity range) at design time is the required goal. In this case, the mission of the proposal is the incorporation of DPR in EHW to evolve a systolic array architecture adaptable through reconfiguration whose evolvability had not been previously checked. In order to achieve the two stated goals, this thesis originally proposes an evolvable platform that integrates an Adaptation Engine (AE), a Reconfiguration Engine (RE) and an adaptable Computing Engine (CE). In the case of parametric adaptation, the proposed platform is characterised by: • a CE featuring a DWT hardware processing core adaptable through reconfigurable registers that holds wavelet filters coefficients • an evolutionary algorithm as AE that searches for candidate wavelet filters through a parametric optimisation process specifically developed for systems featured by scarce computing resources • a new, simplified mutation operator for the selected EA, that together with a fast evaluation mechanism of candidate wavelet filters derived from existing literature, assures the feasibility of the evolutionary search involved in wavelets adaptation In the case of structural adaptation, the platform proposal takes the form of: • a CE based on a reconfigurable 2D systolic array template composed of reconfigurable processing nodes • an evolutionary algorithm as AE that searches for candidate configurations of the array using a set of computational functionalities for the nodes available in a run time accessible library • a hardware RE that exploits native DPR capabilities of FPGAs and makes an efficient use of the available reconfigurable resources of the device to change the behaviour of the CE at run time • a library of reconfigurable processing elements featured by position-independent partial bitstreams used as the set of available configurations for the processing nodes of the array Main contributions of this thesis can be summarised in the following list. • An FPGA-based evolvable platform for parametric and structural self-adaptation of embedded systems composed of a Computing Engine, an evolutionary Adaptation Engine and a Reconfiguration Engine. This platform is further developed and tailored for both parametric and structural self-adaptation. • Regarding parametric self-adaptation, main contributions are: – A CE adaptable through reconfigurable registers that enables parametric adaptation of the coefficients of an adaptive hardware implementation of a DWT core. – An AE based on an Evolutionary Algorithm specifically developed for numerical optimisation applied to wavelet filter coefficients in resource constrained embedded systems. – A run-time self-adaptive DWT IP core for embedded systems that allows for online optimisation of transform performance for image compression for specific deployment environments characterised by different types of input signals. – A software model and hardware implementation of a tool for the automatic, evolutionary construction of custom wavelet transforms. • Lastly, regarding structural self-adaptation, main contributions are: – A CE adaptable through native FPGA fabric reconfiguration featured by a two dimensional systolic array template of reconfigurable processing nodes. Different processing behaviours can be automatically mapped in the array by using a library of simple reconfigurable processing elements. – Definition of a library of such processing elements suited for autonomous runtime synthesis of different image processing tasks. – Efficient incorporation of DPR in EHW systems, overcoming main drawbacks from the previous approach of virtual reconfigurable circuits. Implementation details for both approaches are also originally compared in this work. – A fault tolerant, self-healing platform that enables online functional recovery in hazardous environments. The platform has been characterised from a fault tolerance perspective: fault models at FPGA CLB level and processing elements level are proposed, and using the RE, a systematic fault analysis for one fault in every processing element and for two accumulated faults is done. – A dynamic filtering quality platform that permits on-line adaptation to different types of noise and different computing behaviours considering the available computing resources. On one side, non-destructive filters are evolved, enabling scalable cascaded filtering schemes; and on the other, size-scalable filters are also evolved considering dynamically changing computational filtering requirements. This dissertation is organized in four parts and nine chapters. First part contains chapter 1, the introduction to and motivation of this PhD work. Following, the reference framework in which this dissertation is framed is analysed in the second part: chapter 2 features an introduction to the notions of self-adaptation and autonomic computing as a more general research field to the very specific one of this work; chapter 3 introduces evolutionary computation as the technique to drive adaptation; chapter 4 analyses platforms for reconfigurable computing as the technology to hold self-adaptive hardware; and finally chapter 5 defines, classifies and surveys the field of Evolvable Hardware. Third part of the work follows, which contains the proposal, development and results obtained: while chapter 6 contains an statement of the thesis goals and the description of the proposal as a whole, chapters 7 and 8 address parametric and structural self-adaptation, respectively. Finally, chapter 9 in part 4 concludes the work and describes future research paths.

Multiple Robots, Single Operator: Considerations About Information And Commanding

Multiple robot, single operator scenarios suppose a challenge in terms of human factors. Two relevant issues are keeping the situational awareness and managing the workload of operators. In order to address these problems, this work analyses the management of information and commands in multi-robot missions. About the information, this paper proposes a selection based on mission and operator states. Regarding the commands, this work reflects about the levels of automation and the methods of commanding.

Rapid evolution in plant chitinases: Molecular targets of selection in plant-pathogen coevolution

Many pathogen recognition genes, such as plant R-genes, undergo rapid adaptive evolution, providing evidence that these genes play a critical role in plant-pathogen coevolution. Surprisingly, whether rapid adaptive evolution also occurs in genes encoding other kinds of plant defense proteins is unknown. Unlike recognition proteins, plant chitinases attack pathogens directly, conferring disease resistance by degrading chitin, a component of fungal cell walls. Here, we show that nonsynonymous substitution rates in plant class I chitinase often exceed synonymous rates in the plant genus Arabis (Cruciferae) and in other dicots, indicating a succession of adaptively driven amino acid replacements. We identify individual residues that are likely subject to positive selection by using codon substitution models and determine the location of these residues on the three-dimensional structure of class I chitinase. In contrast to primate lysozymes and plant class III chitinases, structural and functional relatives of class I chitinase, the adaptive replacements of class I chitinase occur disproportionately in the active site cleft. This highly unusual pattern of replacements suggests that fungi directly defend against chitinolytic activity through enzymatic inhibition or other forms of chemical resistance and identifies target residues for manipulating chitinolytic activity. These data also provide empirical evidence that plant defense proteins not involved in pathogen recognition also evolve in a manner consistent with rapid coevolutionary interactions.

Mutators and sex in bacteria: Conflict between adaptive strategies

Bacterial mutation rates can increase and produce genetic novelty, as shown by in vitro and in silico experiments. Despite the cost due to a heavy deleterious mutation load, mutator alleles, which increase the mutation rate, can spread in asexual populations during adaptation because they remain associated with the rare favorable mutations they generate. This indirect selection for a genetic system generating diversity (second-order selection) is expected to be highly sensitive to changes in the dynamics of adaptation. Here we show by a simulation approach that even rare genetic exchanges, such as bacterial conjugation or transformation, can dramatically reduce the selection of mutators. Moreover, drift or competition between the processes of mutation and recombination in the course of adaptation reveal how second-order selection is unable to optimize the rate of generation of novelty.

Adaptive evolution of a candidate gene for aging in Drosophila

Examination of the phenotypic effects of specific mutations has been extensively used to identify candidate genes affecting traits of interest. However, such analyses do not reveal anything about the evolutionary forces acting at these loci, or whether standing allelic variation contributes to phenotypic variance in natural populations. The Drosophila gene methuselah (mth) has been proposed as having major effects on organismal stress response and longevity phenotype. Here, we examine patterns of polymorphism and divergence at mth in population level samples of Drosophila melanogaster, D. simulans, and D. yakuba. Mth has experienced an unusually high level of adaptive amino acid divergence concentrated in the intra- and extracellular loop domains of the receptor protein, suggesting the historical action of positive selection on those regions of the molecule that modulate signal transduction. Further analysis of single nucleotide polymorphisms (SNPs) in D. melanogaster provided evidence for contemporary and spatially variable selection at the mth locus. In ten surveyed populations, the most common mth haplotype exhibited a 40% cline in frequency that coincided with population level differences in multiple life-history traits including lifespan. This clinal pattern was not associated with any particular SNP in the coding region, indicating that selection is operating at a closely linked site that may be involved in gene expression. Together, these consistently nonneutral patterns of inter- and intraspecific variation suggest adaptive evolution of a signal transduction pathway that may modulate lifespan in nature.

Escherichia coli strains that allow antibiotic-free plasmid selection and maintenance by repressor titration

We report the construction of two novel Escherichia coli strains (DH1lacdapD and DH1lacP2dapD) that facilitate the antibiotic-free selection and stable maintenance of recombinant plasmids in complex media. They contain the essential chromosomal gene, dapD, under the control of the lac operator/promoter. Unless supplemented with IPTG (which induces expression of dapD) or DAP, these cells lyse. However, when the strains are transformed with a multicopy plasmid containing the lac operator, the operator competitively titrates the LacI repressor and allows expression of dapD from the lac promoter. Thus transformants can be isolated and propagated simply by their ability to grow on any medium by repressor titration selection. No antibiotic resistance genes or other protein expressing sequences are required on the plasmid, and antibiotics are not necessary for plasmid selection, making these strains a valuable tool for therapeutic DNA and recombinant protein production. We describe the construction of these strains and demonstrate plasmid selection and maintenance by repressor titration, using the new pORT plasmid vectors designed to facilitate recombinant DNA exploitation.

Proofreading-defective DNA polymerase II increases adaptive mutation in Escherichia coli.

The role of Escherichia coli DNA polymerase (Pol) II in producing or avoiding mutations was investigated by replacing the chromosomal Pol II gene (polB+) by a gene encoding an exonuclease-deficient mutant Pol II (polBex1). The polBex1 allele increased adaptive mutations on an episome in nondividing cells under lactose selection. The presence of a Pol III antimutator allele (dnaE915) reduced adaptive mutations in both polB+ cells and cells deleted for polB (polB delta 1) to below the wild-type level, suggesting that both Pol II and Pol III are synthesizing episomal DNA in nondividing cells but that in wild-type cells Pol III generates the adaptive mutations. The adaptive mutations were mainly -1 frame-shifts occurring in short homopolymeric runs and were similar in wild-type, polB delta 1, and polBex1 strains. Mutations produced by both Pol III and Pol II ex1 were corrected by the mutHLS mismatch repair system.

Adaptive mutations in Escherichia coli as a model for the multiple mutational origins of tumors.

The cells in most tumors are found to carry multiple mutations; however, based upon mutation rates determined by fluctuation tests, the frequency of such multiple mutations should be so low that tumors are never detected within human populations. Fluctuation tests, which determine the cell-division-dependent mutation rate per cell generation in growing cells, may not be appropriate for estimating mutation rates in nondividing or very slowly dividing cells. Recent studies of time-dependent, "adaptive" mutations in nondividing populations of microorganisms suggest that similar measurements may be more appropriate to understanding the mutation origins of tumors. Here I use the ebgR and ebgA genes of Escherichia coli to measure adaptive mutation rates where multiple mutations are required for rapid growth. Mutations in either ebgA or ebgR allow very slow growth on lactulose (4-O-beta-D-galactosyl-D-fructose), with doubling times of 3.2 and 17.3 days, respectively. However, when both mutations are present, cells can grow rapidly with doubling times of 2.7 hr. I show that during prolonged (28-day) selection for growth on lactulose, the number of lactulose-utilizing mutants that accumulate is 40,000 times greater than can be accounted for on the basis of mutation rates measured by fluctuation tests, but is entirely consistent with the time-dependent adaptive mutation rates measured under the same conditions of prolonged selection.