Modelling and simulating in systems biology: an approach based on multi-agent systems

Systems Biology is an innovative way of doing biology recently raised in bio-informatics contexts, characterised by the study of biological systems as complex systems with a strong focus on the system level and on the interaction dimension. In other words, the objective is to understand biological systems as a whole, putting on the foreground not only the study of the individual parts as standalone parts, but also of their interaction and of the global properties that emerge at the system level by means of the interaction among the parts. This thesis focuses on the adoption of multi-agent systems (MAS) as a suitable paradigm for Systems Biology, for developing models and simulation of complex biological systems. Multi-agent system have been recently introduced in informatics context as a suitabe paradigm for modelling and engineering complex systems. Roughly speaking, a MAS can be conceived as a set of autonomous and interacting entities, called agents, situated in some kind of nvironment, where they fruitfully interact and coordinate so as to obtain a coherent global system behaviour. The claim of this work is that the general properties of MAS make them an effective approach for modelling and building simulations of complex biological systems, following the methodological principles identified by Systems Biology. In particular, the thesis focuses on cell populations as biological systems. In order to support the claim, the thesis introduces and describes (i) a MAS-based model conceived for modelling the dynamics of systems of cells interacting inside cell environment called niches. (ii) a computational tool, developed for implementing the models and executing the simulations. The tool is meant to work as a kind of virtual laboratory, on top of which kinds of virtual experiments can be performed, characterised by the definition and execution of specific models implemented as MASs, so as to support the validation, falsification and improvement of the models through the observation and analysis of the simulations. A hematopoietic stem cell system is taken as reference case study for formulating a specific model and executing virtual experiments.

A nested Petri net framework for modeling and analyzing multi-agent systems

In the past two decades, multi-agent systems (MAS) have emerged as a new paradigm for conceptualizing large and complex distributed software systems. A multi-agent system view provides a natural abstraction for both the structure and the behavior of modern-day software systems. Although there were many conceptual frameworks for using multi-agent systems, there was no well established and widely accepted method for modeling multi-agent systems. This dissertation research addressed the representation and analysis of multi-agent systems based on model-oriented formal methods. The objective was to provide a systematic approach for studying MAS at an early stage of system development to ensure the quality of design. ^ Given that there was no well-defined formal model directly supporting agent-oriented modeling, this study was centered on three main topics: (1) adapting a well-known formal model, predicate transition nets (PrT nets), to support MAS modeling; (2) formulating a modeling methodology to ease the construction of formal MAS models; and (3) developing a technique to support machine analysis of formal MAS models using model checking technology. PrT nets were extended to include the notions of dynamic structure, agent communication and coordination to support agent-oriented modeling. An aspect-oriented technique was developed to address the modularity of agent models and compositionality of incremental analysis. A set of translation rules were defined to systematically translate formal MAS models to concrete models that can be verified through the model checker SPIN (Simple Promela Interpreter). ^ This dissertation presents the framework developed for modeling and analyzing MAS, including a well-defined process model based on nested PrT nets, and a comprehensive methodology to guide the construction and analysis of formal MAS models.^

FOXC2 expression links epithelial-mesenchymal transition and stem cell properties in breast cancer

Resistance to chemotherapy and metastases are the major causes of breast cancer-related mortality. Moreover, cancer stem cells (CSC) play critical roles in cancer progression and treatment resistance. Previously, it was found that CSC-like cells can be generated by aberrant activation of epithelial–mesenchymal transition (EMT), thereby making anti-EMT strategies a novel therapeutic option for treatment of aggressive breast cancers. Here, we report that the transcription factor FOXC2 induced in response to multiple EMT signaling pathways as well as elevated in stem cell-enriched factions is a critical determinant of mesenchymal and stem cell properties, in cells induced to undergo EMT- and CSC-enriched breast cancer cell lines. More specifically, attenuation of FOXC2 expression using lentiviral short hairpin RNA led to inhibition of the mesenchymal phenotype and associated invasive and stem cell properties, which included reduced mammosphere-forming ability and tumor initiation. Whereas, overexpression of FOXC2 was sufficient to induce CSC properties and spontaneous metastasis in transformed human mammary epithelial cells. Furthermore, a FOXC2-induced gene expression signature was enriched in the claudin-low/basal B breast tumor subtype that contains EMT and CSC features. Having identified PDGFR-β to be regulated by FOXC2, we show that the U.S. Food and Drug Administration-approved PDGFR inhibitor, sunitinib, targets FOXC2-expressing tumor cells leading to reduced CSC and metastatic properties. Thus, FOXC2 or its associated gene expression program may provide an effective target for anti-EMT-based therapies for the treatment of claudin-low/basal B breast tumors or other EMT-/CSC-enriched tumors.

Inhibition of the JAK2/STAT3 pathway in ovarian cancer results in the loss of cancer stem cell-like characteristics and a reduced tumor burden

Background Current treatment of ovarian cancer patients with chemotherapy leaves behind a residual tumor which results in recurrent ovarian cancer within a short time frame. We have previously demonstrated that a single short-term treatment of ovarian cancer cells with chemotherapy in vitro resulted in a cancer stem cell (CSC)-like enriched residual population which generated significantly greater tumor burden compared to the tumor burden generated by control untreated cells. In this report we looked at the mechanisms of the enrichment of CSC-like residual cells in response to paclitaxel treatment. Methods The mechanism of survival of paclitaxel-treated residual cells at a growth inhibitory concentration of 50% (GI50) was determined on isolated tumor cells from the ascites of recurrent ovarian cancer patients and HEY ovarian cancer cell line by in vitro assays and in a mouse xenograft model. Results Treatment of isolated tumor cells from the ascites of ovarian cancer patients and HEY ovarian cancer cell line with paclitaxel resulted in a CSC-like residual population which coincided with the activation of Janus activated kinase 2 (JAK2) and signal transducer and activation of transcription 3 (STAT3) pathway in paclitaxel surviving cells. Both paclitaxel-induced JAK2/STAT3 activation and CSC-like characteristics were inhibited by a low dose JAK2-specific small molecule inhibitor CYT387 (1 μM) in vitro. Subsequent, in vivo transplantation of paclitaxel and CYT387-treated HEY cells in mice resulted in a significantly reduced tumor burden compared to that seen with paclitaxel only-treated transplanted cells. In vitro analysis of tumor xenografts at protein and mRNA levels demonstrated a loss of CSC-like markers and CA125 expression in paclitaxel and CYT387-treated cell-derived xenografts, compared to paclitaxel only-treated cell-derived xenografts. These results were consistent with significantly reduced activation of JAK2 and STAT3 in paclitaxel and CYT387-treated cell-derived xenografts compared to paclitaxel only-treated cell derived xenografts. Conclusions This proof of principle study demonstrates that inhibition of the JAK2/STAT3 pathway by the addition of CYT387 suppresses the ‘stemness’ profile in chemotherapy-treated residual cells in vitro, which is replicated in vivo, leading to a reduced tumor burden. These findings have important implications for ovarian cancer patients who are treated with taxane and/or platinum-based therapies. Keywords: Ovarian carcinoma, Cancer stem cell, Metastasis, Ascites, Chemoresistance, Recurrence, JAK2/STAT3 pathway

Adipocytes promote prostate cancer stem cell self-renewal through amplification of the cholecystokinin autocrine loop

Obesity has long been linked with prostate cancer progression, although the underlying mechanism is still largely unknown. Here, we report that adipocytes promote the enrichment of prostate cancer stem cells (CSCs) through a vicious cycle of autocrine amplification. In the presence of adipocytes, prostate cancer cells actively secrete the peptide hormone cholecystokinin (CCK), which not only stimulates prostate CSC self-renewal, but also induces cathepsin B (CTSB) production of the adipocytes. In return, CTSB facilitates further CCK secretion by the cancer cells. More importantly, inactivation of CCK receptor not only suppresses CTSB secretion by the adipocytes, but also synergizes the inhibitory effect of CTSB inhibitor on adipocyte-promoted prostate CSC self-renewal. In summary, we have uncovered a novel mechanism underlying the mutual interplay between adipocytes and prostate CSCs, which may help explaining the role of adipocytes in prostate cancer progression and provide opportunities for effective intervention.

Stem cell Researches in Brazil: Present and Future Challenges

A bill allowing researches with human embryonic stem cells has been approved by the Brazilian Congress, originally in 2005 and definitively by the Supreme Court in 2008. However, several years before, investigations in Brazil with adult stem cells in vitro in animal models as well as clinical trials, were started and are currently underway. Here, we will summarize the main findings and the challenges of going from bench to bed, focusing on heart, diabetes, cancer, craniofacial, and neuromuscular disorders. We also call attention to the importance of publishing negative results on experimental trials in scientific journals and websites. They are of great value to investigators in the field and may avoid the repeating of unsuccessful experiments. In addition, they could be referred to patients seeking information, aiming to protect them against financial and psychological harm.

Distributed optimization in power networks and general multi-agent systems

The dissertation studies the general area of complex networked systems that consist of interconnected and active heterogeneous components and usually operate in uncertain environments and with incomplete information. Problems associated with those systems are typically large-scale and computationally intractable, yet they are also very well-structured and have features that can be exploited by appropriate modeling and computational methods. The goal of this thesis is to develop foundational theories and tools to exploit those structures that can lead to computationally-efficient and distributed solutions, and apply them to improve systems operations and architecture.

Specifically, the thesis focuses on two concrete areas. The first one is to design distributed rules to manage distributed energy resources in the power network. The power network is undergoing a fundamental transformation. The future smart grid, especially on the distribution system, will be a large-scale network of distributed energy resources (DERs), each introducing random and rapid fluctuations in power supply, demand, voltage and frequency. These DERs provide a tremendous opportunity for sustainability, efficiency, and power reliability. However, there are daunting technical challenges in managing these DERs and optimizing their operation. The focus of this dissertation is to develop scalable, distributed, and real-time control and optimization to achieve system-wide efficiency, reliability, and robustness for the future power grid. In particular, we will present how to explore the power network structure to design efficient and distributed market and algorithms for the energy management. We will also show how to connect the algorithms with physical dynamics and existing control mechanisms for real-time control in power networks.

The second focus is to develop distributed optimization rules for general multi-agent engineering systems. A central goal in multiagent systems is to design local control laws for the individual agents to ensure that the emergent global behavior is desirable with respect to the given system level objective. Ideally, a system designer seeks to satisfy this goal while conditioning each agent’s control on the least amount of information possible. Our work focused on achieving this goal using the framework of game theory. In particular, we derived a systematic methodology for designing local agent objective functions that guarantees (i) an equivalence between the resulting game-theoretic equilibria and the system level design objective and (ii) that the resulting game possesses an inherent structure that can be exploited for distributed learning, e.g., potential games. The control design can then be completed by applying any distributed learning algorithm that guarantees convergence to the game-theoretic equilibrium. One main advantage of this game theoretic approach is that it provides a hierarchical decomposition between the decomposition of the systemic objective (game design) and the specific local decision rules (distributed learning algorithms). This decomposition provides the system designer with tremendous flexibility to meet the design objectives and constraints inherent in a broad class of multiagent systems. Furthermore, in many settings the resulting controllers will be inherently robust to a host of uncertainties including asynchronous clock rates, delays in information, and component failures.

Towards in situ Single Cell Systems Biology

Systems-level studies of biological systems rely on observations taken at a resolution lower than the essential unit of biology, the cell. Recent technical advances in DNA sequencing have enabled measurements of the transcriptomes in single cells excised from their environment, but it remains a daunting technical problem to reconstruct in situ gene expression patterns from sequencing data. In this thesis I develop methods for the routine, quantitative in situ measurement of gene expression using fluorescence microscopy.

The number of molecular species that can be measured simultaneously by fluorescence microscopy is limited by the pallet of spectrally distinct fluorophores. Thus, fluorescence microscopy is traditionally limited to the simultaneous measurement of only five labeled biomolecules at a time. The two methods described in this thesis, super-resolution barcoding and temporal barcoding, represent strategies for overcoming this limitation to monitor expression of many genes in a single cell. Super-resolution barcoding employs optical super-resolution microscopy (SRM) and combinatorial labeling via-smFISH (single molecule fluorescence in situ hybridization) to uniquely label individual mRNA species with distinct barcodes resolvable at nanometer resolution. This method dramatically increases the optical space in a cell, allowing a large numbers of barcodes to be visualized simultaneously. As a proof of principle this technology was used to study the S. cerevisiae calcium stress response. The second method, sequential barcoding, reads out a temporal barcode through multiple rounds of oligonucleotide hybridization to the same mRNA. The multiplexing capacity of sequential barcoding increases exponentially with the number of rounds of hybridization, allowing over a hundred genes to be profiled in only a few rounds of hybridization.

The utility of sequential barcoding was further demonstrated by adapting this method to study gene expression in mammalian tissues. Mammalian tissues suffer both from a large amount of auto-fluorescence and light scattering, making detection of smFISH probes on mRNA difficult. An amplified single molecule detection technology, smHCR (single molecule hairpin chain reaction), was developed to allow for the quantification of mRNA in tissue. This technology is demonstrated in combination with light sheet microscopy and background reducing tissue clearing technology, enabling whole-organ sequential barcoding to monitor in situ gene expression directly in intact mammalian tissue.

The methods presented in this thesis, specifically sequential barcoding and smHCR, enable multiplexed transcriptional observations in any tissue of interest. These technologies will serve as a general platform for future transcriptomic studies of complex tissues.

Automating the product derivation process of multi-agent systems product lines

Agent-oriented software engineering and software product lines are two promising software engineering techniques. Recent research work has been exploring their integration, namely multi-agent systems product lines (MAS-PLs), to promote reuse and variability management in the context of complex software systems. However, current product derivation approaches do not provide specific mechanisms to deal with MAS-PLs. This is essential because they typically encompass several concerns (e.g., trust, coordination, transaction, state persistence) that are constructed on the basis of heterogeneous technologies (e.g., object-oriented frameworks and platforms). In this paper, we propose the use of multi-level models to support the configuration knowledge specification and automatic product derivation of MAS-PLs. Our approach provides an agent-specific architecture model that uses abstractions and instantiation rules that are relevant to this application domain. In order to evaluate the feasibility and effectiveness of the proposed approach, we have implemented it as an extension of an existing product derivation tool, called GenArch. The approach has also been evaluated through the automatic instantiation of two MAS-PLs, demonstrating its potential and benefits to product derivation and configuration knowledge specification.

Co-ordination in multi-agent systems

A multi-agent system is a complex software system which is composed of many relative autonomous smaller softwares called agents. The research on multi-agent systems is concerned with the interaction and coordination among these agents to let them help each other to solve complicated problems, such as finance investment management. The principal contributions represented by these 50 selected papers are "cooperation under uncertainty in distributed expert systems (DESs)", "a tool and algorithms to build DESs", and "information gathering and decision making in multi-agent systems (MASs)".

Meta-models, environment and layers: agent-oriented engineering of complex systems

Traditional software engineering approaches and metaphors fall short when applied to areas of growing relevance such as electronic commerce, enterprise resource planning, and mobile computing: such areas, in fact, generally call for open architectures that may evolve dynamically over time so as to accommodate new components and meet new requirements. This is probably one of the main reasons that the agent metaphor and the agent-oriented paradigm are gaining momentum in these areas. This thesis deals with the engineering of complex software systems in terms of the agent paradigm. This paradigm is based on the notions of agent and systems of interacting agents as fundamental abstractions for designing, developing and managing at runtime typically distributed software systems. However, today the engineer often works with technologies that do not support the abstractions used in the design of the systems. For this reason the research on methodologies becomes the basic point in the scientific activity. Currently most agent-oriented methodologies are supported by small teams of academic researchers, and as a result, most of them are in an early stage and still in the first context of mostly \academic" approaches for agent-oriented systems development. Moreover, such methodologies are not well documented and very often defined and presented only by focusing on specific aspects of the methodology. The role played by meta- models becomes fundamental for comparing and evaluating the methodologies. In fact a meta-model specifies the concepts, rules and relationships used to define methodologies. Although it is possible to describe a methodology without an explicit meta-model, formalising the underpinning ideas of the methodology in question is valuable when checking its consistency or planning extensions or modifications. A good meta-model must address all the different aspects of a methodology, i.e. the process to be followed, the work products to be generated and those responsible for making all this happen. In turn, specifying the work products that must be developed implies dening the basic modelling building blocks from which they are built. As a building block, the agent abstraction alone is not enough to fully model all the aspects related to multi-agent systems in a natural way. In particular, different perspectives exist on the role that environment plays within agent systems: however, it is clear at least that all non-agent elements of a multi-agent system are typically considered to be part of the multi-agent system environment. The key role of environment as a first-class abstraction in the engineering of multi-agent system is today generally acknowledged in the multi-agent system community, so environment should be explicitly accounted for in the engineering of multi-agent system, working as a new design dimension for agent-oriented methodologies. At least two main ingredients shape the environment: environment abstractions - entities of the environment encapsulating some functions -, and topology abstractions - entities of environment that represent the (either logical or physical) spatial structure. In addition, the engineering of non-trivial multi-agent systems requires principles and mechanisms for supporting the management of the system representation complexity. These principles lead to the adoption of a multi-layered description, which could be used by designers to provide different levels of abstraction over multi-agent systems. The research in these fields has lead to the formulation of a new version of the SODA methodology where environment abstractions and layering principles are exploited for en- gineering multi-agent systems.

Advanced computing for systems biology

Systems biology is based on computational modelling and simulation of large networks of interacting components. Models may be intended to capture processes, mechanisms, components and interactions at different levels of fidelity. Input data are often large and geographically disperse, and may require the computation to be moved to the data, not vice versa. In addition, complex system-level problems require collaboration across institutions and disciplines. Grid computing can offer robust, scaleable solutions for distributed data, compute and expertise. We illustrate some of the range of computational and data requirements in systems biology with three case studies: one requiring large computation but small data (orthologue mapping in comparative genomics), a second involving complex terabyte data (the Visible Cell project) and a third that is both computationally and data-intensive (simulations at multiple temporal and spatial scales). Authentication, authorisation and audit systems are currently not well scalable and may present bottlenecks for distributed collaboration particularly where outcomes may be commercialised. Challenges remain in providing lightweight standards to facilitate the penetration of robust, scalable grid-type computing into diverse user communities to meet the evolving demands of systems biology.