Knowledge-Based Task Structure Planning for an Information Gathering Agent

An effective solution to model and apply planning domain knowledge for deliberation and action in probabilistic, agent-oriented control is presented. Specifically, the addition of a task structure planning component and supporting components to an agent-oriented architecture and agent implementation is described. For agent control in risky or uncertain environments, an approach and method of goal reduction to task plan sets and schedules of action is presented. Additionally, some issues related to component-wise, situation-dependent control of a task planning agent that schedules its tasks separately from planning them are motivated and discussed.

A Model of Rights

In this paper, we develop a simple model of the rights a government provides its citizenry. Rights are treated as public goods and taken as primitives in agents utility functions; each agent has preferences over the entire policy vector. We model the interaction among citi-zens and the government as a game in which an exogenous lobbying set makes contributions to the government to in uence policy formu-lation in the matter of rights. When examining contribution schedules comprising truthful Nash strategies, we find that members of the lob-bying set obtain rights closer to their most-preferred bundle, while the rights of non-lobbyers further diverge from their most-preferred bun-dle. Further, if the lobbying set comprises the entire population, the government s allocation of rights does not differ from the allocation achieved in the absence of contributions.

Mechanism of methylation gene reactivation in human cancer cells

Epigenetic silencing of tumor suppressor genes by DNA hypermethylation at promoter regions is a common event in carcinogenesis and tumor progression. Abrogation of methylation and reversal of epigenetic silencing is a very potent way in cancer treatment. However, the reactivation mechanisms are poorly understood. In this study, we first developed a cell line model system named YB5, derived from SW48 cancer cell line, which bears one copy of stably integrated EGFP gene on Chromosome 1p31.1 region. The GFP gene expression is transcriptionally silenced due to the hypermethylated promoter CMV. However, the GFP expression can be restored using demethylating agent 5-aza-2' deoxycytidine (DAC), and detected by FACS and fluorescent microscopy. Using this system, we observed the heterogeneous reactivation induced by DAC treatment. After flow sorting, GFP negative cells exhibited similar level of incomplete demethylation compared to GFP positive cells on repetitive LINE1 element, tumor suppressor genes such as P16, CDH13, and RASSF1a, and CMV promoter as well. However, the local chromatin of CMV-GFP locus altered to an open structure marked by high H3 lysine 9 acetylation and low H3 lysine 27 tri-methylation in GFP positive cells, while the GFP negative cells retained mostly the original repressive marks. Thus, we concluded that DAC induced DNA hypomethylation alone does not directly determine the level of re-expression, and the resetting of the local chromatin structure under hypomethylation environment is required for gene reactivation. Besides, a lentivirus vector-based shRNA screening was performed using the YB5 system. Although it is the rare chance that vector lands in the neighboring region of GFP, we found that the exogenous vector DNA inserted into the upstream region of GFP gene locus led to the promoter demethylation and reactivated the silenced GFP gene. Thus, epigenetic state can be affected by changing of the adjacent nucleic acid sequences. Further, this hypermethylation silenced system was utilized for epigenetic drug screening. We have found that DAC combined with carboplatin would enhance the GFP% yield and increase expression of other tumor suppressor genes than DAC alone, and this synergistic effect may be related to DNA repair process. In summary, these studies reveal that reversing of methylation silencing requires coordinated alterations of DNA methylation, chromatin structure, and local microenvironment. ^

Hispanic incorporation and access to health care in Houston and Harris County, Texas: Adopting an Hispanic perspective to the Aday and Andersen model

This study examines Hispanic levels of incorporation and access to health care. Applying the Aday and Andersen framework for the study of access, the study examined the relationship between two levels of Hispanic incorporation into U.S. society, i.e., mainstream versus ethnic, and potential and realized measures of access to health care. Data for the study were drawn from a 1992 telephone survey of 600 randomly selected Hispanics in Houston and Harris County.^ The hypotheses tested were: (1) Hispanics who are incorporated into mainstream society are more likely to have better potential and realized access to health care than those who are incorporated into ethnic-group enclaves regardless of their socioeconomic status (SES), health status and health needs, and (2) there is no interaction between the levels of incorporation (mainstream or ethnic) and SES, health status, and health needs in predicting potential and realized access.^ The data analysis supported Hypothesis One for the two measures of potential access. The results of bivariate and multiple logistic regression analyses indicated that for Hispanics in Houston and Harris County, being in the "mainstream" incorporation category increased their potential access to care, having "health insurance" and a "regular place of care". For the selected measure of realized access, having a "regular check-up", the analysis did not demonstrate statistically significant differences in having a regular check-up among Hispanics incorporated in the ethnic or mainstream incorporation categories.^ Hypothesis Two, that there is no interaction between the levels of incorporation and socioeconomic characteristics, health status, and health needs in predicting potential and realized access among Hispanics was supported by the data. The results of the logistic regression analysis showed that, after adjusting for socioeconomic status, health status, and health needs, the association between "level of incorporation" and the two measures of potential access ("health insurance" and having a "usual place of care") was not modified by the control variables nor by their interaction with level of incorporation. That is, the effect of incorporation on Hispanics' health insurance coverage, and having a usual place of care, was homogenous across Hispanics with different SES and health status.^ The main research implication of this dissertation is the employment of a theoretical framework for the assessment of cultural factors essential to research on migrating heterogeneous subpopulations. It also provided strategies to solve practical and methodological difficulties in the secondary analyses of data on these populations. ^

ALLERGEN SENSITIZATION AND IMMUNOMODULATION BY SYNTHETIC LIGANDS, PUL-042, IN AN ALLERGEN-INDUCED ASTHMA MURINE MODEL

Allergen-induced asthma is the leading form of asthma and a chronic condition worldwide. Common allergens are known to contribute to the pathogenesis of this disease. Murine models of allergic asthma have mostly used an intraperitoneal route of sensitization (not airway) to study this disease. Allergic asthma pathophysiology involves the activation of TH2-specific cells, which triggers production of IgE antibodies, the up-regulation of TH2-specific cytokines (i.e. IL-4, IL-5, IL-9 and IL-13), increased airway eosinophilia, and mucin hypersecretion. Although there are several therapeutics currently treating asthmatic patients, some of these treatments can result in drug tolerance and may be linked to increased mortality. CpG oligodeoxynucleotides (ODNs) is a synthetic ligand that targets Toll-like Receptor (TLR) 9. It has been evaluated as a therapeutic agent for the treatment of cancer, infectious diseases, and for treating allergy and asthma. PUL-042 is also a synthetic TLR ligand and is composed of two agonists against TLR2/6 heterodimer and TLR9. Previous studies have evaluated PUL-042 for its ability to confer resistance against bacterial and viral lung infection. These findings, combined with studies performed using CpG ODNs, led to speculation that PUL-042 dampens the immune response in allergen-induced asthma. My thesis research investigated airway route sensitization and airway delivery of PUL-042 to evaluate its effects in reducing an allergen-induced asthma phenotype in a murine model. The results of this study contribute to the foundation for future investigations to evaluate the efficacy of PUL-042 as a novel therapy in allergic-asthma disease.

PIM KINASE INHIBITION: SINGLE AGENT AND COMBINATION APPROACHES IN B-CELL LYMPHOMA

Proviral integration site for Moloney murine leukemia virus (Pim) kinases are Ser/Thr/Tyr kinases. They modulate B-cell development but become oncoproteins and promote cancer development once overexpressed. Containing three isoforms, Pim-1, -2 and -3 are known to phosphorylate various substrates that regulate transcription, translation, cell cycle, and survival pathways in both hematological and solid tumors. Mantle cell lymphoma (MCL) is an aggressive B-cell lymphoma. Elevated Pim kinase levels are common in MCL, and it negatively correlates with patient outcome. SGI-1776 is a small molecule inhibitor selective for Pim-1/-3. We hypothesize that SGI-1776 treatment in MCL will inhibit Pim kinase function, and inhibition of downstream substrates phosphorylation will disrupt transcriptional, translational, and cell cycle processes while promoting apoptosis. SGI-1776 treatment induced moderate to high levels of apoptosis in four MCL cell lines (JeKo-1, Mino, SP-53 and Granta-519) and peripheral blood mononuclear cells (PBMCs) from MCL patients. Phosphorylation of transcription and translation regulators, c-Myc and 4E-BP1 declined in both model systems. Additionally, levels of short-lived Mcl-1 mRNA and protein also decreased and correlated with decline of global RNA synthesis. Collectively, our investigations highlight Pim kinases as viable drug targets in MCL and emphasize their roles in transcriptional and translational regulation. We further investigated a combination strategy using SGI-1776 with bendamustine, an FDA-approved DNA-damaging alkylating agent for treating non-Hodgkin’s lymphoma. We hypothesized this combination will enhance SGI-1776-induced transcription and translation inhibition, while promoting bendamustine-triggered DNA damage and inducing additive to synergistic cytotoxicity in B-cell lymphoma. Bendamustine alone resulted in moderate levels of apoptosis induction in MCL cell lines (JeKo-1 and Mino), and in MCL and splenic marginal zone lymphoma (a type of B-cell lymphoma) primary cells. An additive effect in cell killing was observed when combined with SGI-1776. Expectedly, SGI-1776 effectively decreased global RNA and protein synthesis levels, while bendamustine significantly inhibited DNA synthesis and generated DNA damage response. In combination, intensified inhibitory effects in DNA, RNA and protein syntheses were observed. Together, these data suggested feasibility of using Pim kinase inhibitor in combination with chemotherapeutic agents such as bendamustine in B-cell lymphoma, and provided foundation of their mechanism of actions in lymphoma cells.

Development and Characterization of an in vitro Four-species Anaerobic Dental Biofilm Model

Dental caries is the most common chronic disease worldwide. It is characterized by the demineralization of tooth enamel caused by acid produced by cariogenic dental bacteria growing on tooth surfaces, termed bacterial biofilms. Cariogenesis is a complex biological process that is influence by multiple factors and is not attributed to a sole causative agent. Instead, caries is associated with multispecies microbial biofilm communities composed of some bacterial species that directly influence the development of a caries lesion and other species that are seemingly benign but must contribute to the community in an uncharacterized way. Clinical analysis of dental caries and its microbial populations is challenging due to many factors including low sensitivity of clinical measurement tools, variability in saliva chemistry, and variation in the microbiota. Our laboratory has developed an in vitro anaerobic biofilm model for dental carries to facilitate both clinical and basic research-based analyses of the multispecies dynamics and individual factors that contribute to cariogenicity. The rational for development of this system was to improve upon the current models that lack key elements. This model places an emphasis on physiological relevance and ease of maintenance and reproducibility. The uniqueness of the model is based on integrating four critical elements: 1) a biofilm community composed of four distinct and representative species typically associated with dental caries, 2) a semi-defined synthetic growth medium designed to mimic saliva, 3) physiologically relevant biofilm growth substrates, and 4) a novel biofilm reactor device designed to facilitate the maintenance and analysis. Specifically, human tooth sections or hydroxyapatite discs embedded into poly(methyl methacrylate) (PMMA) discs are incubated for an initial 24 hr in a static inverted removable substrate (SIRS) biofilm reactor at 37°C under anaerobic conditions in artificial saliva (CAMM) without sucrose in the presence of 1 X 106 cells/ml of each Actinomyces odontolyticus, Fusobacterium nucleatum, Streptococcus mutans, and Veillonella dispar. During days 2 and 3 the samples are maintained continually in CAMM with various exposures to 0.2% sucrose; all of the discs are transferred into fresh medium every 24 hr. To validate that this model is an appropriate in vitro representation of a caries-associated multispecies biofilm, research aims were designed to test the following overarching hypothesis: an in vitro anaerobic biofilm composed of four species (S. mutans, V. dispar, A. odontolyticus, and F. nucleatum) will form a stable biofilm with a community profile that changes in response to environmental conditions and exhibits a cariogenic potential. For these experiments the biofilms as described above were exposed on days 2 and 3 to either CAMM lacking sucrose (no sucrose), CAMM with 0.2% sucrose (constant sucrose), or were transferred twice a day for 1 hr each time into 0.2% sucrose (intermittent sucrose). Four types of analysis were performed: 1) fluorescence microscopy of biofilms stained with Syto 9 and hexidium idodine to determine the biofilm architecture, 2) quantitative PCR (qPCR) to determine the cell number of each species per cm2, 3) vertical scanning interferometry (VSI) to determine the cariogenic potential of the biofilms, and 4) tomographic pH imaging using radiometric fluorescence microscopy after exposure to pH sensitive nanoparticles to measure the micro-environmental pH. The qualitative and quantitative results reveal the expected dynamics of the community profile when exposed to different sucrose conditions and the cariogenic potential of this in vitro four-species anaerobic biofilm model, thus confirming its usefulness for future analysis of primary and secondary dental caries.

Neocortical hyperexcitability defect in a mutant mouse model of spike-wave epilepsy, {\it stargazer}

Single-locus mutations in mice can express epileptic phenotypes and provide critical insights into the naturally occurring defects that alter excitability and mediate synchronization in the central nervous system (CNS). One such recessive mutation (on chromosome (Chr) 15), stargazer(stg/stg) expresses frequent bilateral 6-7 cycles per second (c/sec) spike-wave seizures associated with behavioral arrest, and provides a valuable opportunity to examine the inherited lesion associated with spike-wave synchronization.^ The existence of distinct and heterogeneous defects mediating spike-wave discharge (SWD) generation has been demonstrated by the presence of multiple genetic loci expressing generalized spike-wave activity and the differential effects of pharmacological agents on SWDs in different spike-wave epilepsy models. Attempts at understanding the different basic mechanisms underlying spike-wave synchronization have focused on $\gamma$-aminobutyric acid (GABA) receptor-, low threshold T-type Ca$\sp{2+}$ channel-, and N-methyl-D-aspartate receptor (NMDA-R)-mediated transmission. It is believed that defects in these modes of transmission can mediate the conversion of normal oscillations in a trisynaptic circuit, which includes the neocortex, reticular nucleus and thalamus, into spike-wave activity. However, the underlying lesions involved in spike-wave synchronization have not been clearly identified.^ The purpose of this research project was to locate and characterize a distinct neuronal hyperexcitability defect favoring spike-wave synchronization in the stargazer brain. One experimental approach for anatomically locating areas of synchronization and hyperexcitability involved an attempt to map patterns of hypersynchronous activity with antibodies to activity-induced proteins.^ A second approach to characterizing the neuronal defect involved examining the neuronal responses in the mutant following application of pharmacological agents with well known sites of action.^ In order to test the hypothesis that an NMDA receptor mediated hyperexcitability defect exists in stargazer neocortex, extracellular field recordings were used to examine the effects of CPP and MK-801 on coronal neocortical brain slices of stargazer and wild type perfused with 0 Mg$\sp{2+}$ artificial cerebral spinal fluid (aCSF).^ To study how NMDA receptor antagonists might promote increased excitability in stargazer neocortex, two basic hypotheses were tested: (1) NMDA receptor antagonists directly activate deep layer principal pyramidal cells in the neocortex of stargazer, presumably by opening NMDA receptor channels altered by the stg mutation; and (2) NMDA receptor antagonists disinhibit the neocortical network by blocking recurrent excitatory synaptic inputs onto inhibitory interneurons in the deep layers of stargazer neocortex.^ In order to test whether CPP might disinhibit the 0 Mg$\sp{2+}$ bursting network in the mutant by acting on inhibitory interneurons, the inhibitory inputs were pharmacologically removed by application of GABA receptor antagonists to the cortical network, and the effects of CPP under 0 Mg$\sp{2+}$aCSF perfusion in layer V of stg/stg were then compared with those found in +/+ neocortex using in vitro extracellular field recordings. (Abstract shortened by UMI.) ^

The two -state model of receptor activation: The agonist and the efficacy

The Two State model describes how drugs activate receptors by inducing or supporting a conformational change in the receptor from “off” to “on”. The beta 2 adrenergic receptor system is the model system which was used to formalize the concept of two states, and the mechanism of hormone agonist stimulation of this receptor is similar to ligand activation of other seven transmembrane receptors. Hormone binding to beta 2 adrenergic receptors stimulates the intracellular production of cyclic adenosine monophosphate (cAMP), which is mediated through the stimulatory guanyl nucleotide binding protein (Gs) interacting with the membrane bound enzyme adenylylcyclase (AC). ^ The effects of cAMP include protein phosphorylation, metabolic regulation and transcriptional regulation. The beta 2 adrenergic receptor system is the most well known of its family of G protein coupled receptors. Ligands have been scrutinized extensively in search of more effective therapeutic agents at this receptor as well as for insight into the biochemical mechanism of receptor activation. Hormone binding to receptor is thought to induce a conformational change in the receptor that increases its affinity for inactive Gs, catalyzes the release of GDP and subsequent binding of GTP and activation of Gs. ^ However, some beta 2 ligands are more efficient at this transformation than others, and the underlying mechanism for this drug specificity is not fully understood. The central problem in pharmacology is the characterization of drugs in their effect on physiological systems, and consequently, the search for a rational scale of drug effectiveness has been the effort of many investigators, which continues to the present time as models are proposed, tested and modified. ^ The major results of this thesis show that for many b2 -adrenergic ligands, the Two State model is quite adequate to explain their activity, but dobutamine (+/−3,4-dihydroxy-N-[3-(4-hydroxyphenyl)-1-methylpropyl]- b -phenethylamine) fails to conform to the predictions of the Two State model. It is a weak partial agonist, but it forms a large amount of high affinity complexes, and these complexes are formed at low concentrations much better than at higher concentrations. Finally, dobutamine causes the beta 2 adrenergic receptor to form high affinity complexes at a much faster rate than can be accounted for by its low efficiency activating AC. Because the Two State model fails to predict the activity of dobutamine in three different ways, it has been disproven in its strictest form. ^

Dynamic contrast agent -enhanced magnetic resonance imaging assessment of tumor microvasculature

Dynamic contrast agent-enhanced magnetic resonance imaging (DCE MRI) data, when analyzed with the appropriate pharmacokinetic models, have been shown to provide quantitative estimates of microvascular parameters important in characterizing the angiogenic activity of malignant tissue. These parameters consist of the whole blood volume per unit volume of tissue, v b, transport constant from the plasma to the extravascular, extracellular space (EES), k1 and the transport constant from the EES to the plasma, k2. Parameters vb and k1 are expected to correlate with microvascular density (MVD) and vascular permeability, respectively, which have been suggested to serve as surrogate markers for angiogenesis. In addition to being a marker for angiogenesis, vascular permeability is also useful in estimating tumor penetration potential of chemotherapeutic agents. ^ Histological measurements of the intratumoral microvascular environment are limited by their invasiveness and susceptibility to sampling errors. Also, MVD and vascular permeability, while useful for characterizing tumors at a single time point, have shown less utility in longitudinal studies, particularly when used to monitor the efficacy of antiangiogenic and traditional chemotherapeutic agents. These limitations led to a search for a non-invasive means of characterizing the microvascular environment of an entire tumor. ^ The overall goal of this project was to determine the utility of DCE MRI for monitoring the effect of antiangiogenic agents. Further applications of a validated DCE MRI technique include in vivo measurements of tumor microvascular characteristics to aid in determining prognosis at presentation and in estimating drug penetration. DCE MRI data were generated using single- and dual-tracer pharmacokinetic models with different molecular-weight contrast agents. The resulting pharmacokinetic parameters were compared to immunohistochemical measurements. The model and contrast agent combination yielding the best correlation between the pharmacokinetic parameters and histological measures was further evaluated in a longitudinal study to evaluate the efficacy of DCE MRI in monitoring the intratumoral microvascular environment following antiangiogenic treatment. ^

Medem Channel profiles based on stand-alone model simulation and corrections with nudging

State-of-the-art process-based models have shown to be applicable to the simulation and prediction of coastal morphodynamics. On annual to decadal temporal scales, these models may show limitations in reproducing complex natural morphological evolution patterns, such as the movement of bars and tidal channels, e.g. the observed decadal migration of the Medem Channel in the Elbe Estuary, German Bight. Here a morphodynamic model is shown to simulate the hydrodynamics and sediment budgets of the domain to some extent, but fails to adequately reproduce the pronounced channel migration, due to the insufficient implementation of bank erosion processes. In order to allow for long-term simulations of the domain, a nudging method has been introduced to update the model-predicted bathymetries with observations. The model-predicted bathymetry is nudged towards true states in annual time steps. Sensitivity analysis of a user-defined correlation length scale, for the definition of the background error covariance matrix during the nudging procedure, suggests that the optimal error correlation length is similar to the grid cell size, here 80-90 m. Additionally, spatially heterogeneous correlation lengths produce more realistic channel depths than do spatially homogeneous correlation lengths. Consecutive application of the nudging method compensates for the (stand-alone) model prediction errors and corrects the channel migration pattern, with a Brier skill score of 0.78. The proposed nudging method in this study serves as an analytical approach to update model predictions towards a predefined 'true' state for the spatiotemporal interpolation of incomplete morphological data in long-term simulations.

Simulating heterogeneous multinational firms

This paper develops a micro-simulation framework for multinational entry and sales activities across countries. The model is based on Eaton, Kortum, and Kramarz's (2010) quantitative trade model adapted towards multinational production. Using micro data on Japanese manufacturing firms, we first stylize the empirical regularities of multinational entry and sales activity and estimate the model's structural parameters with simulated method of moments. We then demonstrate that our adapted model is able to replicate important dimensions of the in-sample moments conditioned in our estimation strategy. Importantly, it is able to replicate activity under an economic period with a far different level of FDI barriers than was conditioned upon in our estimation sample. Overall, our research highlights the richness of the simulation framework for performing counterfactual analysis of various FDI policies.

Heterogeneous multinational firms and productivity gains from falling FDI barriers

During the past decade of declining FDI barriers, small domestic firms disproportionately contracted while large multinational firms experienced a substantial growth in Japan’s manufacturing sector. This paper quantitatively assesses the impact of FDI globalization on intra-industry reallocations and aggregate productivity. We calibrate the firm-heterogeneity model of Eaton, Kortum, and Kramarz (2011) to micro-level data on Japanese multinational firms. Estimating the structural parameters of the model, we demonstrate that the model can strongly replicate the entry and sales patterns of Japanese multinationals. Counterfactual simulations show that declining FDI barriers lead to a disproportionate expansion of foreign production by more efficient firms relative to less efficient firms. A hypothetical 20% reduction in FDI barriers is found to generate a 30.7% improvement in aggregate productivity through market-share reallocation.

Heterogeneous firms and cost sharing in China's marketplaces

This study extends Melitz's model with heterogeneous firms by introducing shared fixed costs in a marketplace. It aims to explain heterogeneous firms' choice between traditional marketplaces and modern distribution channels on the basis of their productivities. The results reveal that the co-existence of a traditional marketplace and modern distribution channels improves social welfare. In addition, a deregulation policy for firm entry outside a marketplace and accumulation of human capital are factors that contribute to improve the social welfare.

Dynamic Model-based Management of Service-Oriented Infrastructure.

Models are an effective tool for systems and software design. They allow software architects to abstract from the non-relevant details. Those qualities are also useful for the technical management of networks, systems and software, such as those that compose service oriented architectures. Models can provide a set of well-defined abstractions over the distributed heterogeneous service infrastructure that enable its automated management. We propose to use the managed system as a source of dynamically generated runtime models, and decompose management processes into a composition of model transformations. We have created an autonomic service deployment and configuration architecture that obtains, analyzes, and transforms system models to apply the required actions, while being oblivious to the low-level details. An instrumentation layer automatically builds these models and interprets the planned management actions to the system. We illustrate these concepts with a distributed service update operation.