Integrating and evaluating neural word embeddings in information retrieval

Recent advances in neural language models have contributed new methods for learning distributed vector representations of words (also called word embeddings). Two such methods are the continuous bag-of-words model and the skipgram model. These methods have been shown to produce embeddings that capture higher order relationships between words that are highly effective in natural language processing tasks involving the use of word similarity and word analogy. Despite these promising results, there has been little analysis of the use of these word embeddings for retrieval. Motivated by these observations, in this paper, we set out to determine how these word embeddings can be used within a retrieval model and what the benefit might be. To this aim, we use neural word embeddings within the well known translation language model for information retrieval. This language model captures implicit semantic relations between the words in queries and those in relevant documents, thus producing more accurate estimations of document relevance. The word embeddings used to estimate neural language models produce translations that differ from previous translation language model approaches; differences that deliver improvements in retrieval effectiveness. The models are robust to choices made in building word embeddings and, even more so, our results show that embeddings do not even need to be produced from the same corpus being used for retrieval.

Neural stem cell characteristics affected by oncogenic pathways and in a human motoneuron disease

Neural stem cell characteristics affected by oncogenic pathways and in a human motoneuron disease Stem cells provide the self-renewing cell pool for developing or regenerating organs. The mechanisms underlying the decisions of a stem or progenitor cell to either self-renew and maintain multipotentiality or alternatively to differentiate are incompletely understood. In this thesis work, I have approached this question by investigating the role of the proto-oncogene Myc in the regulatory functions of neural progenitor cell (NPC) self-renewal, proliferation and differentiation. By using a retroviral transduction technique to create overexpression models in embryonic NPCs cultured as neurospheres, I show that activated levels of Myc increase NPC self-renewal. Furthermore, several mechanisms that regulate the activity of Myc were identified. Myc induced self-renewal is signalled through binding to the transcription factor Miz-1 as shown by the inhibited capacity of a Myc mutant (MycV394D), deficient in binding to Miz-1, to increase self-renewal in NPCs. Furthermore, overexpression of the newly identified proto-oncogene CIP2A recapitulates the effects of Myc overexpression in NPCs. Also the expression levels and in vivo expression patterns of Myc and CIP2A were linked together. CIP2A stabilizes Myc protein levels in several cancer types by inhibiting its degradation and our results suggest the same function for CIP2A in NPCs. Our results also support the conception of self-renewal and proliferation being two separately regulated cellular functions. Finally, I suggest that Myc regulates NPC self-renewal by influencing the way stem and progenitor cells react to the environmental cues that normally dictate the cellular identity of tissues containing self-renewing cells. Neurosphere cultures were also utilised in order to characterise functional defects in a human disease. Neural stem cell cultures obtained post-mortem from foetuses of lethal congenital contracture syndrome (LCCS) were used to reveal possible cell autonomous differentiation defects of patient NPCs. However, LCCS derived NPCs were able to differentiate normally in vitro although several transcriptional differences were identified by using microarray analysis. Proliferation rate of the patient NPCs was also increased as compared to NPCs of age-matched control foetuses.

Genetic variation in tumour necrosis factor and lymphotoxin is not associated with endometriosis in an Australian sample

BACKGROUND Tumour necrosis factor (TNF) is a pleiotropic cytokine with a wide range of immunoregulatory effects. Variation in the promoter region of TNF and the neighbouring lymphotoxin alpha (LTA) gene might be associated with endometriosis. METHODS We examined the association between endometriosis and common single-nucleotide polymorphisms (SNPs) or haplotypes in the TNF/LTA region in an Australian sample by analysing 26 SNPs in 958 endometriosis cases and 959 unrelated controls. We selected functional SNPs in the coding and the promoter region of the TNF gene and HapMap tagging SNPs and typed them on a Sequenom MassARRAY platform. A key SNP (rs1800630) in the promoter region typed in previous studies did not give reliable results. Therefore, we also examined a statistically identical (r(2) = 1) SNP (siSNP) (rs2844482), identified using the web based program ssSNPer. RESULTS Genotype completion rate was 99.5% for SNPs spanning a region of 15.5 kb across the TNF/LTA locus. There was no evidence for association between endometriosis and TNF/LTA SNPs or SNP haplotypes in our case-control study. CONCLUSIONS Our data suggest both TNF and LTA genes are not major susceptibility genes for endometriosis.

Automatic Lameness Detection in a Milking Robot : Instrumentation, measurement software, algorithms for data analysis and a neural network model

The aim of this thesis is to develop a fully automatic lameness detection system that operates in a milking robot. The instrumentation, measurement software, algorithms for data analysis and a neural network model for lameness detection were developed. Automatic milking has become a common practice in dairy husbandry, and in the year 2006 about 4000 farms worldwide used over 6000 milking robots. There is a worldwide movement with the objective of fully automating every process from feeding to milking. Increase in automation is a consequence of increasing farm sizes, the demand for more efficient production and the growth of labour costs. As the level of automation increases, the time that the cattle keeper uses for monitoring animals often decreases. This has created a need for systems for automatically monitoring the health of farm animals. The popularity of milking robots also offers a new and unique possibility to monitor animals in a single confined space up to four times daily. Lameness is a crucial welfare issue in the modern dairy industry. Limb disorders cause serious welfare, health and economic problems especially in loose housing of cattle. Lameness causes losses in milk production and leads to early culling of animals. These costs could be reduced with early identification and treatment. At present, only a few methods for automatically detecting lameness have been developed, and the most common methods used for lameness detection and assessment are various visual locomotion scoring systems. The problem with locomotion scoring is that it needs experience to be conducted properly, it is labour intensive as an on-farm method and the results are subjective. A four balance system for measuring the leg load distribution of dairy cows during milking in order to detect lameness was developed and set up in the University of Helsinki Research farm Suitia. The leg weights of 73 cows were successfully recorded during almost 10,000 robotic milkings over a period of 5 months. The cows were locomotion scored weekly, and the lame cows were inspected clinically for hoof lesions. Unsuccessful measurements, caused by cows standing outside the balances, were removed from the data with a special algorithm, and the mean leg loads and the number of kicks during milking was calculated. In order to develop an expert system to automatically detect lameness cases, a model was needed. A probabilistic neural network (PNN) classifier model was chosen for the task. The data was divided in two parts and 5,074 measurements from 37 cows were used to train the model. The operation of the model was evaluated for its ability to detect lameness in the validating dataset, which had 4,868 measurements from 36 cows. The model was able to classify 96% of the measurements correctly as sound or lame cows, and 100% of the lameness cases in the validation data were identified. The number of measurements causing false alarms was 1.1%. The developed model has the potential to be used for on-farm decision support and can be used in a real-time lameness monitoring system.

N-syndecan and HB-GAM in neural migration and differentiation : Modulation of growth factor activity in brain

The juvenile sea squirt wanders through the sea searching for a suitable rock or hunk of coral to cling to and make its home for life. For this task it has a rudimentary nervous system. When it finds its spot and takes root, it doesn't need its brain any more so it eats it. It's rather like getting tenure. Daniel C. Dennett (from Consciousness Explained, 1991) The little sea squirt needs its brain for a task that is very simple and short. When the task is completed, the sea squirt starts a new life in a vegetative state, after having a nourishing meal. The little brain is more tightly structured than our massive primate brains. The number of neurons is exact, no leeway in neural proliferation is tolerated. Each neuroblast migrates exactly to the correct position, and only a certain number of connections with the right companions is allowed. In comparison, growth of a mammalian brain is a merry mess. The reason is obvious: Squirt brain needs to perform only a few, predictable functions, before becoming waste. The more mobile and complex mammals engage their brains in tasks requiring quick adaptation and plasticity in a constantly changing environment. Although the regulation of nervous system development varies between species, many regulatory elements remain the same. For example, all multicellular animals possess a collection of proteoglycans (PG); proteins with attached, complex sugar chains called glycosaminoglycans (GAG). In development, PGs participate in the organization of the animal body, like in the construction of parts of the nervous system. The PGs capture water with their GAG chains, forming a biochemically active gel at the surface of the cell, and in the extracellular matrix (ECM). In the nervous system, this gel traps inside it different molecules: growth factors and ECM-associated proteins. They regulate the proliferation of neural stem cells (NSC), guide the migration of neurons, and coordinate the formation of neuronal connections. In this work I have followed the role of two molecules contributing to the complexity of mammalian brain development. N-syndecan is a transmembrane heparan sulfate proteoglycan (HSPG) with cell signaling functions. Heparin-binding growth-associated molecule (HB-GAM) is an ECM-associated protein with high expression in the perinatal nervous system, and high affinity to HS and heparin. N-syndecan is a receptor for several growth factors and for HB-GAM. HB-GAM induces specific signaling via N-syndecan, activating c-Src, calcium/calmodulin-dependent serine protein kinase (CASK) and cortactin. By studying the gene knockouts of HB-GAM and N-syndecan in mice, I have found that HB-GAM and N-syndecan are involved as a receptor-ligand-pair in neural migration and differentiation. HB-GAM competes with the growth factors fibriblast growth factor (FGF)-2 and heparin-binding epidermal growth factor (HB-EGF) in HS-binding, causing NSCs to stop proliferation and to differentiate, and affects HB-EGF-induced EGF receptor (EGFR) signaling in neural cells during migration. N-syndecan signaling affects the motility of young neurons, by boosting EGFR-mediated cell migration. In addition, these two receptors form a complex at the surface of the neurons, probably creating a motility-regulating structure.

Thymidine inhibits the incorporation of 5-fluoro-2'-deoxyuridine to DNA of mouse mammary tumour

5-Fluoro-2'-deoxyuricine is incorporated into DNA of mouse breast tumour Image . The incorporation is inhibited by thymidine. Part of the fluorodeoxyuridine is cleaved to fluorouracil and is incorporated into RNA. This incorporation is enhanced by thymidine. The result suggests that the major mechanism of action of the fluorouracil is due to its incorporation into RNA. FUra, 5-Fluorouracil; FdUR, 5-Fluoro-2'-deoxyuridine; FdUMP, 5-Fluoro-2'-deoxyuridine-5'-monophosphate.

CD1 expression and CD1-restricted T cell activity in normal and tumour-bearing human liver

CD1d-restricted natural killer T (NKT) cells expressing invariant Valpha14Jalpha18 T cell receptor alpha-chains are abundant in murine liver and are implicated in the control of malignancy, infection and autoimmunity. Invariant NKT cells have potent anti-metastatic effects in mice and phase I clinical trials involving their homologues in humans are ongoing. However, invariant NKT cells are less abundant in human liver ( approximately 0.5% of hepatic T cells) than in murine liver (up to 50%) and it is not known if other hepatic T cells are CD1-restricted. We have examined expression of CD1a, CD1b, CD1c and CD1d mRNA and protein in human liver and evaluated the reactivity of mononuclear cells (MNC) from histologically normal and tumour-bearing human liver specimens against these CD1 isoforms. Messenger RNA for all CD1 isotypes was detectable in all liver samples. CD1c and CD1d were expressed at the protein level by hepatic MNC. CD1d, only, was detectable at the cell surface, but CD1c and CD1d were found at an intracellular location in significant numbers of liver MNC. CD1b was not expressed by MNC from healthy livers but was detectable within MNC in all tumour samples tested. Hepatic T cells exhibited reactivity against C1R cells expressing transfected CD1c and CD1d, but neither CD1a nor CD1b. These cells secreted interferon-gamma (IFN-gamma) but not interleukin-4 (IL-4) upon stimulation. In contrast, similar numbers of peripheral T cells released 13- and 16-fold less IFN-gamma in response to CD1c and CD1d, respectively. CD1c and CD1d expression and T cell reactivity were not altered in tumour-bearing liver specimens compared to histologically normal livers. These data suggest that, in addition to invariant CD1d-restricted NKT cells, autoreactive T cells that recognise CD1c and CD1d and release inflammatory cytokines are abundant in human liver.

Chemotherapy and zoledronate sensitize solid tumour cells to Vγ9Vδ2 T cell cytotoxicity

Combinations of cellular immune-based therapies with chemotherapy and other antitumour agents may be of significant clinical benefit in the treatment of many forms of cancer. Gamma delta (γδ) T cells are of particular interest for use in such combined therapies due to their potent antitumour cytotoxicity and relative ease of generation in vitro. Here, we demonstrate high levels of cytotoxicity against solid tumour-derived cell lines with combination treatment utilizing Vγ9Vδ2 T cells, chemotherapeutic agents and the bisphosphonate, zoledronate. Pre-treatment with low concentrations of chemotherapeutic agents or zoledronate sensitized tumour cells to rapid killing by Vγ9Vδ2 T cells with levels of cytotoxicity approaching 90%. In addition, zoledronate enhanced the chemotherapy-induced sensitization of tumour cells to Vγ9Vδ2 T cell cytotoxicity resulting in almost 100% lysis of tumour targets in some cases. Vγ9Vδ2 T cell cytotoxicity was mediated by perforin following TCR-dependent and isoprenoid-mediated recognition of tumour cells. Production of IFN-γ by Vγ9Vδ2 T cells was also induced after exposure to sensitized targets. We conclude that administration of Vγ9Vδ2 T cells at suitable intervals after chemotherapy and zoledronate may substantially increase antitumour activities in a range of malignancies.