Bayesian and L1 Approaches to Sparse Unsupervised Learning

The use of L1 regularisation for sparse learning has generated immense research interest, with successful application in such diverse areas as signal acquisition, image coding, genomics and collaborative filtering. While existing work highlights the many advantages of L1 methods, in this paper we find that L1 regularisation often dramatically underperforms in terms of predictive performance when compared with other methods for inferring sparsity. We focus on unsupervised latent variable models, and develop L1 minimising factor models, Bayesian variants of "L1", and Bayesian models with a stronger L0-like sparsity induced through spike-and-slab distributions. These spike-and-slab Bayesian factor models encourage sparsity while accounting for uncertainty in a principled manner and avoiding unnecessary shrinkage of non-zero values. We demonstrate on a number of data sets that in practice spike-and-slab Bayesian methods outperform L1 minimisation, even on a computational budget. We thus highlight the need to re-assess the wide use of L1 methods in sparsity-reliant applications, particularly when we care about generalising to previously unseen data, and provide an alternative that, over many varying conditions, provides improved generalisation performance.

Low-rank optimization with trace norm penalty

The paper addresses the problem of low-rank trace norm minimization. We propose an algorithm that alternates between fixed-rank optimization and rank-one updates. The fixed-rank optimization is characterized by an efficient factorization that makes the trace norm differentiable in the search space and the computation of duality gap numerically tractable. The search space is nonlinear but is equipped with a Riemannian structure that leads to efficient computations. We present a second-order trust-region algorithm with a guaranteed quadratic rate of convergence. Overall, the proposed optimization scheme converges superlinearly to the global solution while maintaining complexity that is linear in the number of rows and columns of the matrix. To compute a set of solutions efficiently for a grid of regularization parameters we propose a predictor-corrector approach that outperforms the naive warm-restart approach on the fixed-rank quotient manifold. The performance of the proposed algorithm is illustrated on problems of low-rank matrix completion and multivariate linear regression. © 2013 Society for Industrial and Applied Mathematics.

A 5.6-mW Power Dissipation CMOS Frequency Synthesizer for L1/L2 Dual-Band GPS Application

This paper presents a wide tuning range CMOS frequency synthesizer for dual-band GPS receiver, which has been fabricated in a standard 0.18-um RF CMOS process. With a high Q on-chip inductor, the wide-band VCO shows a tuning range from 2 to 3.6GHz to cover 2.45GHz and 3.14GHz in case of process corner or temperature variation, with a current consumption varying accordingly from 0.8mA to 0.4mA, from a 1.8V supply voltage. The measurement results show that the whole frequency synthesizer costs a very low power consumption of 5.6mW working at L I band with in-band phase noise less than -82dBc/Hz and out-of-band phase noise about -112 dBc/Hz at 1MHz offset from a 3.142GHz carrier.

Nutritional Control of L1 Arrest and Recovery in Caenorhabditis elegans by Insulin-like Peptides and Signaling

Animals must coordinate development with fluctuating nutrient availability. Nutrient availability governs post-embryonic development in Caenorhabditis elegans: larvae that hatch in the absence of food do not initiate post-embryonic development but enter "L1 arrest" (or "L1 diapause") and can survive starvation for weeks, while rapidly resume normal development once get fed. Insulin-like signaling (IIS) has been shown to be a key regulator of L1 arrest and recovery. However, the C. elegans genome encodes 40 insulin-like peptides (ILPs), and it is unknown which peptides participate in nutritional control of L1 arrest and recovery. Work in other contexts has identified putative receptor agonists and antagonists, but the extent of specificity versus redundancy is unclear beyond this distinction.

We measured mRNA expression dynamics with high temporal resolution for all 40 insulin-like genes during entry into and recovery from L1 arrest. Nutrient availability influences expression of the majority of insulin-like genes, with variable dynamics suggesting complex regulation. We identified 13 candidate agonists and 8 candidate antagonists based on expression in response to nutrient availability. We selected ten candidate agonists (daf-28, ins-3, ins-4, ins-5, ins-6, ins-7, ins-9, ins-26, ins-33 and ins-35) for further characterization in L1 stage larvae. We used destabilized reporter genes to determine spatial expression patterns. Expression of candidate agonists was largely overlapping in L1 stage larvae, suggesting a role of the intestine, chemosensory neurons ASI and ASJ, and the interneuron PVT in systemic control of L1 development. Transcriptional regulation of candidate agonists was most significant in the intestine, as if nutrient uptake was a more important influence on transcription than sensory perception. Scanning in the 5' upstream promoter region of these 40 ILPs, We found that transcription factor PQM-1 and GATA putative binding sites are depleted in the promoter region of antagonists. A novel motif was also found to be over-represented in ILPs.

Phenotypic analysis of single and compound deletion mutants did not reveal effects on L1 recovery/developmental dynamics, though simultaneous disruption of ins-4 and daf-28 extended survival of L1 arrest without enhancing thermal tolerance, while overexpression of ins-4, ins-6 or daf-28 shortened L1 survival. Simultaneous disruption of several ILPs showed a temperature independent, transient dauer phenotype. These results revealed the relative redundancy and specificity among agonistic ILPs.

TGF- β and steroid hormone (SH) signaling have been reported to control the dauer formation along with IIS. Our preliminary results suggest they may also mediate the IIS control of L1 arrest and recovery, as the expression of several key components of TGF-β and SH signaling pathway genes are negatively regulated by DAF-16, and loss-of-function of these genes partially represses daf-16 null phenotype in L1 arrest, and causes a retardation in L1 development.

In summary, my dissertation study focused on the IIS, characterized the dynamics and sites of ILPs expression in response to nutrient availability, revealed the function of specific agonistic ILPs in L1 arrest, and suggested potential cross-regulation among IIS, TGF-β signaling and SH signaling in controlling L1 arrest and recovery. These findings provide insights into how post-embryonic development is governed by insulin-like signaling and nutrient availability.

Ins-4 and daf-28 function redundantly to regulate C. elegans L1 arrest

© 2014 The Authors.Caenorhabditis elegans larvae reversibly arrest development in the first larval stage in response to starvation (L1 arrest or L1 diapause). Insulin-like signaling is a critical regulator of L1 arrest. However, the C. elegans genome encodes 40 insulin-like peptides, and it is unknown which peptides participate in nutritional control of L1 development. Work in other contexts has revealed that insulin-like genes can promote development ("agonists") or developmental arrest ("antagonists"), suggesting that such agonists promote L1 development in response to feeding. We measured mRNA expression dynamics with high temporal resolution for all 40 insulin-like genes during entry into and recovery from L1 arrest. Nutrient availability influences expression of the majority of insulin-like genes, with variable dynamics suggesting complex regulation. We identified thirteen candidate agonists and eight candidate antagonists based on expression in response to nutrient availability. We selected ten candidate agonists (. daf-28, ins-3, ins-4, ins-5, ins-6, ins-7, ins-9, ins-26, ins-33 and ins-35) for further characterization in L1 stage larvae. We used destabilized reporter genes to determine spatial expression patterns. Expression of candidate agonists is largely overlapping in L1 stage larvae, suggesting a role of the intestine, chemosensory neurons ASI and ASJ, and the interneuron PVT in control of L1 development. Transcriptional regulation of candidate agonists is most significant in the intestine, as if internal nutrient status is a more important influence on transcription than sensory perception. Phenotypic analysis of single and compound deletion mutants did not reveal effects on L1 developmental dynamics, though simultaneous disruption of ins-4 and daf-28 increases survival of L1 arrest. Furthermore, overexpression of ins-4, ins-6 or daf-28 alone decreases survival and promotes cell division during starvation. These results suggest extensive functional overlap among insulin-like genes in nutritional control of L1 development while highlighting the role of ins-4, daf-28 and to a lesser extent ins-6.

To grow or not to grow: nutritional control of development during Caenorhabditis elegans L1 arrest.

It is widely appreciated that larvae of the nematode Caenorhabditis elegans arrest development by forming dauer larvae in response to multiple unfavorable environmental conditions. C. elegans larvae can also reversibly arrest development earlier, during the first larval stage (L1), in response to starvation. "L1 arrest" (also known as "L1 diapause") occurs without morphological modification but is accompanied by increased stress resistance. Caloric restriction and periodic fasting can extend adult lifespan, and developmental models are critical to understanding how the animal is buffered from fluctuations in nutrient availability, impacting lifespan. L1 arrest provides an opportunity to study nutritional control of development. Given its relevance to aging, diabetes, obesity and cancer, interest in L1 arrest is increasing, and signaling pathways and gene regulatory mechanisms controlling arrest and recovery have been characterized. Insulin-like signaling is a critical regulator, and it is modified by and acts through microRNAs. DAF-18/PTEN, AMP-activated kinase and fatty acid biosynthesis are also involved. The nervous system, epidermis, and intestine contribute systemically to regulation of arrest, but cell-autonomous signaling likely contributes to regulation in the germline. A relatively small number of genes affecting starvation survival during L1 arrest are known, and many of them also affect adult lifespan, reflecting a common genetic basis ripe for exploration. mRNA expression is well characterized during arrest, recovery, and normal L1 development, providing a metazoan model for nutritional control of gene expression. In particular, post-recruitment regulation of RNA polymerase II is under nutritional control, potentially contributing to a rapid and coordinated response to feeding. The phenomenology of L1 arrest will be reviewed, as well as regulation of developmental arrest and starvation survival by various signaling pathways and gene regulatory mechanisms.