Exponentiated gradient algorithms for conditional random fields and max-margin Markov Networks

Log-linear and maximum-margin models are two commonly-used methods in supervised machine learning, and are frequently used in structured prediction problems. Efficient learning of parameters in these models is therefore an important problem, and becomes a key factor when learning from very large data sets. This paper describes exponentiated gradient (EG) algorithms for training such models, where EG updates are applied to the convex dual of either the log-linear or max-margin objective function; the dual in both the log-linear and max-margin cases corresponds to minimizing a convex function with simplex constraints. We study both batch and online variants of the algorithm, and provide rates of convergence for both cases. In the max-margin case, O(1/ε) EG updates are required to reach a given accuracy ε in the dual; in contrast, for log-linear models only O(log(1/ε)) updates are required. For both the max-margin and log-linear cases, our bounds suggest that the online EG algorithm requires a factor of n less computation to reach a desired accuracy than the batch EG algorithm, where n is the number of training examples. Our experiments confirm that the online algorithms are much faster than the batch algorithms in practice. We describe how the EG updates factor in a convenient way for structured prediction problems, allowing the algorithms to be efficiently applied to problems such as sequence learning or natural language parsing. We perform extensive evaluation of the algorithms, comparing them to L-BFGS and stochastic gradient descent for log-linear models, and to SVM-Struct for max-margin models. The algorithms are applied to a multi-class problem as well as to a more complex large-scale parsing task. In all these settings, the EG algorithms presented here outperform the other methods.

Delivery of dimethyloxallyl glycine in mesoporous bioactive glass scaffolds to improve angiogenesis and osteogenesis of human bone marrow stromal cells

Development of hypoxia-mimicking bone tissue engineering scaffolds is of great importance in stimulating angiogenesis for bone regeneration. Dimethyloxallyl glycine (DMOG) is a cell-permeable, competitive inhibitor of hypoxia-inducible factor prolyl hydroxylase (HIF-PH), which can stabilize hypoxia-inducible factor 1α (HIF-1α) expression. The aim of this study was to develop hypoxia-mimicking scaffolds by delivering DMOG in mesoporous bioactive glass (MBG) scaffolds and to investigate whether the delivery of DMOG could induce a hypoxic microenvironment for human bone marrow stromal cells (hBMSC). MBG scaffolds with varied mesoporous structures (e.g. surface area and mesopore volume) were prepared by controlling the contents of mesopore-template agent. The composition, large-pore microstructure and mesoporous properties of MBG scaffolds were characterized. The effect of mesoporous properties on the loading and release of DMOG in MBG scaffolds was investigated. The effects of DMOG delivery on the cell morphology, cell viability, HIF-1α stabilization, vascular endothelial growth factor (VEGF) secretion and bone-related gene expression (alkaline phosphatase, ALP; osteocalcin, OCN; and osteopontin, OPN) of hBMSC in MBG scaffolds were systematically investigated. The results showed that the loading and release of DMOG in MBG scaffolds can be efficiently controlled by regulating their mesoporous properties via the addition of different contents of mesopore-template agent. DMOG delivery in MBG scaffolds had no cytotoxic effect on the viability of hBMSC. DMOG delivery significantly induced HIF-1α stabilization, VEGF secretion and bone-related gene expression of hBMSC in MBG scaffolds in which DMOG counteracted the effect of HIF-PH and stabilized HIF-1α expression under normoxic condition. Furthermore, it was found that MBG scaffolds with slow DMOG release significantly enhanced the expression of bone-related genes more than those with instant DMOG release. The results suggest that the controllable delivery of DMOG in MBG scaffolds can mimic a hypoxic microenvironment, which not only improves the angiogenic capacity of hBMSC, but also enhances their osteogenic differentiation.

The organisation and expression of the genes encoding the mitochondrial glycine decarboxylase complex and serine hydroxymethyltransferase in pea (Pisum sativum)

Restriction fragment length polymorphisms have been used to determine the chromosomal location of the genes encoding the glycine decarboxylase complex (GDC) and serine hydroxymethyltransferase (SHMT) of pea leaf mitochondria. The genes encoding the H subunit of GDC and the genes encoding SHMT both show linkage to the classical group I marker i. In addition, the genes for the P protein of GDC show linkage to the classic group I marker a. The genes for the L and T proteins of GDC are linked to one another and are probably situated on the satellite of chromosome 7. The mRNAs encoding the five polypeptides that make up GDC and SHMT are strongly induced when dark-grown etiolated pea seedlings are placed in the light. Similarly, when mature plants are placed in the dark for 48 h, the levels of both GDC protein and SHMT mRNAs decline dramatically and then are induced strongly when these plants are returned to the light. During both treatments a similar pattern of mRNA induction is observed, with the mRNA encoding the P protein of GDC being the most rapidly induced and the mRNA for the H protein the slowest. Whereas during the greening of etiolated seedlings the polypeptides of GDC and SHMT show patterns of accumulation similar to those of the corresponding mRNAs, very little change in the level of the polypeptides is seen when mature plants are placed in the dark and then re-exposed to the light.

Soluble laminin and arginine-glycine-aspartic acid containing peptides differentially regulate type IV collagenase messenger RNA, activation, and localization in testicular cell culture

Rat testicular cells in culture produce several metalloproteinases including type IV collagenases (Sang et al. Biol Reprod 1990; 43:946-955, 956-964). We have now investigated the regulation of testicular cell type IV collagenase and other metalloprotemases in vitro. Soluble laminin stimulated Sertoli cell type IV collagenase mRNA levels. However, three peptides corresponding to different domains of the laminin molecule (CSRAKQAASIKVASADR, FALRGDNP, CLQDGDVRV) did not influence type IV collagenase mENA levels. Zyniographic analysis of medium collected from these cultures revealed that neither soluble laminin nor any of the peptides influenced 72-Wa type IV collagenase protein levels. However, peptide FALRGDNP resulted in both, a selective increase in two higher molecular-weight metalloprotemnases (83 kDa and 110 Wa and in an activation of the 72-Wa rat type IV collagenase. Interleukin-1, phorbol ester, testosterone, and FSH did not affect collagenase activation, lmmunocytochemical studies demonstrated that the addition of soluble laminin resulted in a redistribution of type IV collagenase from intracellular vesicles to the cell-substrate region beneath the cells. Peptide FALRGDNP induced a change from a vesicular to peripheral plasma membrane type of staining pattern. Zymography of plasma membrane preparations demonstrated triton-soluble gelatinases of 76 Wa, 83 Wa, and 110 Wa and a triton-insoluble gelatinase of 225 Wa, These results indicate that testicular cell type IV collagenase mRNA levels, enzyme activation, and distribution are influenced by laminin and RGD-containing peptides.

A novel ACVR1 mutation in the glycine/serine-rich domain found in the most benign case of a fibrodysplasia ossificans progressiva variant reported to date

Fibrodysplasia Ossificans Progressiva (FOP) is a rare, autosomal dominant condition, classically characterised by heterotopic ossification beginning in childhood and congenital great toe malformations; occurring in response to a c.617 G>A ACVR1 mutation in the functionally important glycine/serine-rich domain of exon 6. Here we describe a novel c.587 T>C mutation in the glycine/serine-rich domain of ACVR1, associated with delayed onset of heterotopic ossification and an exceptionally mild clinical course. Absence of great toe malformations, the presence of early ossification of the cervical spine facets joints, plus mild bilateral camptodactyly of the 5th fingers, together with a novel ACVR1 mutation, are consistent with the 'FOP-variant' syndrome. The c.587 T>C mutation replaces a conserved leucine with proline at residue 196. Modelling of the mutant protein reveals a steric clash with the kinase domain that will weaken interactions with FKBP12 and induce exposure of the glycine/serine-rich repeat. The mutant receptor is predicted to be hypersensitive to ligand stimulation rather than being constitutively active, consistent with the mild clinical phenotype. This case extends our understanding of the 'FOP-variant' syndrome.

Mary and Max

Synopsis and critique of Australian film in animation, comedy, and drama genres.

Judge Max Frankenbach of Berlin hiking with his wife Grete Frankenbach nee Bernstein; Sassal-Massone Portraits Couples

Digital Image

Max and Martha Liebermann with unidentified group at a celebration for Max Liebermann at the Akademie der Kunste, Berlin Portraits; Groups

Verso: "Liebermann Feierlichkeiten in der Akademie der Kuenste. In der Mitte: Max Liebermann und Frau. Becker."

Portrait of Max Meyerhof.

Max Meyerhof was a distinguished opthamologist, author, medical historian. He died in Cairo where he helped establish the Egyptian medical service.

Newspaper obituary for Max Molling in the Hannoverscher Anzeiger; Hannover, Germany.

Digital Image

Newspaper obituary for Max Molling in the Hannoverscher Anzeiger by the personel of M. Molling & Co.; Hannover, Germany.

Digital Image

Reproduction of newspaper obituary for Max Molling in the Hannoverscher Anzeiger.

Digital Image

Reproduction of newspaper obituary for Max Molling in the Hannoverscher Anzeiger.

Digital Image

Newspaper obituary for Max Molling in the Hannoverscher Anzeiger; Hannover, Germany.

Digital Image