Incorporating curvature information into on-line learning

We analyse the dynamics of a number of second order on-line learning algorithms training multi-layer neural networks, using the methods of statistical mechanics. We first consider on-line Newton's method, which is known to provide optimal asymptotic performance. We determine the asymptotic generalization error decay for a soft committee machine, which is shown to compare favourably with the result for standard gradient descent. Matrix momentum provides a practical approximation to this method by allowing an efficient inversion of the Hessian. We consider an idealized matrix momentum algorithm which requires access to the Hessian and find close correspondence with the dynamics of on-line Newton's method. In practice, the Hessian will not be known on-line and we therefore consider matrix momentum using a single example approximation to the Hessian. In this case good asymptotic performance may still be achieved, but the algorithm is now sensitive to parameter choice because of noise in the Hessian estimate. On-line Newton's method is not appropriate during the transient learning phase, since a suboptimal unstable fixed point of the gradient descent dynamics becomes stable for this algorithm. A principled alternative is to use Amari's natural gradient learning algorithm and we show how this method provides a significant reduction in learning time when compared to gradient descent, while retaining the asymptotic performance of on-line Newton's method.

War words:language, history and the disciplining of English

Debates about the nature of literacy and literacy practices have been conducted extensively in the last fifteen years or so. The fact that both previous and current British governments have effectively suppressed any real debate makes the publication of this book both timely and important. Here, Urszula Clark stresses the underlying ideological character of such debates and shows that they have deep historical roots. She also makes the point that issues regarding the relationship between language and identity, especially national identity, become sharply focused at times of crisis in that identity. By undertaking a comparison with other major English-speaking countries, most notably Australia, New Zealand and the USA, Clark shows how these times of crisis reverberate around the globe.

(Re)inventing the past: the politics of 'national' history in the Ukrainian classroom

This article examines how the Ukrainian state has used, and continues to use, history to forge collective identities in Ukraine. It assesses how history textbooks are utilised by the state as ‘tools’ to introduce schoolchildren to key historical episodes around which a modern Ukrainian national identity can be shaped. Attempts to ‘historicise’ Ukrainian national identity must answer fundamental questions such as: Who are we? Where have we come from? Where are we going? Who are we not? The final question is vital in understanding ‘who we are’ in comparison to the ‘other’. Thus, emphasis is placed on how the Ukrainian state is attempting to form an all-encompassing Ukrainian identity by distancing itself from Russia. The article argues that while a ‘national’ history is being espoused, a ‘regional politics of the textbook’ is subtly being allowed by the state to develop. This stands at odds with state attempts to create one universal, all-encompassing Ukrainian history.

Brand-driven leadership for change management in retailing

Change management theorists largely overlook using the brand as a vehicle for change. Similarly, while branding has become an increasingly popular research and business topic, the branding literature appears to neglect change management. Our research bridges this gap through the development of brand identity as the main driver of organizational renewal. In the article we provide insights into brand-driven leadership for change which have been develope by collaborative action research with CEOs and owners of retail firms over a twenty year period. In contrast to the usual planning of change attempting to fit the firm to external trends and considering internal resources our brand-driven approach is based on resonance with consumers by the use of external socio-cultural meanings in society. We highlight phases in the development of brand identity by reference to a prototypical retail case study and presenta framework to help managers with brand-driven leadership for change.

Smart structure sensors based on embedded fibre Bragg grating arrays in aluminium alloy matrix by ultrasonic consolidation

Smart structure sensors based on embedded fibre Bragg grating (FBG) arrays in aluminium alloy matrix by ultrasonic consolidation (UC) technique have been proposed and demonstrated successfully. The temperature, loading and bending responses of the embedded FBG arrays have been systematically characterized. The embedded FBGs exhibit an average temperature sensitivity of ~36 pm °C-1, which is three times higher than that of normal FBGs, a bending sensitivity of 0.73 nm/m-1 and a loading responsivity of ~0.1 nm kg-1 within the dynamic range from 0 kg to 3 kg. These initial experimental results clearly demonstrate that the UC produced metal matrix structures can be embedded with FBG sensor arrays to become smart structures with capabilities to monitor the structure operation and health conditions in applications.

Matrix changes induced by transglutaminase 2 lead to inhibition of angiogenesis and tumor growth

Administration of active TG2 to two different in vitro angiogenesis assays resulted in the accumulation of a complex extracellular matrix (ECM) leading to the suppression of endothelial tube formation without causing cell death. Matrix accumulation was accompanied by a decreased rate of ECM turnover, with increased resistance to matrix metalloproteinase-1. Intratumor injection of TG2 into mice bearing CT26 colon carcinoma tumors demonstrated a reduction in tumor growth, and in some cases tumor regression. In TG2 knockout mice, tumor progression was increased and survival rate reduced compared to wild-type mice. In wild-type mice, an increased presence of TG2 was detectable in the host tissue around the tumor. Analysis of CT26 tumors injected with TG2 revealed fibrotic-like tissue containing increased collagen, TG2-mediated crosslink and reduced organized vasculature. TG2-mediated modulation of cell behavior via changes in the ECM may provide a new approach to solid tumor therapy.

Increased TG2 expression can result in induction of transforming growth factor β1, causing increased synthesis and deposition of matrix proteins, which can be regulated by nitric oxide

In fibrotic conditions increases in TG2 activity has been linked to an increase in the deposition of extracellular matrix proteins. Using TG2 transfected Swiss 3T3 fibroblasts expressing TG2 under the control of the tetracycline-regulated inducible promoter, we demonstrate that induction of TG2 not only stimulates an increase in collagen and fibronectin deposition but also an increase in the expression of these proteins. Increased TG2 expression in these fibroblasts led to NF-kappaB activation, resulting in the increased expression of transforming growth factor (TGF) beta(1). In addition, cells overexpressing TG2 demonstrated an increase in biologically active TGFbeta(1) in the extracellular environment. A specific site-directed inhibitor of TG abolished the NF-kappaB and TGFbeta1 activation and the subsequent elevation in the synthesis and deposition of extracellular matrix proteins, confirming that this process depends on the induction of transglutaminase activity. Treatment of TG2-induced fibroblasts with nontoxic doses of nitric oxide donor S-nitroso-N-acetylpenicillamine resulted in decreased TG2 activity and apprehension of the inactive enzyme on the cell surface. This was paralleled by a reduction in activation of NF-kappaB and TGFbeta(1) production with a subsequent decrease in collagen expression and deposition. These findings support a role for NO in the regulation of TG2 function in the extracellular environment.

Inhibition of transglutaminase activity reduces extracellular matrix accumulation induced by high glucose levels in proximal tubular epithelial cells

Diabetic nephropathy affects 30-40% of diabetics leading to end-stage kidney failure through progressive scarring and fibrosis. Previous evidence suggests that tissue transglutaminase (tTg) and its protein cross-link product epsilon(gamma-glutamyl)lysine contribute to the expanding renal tubulointerstitial and glomerular basement membranes in this disease. Using an in vitro cell culture model of renal proximal tubular epithelial cells we determined the link between elevated glucose levels with changes in expression and activity of tTg and then, by using a highly specific site directed inhibitor of tTg (1,3-dimethyl-2[(oxopropyl)thio]imidazolium), determined the contribution of tTg to glucose-induced matrix accumulation. Exposure of cells to 36 mm glucose over 96 h caused an mRNA-dependent increase in tTg activity with a 25% increase in extracellular matrix (ECM)-associated tTg and a 150% increase in ECM epsilon(gamma-glutamyl)lysine cross-linking. This was paralleled by an elevation in total deposited ECM resulting from higher levels of deposited collagen and fibronectin. These were associated with raised mRNA for collagens III, IV, and fibronectin. The specific site-directed inhibitor of tTg normalized both tTg activity and ECM-associated epsilon(gamma-glutamyl)lysine. Levels of ECM per cell returned to near control levels with non-transcriptional reductions in deposited collagen and fibronectin. No changes in transforming growth factor beta1 (expression or biological activity) occurred that could account for our observations, whereas incubation of tTg with collagen III indicated that cross-linking could directly increase the rate of collagen fibril/gel formation. We conclude that Tg inhibition reduces glucose-induced deposition of ECM proteins independently of changes in ECM and transforming growth factor beta1 synthesis thus opening up its possible application in the treatment other fibrotic and scarring diseases where tTg has been implicated.

Embedded fibre Bragg grating array sensors in aluminium alloy matrix by ultrasonic consolidation

Fibre Bragg Grating (FBG) array sensors have been successfully embedded in aluminium alloy matrix by ultrasonic consolidation (UC) technique. The temperature and loading responses of the embedded FBG arrays have been systematically characterised. The embedded grating sensors exhibit an average temperature sensitivity of ~36pm/°C, which is three times higher than that of normal FBGs, and a loading responsivity of ~0.1nm/kg within the dynamic range from 0kg to 3kg. This initial experiment clearly demonstrates that FBG array sensors can be embedded in metal matrix together with other passive and active fibres to fabricate smart materials to monitor the operation and health of engineering structures.

Matrix-assisted diffusion-ordered spectroscopy:mixture resolution by NMR using SDSmicelles

Diffusion-ordered spectroscopy (DOSY) is a powerful technique for mixture analysis, but in its basic form it cannot separate the component spectra for species with very similar diffusion coefficients. It has been recently demonstrated that the component spectra of a mixture of isomers with nearly identical diffusion coefficients (the three dihydroxybenzenes) can be resolved using matrix-assisted DOSY (MAD), in which diffusion is perturbed by the addition of a co-solute such as a surfactant [R. Evans, S. Haiber, M. Nilsson, G. A. Morris, Anal. Chem. 2009, 81, 4548-4550]. However, little is known about the conditions required for such a separation, for example, the concentrations and concentration ratios of surfactant and solutes. The aim of this study was to explore the concentration range over whichmatrix-assisted DOSY using the surfactant SDS can achieve diffusion resolution of a simple model set of isomers, the monomethoxyphenols. The results show that the separation is remarkably robust with respect to both the concentrations and the concentration ratios of surfactant and solutes, supporting the idea that MAD may become a valuable tool formixture analysis. © 2010 John Wiley & Sons, Ltd.

Modulation of interleukin-6 and matrix metalloproteinase 2 expression in human fibroblast-like synoviocytes by functional ionotropic glutamate receptors

Objective. Patients with rheumatoid arthritis (RA) have increased concentrations of the amino acid glutamate in synovial fluid. This study was undertaken to determine whether glutamate receptors are expressed in the synovial joint, and to determine whether activation of glutamate receptors on human synoviocytes contributes to RA disease pathology. Methods. Glutamate receptor expression was examined in tissue samples from rat knee joints and in human fibroblast-like synoviocytes (FLS). FLS from 5 RA patients and 1 normal control were used to determine whether a range of glutamate receptor antagonists influenced expression of the proinflammatory cytokine interleukin-6 (IL-6), enzymes involved in matrix degradation and cytokine processing (matrix metalloproteinase 2 [MMP-2] and MMP-9), and the inhibitors of these enzymes (tissue inhibitor of metalloproteinases 1 [TIMP-1] and TIMP-2). IL-6 concentrations were determined by enzyme-linked immunosorbent assay, MMP activity was measured by gelatin zymography, and TIMP activity was determined by reverse zymography. Fluorescence imaging of intracellular calcium concentrations in live RA FLS stimulated with specific antagonists was used to reveal functional activation of glutamate receptors that modulated IL-6 or MMP-2. Results. Ionotropic and metabotropic glutamate receptor subunit mRNA were expressed in the patella, fat pad, and meniscus of the rat knee and in human articular cartilage. Inhibition of N-methyl-D-aspartate (NMDA) receptors in RA FLS increased proMMP-2 release, whereas non-NMDA ionotropic glutamate receptor antagonists reduced IL-6 production by these cells. Stimulation with glutamate, NMDA, or kainate (KA) increased intracellular calcium concentrations in RA FLS, demonstrating functional activation of specific ionotropic glutamate receptors. Conclusion. Our findings indicate that activation of NMDA and KA glutamate receptors on human synoviocytes may contribute to joint destruction by increasing IL-6 expression. © 2007, American College of Rheumatology.

Embedded fibre Bragg grating array sensors in aluminium alloy matrix by ultrasonic consolidation

Fibre Bragg Grating (FBG) array sensors have been successfully embedded in aluminium alloy matrix by ultrasonic consolidation (UC) technique. The temperature and loading responses of the embedded FBG arrays have been systematically characterised. The embedded grating sensors exhibit an average temperature sensitivity of ~36pm/°C, which is three times higher than that of normal FBGs, and a loading responsivity of ~0.1nm/kg within the dynamic range from 0kg to 3kg. This initial experiment clearly demonstrates that FBG array sensors can be embedded in metal matrix together with other passive and active fibres to fabricate smart materials to monitor the operation and health of engineering structures.

Recovery of glass fibre and carbon fibres from reinforced thermosets by batch pyrolysis and investigation of fibre re-using as reinforcement in LDPE matrix

A semi-batch pyrolysis process was used to recover samples carbon fibre and glass fibre from their respective wastes. The mechanical properties of the recovered fibres were tested and compared to those of virgin fibres, showing good retention of the fibre properties. The recovered fibres were then used to prepare new LDPE composite materials with commercial and laboratory-synthesized compatibilizers. Mild oxidation of the post-pyrolysis recovered fibres and the use of different compatibilizers gave significant improvements in the mechanical properties of the LDPE composites; however some of the manufactured composites made from recovered fibres had properties similar to those made from virgin fibres.