On-line learning with adaptive back-propagation in two-layer networks

An adaptive back-propagation algorithm parameterized by an inverse temperature 1/T is studied and compared with gradient descent (standard back-propagation) for on-line learning in two-layer neural networks with an arbitrary number of hidden units. Within a statistical mechanics framework, we analyse these learning algorithms in both the symmetric and the convergence phase for finite learning rates in the case of uncorrelated teachers of similar but arbitrary length T. These analyses show that adaptive back-propagation results generally in faster training by breaking the symmetry between hidden units more efficiently and by providing faster convergence to optimal generalization than gradient descent.

Hebbian and homeostatic plasticity mechanisms in regular spiking and intrinsic bursting cells of cortical layer 5

Layer 5 contains the major projection neurons of the neocortex and is composed of two major cell types: regular spiking (RS) cells, which have cortico-cortical projections, and intrinsic bursting cells (IB), which have subcortical projections. Little is known about the plasticity processes and specifically the molecular mechanisms by which these two cell classes develop and maintain their unique integrative properties. In this study, we find that RS and IB cells show fundementally different experience-dependent plasticity processes and integrate Hebbian and homeostatic components of plasticity differently. Both RS and IB cells showed TNFα-dependent homeostatic plasticity in response to sensory deprivation, but IB cells were capable of a much faster synaptic depression and homeostatic rebound than RS cells. Only IB cells showed input-specific potentiation that depended on CaMKII autophosphorylation. Our findings demonstrate that plasticity mechanisms are not uniform within the neocortex, even within a cortical layer, but are specialized within subcircuits.

Simultaneous estimation of global background synaptic inhibition and excitation from membrane potential fluctuations in layer III neurons of the rat entorhinal cortex in vitro

It is becoming clear that the detection and integration of synaptic input and its conversion into an output signal in cortical neurons are strongly influenced by background synaptic activity or "noise." The majority of this noise results from the spontaneous release of synaptic transmitters, interacting with ligand-gated ion channels in the postsynaptic neuron [Berretta N, Jones RSG (1996); A comparison of spontaneous synaptic EPSCs in layer V and layer II neurones in the rat entorhinal cortex in vitro. J Neurophysiol 76:1089-1110; Jones RSG, Woodhall GL (2005) Background synaptic activity in rat entorhinal cortical neurons: differential control of transmitter release by presynaptic receptors. J Physiol 562:107-120; LoTurco JJ, Mody I, Kriegstein AR (1990) Differential activation of glutamate receptors by spontaneously released transmitter in slices of neocortex. Neurosci Lett 114:265-271; Otis TS, Staley KJ, Mody I (1991) Perpetual inhibitory activity in mammalian brain slices generated by spontaneous GABA release. Brain Res 545:142-150; Ropert N, Miles R, Korn H (1990) Characteristics of miniature inhibitory postsynaptic currents in CA1 pyramidal neurones of rat hippocampus. J Physiol 428:707-722; Salin PA, Prince DA (1996) Spontaneous GABAA receptor-mediated inhibitory currents in adult rat somatosensory cortex. J Neurophysiol 75:1573-1588; Staley KJ (1999) Quantal GABA release: noise or not? Nat Neurosci 2:494-495; Woodhall GL, Bailey SJ, Thompson SE, Evans DIP, Stacey AE, Jones RSG (2005) Fundamental differences in spontaneous synaptic inhibition between deep and superficial layers of the rat entorhinal cortex. Hippocampus 15:232-245]. The function of synaptic noise has been the subject of debate for some years, but there is increasing evidence that it modifies or controls neuronal excitability and, thus, the integrative properties of cortical neurons. In the present study we have investigated a novel approach [Rudolph M, Piwkowska Z, Badoual M, Bal T, Destexhe A (2004) A method to estimate synaptic conductances from membrane potential fluctuations. J Neurophysiol 91:2884-2896] to simultaneously quantify synaptic inhibitory and excitatory synaptic noise, together with postsynaptic excitability, in rat entorhinal cortical neurons in vitro. The results suggest that this is a viable and useful approach to the study of the function of synaptic noise in cortical networks. © 2007 IBRO.

The casing layer in the culture of Agaricus bisporus, the cultivated mushroom

The casing layer is an essential component of the system employed in the culture of Agaricus bisporus. The literature appropriate to the casing layer is fully reviewed, including aspects relating to fructification and morphogenesis in A.bisporus, together with an appraisal of the various media employed, their properties and functions, and the commercial significance of the casing layer. Equipment is described for use in experiments in mushroom culture, based on a scaled-down version of normal growing technique, allowing the analysis of both weights and number of fruitbodies forming, which was useful in assessing the effects of different casing treatments. The basic steps in the production of fruitbodies in A.bisporus.are described, including a photographic study of the colonisation of casing and fructification. Various alterations to the physical structure of peat/chalk casing mixtures were found to have an effect on fructification; those causing an opening-out of the casing structure tended to give better yields, especially in the early stages of production. It was shown that, in order to obtain greater yield through casing amendment, fructification must be stimulated, giving increased numbers of fruitbodies, disproportionate to their total weight and consequently of lower mean weight. A synthetic casing medium based on the light glass-like mineral, perlite, was developed. The best formula obtained was -.1 part perlite: 1 part montmorillonite clay (by weight): 3 parts 0.01% glucose solution. Perlite/montmorillonite casing could be improved by adding compost colonised by mycelium of A.bisporus, or adding a peat-chalk casing extract. Perlite was also found to be suitable for admixture with the standard casing medium and a mixture of equal parts by volume performed as well as the peat/chalk casing normally used.

Network lifetime maximization with cross-layer design in wireless sensor networks

This paper investigates a cross-layer design approach for minimizing energy consumption and maximizing network lifetime (NL) of a multiple-source and single-sink (MSSS) WSN with energy constraints. The optimization problem for MSSS WSN can be formulated as a mixed integer convex optimization problem with the adoption of time division multiple access (TDMA) in medium access control (MAC) layer, and it becomes a convex problem by relaxing the integer constraint on time slots. Impacts of data rate, link access and routing are jointly taken into account in the optimization problem formulation. Both linear and planar network topologies are considered for NL maximization (NLM). With linear MSSS and planar single-source and single-sink (SSSS) topologies, we successfully use Karush-Kuhn-Tucker (KKT) optimality conditions to derive analytical expressions of the optimal NL when all nodes are exhausted simultaneously. The problem for planar MSSS topology is more complicated, and a decomposition and combination (D&C) approach is proposed to compute suboptimal solutions. An analytical expression of the suboptimal NL is derived for a small scale planar network. To deal with larger scale planar network, an iterative algorithm is proposed for the D&C approach. Numerical results show that the upper-bounds of the network lifetime obtained by our proposed optimization models are tight. Important insights into the NL and benefits of cross-layer design for WSN NLM are obtained.

On the capacity improvement of multicast throughput in wireless ad hoc networks with physical-layer network coding

This paper attempts to address the effectiveness of physical-layer network coding (PNC) on the capacity improvement for multi-hop multicast in random wireless ad hoc networks (WAHNs). While it can be shown that there is a capacity gain by PNC, we can prove that the per session throughput capacity with PNC is ? (nR(n))), where n is the total number of nodes, R(n) is the communication range, and each multicast session consists of a constant number of sinks. The result implies that PNC cannot improve the capacity order of multicast in random WAHNs, which is different from the intuition that PNC may improve the capacity order as it allows simultaneous signal reception and combination. Copyright © 2010 ACM.

Charge effects on the hindered transport of macromolecules across the endothelial surface glycocalyx layer

A fluid mechanical and electrostatic model for the transport of solute molecules across the vascular endothelial surface glycocalyx layer (EGL) was developed to study the charge effect on the diffusive and convective transport of the solutes. The solute was assumed to be a spherical particle with a constant surface charge density, and the EGL was represented as an array of periodically arranged circular cylinders of like charge, with a constant surface charge density. By combining the fluid mechanical analyses for the flow around a solute suspended in an electrolyte solution and the electrostatic analyses for the free energy of the interaction between the solute and cylinders based on a mean field theory, we estimated the transport coefficients of the solute across the EGL. Both of diffusive and convective transports are reduced compared to those for an uncharged system, due to the stronger exclusion of the solute that results from the repulsive electrostatic interaction. The model prediction for the reflection coefficient for serum albumin agreed well with experimental observations if the charge density in the EGL is ranged from approximately -10 to -30 mEq/l.

Asymptotic theory of wall-attached convection in a horizontal fluid layer with a vertical magnetic field

A horizontal fluid layer heated from below in the presence of a vertical magnetic field is considered. A simple asymptotic analysis is presented which demonstrates that a convection mode attached to the side walls of the layer sets in at Rayleigh numbers much below those required for the onset of convection in the bulk of the layer. The analysis complements an earlier analysis by Houchens [J. Fluid Mech. 469, 189 (2002)] which derived expressions for the critical Rayleigh number for the onset of convection in a vertical cylinder with an axial magnetic field in the cases of two aspect ratios. © 2008 American Institute of Physics.

Efficient THz radiation from a nanocrystalline silicon-based multi-layer photomixer

In this paper we propose a novel type of multiple-layer photomixer based on amorphous/nano-crystalline-Si. Such a device implies that it could be possible to enhance the conversion efficiency from optical power to THz emission by increasing the absorption length and by reducing the device overheating through the use of substrates with higher thermal conductivity compared to GaAs. Our calculations show that the output power from a two-layer Si-based photomixer is at least ten times higher than that from conventional LT-GaAs photomixers at 1 THz.

Physical characteristics of localized surface plasmons resulting from nano-scale structured multi-layer thin films deposited on D-shaped optical fiber

Novel surface plasmonic optical fiber sensors have been fabricated using multiple coatings deposited on a lapped section of a single mode fiber. UV laser irradiation processing with a phase mask produces a nano-scaled surface relief grating structure resembling nano-wires. The resulting individual corrugations produced by material compaction are approximately 20 μm long with an average width at half maximum of 100 nm and generate localized surface plasmons. Experimental data are presented that show changes in the spectral characteristics after UV processing, coupled with an overall increase in the sensitivity of the devices to surrounding refractive index. Evidence is presented that there is an optimum UV dosage (48 joules) over which no significant additional optical change is observed. The devices are characterized with regards to change in refractive index, where significantly high spectral sensitivities in the aqueous index regime are found, ranging up to 4000 nm/RIU for wavelength and 800 dB/RIU for intensity. © 2013 Optical Society of America.

Strain-facilitated process for the lift-off of a Si layer of less than 20 nm thickness

We report a process for the lift-off of an ultrathin Si layer. By plasma hydrogenation of a molecular-beam-epitaxy-grown heterostructure of SiSb-doped-SiSi, ultrashallow cracking is controlled to occur at the depth of the Sb-doped layer. Prior to hydrogenation, an oxygen plasma treatment is used to induce the formation of a thin oxide layer on the surface of the heterostructure. Chemical etching of the surface oxide layer after hydrogenation further thins the thickness of the separated Si layer to be only 15 nm. Mechanisms of hydrogen trapping and strain-facilitated cracking are discussed. © 2005 American Institute of Physics.

Spike firing and IPSPs in layer V pyramidal neurons during beta oscillations in rat primary motor cortex (M1) in vitro

Beta frequency oscillations (10-35 Hz) in motor regions of cerebral cortex play an important role in stabilising and suppressing unwanted movements, and become intensified during the pathological akinesia of Parkinson's Disease. We have used a cortical slice preparation of rat brain, combined with concurrent intracellular and field recordings from the primary motor cortex (M1), to explore the cellular basis of the persistent beta frequency (27-30 Hz) oscillations manifest in local field potentials (LFP) in layers II and V of M1 produced by continuous perfusion of kainic acid (100 nM) and carbachol (5 µM). Spontaneous depolarizing GABA-ergic IPSPs in layer V cells, intracellularly dialyzed with KCl and IEM1460 (to block glutamatergic EPSCs), were recorded at -80 mV. IPSPs showed a highly significant (P< 0.01) beta frequency component, which was highly significantly coherent with both the Layer II and V LFP oscillation (which were in antiphase to each other). Both IPSPs and the LFP beta oscillations were abolished by the GABAA antagonist bicuculline. Layer V cells at rest fired spontaneous action potentials at sub-beta frequencies (mean of 7.1+1.2 Hz; n = 27) which were phase-locked to the layer V LFP beta oscillation, preceding the peak of the LFP beta oscillation by some 20 ms. We propose that M1 beta oscillations, in common with other oscillations in other brain regions, can arise from synchronous hyperpolarization of pyramidal cells driven by synaptic inputs from a GABA-ergic interneuronal network (or networks) entrained by recurrent excitation derived from pyramidal cells. This mechanism plays an important role in both the physiology and pathophysiology of control of voluntary movement generation.

Achievable performance gain of IEEE 802.11 multi-rate link adaptation algorithm with cross-layer design

Link quality-based rate adaptation has been widely used for IEEE 802.11 networks. However, network performance is affected by both link quality and random channel access. Selection of transmit modes for optimal link throughput can cause medium access control (MAC) throughput loss. In this paper, we investigate this issue and propose a generalised cross-layer rate adaptation algorithm. It considers jointly link quality and channel access to optimise network throughput. The objective is to examine the potential benefits by cross-layer design. An efficient analytic model is proposed to evaluate rate adaptation algorithms under dynamic channel and multi-user access environments. The proposed algorithm is compared to link throughput optimisation-based algorithm. It is found rate adaptation by optimising link layer throughput can result in large performance loss, which cannot be compensated by the means of optimising MAC access mechanism alone. Results show cross-layer design can achieve consistent and considerable performance gains of up to 20%. It deserves to be exploited in practical design for IEEE 802.11 networks.

On the k-anonymization of time-varying and multi-layer social graphs

The popularity of online social media platforms provides an unprecedented opportunity to study real-world complex networks of interactions. However, releasing this data to researchers and the public comes at the cost of potentially exposing private and sensitive user information. It has been shown that a naive anonymization of a network by removing the identity of the nodes is not sufficient to preserve users’ privacy. In order to deal with malicious attacks, k -anonymity solutions have been proposed to partially obfuscate topological information that can be used to infer nodes’ identity. In this paper, we study the problem of ensuring k anonymity in time-varying graphs, i.e., graphs with a structure that changes over time, and multi-layer graphs, i.e., graphs with multiple types of links. More specifically, we examine the case in which the attacker has access to the degree of the nodes. The goal is to generate a new graph where, given the degree of a node in each (temporal) layer of the graph, such a node remains indistinguishable from other k-1 nodes in the graph. In order to achieve this, we find the optimal partitioning of the graph nodes such that the cost of anonymizing the degree information within each group is minimum. We show that this reduces to a special case of a Generalized Assignment Problem, and we propose a simple yet effective algorithm to solve it. Finally, we introduce an iterated linear programming approach to enforce the realizability of the anonymized degree sequences. The efficacy of the method is assessed through an extensive set of experiments on synthetic and real-world graphs.

Assembly of a high-dielectric constant thin TiOX layer directly on H-terminated semiconductor diamond

A high-dielectric constant (high-k) TiOx thin layer was fabricated on hydrogen-terminated diamond (H-diamond) surface by low temperature oxidation of a thin titanium layer in ambient air. The metallic titanium layer was deposited by sputter deposition. The dielectric constant of the resultant TiOx was calculated to be around 12. The capacitance density of the metal-oxide-semiconductor (MOS) based on the TiOx/H-diamond was as high as 0.75 µF/cm2 contributed from the high-k value and the very thin thickness of the TiOx layer. The leakage current was lower than 10-13 A at reverse biases and 10-7A at the forward bias of -2 V. The MOS field-effect transistor based on the high-k TiOx/H-diamond was demonstrated. The utilization of the high-k TiOx with a very thin thickness brought forward the features of an ideally low subthreshold swing slope of 65 mV per decade and improved drain current at low gate voltages. The advantages of the utilization high-k dielectric for diamond MOSFETs are anticipated.