The theory of on-line learning: a statistical physics approach

In this paper we review recent theoretical approaches for analysing the dynamics of on-line learning in multilayer neural networks using methods adopted from statistical physics. The analysis is based on monitoring a set of macroscopic variables from which the generalisation error can be calculated. A closed set of dynamical equations for the macroscopic variables is derived analytically and solved numerically. The theoretical framework is then employed for defining optimal learning parameters and for analysing the incorporation of second order information into the learning process using natural gradient descent and matrix-momentum based methods. We will also briefly explain an extension of the original framework for analysing the case where training examples are sampled with repetition.

Accounting information systems as knowledge objects:some effects of objectualization

This paper will outline a research methodology informed by theorists who have contributed to actor network theory (ANT). Research informed from such a perspective recognizes the constitutive role of accounting systems in the achievement of broader social goals. Latour, Knoor Cetina and others argue that the bringing in of non-human actants, through the growth of technology and science, has added immeasurably to the complexity of modern society. The paper ‘sees’ accounting and accounting systems as being constituted by technological ‘black boxes’ and seeks to discuss two questions. One concerns the processes which surround the establishment of ‘facts’, i.e. how ‘black boxes’ are created or accepted (even if temporarily) within society. The second concerns the role of existing ‘black boxes’ within society and organizations. Accounting systems not only promote a particular view of the activities of an organization or a subunit, but in their very implementation and operation ‘mobilize’ other organizational members in a particular direction. The implications of such an interpretation are explored in this paper. Firstly through a discussion of some of the theoretic constructs that have been proposed to frame ANT research. Secondly an attempt is made to relate some of these ideas to aspects of the empirics in a qualitative case study. The case site is in the health sector and involves the implementation of a casemix accounting system. Evidence from the case research is used to exemplify aspects of the theoretical constructs.

The effect of pH on PAMAM dendrimer-siRNA complexation:endosomal considerations as determined by molecular dynamics simulation

Intracellular degradation of genes, most notably within the endo-lysosomal compartment is considered a significant barrier to (non-viral) gene delivery in vivo. Previous reports based on in vitro studies claim that carriers possessing a mixture of primary, secondary and tertiary amines are able to buffer the acidic environment within the endosome, allowing for timely release of their contents, leading to higher transfection rates. In this report, we adopt an atomistic molecular dynamics (MD) simulation approach, comparing the complexation of 21-bp siRNA with low-generation polyamidoamine (PAMAM) dendrimers (G0 and G1) at both neutral and acidic pHs, the latter of which mimics the degradative environment within maturing 'late-endosomes'. Our simulations reveal that the time taken for the dendrimer-gene complex (dendriplex) to reach equilibrium is appreciably longer at low pH and this is accompanied by more compact packaging of the dendriplex, as compared to simulations performed at neutral pH. We also note larger absolute values of calculated binding free energies of the dendriplex at low pH, indicating a higher dendrimer-nucleic acid affinity in comparison with neutral pH. These novel simulations provide a more detailed understanding of low molecular-weight polymer-siRNA behavior, mimicking the endosomal environment and provide input of direct relevance to the "proton sponge theory", thereby advancing the rational design of non-viral gene delivery systems.

Assessing the effectiveness of business support services in England:evidence from a theory based evaluation

In England, publicly supported advice to small firms is organized primarily through the Business Link (BL) network. Using the programme theory underlying this business support, we develop four propositions and test these empirically using data from a new survey of over 3000 English SMEs. We find strong support for the value to BL operators of a high profile to boost take-up. We find support for the BL’s market segmentation that targets intensive assistance to younger firms and those with limited liability. Allowing for sample selection, we find no significant effects on growth from ‘other’ assistance but find a significant employment boost from intensive assistance. This partially supports the programme theory assertion that BL improves business growth and strongly supports the proposition that there are differential outcomes from intensive and other assistance. This suggests an improvement in the BL network, compared with earlier studies, notably Roper et al. (2001), Roper and Hart (2005).

Do the lichens Xanthoparmelia conspersa (Ach.) Hale and Rhizocarpon Ram. Em. Th. Fr. subgenus Rhizocarpon utilise exogenous carbohydrates for radial growth?

To field test the hypothesis that lichen thalli can use environmental sources of carbon, solutions of ribitol, arabitol and mannitol were added to intact thalli of Xanthoparmelia conspersa (Ach.) Hale and a yellow species of Rhizocarpon (Rhizocarpon Ram. Em. Th. Fr. subgenus Rhizocarpon). In addition, ribitol and an arabitol/mannitol mixture were added to the marginal hypothalli of Rhizocarpon thalli after removal of the areolae. Carbohydrates were added at the beginning of 2- or 3-month growth periods for up to 15 months at concentrations approximately three times the levels estimated to be in the thalli. Addition of carbohydrates to intact thalli of both species had no effect on total radial growth but addition of mannitol significantly increased growth of X. conspersa thalli in the September/October growth period in one experiment. However, this effect was not repeated in a subsequent experiment in which different concentrations of mannitol were added to intact thalli. Addition of ribitol to hypothalli of Rhizocarpon resulted in significantly increased growth in the first few months of the experiment, growth then declining to levels below that of untreated thalli. The data suggest that although hypothalli of Rhizocarpon may have the ability to utilise exogenous carbohydrates for growth, there was little evidence that intact thalli of either species utilise environmental sources of carbon in the field.

Experimental studies of hypothallus growth in the lichen Rhizocarpon geographicum

Removal of the areolae of the crustose lichen Rhizocarpon geographicum (L.)DC. resulted in either low or no measurable radial growth of the marginal hypothallus. Radial growth of the hypothallus was also significantly reduced compared with intact thalli when (1) areolae were removed to within 1 and 2 mm of the hypothallus and (2) a 5 mm wide ‘moat’ was created between the areolae and the hypothallus. Adding ribitol (0.01 M) to isolated hypothalli at 3-month intervals over 15 months results in total radial growth c. 60% that of intact thalli. Adding an arabitol/mannitol mixture (0.05 M arabitol, 0.03 M mannitol) increased radial growth compared with deionized water and ribitol treatments. Adding ribitol (0.7 M), arabitol (0.2 M) and mannitol (0.08 M) to the areolae of intact thalli had no significant effects on radial growth of the hypothallus. On a south-facing rock surface, isolated hypothalli grew at a similar rate to intact thalli for 2 months. Growth then declined and the hypothalli disappeared from the rock surface within 6 months. The effects of addition of carbohydrate suggest that the marginal hypothallus has the capacity to utilize exogeneous materials. However, in intact thalli in the field, the radial growth of the hypothallus is likely to be a result of transfer of materials from the areolae through hyphal connections.

Range of validity of weakly non-linear theory in Rayleigh-Bénard problem

In this paper we examine the equilibrium states of finite amplitude flow in a horizontal fluid layer with differential heating between the two rigid boundaries. The solutions to the Navier-Stokes equations are obtained by means of a perturbation method for evaluating the Landau constants and through a Newton-Raphson iterative method that results from the Fourier expansion of the solutions that bifurcate above the linear stability threshold of infinitesimal disturbances. The results obtained from these two different methods of evaluating the convective flow are compared in the neighborhood of the critical Rayleigh number. We find that for small Prandtl numbers the discrepancy of the two methods is noticeable. © 2009 The Physical Society of Japan.

Appearance of bound states in random potentials with applications to soliton theory

We analyze the stochastic creation of a single bound state (BS) in a random potential with a compact support. We study both the Hermitian Schrödinger equation and non-Hermitian Zakharov-Shabat systems. These problems are of special interest in the inverse scattering method for Korteveg–de-Vries and the nonlinear Schrödinger equations since soliton solutions of these two equations correspond to the BSs of the two aforementioned linear eigenvalue problems. Analytical expressions for the average width of the potential required for the creation of the first BS are given in the approximation of delta-correlated Gaussian potential and additionally different scenarios of eigenvalue creation are discussed for the non-Hermitian case.

An assessment of factors affecting performance and growth of new technology based firms in the UK

New Technology Based Firms (NTBF) are considered to be important for the economic development of a country in regards to both employment growth and innovative activity. The latter is believed to contribute significantly to the increase in productivity and therefore the competitiveness of UK’s economy. This study contributes to the above literature by investigating two of the factors believed to limit the growth of such firms in the UK. The first concerns the existence of a ‘knowledge gap’ while the second the existence of a ‘financial gap’. These themes are developed along three main research lines. Firstly, based upon the human capital theory initially proposed by Backer (1964) new evidence is provided on the human capital characteristics (experience and education) of the current UK NTBF entrepreneurs. Secondly, the causal relationship between general and specific human capital (as well as their interactions) upon the company performance and growth is investigated via its traditional direct effect as well as via its indirect effect upon the access to external finance. Finally, more light is shed on the financial structure and the type of financial constraints that high-tech firms face at start-up. In particular, whether a financial gap exists is explored by distinguishing between the demand and the supply of external finance as well as by type of external source of financing. The empirical testing of the various research hypotheses has been obtained by carrying out an original survey of new technology based firms defined as independent companies, established in the past 25 years in R&D intensive sectors. The resulting dataset contains information for 412 companies on a number of general company characteristics and the characteristics of their entrepreneurs in 2004. Policy and practical implications for future and current entrepreneurs and also providers of external finance are provided.

Range of validity of weakly non-linear theory in Rayleigh-Bénard convection

In this paper we examine the equilibrium states of periodic finite amplitude flow in a horizontal channel with differential heating between the two rigid boundaries. The solutions to the Navier-Stokes equations are obtained by means of a perturbation method for evaluating the Landau coefficients and through a Newton-Raphson iterative method that results from the Fourier expansion of the solutions that bifurcate above the linear stability threshold of infini- tesimal disturbances. The results obtained from these two different methods of evaluating the convective flow are compared in the neighbourhood of the critical Rayleigh number. We find that for small Prandtl numbers the discrepancy of the two methods is noticeable.

The development and stability analysis of a nonlinear growth model for microorganisms

A nonlinear dynamic model of microbial growth is established based on the theories of the diffusion response of thermodynamics and the chemotactic response of biology. Except for the two traditional variables, i.e. the density of bacteria and the concentration of attractant, the pH value, a crucial influencing factor to the microbial growth, is also considered in this model. The pH effect on the microbial growth is taken as a Gaussian function G0e-(f- fc)2/G1, where G0, G1 and fc are constants, f represents the pH value and fc represents the critical pH value that best fits for microbial growth. To study the effects of the reproduction rate of the bacteria and the pH value on the stability of the system, three parameters a, G0 and G1 are studied in detail, where a denotes the reproduction rate of the bacteria, G0 denotes the impacting intensity of the pH value to microbial growth and G1 denotes the bacterial adaptability to the pH value. When the effect of the pH value of the solution which microorganisms live in is ignored in the governing equations of the model, the microbial system is more stable with larger a. When the effect of the bacterial chemotaxis is ignored, the microbial system is more stable with the larger G1 and more unstable with the larger G0 for f0 > fc. However, the stability of the microbial system is almost unaffected by the variation G0 and G1 and it is always stable for f0 < fc under the assumed conditions in this paper. In the whole system model, it is more unstable with larger G1 and more stable with larger G0 for f0 < fc. The system is more stable with larger G1 and more unstable with larger G0 for f0 > fc. However, the system is more unstable with larger a for f0 < fc and the stability of the system is almost unaffected by a for f0 > fc. The results obtained in this study provide a biophysical insight into the understanding of the growth and stability behavior of microorganisms.

The role of line managers in employee career management:an attachment theory perspective

Line managers increasingly play a key role in organizational career development systems, yet few studies have examined the nature of this role or its implications for employee career attitudes and behaviors. In two studies, we used attachment theory to explore this issue. In Study 1, in-depth interviews (N = 20) showed that employees viewed career management as a relational process in which line managers are expected to act as ‘caregiver’ to support individualized career development. Study 2 was a large-scale international survey (N = 891). Participants scoring higher on attachment avoidance in their line manager relationships reported more negative perceptions of career growth opportunities, lower participation in organizational career development activities and higher turnover intentions. Trust in the organization partially mediated the relationship. Theoretical and practical implications for HRM are discussed.

Constitutive glycogen synthase kinase-3α/β activity protects against chronic β-adrenergic remodelling of the heart

Aims - Glycogen synthase kinase 3 (GSK-3) signalling is implicated in the growth of the heart during development and in response to stress. However, its precise role remains unclear. We set out to characterize developmental growth and response to chronic isoproterenol (ISO) stress in knockin (KI) mice lacking the critical N-terminal serines, 21 of GSK-3 and 9 of GSK-3 respectively, required for inactivation by upstream kinases. Methods and results - Between 5 and 15 weeks, KI mice grew more rapidly, but normalized heart weight and contractile performance were similar to wild-type (WT) mice. Isolated hearts of both genotypes responded comparably to acute ISO infusion with increases in heart rate and contractility. In WT mice, chronic subcutaneous ISO infusion over 14 days resulted in cardiac hypertrophy, interstitial fibrosis, and impaired contractility, accompanied by foetal gene reactivation. These effects were all significantly attenuated in KI mice. Indeed, ISO-treated KI hearts demonstrated reversible physiological remodelling traits with increased stroke volume and a preserved contractile response to acute adrenergic stimulation. Furthermore, simultaneous pharmacological inhibition of GSK-3 in KI mice treated with chronic subcutaneous ISO recapitulated the adverse remodelling phenotype seen in WT hearts. Conclusion - Expression of inactivation-resistant GSK-3/does not affect eutrophic myocardial growth but protects against pathological hypertrophy induced by chronic adrenergic stimulation, maintaining cardiac function and attenuating interstitial fibrosis. Accordingly, strategies to prevent phosphorylation of Ser-21/9, and consequent inactivation of GSK-3/, may enable a sustained cardiac response to chronic-agonist stimulation while preventing pathological remodelling. © 2010 The Author.

Stochastically driven instability in rotating shear flows

Origin of hydrodynamic turbulence in rotating shear flows is investigated. The particular emphasis is on flows whose angular velocities decrease but specific angular momenta increase with increasing radial coordinate. Such flows are Rayleigh stable, but must be turbulent in order to explain observed data. Such a mismatch between the linear theory and observations/experiments is more severe when any hydromagnetic/magnetohydrodynamic instability and the corresponding turbulence therein is ruled out. The present work explores the effect of stochastic noise on such hydrodynamic flows. We focus on a small section of such a flow which is essentially a plane shear flow supplemented by the Coriolis effect. This also mimics a small section of an astrophysical accretion disk. It is found that such stochastically driven flows exhibit large temporal and spatial correlations of perturbation velocities, and hence large energy dissipations, that presumably generate instability. A range of angular velocity profiles (for the steady flow), starting with the constant angular momentum to that of the constant circular velocity are explored. It is shown that the growth and roughness exponents calculated from the contour (envelope) of the perturbed flows are all identical, revealing a unique universality class for the stochastically forced hydrodynamics of rotating shear flows. This work, to the best of our knowledge, is the first attempt to understand origin of instability and turbulence in the three-dimensional Rayleigh stable rotating shear flows by introducing additive stochastic noise to the underlying linearized governing equations. This has important implications in resolving the turbulence problem in astrophysical hydrodynamic flows such as accretion disks.

On the theory of self-similar parabolic optical pulses

Self-similar optical pulses (or “similaritons”) of parabolic intensity profile can be found as asymptotic solutions of the nonlinear Schr¨odinger equation in a gain medium such as a fiber amplifier or laser resonator. These solutions represent a wide-ranging significance example of dissipative nonlinear structures in optics. Here, we address some issues related to the formation and evolution of parabolic pulses in a fiber gain medium by means of semi-analytic approaches. In particular, the effect of the third-order dispersion on the structure of the asymptotic solution is examined. Our analysis is based on the resolution of ordinary differential equations, which enable us to describe the main properties of the pulse propagation and structural characteristics observable through direct numerical simulations of the basic partial differential equation model with sufficient accuracy.