Incorporating curvature information into on-line learning

We analyse the dynamics of a number of second order on-line learning algorithms training multi-layer neural networks, using the methods of statistical mechanics. We first consider on-line Newton's method, which is known to provide optimal asymptotic performance. We determine the asymptotic generalization error decay for a soft committee machine, which is shown to compare favourably with the result for standard gradient descent. Matrix momentum provides a practical approximation to this method by allowing an efficient inversion of the Hessian. We consider an idealized matrix momentum algorithm which requires access to the Hessian and find close correspondence with the dynamics of on-line Newton's method. In practice, the Hessian will not be known on-line and we therefore consider matrix momentum using a single example approximation to the Hessian. In this case good asymptotic performance may still be achieved, but the algorithm is now sensitive to parameter choice because of noise in the Hessian estimate. On-line Newton's method is not appropriate during the transient learning phase, since a suboptimal unstable fixed point of the gradient descent dynamics becomes stable for this algorithm. A principled alternative is to use Amari's natural gradient learning algorithm and we show how this method provides a significant reduction in learning time when compared to gradient descent, while retaining the asymptotic performance of on-line Newton's method.

Attentional processes link perception and action

Behavioural studies on normal and brain-damaged individuals provide convincing evidence that the perception of objects results in the generation of both visual and motor signals in the brain, irrespective of whether or not there is an intention to act upon the object. In this paper we sought to determine the basis of the motor signals generated by visual objects. By examining how the properties of an object affect an observer's reaction time for judging its orientation, we provide evidence to indicate that directed visual attention is responsible for the automatic generation of motor signals associated with the spatial characteristics of perceived objects.

The role of context and timeframe in moderating relationships within the theory of planned behaviour

This study examined the moderating effect of context and timeframe on the predictive ability of Theory of Planned Behaviour (TPB) constructs. Three hundred and eighty-three students completed TPB measures either in a campus bar or a library and were randomly allocated to one of three timeframe conditions: tonight, tomorrow or next week. There was a threeway interaction such that the subjective norms of participants in a bar were more predictive of their intentions to binge drink that night, whereas thesubjective norms of participants in a library were less predictive of intentions to binge drink that night. This research provides empirical evidence that ignoring context may result in underestimation of the importance of normative factors in binge drinking. It also suggests that other research utilising the TPB needs to take greater account of the impact of context of data collection, which has been neglected to date.

Study of the deposition, properties and applications of electroless deposits containing particles

The deposition efficiencies of a number of electroless nickel and cobalt plating solutions were studied and in the case of nickel compared with a commercial plating solution Nifoss 80. At the optimum plating conditions (92ºC and pH 4.5) Nifoss 80 produced nickel layers most efficiently, the alkaline cobalt solution operated most efficiently at 90ºC and pH 9. The methods of producing compostte layers containing 2-3 µm carbide particles and chromium powder is described. Nickel and cobalt layers containing approximately 27% carbide particles, or 40% (Ni) and 30% (Co) chromium particles by volume were obtained. This value is independent of the particle concentration in the plating solution within the range (20~200 g/l). Hardness of the nickel. as deposited was 515 Hv, this was increased to a maximum of 1155 Hv by heat treatment at 200ºC for 5 hours in vacuum. Incorporation. of .chromium carbide particles resulted in a maximum hardness of 1225 Hv after heating at 500ºC for 5 hours in vacuum and chromium particles resulted in a maximum hardness of 16S0 Hv after heat treatment at 400ºC for 2 hours in vacuum. Similarly the hardness of cobalt as deposited was 600 Hv, this was increased to a maximum of 1300 Hv after heat treatment at 400ºC for 1 hour. Incorporation of chromium carbide particles resulted jn a maximum hardness of 1405 Hv after heating at 400ºC for 5 hours in vacuum and chromium particles resulted in a maximum hardness of 1440 Hv after. heat treating for 2 hours at 400ºC in vacuum. The structure of the deposits was studied by optical and scanning electron microscopy. The wear rate and coefficient of friction was determined by a pin and disc method. Wear rate and coefficient of friction decreased with increase in hardness. The wear resistance of the materials was also determined using a simulated forging test. Dies made of standard die steel were coated and the wear rates of the layers as deposited and after heat treatment were compared with those of uncoated tools. The wear resistance generally increased with hardness, it was 50-75% more than the uncoated die steel. Acetic acid salt spray test and outdoor exposure for six months was used to study the corrosion behaviour of the deposits and potentiodynamic curves plotted to find their corrosion potential. Nickel deposit exhibited less staining than carbide composite deposits and nickel-chromium deposits had the most noble corrosion potential.

Indigenous and foreign innovation efforts and drivers of technological upgrading:evidence from China

This paper explores the role of indigenous and foreign innovation efforts in technological upgrading in developing countries, taking into account sectoral specificities in technical change. Using a Chinese firm-level panel dataset covering 2001–05, the paper decomposes productivity growth into technical change and efficiency improvement and examines the impact of indigenous and foreign innovation efforts on these changes. Indigenous firms are found to be the leading force on the technological frontier in the low- and medium-technology industries, while foreign-invested firms enjoy a clear lead in the high-technology sector. Collective indigenous R&D activities at the industry level are found to be the major driver of technology upgrading of indigenous firms that push out the technology frontier. While foreign investment appears to contribute to static industry capabilities, R&D activities of foreign-invested firms have exerted a significant negative effect on the technical change of local firms over the sample period.

Factors preventing myopia progression with orthokeratology correction

PURPOSE: To examine which baseline measurements constitute predictive factors for axial length growth over 2 years in children wearing orthokeratology contact lenses (OK) and single-vision spectacles (SV). METHODS: Sixty-one children were prospectively assigned to wear either OK (n = 31) or SV (n = 30) for 2 years. The primary outcome measure (dependent variable) was axial length change at 2 years relative to baseline. Other measurements (independent variables) were age, age of myopia onset, gender, myopia progression 2 years before baseline and baseline myopia, anterior chamber depth, corneal power and shape (p value), and iris and pupil diameters as well as parental refraction. The contribution of all independent variables to the 2-year change in axial length was assessed using univariate and multivariate regression analyses. RESULTS: After univariate analyses, smaller increases in axial length were found in the OK group compared to the SV group in children who were older, had earlier onset of myopia, were female, had lower rate of myopia progression before baseline, had less myopia at baseline, had longer anterior chamber depth, had greater corneal power, had more prolate corneal shape, had larger iris diameter, had larger pupil sizes, and had lower levels of parental myopia (all p < 0.05). In multivariate analyses, older age and greater corneal power were associated with smaller increases in axial length in the OK group (both p < 0.05), whereas in SV wearers, smaller iris diameter was associated with smaller increases in axial length (p = 0.021). CONCLUSIONS: Orthokeratology is a successful treatment option in controlling axial elongation compared to SV in children of older age, had earlier onset of myopia, were female, had lower rate of myopia progression before baseline, had lower myopia at baseline, had longer anterior chamber depth, had greater corneal power, had more prolate corneal shape, had larger iris and pupil diameters, and had lower levels of parental myopia. © American Academy of Optometry.