Globally optimal learning rates in multilayer neural networks

A method for calculating the globally optimal learning rate in on-line gradient-descent training of multilayer neural networks is presented. The method is based on a variational approach which maximizes the decrease in generalization error over a given time frame. We demonstrate the method by computing optimal learning rates in typical learning scenarios. The method can also be employed when different learning rates are allowed for different parameter vectors as well as to determine the relevance of related training algorithms based on modifications to the basic gradient descent rule.

Rotational and centration stability of an aspheric intraocular lens with a simulated toric design

Purpose: To assess the stability of the Akreos AO intraocular lens (IOL) platform with a simulated toric design using objective image analysis. Setting: Six hospital eye clinics across Europe. Methods: After implantation in 1 eye of patients, IOLs with orientation marks were imaged at 1 to 2 days, 7 to 14 days, 30 to 60 days, and 120 to 180 days. The axis of rotation and IOL centration were objectively assessed using validated image analysis. Results: The study enrolled 107 patients with a mean age of 69.9 years ± 7.7 (SD). The image quality was sufficient for IOL rotation analysis in 91% of eyes. The mean rotation between the first day postoperatively and 120 to 180 days was 1.93 ± 2.33 degrees, with 96% of IOLs rotating fewer than 5 degrees and 99% rotating fewer than 10 degrees. There was no significant rotation between visits and no clear bias in the direction of rotation. In 71% of eyes, the dilation and image quality was sufficient for image analysis of centration. The mean change in centration between 1 day and 120 to 180 days was 0.21 ± 0.11 mm, with all IOLs decentering less than 0.5 mm. There was no significant decentration between visits and no clear bias in the direction of the decentration. Conclusion: Objective analysis of digital retroillumination images taken at different postoperative periods shows the aspheric IOL platform was stable in the eye and is therefore suitable for the application of a toric surface to correct corneal astigmatism.

Serial dark soliton for 100-Gb/s applications

We analyze the performance through numerical simulations of a new modulation format: serial dark soliton (SDS) for wide-area 100-Gb/s applications. We compare the performance of the SDS with conventional dark soliton, amplitude-modulation phase-shift keying (also known as duobinary), nonreturn-to-zero, and return-to-zero modulation formats, when subjected to typical wide-area-network impairments. We show that the SDS has a strong chromatic dispersion and polarization-mode-dispersion tolerance, while maintaining a compact spectrum suitable for strong filtering requirement in ultradense wavelength-division-multiplexing applications. The SDS can be generated using commercially available components for 40-Gb/s applications and is cost efficient when compared with other 100-Gb/s electrical-time-division-multiplexing systems.

Effect of maternal protein restriction during pregnancy and postweaning high-fat feeding on diet-induced thermogenesis in adult mouse offspring

Purpose: Prenatal undernutrition followed by postweaning feeding of a high-fat diet results in obesity in the adult offspring. In this study, we investigated whether diet-induced thermogenesis is altered as a result of such nutritional mismatch. Methods: Female MF-1 mice were fed a normal protein (NP, 18 % casein) or a protein-restricted (PR, 9 % casein) diet throughout pregnancy and lactation. After weaning, male offspring of both groups were fed either a high-fat diet (HF; 45 % kcal fat) or standard chow (C, 7 % kcal fat) to generate the NP/C, NP/HF, PR/C and PR/HF adult offspring groups (n = 7-11 per group). Results: PR/C and NP/C offspring have similar body weights at 30 weeks of age. Postweaning HF feeding resulted in significantly heavier NP/HF offspring (P <0.01), but not in PR/HF offspring, compared with their chow-fed counterparts. However, the PR/HF offspring exhibited greater adiposity (P <0.01) v the NP/HF group. The NP/HF offspring had increased energy expenditure and increased mRNA expression of uncoupling protein-1 and β-3 adrenergic receptor in the interscapular brown adipose tissue (iBAT) compared with the NP/C mice (both at P <0.01). No such differences in energy expenditure and iBAT gene expression were observed between the PR/HF and PR/C offspring. Conclusions: These data suggest that a mismatch between maternal diet during pregnancy and lactation, and the postweaning diet of the offspring, can attenuate diet-induced thermogenesis in the iBAT, resulting in the development of obesity in adulthood. © 2014 Springer-Verlag Berlin Heidelberg.