Improving neural network training solutions using regularisation

This paper describes the application of regularisation to the training of feedforward neural networks, as a means of improving the quality of solutions obtained. The basic principles of regularisation theory are outlined for both linear and nonlinear training and then extended to cover a new hybrid training algorithm for feedforward neural networks recently proposed by the authors. The concept of functional regularisation is also introduced and discussed in relation to MLP and RBF networks. The tendency for the hybrid training algorithm and many linear optimisation strategies to generate large magnitude weight solutions when applied to ill-conditioned neural paradigms is illustrated graphically and reasoned analytically. While such weight solutions do not generally result in poor fits, it is argued that they could be subject to numerical instability and are therefore undesirable. Using an illustrative example it is shown that, as well as being beneficial from a generalisation perspective, regularisation also provides a means for controlling the magnitude of solutions. (C) 2001 Elsevier Science B.V. All rights reserved.

Color preferences in gorillas (Gorilla gorilla gorilla) and chimpanzees (Pan troglodytes)

Color plays an important biological role in the lives of many animals, with some species exhibiting preferences for certain colors over others. This study explored the color preferences of two species of ape, which, like humans, possess trichromatic color vision. Six western lowland gorillas, and six chimpanzees, housed in Belfast Zoological Gardens, were exposed to three stimuli (cloths, boxes, sheets of acetate) in red, blue, and green. Six stimuli of the same nature, in each of the three colors, were provided to both species for 5 days per stimulus. The amount of interest that the animals showed toward each stimulus of each color was recorded for 1 hr. Results showed that the apes, both when analyzed as two separate groups, and when assessed collectively, showed significant color preferences, paying significantly less attention to the red-, than to the blue- or green-colored stimuli. The animals' interest in the blue- and green-colored stimuli did not differ significantly. Overall, the findings suggest that gorillas and chimpanzees, our closest living relatives, may harbor color preferences comparable to those of humans and other species. © 2008 American Psychological Association.


--------------------------------------------------------------------------------

Reaxys Database Information|

--------------------------------------------------------------------------------

Effect of heat treatment on the antioxidant activity, color, and free phenolic acid profile of malt

Green malt was kilned at 95 degrees C following two regimens: a standard regimen (SKR) and a rapid regimen (RKR). Both resulting malts were treated further in a tray dryer heated to 120 degrees C, as was green malt previously dried to 65 degrees C (TDR). Each regimen was monitored by determining the color, antioxidant activity (by both ABTS(center dot+) and FRAP methods), and polyphenolic profile. SKR and RKR malts exhibited decreased L* and increased b* values above approximately 80 degrees C. TDR malts changed significantly less, and color did not develop until 110 degrees C, implying that different chemical reactions lead to color in those malts. Antioxidant activity increased progressively with each regimen, although with TDR malts this became significant only at 110-120 degrees C. The RKR malt ABTS(center dot+) values were higher than those of the SKR malt. The main phenolics, that is, ferulic, p-coumaric, and vanillic acids, were monitored throughout heating. Ferulic acid levels increased upon heating to 80 degrees C for SKR and to 70 degrees C for RKR, with subsequent decreases. However, the levels for TDR malts did not increase significantly. The increase in free phenolics early in kilning could be due to enzymatic release of bound phenolics and/or easier extractability due to changes in the matrix. The differences between the kilning regimens used suggest that further modification of the regimens could lead to greater release of bound phenolics with consequent beneficial effects on flavor stability in beer and, more generally, on human health.

WASP-4b: A 12th magnitude transiting hot Jupiter in the southern hemisphere

We report the discovery of WASP-4b, a large transiting gas-giant planet with an orbital period of 1.34 days. This is the first planet to be discovered by the SuperWASP-South observatory and CORALIE collaboration and the first planet orbiting a star brighter than 16th magnitude to be discovered in the southern hemisphere. A simultaneous fit to high-quality light curves and precision radial velocity measurements leads to a planetary mass of 1.22(-0.08)(+0.09) M-Jup and a planetary radius of 1.42(-0.04)(+0.07) R-Jup. The host star is USNO-B1.0 0479-0948995, a G7 V star of visual magnitude 12.5. As a result of the short orbital period, the predicted surface temperature of the planet is 1761 K, making it an ideal candidate for detections of the secondary eclipse at infrared wavelengths.

Antioxidant properties of kilned and roasted malts

Compounds possessing antioxidant activity play a crucial role in delaying or preventing lipid oxidation in foods and beverages during processing and storage. Such reactions lead to loss of product quality, especially as a consequence of off-flavor formation. The aim of this study was to determine the antioxidant activity of kilned (standard) and roasted (speciality) malts in relation to phenolic compounds, sugars, amino acids, and color [assessed as European Brewing Convention units (degrees EBC) and absorbance at 420 nm]. The concentrations of sugars and amino acids decreased with the intensity of the applied heat treatment, and this was attributed to the extent of the Maillard reaction, as well as sugar caramelization, in the highly roasted malts. Proline, followed by glutamine, was the most abundant free amino/imino acid in the malt samples, except those that were highly roasted, and maltose was the most abundant sugar in all malts. Levels of total phenolic compounds decreased with heat treatment. Catechin and ferulic acid were the most abundant phenolic compounds in the majority of the malts, and amounts were highest in the kilned samples. In highly roasted malts, degradation products of ferulic acid were identified. Antioxidant activity increased with the intensity of heating, in parallel with color formation, and was significantly higher for roasted malts compared to kilned malts. In kilned malts, phenolic compounds were the main identified contributors to antioxidant activity, with Maillard reaction products also playing a role. In roasted malts, Maillard reaction products were responsible for the majority of the antioxidant activity.

Relationships between antioxidant activity, color, and flavor compounds of crystal malt extracts

Aqueous extracts were prepared from five barley crystal malts (color range 15-440 degrees EBC, European Brewing Convention units). Antioxidant activity was determined by using the 2,2'-azinobis(3-ethylbenothiazoline-6-sulfonic acid) (ABTS(.+)) radical cation scavenging method. Antioxidant activity increased with increasing color value although the rate of increase decreased with increasing color value. Color was measured in CIELAB space. Extracts of the 15, 23, and 72 degrees EBC malts followed the same dilution pathway as did the 148 degrees EBC sample at higher dilution levels, indicating that they could each be used to give the same color by appropriate dilution. The 440 degrees EBC sample followed a different dilution pathway, indicating that different compounds were responsible for color in this extract. Fifteen selected volatile compounds were monitored using gas chromatography/mass spectrometry (GC/MS). Levels of methylpropanal, 2-methylbutanal, and 3-methylbutanal were highest for the 72 degrees EBC sample. When odor threshold values of the selected compounds were taken into account, 3-methylbutanal was the most important contributor to flavor., Relationships between levels of the lipid oxidation products, hexanal and (E)-2-nonenal, and antioxidant activity were complex, and increasing antioxidant activity for samples in the range of 15-148 degrees EBC did-not result in reduced levels of these lipid-derived compounds. When different colored malt extracts were diluted to give the same a* and b* values, calculated antioxidant activity and amounts of 3-methylbutanal, hexanal, and (E)-2-nonenal decreased with increasing degrees EBC value.

The natural plasma testosterone profile of male blue tits during the breeding season and its relation to song output

In male birds, the gonadal hormone testosterone (T) is known to influence territorial and mating behaviour. Plasma levels of T show seasonal fluctuations which vary in relation to mating system and social instability. First, we determined the natural T profile of male blue tits Parus caeruleus during the breeding season. We found that plasma levels of T increased at the onset of nest building. Thus, the increase in circulating T was not associated with territory establishment, nor with the fertile period of the males' mates. In most individuals, T levels dropped to values close to zero during the period of chick feeding. Second, we investigated the relationship between plasma levels of T and male age, size, and singing behaviour. During the mating period, T levels did not differ between 1 yr old and older males and did not correlate with body size or condition. However, song output during the dawn chorus tended to be positively correlated with T levels. Therefore, if high T levels are costly, song output might be an honest indicator of male quality in blue tits. Finally, we show that plasma levels of T are significantly higher during the night than during the day. This pattern has also been observed in captive non-passerine birds, but its functional significance remains unknown.

Bronsted-Evans-Polanyi relation of multistep reactions and volcano curve in heterogeneous catalysis

Multistep surface processes involving a number of association reactions and desorption processes may be considered as hypothetical one-step desorption processes. Thus, heterogeneous catalytic reactions can be treated kinetically as consisting of two steps: adsorption and desorption. It is also illustrated that the hypothetical one-step desorption process follows the BEP relation. A volcano curve can be obtained from kinetic analysis by including both adsorption and desorption processes.

Neural compensation for compliant loads during rhythmic movement

An experiment was performed to characterise the movement kinematics and the electromyogram (EMG) during rhythmic voluntary flexion and extension of the wrist against different compliant (elastic-viscous-inertial) loads. Three levels of each type of load, and an unloaded condition, were employed. The movements were paced at a frequency of I Hz by an auditory metronome, and visual feedback of wrist displacement in relation to a target amplitude of 100degrees was provided. Electro-myographic recordings were obtained from flexor carpi radialis (FCR) and extensor carpi radialis brevis (ECR). The movement profiles generated in the ten experimental conditions were indistinguishable, indicating that the CNS was able to compensate completely for the imposed changes in the task dynamics. When the level of viscous load was elevated, this compensation took the form of an increase in the rate of initial rise of the flexor and the extensor EMG burst. In response to increases in inertial load, the flexor and extensor EMG bursts commenced and terminated earlier in the movement cycle, and tended to be of greater duration. When the movements were performed in opposition to an elastic load, both the onset and offset of EMG activity occurred later than in the unloaded condition. There was also a net reduction in extensor burst duration with increases in elastic load, and an increase in the rate of initial rise of the extensor burst. Less pronounced alterations in the rate of initial rise of the flexor EMG burst were also observed. In all instances, increases in the magnitude of the external load led to elevations in the overall level of muscle activation. These data reveal that the elements of the central command that are modified in response to the imposition of a compliant load are contingent, not only upon the magnitude, but also upon the character of the load.