Improving neural network training solutions using regularisation

This paper describes the application of regularisation to the training of feedforward neural networks, as a means of improving the quality of solutions obtained. The basic principles of regularisation theory are outlined for both linear and nonlinear training and then extended to cover a new hybrid training algorithm for feedforward neural networks recently proposed by the authors. The concept of functional regularisation is also introduced and discussed in relation to MLP and RBF networks. The tendency for the hybrid training algorithm and many linear optimisation strategies to generate large magnitude weight solutions when applied to ill-conditioned neural paradigms is illustrated graphically and reasoned analytically. While such weight solutions do not generally result in poor fits, it is argued that they could be subject to numerical instability and are therefore undesirable. Using an illustrative example it is shown that, as well as being beneficial from a generalisation perspective, regularisation also provides a means for controlling the magnitude of solutions. (C) 2001 Elsevier Science B.V. All rights reserved.

Parent-offspring conflict and motivational control of brooding in an amphipod (Crustacea)

Models of parent - offspring conflict concerning levels of caregiving centre on conflict resolution by offspring control, compromise or offspring 'honest signalling' that parents use to maximize their own fitness. Recent empirical studies on motivational control of parental feeding of offspring are interpreted as supporting the latter model. Here, we examine parental care in an amphipod, Crangonyx pseudogracilis, which directs care to embryos in a brood pouch. Embryo removal and transplantation elucidated causal factors that determine levels of caregiving. In the short-term, females with all embryos removed reduced care activities, but partial embryo removal did not affect caregiving, evidence of 'unshared' parental care. In the long-term, females with all embryos removed ceased care. Thus, females have a maternal state that is maintained by stimuli from offspring. Transplantation of early/late stage embryos among females originally carrying early/late stage embryos revealed that stimuli from embryos indicate their age-dependent needs, but only modify caregiving within the constraints of a changing endogenous maternal state. Thus, we demonstrate that mothers and offspring share motivational control of care. However, we highlight the inappropriate use of motivational data in reaching conclusions about the resolution of parent - offspring conflict.

Use of the multispecies freshwater biomonitor to assess behavioral changes of Corophium volutator (Pallas, 1766) (Crustacea, Amphipoda) in response to toxicant exposure in sediment

Automated sediment toxicity testing and biomonitoring has grown rapidly. This study tested the suitability of the marine amphipod Corophium volutator (Pallas, 1766) for sediment biomonitoring using the Multispecies Freshwater Biomonitor (MFB). Two experiments were undertaken to (1) characterize individual behaviors of C. volutator using the MFB and (2) examine behavioral changes in response to sediment spiked with the pesticide Bioban. Four behaviors were visually identified (walking, swimming, grooming and falling) and characterized in the MFB as different patterns of locomotor activity (0-2 Hz range). Ventilation was not visually observed but was detected by the MFB (2-8 Hz). No clear diel activity patterns were detected. The MFB detected an overall increase in C. volutator locomotor activity after Bioban addition to the sediments (56, 100, 121 mg kg(-1)). C. volutator was more active (both locomotion and ventilation) in the water column than the spiked sediment. C. volutator appears a sensitive and appropriate species for behavioral sediment toxicity assessment and biomonitoring. (c) 2005 Elsevier Inc. All rights reserved.

Parent-off spring associations in wintering brent geese: parental investment or mutual assistance?

The continued parent-offspring associations in the Eastern Canadian High Arctic light-bellied brent goose Branta bernicla hrota was examined to determine whether this is an example of continued parental investment or mutual assistance. Adults with juveniles spend more than twice as much time being vigilant and aggressive than do those without offspring. The loss of a partner, however, does not result in the remaining parent increasing parental care but does result in increased 'self-care' by the juveniles. Neither parents nor single-parent juveniles appear to pay an energetic cost relative to non-parental adults and two-parent juveniles, respectively. Differences in the feeding distribution of parents and non-parents and equivalent or better physical condition suggests that families are able to maintain access to a superior food supply over the winter. Passive 'assistance' by juveniles may assist in maintaining this position in favoured areas, and this is achieved with little overt aggression. The present study thus provides no data that show a net cost to parents by remaining with their juveniles over the winter period. Thus, mutual assistance might be a better explanation of the prolonged association rather than a period of parental investment with an overall cost.

Shared or unshared parental care in overwintering brent geese (Branta bernicla hrota)

We examine brood size effects on the behaviour of wintering parent and juvenile brent geese (Branta bernicla hrota) to test predictions of shared and unshared parental care models. The behaviour of both parents and offspring appear to be influenced by declining food availability over the winter. Parental vigilance increased with brood size and may be explained by vigilance having functions in addition to antipredator behaviour where the benefits are shared among the brood. There was no increase in parental aggression with brood size and this does not fit the prediction of shared care. Nevertheless, large families are able to monopolize better feeding areas compared with smaller families and large families static feed more but walk feed less than do small families, the former apparently being the preferred mode. The presence of additional young, rather than increasing the amount of parental aggression, seems to enhance the family's competitive ability. Because parents with large broods benefit from enhanced access to resources there is likely to be no additional significant cost in the parental care of larger broods (sensu Trivers 1972).

Parent-Reported Quality of Life of Children With Cerebral Palsy in Europe

OBJECTIVE. The goal was to determine whether the type and severity of the child's impairments and the family's psychosocial, social, and economic characteristics influence parent-reported child quality of life across the spectrum of severity of cerebral palsy.

METHODS. Our population-based, cross-sectional survey conducted in 2004 to 2005 involved 818 children with cerebral palsy, 8 to 12 years of age, from 7 countries (9 regions) in Europe. Child quality of life was assessed through parent reports by using the Kidscreen questionnaire, and data were analyzed separately for each of its 10 domains.

RESULTS. The parental response rates were >93% for all domains except one. Gross motor function and IQ level were found to be associated independently with quality of life in most domains. However, greater severity of impairment was not always associated with poorer quality of life; in the moods and emotions, self-perception, social acceptance, and school environment domains, less severely impaired children were more likely to have poor quality of life. Pain was associated with poor quality of life in the physical and psychological well-being and self-perception domains. Parents with higher levels of stress were more likely to report poor quality of life in all domains, which suggests that factors other than the severity of the child's impairment may influence the way in which parents report quality of life.

CONCLUSIONS. The parent-reported quality of life for children with cerebral palsy is associated strongly with impairment. However, depending on the areas of life, the most severely impaired children (in terms of motor functioning or intellectual ability) do not always have the poorest quality of life.

Training of Reaching in Stroke Survivors With Severe and Chronic Upper Limb Paresis Using a Novel Nonrobotic Device: A Randomized Clinical Trial

Background and Purpose—Severe upper limb paresis is a major contributor to disability after stroke. This study investigated the efficacy of a new nonrobotic training device, the Sensorimotor Active Rehabilitation Training (SMART) Arm, that was used with or without electromyography-triggered electrical stimulation of triceps brachii to augment elbow extension, permitting stroke survivors with severe paresis to practice a constrained reaching task.

Methods—A single-blind, randomized clinical trial was conducted with 42 stroke survivors with severe and chronic paresis. Thirty-three participants completed the study, of whom 10 received training using the SMART Arm with electromyography-triggered electrical stimulation, 13 received training using the SMART Arm alone, and 10 received no intervention (control). Training consisted of 12 1-hour sessions over 4 weeks. The primary outcome measure was “upper arm function,” item 6 of the Motor Assessment Scale. Secondary outcome measures included impairment measures; triceps muscle strength, reaching force, modified Ashworth scale; and activity measures: reaching distance and Motor Assessment Scale. Assessments were administered before (0 weeks) and after training (4 weeks) and at 2 months follow-up (12 weeks).

Results—Both SMART Arm groups demonstrated significant improvements in all impairment and activity measures after training and at follow-up. There was no significant difference between these 2 groups. There was no change in the control group.

Conclusions—Our findings indicate that training of reaching using the SMART Arm can reduce impairment and improve activity in stroke survivors with severe and chronic upper limb paresis, highlighting the benefits of intensive task-oriented practice, even in the context of severe paresis.

Age-related differences in rapid muscle activation after rate of force development training of the elbow flexors

In young adults, improvements in the rate of force development as a result of resistance training are accompanied by increases in neural drive in the very initial phase of muscle activation. The purpose of this experiment was to determine if older adults also exhibit similar adaptations in response to rate of force development (RFD) training. Eight young (21-35 years) and eight older (60-79 years) adults were assessed during the production of maximum rapid contractions, before and after four weeks of progressive resistance training for the elbow flexors. Young and older adults exhibited significant increases (P<0.01) in peak RFD, of 25.6% and 28.6% respectively. For both groups the increase in RFD was accompanied by an increase in the root mean square (RMS) amplitude and in the rate of rise (RER) in the electromyogram (EMG) throughout the initial 100 ms of activation. For older adults, however, this training response was only apparent in the brachialis and brachioradialis muscles. This response was not observed in surface EMG recorded from the biceps brachii muscle during either RFD testing or throughout training, nor was it observed in the pronator teres muscle. The minimal adaptations observed for older adults in the bifunctional muscles biceps brachii and pronator teres are considered to indicate a compromise of the neural adaptations older adults might experience in response to resistance training.

Transfer of resistance training to enhance rapid coordinated force production by older adults

The purpose of this study was to examine the capacity of resistance training to enhance the rapid and coordinated production of force by older people. Thirty adults (greater than or equal to 60 years) completed a visually guided aiming task that required the generation of isometric torque in 2 df about the elbow prior to and following a 4-week training period. Groups of six participants were allocated to two progressive ( 40 - 100% maximal voluntary contraction (MVC)) resistance-training (PRT) groups, to two constant low-load (10% MVC) training groups (CLO) and to one no-training control group. Training movements required the generation of either combined flexion and supination (FLESUP), or combined extension and supination (EXTSUP). In response to training, target acquisition times in the aiming task decreased for all groups; however, both the nature of the training load and the training movement influenced the pattern and magnitude of improvements (EXTSUP_ CLO: 36%, FLESUP_ PRT 26%, EXTSUP_ PRT 22%, FLESUP_ CLO 20%, CONTROL 15%). For one group that trained with progressively increasing loads, there arose a subsequent decrease in performance in one condition of the transfer task. For each group, these adaptations were accompanied by systematic changes in the coordination of muscles about the elbow joint, particularly the biceps brachii.

The consequences of resistance training for movement control in older adults

Older adults who undertake resistance training are typically seeking to maintain or increase their muscular strength with the goal of preserving or improving their functional capabilities. The extent to which resistance training adaptations lead to improved performance on tasks of everyday living is not particularly well understood. Indeed, studies examining changes in functional task performance experienced by older adults following periods of resistance training have produced equivocal findings. A clear understanding of the principles governing the transfer of resistance training adaptations is therefore critical in seeking to optimize the prescription of training regimes that have as their aim the maintenance and improvement of functional movement capacities in older adults. The degenerative processes that occur in the aging motor system are likely to influence heavily any adaptations to resistance training and the subsequent transfer to functional task performance. The resulting characteristics of motor behavior, such as the substantial decline in the rate of force development and the decreased steadiness of force production, may entail that specialized resistance training strategies are necessary to maximize the benefits for older adults. In this review, we summarize the alterations in the neuromuscular system that are responsible for the declines in strength, power, and force control, and the subsequent deterioration in the everyday movement capabilities of older adults. We examine the literature concerning the neural adaptations that older adults experience in response to resistance training, and consider the readiness with which these adaptations will improve the functional movement capabilities of older adults.

The sites of neural adaptation induced by resistance training in humans

Although it has long been supposed that resistance training causes adaptive changes in the CNS, the sites and nature of these adaptations have not previously been identified. In order to determine whether the neural adaptations to resistance training occur to a greater extent at cortical or subcortical sites in the CNS, we compared the effects of resistance training on the electromyographic (EMG) responses to transcranial magnetic (TMS) and electrical (TES) stimulation. Motor evoked potentials (MEPs) were recorded from the first dorsal interosseous muscle of 16 individuals before and after 4 weeks of resistance training for the index finger abductors (n=8), or training involving finger abduction-adduction without external resistance (n=8). TMS was delivered at rest at intensities from 5% below the passive threshold to the maximal output of the stimulator. TMS and TES were also delivered at the active threshold intensity while the participants exerted torques ranging from 5 to 60% of their maximum voluntary contraction (MVC) torque. The average latency of MEPs elicited by TES was significantly shorter than that of TMS MEPs (TES latency=21.5+/-1.4 ms; TMS latency=23.4+/-1.4 ms; P

Neural adaptations to resistance training - Implications for movement control

It has long been believed that resistance training is accompanied by changes within the nervous system that play an important role in the development of strength. Many elements of the nervous system exhibit the potential for adaptation in response to resistance training, including supraspinal centres, descending neural tracts, spinal circuitry and the motor end plate connections between motoneurons and muscle fibres. Yet the specific sites of adaptation along the neuraxis have seldom been identified experimentally, and much of the evidence for neural adaptations following resistance training remains indirect. As a consequence of this current lack of knowledge, there exists uncertainty regarding the manner in which resistance training impacts upon the control and execution of functional movements. We aim to demonstrate that resistance training is likely to cause adaptations to many neural elements that are involved in the control of movement, and is therefore likely to affect movement execution during a wide range of tasks.

Resistance training enhances the stability of sensorimotor coordination

Strategics for the control of human movement are constrained by the neuroanatomical characteristics of the motor system. In particular, there is evidence that the capacity of muscles for producing force has a strong influence on the stability of coordination in certain movement tasks. In the present experiment, our aim was to determine whether physiological adaptations that cause relatively long-lasting changes in the ability of muscles to produce force can influence the stability of coordination in a systematic manner. We assessed the effects of resistance training on the performance of a difficult coordination task that required participants to synchronize or syncopate movements of their index finger with an auditory metronome. Our results revealed that training that increased isometric finger strength also enhanced the stability of movement coordination. These changes were accompanied by alterations in muscle recruitment patterns. In Particular, the trained muscles were recruited in a more consistent fashion following the programme of resistance training. These results indicate that resistance training produces functional adaptations of the neuroanatomical constraints that underlie the control of voluntary movement.