Extending in vitro conditioning in Aplysia to analyze operant and classical processes in the same preparation.

Operant and classical conditioning are major processes shaping behavioral responses in all animals. Although the understanding of the mechanisms of classical conditioning has expanded significantly, the understanding of the mechanisms of operant conditioning is more limited. Recent developments in Aplysia are helping to narrow the gap in the level of understanding between operant and classical conditioning, and have raised the possibility of studying the neuronal processes underlying the interaction of operant and classical components in a relatively complex learning task. In the present study, we describe a first step toward realizing this goal, by developing a single in vitro preparation in which both operant and classical conditioning can be studied concurrently. The new paradigm reproduced previously published results, even under more conservative and homogenous selection criteria and tonic stimulation regime. Moreover, the observed learning was resistant to delay, shortening, and signaling of reinforcement.

In vitro analog of classical conditioning of feeding behavior in aplysia.

The feeding behavior of Aplysia californica can be classically conditioned using tactile stimulation of the lips as a conditioned stimulus (CS) and food as an unconditioned stimulus (US). Moreover, several neural correlates of classical conditioning have been identified. The present study extended previous work by developing an in vitro analog of classical conditioning and by investigating pairing-specific changes in neuronal and synaptic properties. The preparation consisted of the isolated cerebral and buccal ganglia. Electrical stimulation of a lip nerve (AT4) and a branch of the esophageal nerve (En2) served as the CS and US, respectively. Three protocols were used: paired, unpaired, and US alone. Only the paired protocol produced a significant increase in CS-evoked fictive feeding. At the cellular level, classical conditioning enhanced the magnitude of the CS-evoked synaptic input to pattern-initiating neuron B31/32. In addition, paired training enhanced both the magnitude of the CS-evoked synaptic input and the CS-evoked spike activity in command-like neuron CBI-2. The in vitro analog of classical conditioning reproduced all of the cellular changes that previously were identified following behavioral conditioning and has led to the identification of several new learning-related neural changes. In addition, the pairing-specific enhancement of the CS response in CBI-2 indicates that some aspects of associative plasticity may occur at the level of the cerebral sensory neurons.

Olfactory conditioning facilitates diet transition in human infants.

We evaluated whether Pavlovian conditioning methods could be used to increase the ingestion of non-preferred solutions by formula-fed human infants. In baseline measures, 5-7 month old infants sucked less frequently and consumed less water than regular formula. During a 3-day olfactory conditioning period, parents placed a small scented disk, the conditioned stimulus, on the rim of their infants' formula bottle at every feeding. Following this training, infants' responses to water were tested when their water bottles had a disk scented with the training odor, a novel odor, or no odor. Infants tested with the training odor sucked more frequently and consumed significantly more water than they had at baseline. Infants tested with no odor or a novel odor consumed water at or below baseline levels. These data demonstrate that olfactory conditioning can be used to enhance ingestion in infants and suggest that such methods may be useful for infants experiencing difficulty when making transitions from one diet to another.

Cerebellar cortex involvement in classical eyelid conditioning

A model for cerebellar involvement in motor learning was tested using classical eyelid conditioning in the rabbit. Briefly, we assume that modifications of the strength of granule cell synapses at Purkinje cells in the cerebellar cortex and mossy fiber (MF) synapses at cerebellar interpositus nuclei are responsible for the acquisition, adaptively-timed expression, and extinction of conditioned eyelid responses (CRs). A corollary of these assumptions is that the cerebellar cortex is necessary for acquisition and extinction. This model also suggests a mechanism whereby the cerebellar cortex can discriminate different times during a conditioned stimulus (CS) and thus mediate the learned timing of CRs. Therefore, experiments were done to determine the role of the cerebellar cortex in the timing, extinction, and acquisition of CRs. Lesions of the cerebellar cortex that included the anterior lobe disrupted the learned timing of CRs such that they occurred at extremely short latencies. Stimulation of MFs in the middle cerebellar peduncle as the CS could support differently timed CRs in the same animal. These data indicate that synaptic plasticity in the cerebellar cortex mediates the learned timing of CRs. These short-latency CRs which resulted from anterior lobe damage did not extinguish, while CRs in animals receiving lesions which did not include the anterior lobe extinguished normally. Preliminary data suggests that lesions of the anterior lobe which produce short-latency responses prevent the acquisition of CRs to a novel CS. These findings indicate that the anterior lobe of cerebellar cortex is necessary for eyelid conditioning. The involvement of the anterior lobe in eyelid conditioning has not been previously reported, however, the anterior lobe has generally been spared in lesion studies examining cerebellar cortex involvement in eyelid conditioning due to its relatively inaccessible location. The observation that the anterior lobe of the cerebellar cortex is not always required for the basic expression of CRs, but is necessary for response timing, extinction, and acquisition, is consistent with the hypothesis that eyelid conditioning can involve plasticity in both the cerebellar cortex and interpositus nucleus and that plasticity in the nucleus is controlled by Purkinje cell activity. ^

Behavioral and cellular analysis of classical conditioning of feeding behavior in Aplysia

In classical conditioning, an associative form of learning, animals learn to associate two stimuli. Cellular and molecular mechanisms for the induction and consolidation of associative learning and memory at the level of single cells and synaptic connections have been studied in both vertebrate and invertebrate animals. The majority of studies, however, relied on aversive stimuli to induce learning. This bias may limit the extent to which identified mechanisms generalize to other forms of associative learning and memory, such as appetitive forms. The goal of the present study was to develop a classical conditioning procedure for the marine mollusk Aplysia californica using appetitive reinforcement, and to analyze associative learning using behavioral and electrophysiological techniques. ^ Using tactile stimulation of the lips as the conditional stimulus (CS) and food as the unconditional stimulus (US) a training protocol was developed that reliably induced classical conditioning of feeding behavior. Memory persisted for at least 24 hours. The gross organization of reinforcement-mediating pathways was analyzed in additional behavioral experiments. Moreover, neurophysiological correlates of classical conditioning were identified and characterized in an in vitro preparation containing the circuitry for feeding behavior. In vitro stimulation of a nerve (AT4) that may mediate the CS during training, resulted in a greater number of buccal motor patterns (BMPs) in brains from conditioned animals, as compared to control animals. The majority of these BMPs were ingestion-like, consistent with the increased number of bites in response to the CS after classical conditioning. Moreover, classical conditioning correlated with increased excitatory synaptic input to BMP-initiating neuron B31/32, in response to stimulation of AT 4, as compared to controls. The expression of the correlates of classical conditioning identified in this study was specific to stimulation of AT 4, which is consistent the stimulus specificity that is characteristic for classical conditioning. ^ The identification of cellular correlates of classical conditioning documented here provides the basis for future, more detailed analyses of an appetitive form of associative learning and memory, that may extend the working knowledge of the cellular and molecular mechanisms for associative plasticity in general. ^

Cellular mechanisms of operant and classical conditioning

The ability to associate a predictive stimulus with a subsequent salient event (i.e., classical conditioning) and the ability to associate an expressed behavior with the consequences (i.e., operant conditioning) allow for a predictive understanding of a changing environment. Although they are operationally distinct, there has been considerable debate whether at some fundamental level classical and operant conditioning are mechanistically distinct or similar. Feeding behavior of Aplysia (i.e., biting) was chosen as the model system and was successfully conditioned with appetitive forms of both operant and classical conditioning. The neuronal circuitry responsible for feeding is well understood and is suitable for cellular analyses, thus providing for a mechanistic comparison between these two forms of associative learning. ^ Neuron B51 is part of the feeding circuitry of Aplysia and is critical for the expression of ingestive behaviors. B51 also is a locus of plasticity following both operant and classical conditioning. Both in vivo and in vitro operant conditioning increased the input resistance and the excitability of B51. No pairing-specific changes in the input resistance were observed following both in vivo and in vitro classical conditioning. However, classical conditioning decreased the excitability of B51. Thus, both operant and classical conditioning modified the threshold level for activation of neuron B51, but in opposite directions, revealing key differences in the cellular mechanisms underlying these two forms of associative learning. ^ Next, the cellular mechanisms underlying operant conditioning were investigated in more detail using a single-cell analogue. The single-cell analogue successfully recapitulated the previous in vivo and in vitro operant conditioning results by increasing the input resistance and the excitability of B51. Both PKA and PKC were necessary for operant conditioning. Dopamine appears to be the transmitter mediating the reinforcement signal in this form of conditioning. A D1 dopamine receptor antibody revealed that the D1receptor localizes to the axon hillock, which is also the region that gives the strongest response when iontophoresing dopamine. ^ The studies presented herein, thus, provide for a greater understanding of the mechanisms underlying both of these forms of associative learning and demonstrate that they likely operate through distinct cellular mechanisms. ^

Contingency awareness in human aversive conditioning involves the middle frontal gyrus.

In contrast to the wealth of data describing the neural mechanisms underlying classical conditioning, we know remarkably little about the mechanisms involved in acquisition of explicit contingency awareness. Subjects variably acquire contingency awareness in classical conditioning paradigms, in which they are able to describe the temporal relationship between a conditioned cue and its outcome. Previous studies have implicated the hippocampus and prefrontal cortex in the acquisition of explicit knowledge, although their specific roles remain unclear. We used functional magnetic resonance imaging to track the trial-by-trial acquisition of explicit knowledge in a concurrent trace and delay conditioning paradigm. We show that activity in bilateral middle frontal gyrus and parahippocampal gyrus correlates with the accuracy of explicit contingency awareness on each trial. In contrast, amygdala activation correlates with conditioned responses indexed by skin conductance responses (SCRs). These results demonstrate that brain regions known to be involved in other aspects of learning and memory also play a specific role, reflecting on each trial the acquisition and representation of contingency awareness.

Frequency-adjustable positive sequence detector for power conditioning applications

This paper proposes a novel and simple positive sequence detector (PSD), which is inherently self-adjustable to fundamental frequency deviations by means of a software-based PLL (Phase Locked Loop). Since the proposed positive sequence detector is not based on Fortescue's classical decomposition and no special input filtering is needed, its dynamic response may be as fast as one fundamental cycle. The digital PLL ensures that the positive sequence components can be calculated even under distorted waveform conditions and fundamental frequency deviations. For the purpose of validating the proposed models, the positive sequence detector has been implemented in a PC-based Power Quality Monitor and experimental results illustrate its good performance. The PSD algorithm has also been evaluated in the control loop of a Series Active Filter and simulation results demonstrate its effectiveness in a closed-loop system. Moreover, considering single-phase applications, this paper also proposes a general single-phase PLL and a Fundamental Wave Detector (FWD) immune to frequency variations and waveform distortions. © 2005 IEEE.

Distance-based kriging relying on proxy simulations for inverse conditioning

Let us consider a large set of candidate parameter fields, such as hydraulic conductivity maps, on which we can run an accurate forward flow and transport simulation. We address the issue of rapidly identifying a subset of candidates whose response best match a reference response curve. In order to keep the number of calls to the accurate flow simulator computationally tractable, a recent distance-based approach relying on fast proxy simulations is revisited, and turned into a non-stationary kriging method where the covariance kernel is obtained by combining a classical kernel with the proxy. Once the accurate simulator has been run for an initial subset of parameter fields and a kriging metamodel has been inferred, the predictive distributions of misfits for the remaining parameter fields can be used as a guide to select candidate parameter fields in a sequential way. The proposed algorithm, Proxy-based Kriging for Sequential Inversion (ProKSI), relies on a variant of the Expected Improvement, a popular criterion for kriging-based global optimization. A statistical benchmark of ProKSI’s performances illustrates the efficiency and the robustness of the approach when using different kinds of proxies.

Enhancement of sensorimotor connections by conditioning-related stimulation in Aplysia depends upon postsynaptic Ca2+.

Classical conditioning of Aplysia's siphon-withdrawal reflex is thought to be due to a presynaptic mechanism-activity-dependent presynaptic facilitation of sensorimotor connections. Recent experiments with sensorimotor synapses in dissociated cell culture, however, provide an alternative cellular mechanism for classical conditioning-Hebbian long-term potentiation (LTP) of sensorimotor connections. Induction of Hebbian LTP of these connections is mediated by activation of N-methyl-D-aspartate-related receptors and requires the postsynaptic elevation of intracellular Ca2+. To determine whether the enhancement of sensorimotor synapses during classical conditioning in Aplysia-like LTP of sensorimotor synapses in culture-also depends upon the elevation of postsynaptic Ca2+, we carried out experiments involving the cellular analog of classical conditioning of siphon withdrawal. We examined changes in the strength of monosynaptic siphon sensorimotor connections in the abdominal ganglion of Aplysia following paired presentations of sensory neuron activation and tail nerve shock. This training regimen resulted in significant enhancement of the monosynaptic sensorimotor excitatory postsynaptic potential, as compared with the sensorimotor excitatory postsynaptic potential in preparations that received only test stimulation. Infusing the motor neuron with 1,2-bis(2-aminophenoxy)ethane-N,N-N',N'-tetraacetic acid, a specific chelator of intracellular Ca2+, prior to paired stimulation training blocked this synaptic enhancement. Our results implicate a postsynaptic, possibly Hebbian, mechanism in classical conditioning in Aplysia.

Functional anatomy of human eyeblink conditioning determined with regional cerebral glucose metabolism and positron-emission tomography.

Relative cerebral glucose metabolism was examined with positron-emission tomography (PET) as a measure of neuronal activation during performance of the classically conditioned eyeblink response in 12 young adult subjects. Each subject received three sessions: (i) a control session with PET scan in which unpaired presentations of the tone conditioned stimulus and corneal airpuff unconditioned stimulus were administered, (ii) a paired training session to allow associative learning to occur, and (iii) a paired test session with PET scan. Brain regions exhibiting learning-related activation were identified as those areas that showed significant differences in glucose metabolism between the unpaired control condition and well-trained state in the 9 subjects who met the learning criterion. Areas showing significant activation included bilateral sites in the inferior cerebellar cortex/deep nuclei, anterior cerebellar vermis, contralateral cerebellar cortex and pontine tegmentum, ipsilateral inferior thalamus/red nucleus, ipsilateral hippocampal formation, ipsilateral lateral temporal cortex, and bilateral ventral striatum. Among all subjects, including those who did not meet the learning criterion, metabolic changes in ipsilateral cerebellar nuclei, bilateral cerebellar cortex, anterior vermis, contralateral pontine tegmentum, ipsilateral hippocampal formation, and bilateral striatum correlated with degree of learning. The localization to cerebellum and its associated brainstem circuitry is consistent with neurobiological studies in the rabbit model of eyeblink classical conditioning and neuropsychological studies in brain-damaged humans. In addition, these data support a role for the hippocampus in conditioning and suggest that the ventral striatum may also be involved.

Market Structures in Air Conditioning Maintenance Activity

It is questionable whether activities like construction, including maintenance and repair, can be considered a single entity or industry - on the basis that different sectors of construction/maintenance use fundamentally distinct resource and skill bases. This creates a number of issues including the development of competition and reform policy. de Valance deployed the Structure-Conduct-Performance model (SCP) to delineate sectors of new/installation construction activity and, in doing so, proposes that there exists multiple market structures in a given project. The purpose of this paper is to apply the SCP model to a different sector of construction activity, that is air conditioning maintenance and test de Valance's proposition concerning the existence of multiple market structures in a supply chain but this time to a built facility. The research method combines secondary data concerning the "Structure" component of the SCP model and primary data with regard to the "Conduct" and "Performance" parts of the SCP model. The results provide further support (beyond de Valance's analysis of new/installation activity) that a sector system approach using the SCP model is a more effective way to analyse market structures in construction activity. This paper also supports de Valance's proposition concerning the existence of multiple market structures in a supply chain to a project/facility.