Dopaminergic and Non-Dopaminergic Value Systems in Conditioning and Outcome-Specific Revaluation

Animals are motivated to choose environmental options that can best satisfy current needs. To explain such choices, this paper introduces the MOTIVATOR (Matching Objects To Internal Values Triggers Option Revaluations) neural model. MOTIVATOR describes cognitiveemotional interactions between higher-order sensory cortices and an evaluative neuraxis composed of the hypothalamus, amygdala, and orbitofrontal cortex. Given a conditioned stimulus (CS), the model amygdala and lateral hypothalamus interact to calculate the expected current value of the subjective outcome that the CS predicts, constrained by the current state of deprivation or satiation. The amygdala relays the expected value information to orbitofrontal cells that receive inputs from anterior inferotemporal cells, and medial orbitofrontal cells that receive inputs from rhinal cortex. The activations of these orbitofrontal cells code the subjective values of objects. These values guide behavioral choices. The model basal ganglia detect errors in CS-specific predictions of the value and timing of rewards. Excitatory inputs from the pedunculopontine nucleus interact with timed inhibitory inputs from model striosomes in the ventral striatum to regulate dopamine burst and dip responses from cells in the substantia nigra pars compacta and ventral tegmental area. Learning in cortical and striatal regions is strongly modulated by dopamine. The model is used to address tasks that examine food-specific satiety, Pavlovian conditioning, reinforcer devaluation, and simultaneous visual discrimination. Model simulations successfully reproduce discharge dynamics of known cell types, including signals that predict saccadic reaction times and CS-dependent changes in systolic blood pressure.

Localization in systems of non-identical oscillators

A singular perturbation method is applied to a non-conservative system of two weakly coupled strongly nonlinear non-identical oscillators. For certain parameters, localized solutions exist for which the amplitude of one oscillator is an order of magnitude smaller than the other. It is shown that these solutions are described by coupled equations for the phase difference and scaled amplitudes. Three types of localized solutions are obtained as solutions to these equations which correspond to phase locking, phase drift, and phase entrainment. Quantitative results for the phases and amplitudes of the oscillators and the stability of these phenomena are expressed in terms of the parameters of the model.

Plankton indicators and ocean observing systems: support to the marine ecosystem state assessment

Ecological indicators are used extensively as tools to manage environmental resources. In the oceans, indicators of plankton can be measured using a variety of observing systems including: mooring stations, ships, autonomous floats and ocean colour remote sensing. Given the broad range of temporal and spatial sampling resolutions of these different observing systems, as well as discrepancies in measurements obtained from different sensors, the estimation and interpretation of plankton indicators can present significant challenges. To provide support to the assessment of the state of the marine ecosystem, we propose a suite of plankton indicators and subsequently classify them in an ecological framework that characterizes key attributes of the ecosystem. We present two case studies dealing with plankton indicators of biomass, size structure and phenology, estimated using the most spatially extensive and longest in situ and remote-sensing observations. Discussion of these studies illustrates how some of the challenges in estimating and interpreting plankton indicators may be addressed by using for example relative measurement thresholds, interpolation procedures and delineation of biogeochemical provinces. We demonstrate that one of the benefits attained, when analyzing a suite of plankton indicators classified in an ecological framework, is the elucidation of non-trivial changes in composition, structure and functioning of the marine ecosystem.

Stability of 5-aminolevulinic acid in novel non-aqueous gel and patch-type systems intended for topical application.

Aminolevulinic acid (ALA) stability within topical formulations intended for photodynamic therapy (PDT) is poor due to dimerisation to pyrazine-2,5-dipropionic acid (PY). Most strategies to improve stability use low pH vehicles, which can cause cutaneous irritancy. To overcome this problem, a novel approach is investigated that uses a non-aqueous vehicle to retard proton-induced charge separation across the 4-carbonyl group on ALA and lessen nucleophilic attack that leads to condensation dimerisation. Bioadhesive anhydrous vehicles based on methylvinylether-maleic anhydride copolymer patches and poly(ethyleneglycol) or glycerol thickened poly(acrylic acid) gels were formulated. ALA stability fell below pharmaceutically acceptable levels after 6 months, with bioadhesive patches stored at 5°C demonstrating the best stability by maintaining 86.2% of their original loading. Glycerol-based gels maintained 40.2% in similar conditions. However, ALA loss did not correspond to expected increases in PY, indicating the presence of another degradative process that prevented dimerisation. Nuclear magnetic resonance (NMR) analysis was inconclusive in respect of the mechanism observed in the patch system, but showed clearly that an esterification reaction involving ALA and both glycerol and poly(ethyleneglycol) was occurring. This was especially marked in the glycerol gels, where only 2.21% of the total expected PY was detected after 204 days at 5°C. Non-specific esterase hydrolysis demonstrated that ALA was recoverable from the gel systems, further supporting esterified binding within the gel matrices. It is conceivable that skin esterases could duplicate this finding upon topical application of the gel and convert these derivatives back to ALA in situ, provided skin penetration is not affected adversely.

Sequentially continuous non-linear fundamental systems of solutions of affine equations in locally convex spaces

According to the Mickael's selection theorem any surjective continuous linear operator from one Fr\'echet space onto another has a continuous (not necessarily linear) right inverse. Using this theorem Herzog and Lemmert proved that if $E$ is a Fr\'echet space and $T:E\to E$ is a continuous linear operator such that the Cauchy problem $\dot x=Tx$, $x(0)=x_0$ is solvable in $[0,1]$ for any $x_0\in E$, then for any $f\in C([0,1],E)$, there exists a continuos map $S:[0,1]\times E\to E$, $(t,x)\mapsto S_tx$ such that for any $x_0\in E$, the function $x(t)=S_tx_0$ is a solution of the Cauchy problem $\dot x(t)=Tx(t)+f(t)$, $x(0)=x_0$ (they call $S$ a fundamental system of solutions of the equation $\dot x=Tx+f$). We prove the same theorem, replacing "continuous" by "sequentially continuous" for locally convex spaces from a class which contains strict inductive limits of Fr\'echet spaces and strong duals of Fr\'echet--Schwarz spaces and is closed with respect to finite products and sequentially closed subspaces. The key-point of the proof is an extension of the theorem on existence of a sequentially continuous right inverse of any surjective sequentially continuous linear operator to some class of non-metrizable locally convex spaces.

Building Autonomous Sensitive Artificial Listeners

This paper describes a substantial effort to build a real-time interactive multimodal dialogue system with a focus on emotional and non-verbal interaction capabilities. The work is motivated by the aim to provide technology with competences in perceiving and producing the emotional and non-verbal behaviours required to sustain a conversational dialogue. We present the Sensitive Artificial Listener (SAL) scenario as a setting which seems particularly suited for the study of emotional and non- verbal behaviour, since it requires only very limited verbal understanding on the part of the machine. This scenario allows us to concentrate on non-verbal capabilities without having to address at the same time the challenges of spoken language understanding, task modeling etc. We first report on three prototype versions of the SAL scenario, in which the behaviour of the Sensitive Artificial Listener characters was determined by a human operator. These prototypes served the purpose of verifying the effectiveness of the SAL scenario and allowed us to collect data required for building system components for analysing and synthesising the respective behaviours. We then describe the fully autonomous integrated real-time system we created, which combines incremental analysis of user behaviour, dialogue management, and synthesis of speaker and listener behaviour of a SAL character displayed as a virtual agent. We discuss principles that should underlie the evaluation of SAL-type systems. Since the system is designed for modularity and reuse, and since it is publicly available, the SAL system has potential as a joint research tool in the affective computing research community.

Voltage Sensing Using an Asynchronous Charge-to-Digital Converter for Energy-Autonomous Environments

In future systems with relatively unreliable and unpredictable energy sources such as harvesters, the system power supply may become non-deterministic. For energy effective operations, Vdd is an important parameter in any meaningful system control mechanism. Reliable and accurate on-chip voltage sensors are therefore indispensible for the power and computation management of such systems. Existing voltage sensing methods are not suitable because they usually require a stable and known reference (voltage, current, time, frequency, etc.), which is difficult to obtain in this environment. This paper describes an autonomous reference-free voltage sensor designed using an asynchronous counter powered by the charge on a capacitor and a small controller. Unlike existing methods, the voltage information is directly generated as a digital code. The sensor, fabricated in the 180 nm technology node, was tested successfully through performing measurements over the voltage range from 1.8 V down to 0.8 V.

Enhancing non-classicality in mechanical systems

We study the effects of post-selection measurements on both the non-classicality of the state of a mechanical oscillator and the entanglement between two mechanical systems that are part of a distributed optomechanical network. We address the cases of both Gaussian and non-Gaussian measurements, identifying in which cases simple photon counting and Geiger-like measurements are effective in distilling a strongly non-classical mechanical state and enhancing the purely mechanical entanglement between two elements of the network.