Vision-based representation and recognition of human activities in image sequences

Magdeburg, Univ., Fak. für Elektrotechnik und Informationstechnik, Diss., 2013

Representation of motor habit in a sequence of repetitive reach and grasp movements performed by macaque monkeys: evidence for a contribution of the dorsolateral prefrontal cortex.

In the context of an autologous cell transplantation study, a unilateral biopsy of cortical tissue was surgically performed from the right dorsolateral prefrontal cortex (dlPFC) in two intact adult macaque monkeys (dlPFC lesioned group), together with the implantation of a chronic chamber providing access to the left motor cortex. Three other monkeys were subjected to the same chronic chamber implantation, but without dlPFC biopsy (control group). All monkeys were initially trained to perform sequential manual dexterity tasks, requiring precision grip. The motor performance and the prehension's sequence (temporal order to grasp pellets from different spatial locations) were analysed for each hand. Following the surgery, transient and moderate deficits of manual dexterity per se occurred in both groups, indicating that they were not due to the dlPFC lesion (most likely related to the recording chamber implantation and/or general anaesthesia/medication). In contrast, changes of motor habit were observed for the sequential order of grasping in the two monkeys with dlPFC lesion only. The changes were more prominent in the monkey subjected to the largest lesion, supporting the notion of a specific effect of the dlPFC lesion on the motor habit of the monkeys. These observations are reminiscent of previous studies using conditional tasks with delay that have proposed a specialization of the dlPFC for visuo-spatial working memory, except that this is in a different context of "free-will", non-conditional manual dexterity task, without a component of working memory.

Hemispheric competence for auditory spatial representation.

Sound localization relies on the analysis of interaural time and intensity differences, as well as attenuation patterns by the outer ear. We investigated the relative contributions of interaural time and intensity difference cues to sound localization by testing 60 healthy subjects: 25 with focal left and 25 with focal right hemispheric brain damage. Group and single-case behavioural analyses, as well as anatomo-clinical correlations, confirmed that deficits were more frequent and much more severe after right than left hemispheric lesions and for the processing of interaural time than intensity difference cues. For spatial processing based on interaural time difference cues, different error types were evident in the individual data. Deficits in discriminating between neighbouring positions occurred in both hemispaces after focal right hemispheric brain damage, but were restricted to the contralesional hemispace after focal left hemispheric brain damage. Alloacusis (perceptual shifts across the midline) occurred only after focal right hemispheric brain damage and was associated with minor or severe deficits in position discrimination. During spatial processing based on interaural intensity cues, deficits were less severe in the right hemispheric brain damage than left hemispheric brain damage group and no alloacusis occurred. These results, matched to anatomical data, suggest the existence of a binaural sound localization system predominantly based on interaural time difference cues and primarily supported by the right hemisphere. More generally, our data suggest that two distinct mechanisms contribute to: (i) the precise computation of spatial coordinates allowing spatial comparison within the contralateral hemispace for the left hemisphere and the whole space for the right hemisphere; and (ii) the building up of global auditory spatial representations in right temporo-parietal cortices.

A numerical solver for a nonlinear Fokker-Planck equation representation of neuronal network dynamics

To describe the collective behavior of large ensembles of neurons in neuronal network, a kinetic theory description was developed in [13, 12], where a macroscopic representation of the network dynamics was directly derived from the microscopic dynamics of individual neurons, which are modeled by conductance-based, linear, integrate-and-fire point neurons. A diffusion approximation then led to a nonlinear Fokker-Planck equation for the probability density function of neuronal membrane potentials and synaptic conductances. In this work, we propose a deterministic numerical scheme for a Fokker-Planck model of an excitatory-only network. Our numerical solver allows us to obtain the time evolution of probability distribution functions, and thus, the evolution of all possible macroscopic quantities that are given by suitable moments of the probability density function. We show that this deterministic scheme is capable of capturing the bistability of stationary states observed in Monte Carlo simulations. Moreover, the transient behavior of the firing rates computed from the Fokker-Planck equation is analyzed in this bistable situation, where a bifurcation scenario, of asynchronous convergence towards stationary states, periodic synchronous solutions or damped oscillatory convergence towards stationary states, can be uncovered by increasing the strength of the excitatory coupling. Finally, the computation of moments of the probability distribution allows us to validate the applicability of a moment closure assumption used in [13] to further simplify the kinetic theory.

Semi-supervised segmentation of ultrasound images based on patch representation and continuous min cut.

Ultrasound segmentation is a challenging problem due to the inherent speckle and some artifacts like shadows, attenuation and signal dropout. Existing methods need to include strong priors like shape priors or analytical intensity models to succeed in the segmentation. However, such priors tend to limit these methods to a specific target or imaging settings, and they are not always applicable to pathological cases. This work introduces a semi-supervised segmentation framework for ultrasound imaging that alleviates the limitation of fully automatic segmentation, that is, it is applicable to any kind of target and imaging settings. Our methodology uses a graph of image patches to represent the ultrasound image and user-assisted initialization with labels, which acts as soft priors. The segmentation problem is formulated as a continuous minimum cut problem and solved with an efficient optimization algorithm. We validate our segmentation framework on clinical ultrasound imaging (prostate, fetus, and tumors of the liver and eye). We obtain high similarity agreement with the ground truth provided by medical expert delineations in all applications (94% DICE values in average) and the proposed algorithm performs favorably with the literature.

Application of a roughness-length representation to parameterize energy loss in 3-D numerical simulations of large rivers

Recent technological advances in remote sensing have enabled investigation of the morphodynamics and hydrodynamics of large rivers. However, measuring topography and flow in these very large rivers is time consuming and thus often constrains the spatial resolution and reach-length scales that can be monitored. Similar constraints exist for computational fluid dynamics (CFD) studies of large rivers, requiring maximization of mesh-or grid-cell dimensions and implying a reduction in the representation of bedform-roughness elements that are of the order of a model grid cell or less, even if they are represented in available topographic data. These ``subgrid'' elements must be parameterized, and this paper applies and considers the impact of roughness-length treatments that include the effect of bed roughness due to ``unmeasured'' topography. CFD predictions were found to be sensitive to the roughness-length specification. Model optimization was based on acoustic Doppler current profiler measurements and estimates of the water surface slope for a variety of roughness lengths. This proved difficult as the metrics used to assess optimal model performance diverged due to the effects of large bedforms that are not well parameterized in roughness-length treatments. However, the general spatial flow patterns are effectively predicted by the model. Changes in roughness length were shown to have a major impact upon flow routing at the channel scale. The results also indicate an absence of secondary flow circulation cells in the reached studied, and suggest simpler two-dimensional models may have great utility in the investigation of flow within large rivers. Citation: Sandbach, S. D. et al. (2012), Application of a roughness-length representation to parameterize energy loss in 3-D numerical simulations of large rivers, Water Resour. Res., 48, W12501, doi: 10.1029/2011WR011284.

Visual representation of food in the brain : effects of repeated exposure and gut hormone secretion

The thesis at hand is concerned with the spatio-temporal brain mechanisms of visual food perception as investigated by electrical neuroimaging. Due to the increasing prevalence of obesity and its associated challenges for public health care, there is a need to better understand behavioral and brain processes underlying food perception and food-based decision-making. The first study (Study A) of this thesis was concerned with the role of repeated exposure to visual food cues. In our everyday lives we constantly and repeatedly encounter food and these exposures influence our food choices and preferences. In Study A, we therefore applied electrical neuroimaging analyses of visual evoked potentials to investigate the spatio-temporal brain dynamics linked to the repeated viewing of high- and low-energy food cues (published manuscript: "The role of energetic value in dynamic brain response adaptation during repeated food image viewing" (Lietti et al., 2012)). In this study, we found that repetitions differentially affect behavioral and brain mechanisms when high-energy, as opposed to low-energy foods and non-food control objects, were viewed. The representation of high-energy food remained invariant between initial and repeated exposures indicating that the sight of high-energy dense food induces less behavioral and neural adaptation than the sight of low-energy food and non-food control objects. We discuss this finding in the context of the higher salience (due to greater motivation and higher reward or hedonic valuation) of energy- dense food that likely generates a more mnemonically stable representation. In turn, this more invariant representation of energy-dense food is supposed to (partially) explain why these foods are over-consumed despite of detrimental health consequences. In Study Β we investigated food responsiveness in patients who had undergone Roux-en-Y gastric bypass surgery to overcome excessive obesity. This type of gastric bypass surgery is not only known to alter food appreciation, but also the secretion patterns of adipokines and gut peptides. Study Β aimed at a comprehensive and interdisciplinary investigation of differences along the gut-brain axis in bypass-operated patients as opposed to weight-matched non-operated controls. On the one hand, the spatio-temporal brain dynamics to the visual perception of high- vs. low-energy foods under differing states of motivation towards food intake (i.e. pre- and post-prandial) were assessed and compared between groups. On the other hand, peripheral gut hormone measures were taken in pre- and post-prandial nutrition state and compared between groups. In order to evaluate alterations in the responsiveness along the gut-brain-axis related to gastric bypass surgery, correlations between both measures were compared between both participant groups. The results revealed that Roux-en- Y gastric bypass surgery alters the spatio-temporal brain dynamics to the perception of high- and low-energy food cues, as well as the responsiveness along the gut-brain-axis. The potential role of these response alterations is discussed in relation to previously observed changes in physiological factors and food intake behavior post-Roux-en-Y gastric bypass surgery. By doing so, we highlight potential behavioral, neural and endocrine (i.e. gut hormone) targets for the future development of intervention strategies for deviant eating behavior and obesity. Together, the studies showed that the visual representation of foods in the brain is plastic and that modulations in neural activity are already noted at early stages of visual processing. Different factors of influence such as a repeated exposure, Roux-en-Y gastric bypass surgery, motivation (nutrition state), as well as the energy density of the visually perceived food were identified. En raison de la prévalence croissante de l'obésité et du défi que cela représente en matière de santé publique, une meilleure compréhension des processus comportementaux et cérébraux liés à la nourriture sont nécessaires. En particulier, cette thèse se concentre sur l'investigation des mécanismes cérébraux spatio-temporels liés à la perception visuelle de la nourriture. Nous sommes quotidiennement et répétitivement exposés à des images de nourriture. Ces expositions répétées influencent nos choix, ainsi que nos préférences alimentaires. La première étude (Study A) de cette thèse investigue donc l'impact de ces exposition répétée à des stimuli visuels de nourriture. En particulier, nous avons comparé la dynamique spatio-temporelle de l'activité cérébrale induite par une exposition répétée à des images de nourriture de haute densité et de basse densité énergétique. (Manuscrit publié: "The role of energetic value in dynamic brain response adaptation during repeated food image viewing" (Lietti et al., 2012)). Dans cette étude, nous avons pu constater qu'une exposition répétée à des images représentant de la nourriture de haute densité énergétique, par opposition à de la nourriture de basse densité énergétique, affecte les mécanismes comportementaux et cérébraux de manière différente. En particulier, la représentation neurale des images de nourriture de haute densité énergétique est similaire lors de l'exposition initiale que lors de l'exposition répétée. Ceci indique que la perception d'images de nourriture de haute densité énergétique induit des adaptations comportementales et neurales de moindre ampleur par rapport à la perception d'images de nourriture de basse densité énergétique ou à la perception d'une « catégorie contrôle » d'objets qui ne sont pas de la nourriture. Notre discussion est orientée sur les notions prépondérantes de récompense et de motivation qui sont associées à la nourriture de haute densité énergétique. Nous suggérons que la nourriture de haute densité énergétique génère une représentation mémorielle plus stable et que ce mécanisme pourrait (partiellement) être sous-jacent au fait que la nourriture de haute densité énergétique soit préférentiellement consommée. Dans la deuxième étude (Study Β) menée au cours de cette thèse, nous nous sommes intéressés aux mécanismes de perception de la nourriture chez des patients ayant subi un bypass gastrique Roux- en-Y, afin de réussir à perdre du poids et améliorer leur santé. Ce type de chirurgie est connu pour altérer la perception de la nourriture et le comportement alimentaire, mais également la sécrétion d'adipokines et de peptides gastriques. Dans une approche interdisciplinaire et globale, cette deuxième étude investigue donc les différences entre les patients opérés et des individus « contrôles » de poids similaire au niveau des interactions entre leur activité cérébrale et les mesures de leurs hormones gastriques. D'un côté, nous avons investigué la dynamique spatio-temporelle cérébrale de la perception visuelle de nourriture de haute et de basse densité énergétique dans deux états physiologiques différent (pre- et post-prandial). Et de l'autre, nous avons également investigué les mesures physiologiques des hormones gastriques. Ensuite, afin d'évaluer les altérations liées à l'intervention chirurgicale au niveau des interactions entre la réponse cérébrale et la sécrétion d'hormone, des corrélations entre ces deux mesures ont été comparées entre les deux groupes. Les résultats révèlent que l'intervention chirurgicale du bypass gastrique Roux-en-Y altère la dynamique spatio-temporelle de la perception visuelle de la nourriture de haute et de basse densité énergétique, ainsi que les interactions entre cette dernière et les mesures périphériques des hormones gastriques. Nous discutons le rôle potentiel de ces altérations en relation avec les modulations des facteurs physiologiques et les changements du comportement alimentaire préalablement déjà démontrés. De cette manière, nous identifions des cibles potentielles pour le développement de stratégies d'intervention future, au niveau comportemental, cérébral et endocrinien (hormones gastriques) en ce qui concerne les déviances du comportement alimentaire, dont l'obésité. Nos deux études réunies démontrent que la représentation visuelle de la nourriture dans le cerveau est plastique et que des modulations de l'activité neurale apparaissent déjà à un stade très précoce des mécanismes de perception visuelle. Différents facteurs d'influence comme une exposition repetee, le bypass gastrique Roux-en-Y, la motivation (état nutritionnel), ainsi que la densité énergétique de la nourriture qui est perçue ont pu être identifiés.

COAC "To Protect and to Serve" the separate representation of children in private law proceedings (PDF 379 KB)

Children Order Advisory Committee discussion paper on separate representation of children in private law proceedings

Reduction of the hand representation in the ipsilateral primary motor cortex following unilateral section of the corticospinal tract at cervical level in monkeys.

BACKGROUND: After sub-total hemi-section of cervical cord at level C7/C8 in monkeys, the ipsilesional hand exhibited a paralysis for a couple of weeks, followed by incomplete recovery of manual dexterity, reaching a plateau after 40-50 days. Recently, we demonstrated that the level of the plateau was related to the size of the lesion and that progressive plastic changes of the motor map in the contralesional motor cortex, particularly the hand representation, took place following a comparable time course. The goal of the present study was to assess, in three macaque monkeys, whether the hand representation in the ipsilesional primary motor cortex (M1) was also affected by the cervical hemi-section.¦RESULTS: Unexpectedly, based on the minor contribution of the ipsilesional hemisphere to the transected corticospinal (CS) tract, a considerable reduction of the hand representation was also observed in the ipsilesional M1. Mapping control experiments ruled out the possibility that changes of motor maps are due to variability of the intracortical microstimulation mapping technique. The extent of the size reduction of the hand area was nearly as large as in the contralesional hemisphere in two of the three monkeys. In the third monkey, it represented a reduction by a factor of half the change observed in the contralesional hemisphere. Although the hand representation was modified in the ipsilesional hemisphere, such changes were not correlated with a contribution of this hemisphere to the incomplete recovery of the manual dexterity for the hand affected by the lesion, as demonstrated by reversible inactivation experiments (in contrast to the contralesional hemisphere). Moreover, despite the size reduction of M1 hand area in the ipsilesional hemisphere, no deficit of manual dexterity for the hand opposite to the cervical hemi-section was detected.¦CONCLUSION: After cervical hemi-section, the ipsilesional motor cortex exhibited substantial reduction of the hand representation, whose extent did not match the small number of axotomized CS neurons. We hypothesized that the paradoxical reduction of hand representation in the ipsilesional hemisphere is secondary to the changes taking place in the contralesional hemisphere, possibly corresponding to postural adjustments and/or re-establishing a balance between the two hemispheres.

Bats of Borneo: diversity, distributions and representation in protected areas

Protected areas are valuable in conserving tropical biodiversity, but an insufficient understanding of species diversity and distributions makes it difficult to evaluate their effectiveness. This is especially true on Borneo, a species rich island shared by three countries, and is particularly concerning for bats, a poorly known component of mammal diversity that may be highly susceptible to landscape changes. We reviewed the diversity, distributions and conservation status of 54 bat species to determine the representation of these taxa in Borneo's protected areas, and whether these reserves complement each other in terms of bat diversity. Lower and upper bound estimates of bat species composition were characterised in 23 protected areas and the proposed boundaries of the Heart of Borneo conservation area. We used lower and upper bound estimates of species composition. By using actual inventories, species representation was highly irregular, and even if some reserves were included in the Heart of Borneo, the protected area network would still exhibit low complementarity. By inferring species presence from distributions, composition between most reserves was similar, and complementarity was much higher. Predicting species richness using abundance information suggested that bat species representation in reserves may lie between these two extremes. We recommend that researchers better sample biodiversity over the island and address the conservation threats faced in Borneo both within and outside protected areas. While the Heart of Borneo Initiative is commendable, it should not divert attention from other conservation areas.

The Strength of Promissory Representation : What Makes MPs Change their Positions ?

The paper analyses the positional congruence between pre-election statements in the Swiss voting assistance application "smartvote" and post-election behaviour in the Swiss lower house between 2003 and 2009. For this purpose, we selected 34 smartvote questions which subsequently came up in parliament. Unlike previous studies which assessed the program-to-policy linkage of governments or party groups the paper examines the question at the level of individual MPs which seems appropriate for political systems which follow the idea of power dispersion. While the average rate of political congruence is at some 85 percent, a multivariate analysis detects the underlying factors which push or curb a candidate's propensity to change his or her mind once elections are over. The results show that positional changes are more likely if (1) MPs are freshmen, (2) individual voting behaviour is invisible to the public, (3) the vote is not about a party's core issue, (4) the MP belongs to a party which is located in the political centre, and (5) if the pre-election statement is in disagreement with the majority position of the legislative party group. The last-mentioned factor is paramount: the farer away a candidate's pre-election profile from his or her party is located, the weaker turns out to be the electoral link of promissory representation.

Prismatic adaptation changes visuospatial representation in the inferior parietal lobule.

Prismatic adaptation has been shown to induce a realignment of visuoproprioceptive representations and to involve parietocerebellar networks. We have investigated in humans how far other types of functions known to involve the parietal cortex are influenced by a brief exposure to prismatic adaptation. Normal subjects underwent an fMRI evaluation before and after a brief session of prismatic adaptation using rightward deviating prisms for one group or after an equivalent session using plain glasses for the other group. Activation patterns to three tasks were analyzed: (1) visual detection; (2) visuospatial short-term memory; and (3) verbal short-term memory. The prismatic adaptation-related changes were found bilaterally in the inferior parietal lobule when prisms, but not plain glasses, were used. This effect was driven by selective changes during the visual detection task: an increase in neural activity was induced on the left and a decrease on the right parietal side after prismatic adaptation. Comparison of activation patterns after prismatic adaptation on the visual detection task demonstrated a significant increase of the ipsilateral field representation in the left inferior parietal lobule and a significant decrease in the right inferior parietal lobule. In conclusion, a brief exposure to prismatic adaptation modulates differently left and right parietal activation during visual detection but not during short-term memory. Furthermore, the visuospatial representation within the inferior parietal lobule changes, with a decrease of the ipsilateral hemifield representation on the right and increase on the left side, suggesting thus a left hemispheric dominance.