Action and perception: Neural indices of learning in infants

Early human development offers a unique perspective in investigating the potential cognitive and social implications of action and perception. Specifically, during infancy, action production and action perception undergo foundational developments. One essential component to examine developments in action processing is the analysis of others’ actions as meaningful and goal-directed. Little research, however, has examined the underlying neural systems that may be associated with emerging action and perception abilities, and infants’ learning of goal-directed actions. The current study examines the mu rhythm—a brain oscillation found in the electroencephalogram (EEG)—that has been associated with action and perception. Specifically, the present work investigates whether the mu signal is related to 9-month-olds’ learning of a novel goal-directed means-end task. The findings of this study demonstrate a relation between variations in mu rhythm activity and infants’ ability to learn a novel goal-directed means-end action task (compared to a visual pattern learning task used as a comparison task). Additionally, we examined the relations between standardized assessments of early motor competence, infants’ ability to learn a novel goal-directed task, and mu rhythm activity. We found that: 1a) mu rhythm activity during observation of a grasp uniquely predicted infants’ learning on the cane training task, 1b) mu rhythm activity during observation and execution of a grasp did not uniquely predict infants’ learning on the visual pattern learning task (comparison learning task), 2) infants’ motor competence did not predict infants’ learning on the cane training task, 3) mu rhythm activity during observation and execution was not related to infants’ measure of motor competence, and 4) mu rhythm activity did not predict infants’ learning on the cane task above and beyond infants’ motor competence. The results from this study demonstrate that mu rhythm activity is a sensitive measure to detect individual differences in infants’ action and perception abilities, specifically their learning of a novel goal-directed action.

Visual Insight in Geometry

According to a traditional rationalist proposal, it is possible to attain knowledge of certain necessary truths by means of insight—an epistemic mental act that combines the 'presentational' character of perception with the a priori status usually reserved for discursive reasoning. In this dissertation, I defend the insight proposal in relation to a specific subject matter: elementary Euclidean plane geometry, as set out in Book I of Euclid's Elements. In particular, I argue that visualizations and visual experiences of diagrams allow human subjects to grasp truths of geometry by means of visual insight. In the first two chapters, I provide an initial defense of the geometrical insight proposal, drawing on a novel interpretation of Plato's Meno to motivate the view and to reply to some objections. In the remaining three chapters, I provide an account of the psychological underpinnings of geometrical insight, a task that requires considering the psychology of visual imagery alongside the details of Euclid's geometrical system. One important challenge is to explain how basic features of human visual representations can serve to ground our intuitive grasp of Euclid's postulates and other initial assumptions. A second challenge is to explain how we are able to grasp general theorems by considering diagrams that depict only special cases. I argue that both of these challenges can be met by an account that regards geometrical insight as based in visual experiences involving the combined deployment of two varieties of 'dynamic' visual imagery: one that allows the subject to visually rehearse spatial transformations of a figure's parts, and another that allows the subject to entertain alternative ways of structurally integrating the figure as a whole. It is the interplay between these two forms of dynamic imagery that enables a visual experience of a diagram, suitably animated in visual imagination, to justify belief in the propositions of Euclid’s geometry. The upshot is a novel dynamic imagery account that explains how intuitive knowledge of elementary Euclidean plane geometry can be understood as grounded in visual insight.

Iluminação emocional, percepção visual e bem-estar

Dissertação de Mestrado para obtenção do grau de Mestre em Design de Produto, apresentada na Universidade de Lisboa - Faculdade de Arquitectura.

Ampliação de movimentos na dança circular com pessoas com deficiência visual

This paper aims at studying how circular dance can afford to sight-disabled peoples movement and how they can learn to cope with the deep movement of relation, consciousness, appropriation and communion with the world. Inside circular dance, a cosmic metaphor, is inscribed the movement of the world, which tells and changes amorously the human history. In the works of Paulo Freire and Maurice Merleau-Ponty one can find the necessary support to discuss, as long as possible, movement and existence. Research-action is used as a methodological approach whose empirical center is placed on the Institute of Education and Rehabilitation of Blind, in Natal, which shelters eight sightdisabled adults. The research s data reveal that the practice of circular dance concurs to enlarge the movement of the research s subjects, to develop a more accurate perception of their selves and of their own capacities, as well as improve the relations Me/Others, Me/World, which require a context of differences. The study has revealed that the practice of dance develops a better perception of the limits and surpasses as a human condition and, in consequence, the discovery of one s own body and the other s body as a resource of lessons and representations of the self and of the world. It lets out the development of a new way of thinking and coping with discrimination surrounding the disabled persons. In movement, in circular dance, the barrier between sight disablement and vision loses force.

Dynamic Image Precompensation for Improving Visual Performance of Computer Users with Ocular Aberrations

With the progress of computer technology, computers are expected to be more intelligent in the interaction with humans, presenting information according to the user's psychological and physiological characteristics. However, computer users with visual problems may encounter difficulties on the perception of icons, menus, and other graphical information displayed on the screen, limiting the efficiency of their interaction with computers. In this dissertation, a personalized and dynamic image precompensation method was developed to improve the visual performance of the computer users with ocular aberrations. The precompensation was applied on the graphical targets before presenting them on the screen, aiming to counteract the visual blurring caused by the ocular aberration of the user's eye. A complete and systematic modeling approach to describe the retinal image formation of the computer user was presented, taking advantage of modeling tools, such as Zernike polynomials, wavefront aberration, Point Spread Function and Modulation Transfer Function. The ocular aberration of the computer user was originally measured by a wavefront aberrometer, as a reference for the precompensation model. The dynamic precompensation was generated based on the resized aberration, with the real-time pupil diameter monitored. The potential visual benefit of the dynamic precompensation method was explored through software simulation, with the aberration data from a real human subject. An "artificial eye'' experiment was conducted by simulating the human eye with a high-definition camera, providing objective evaluation to the image quality after precompensation. In addition, an empirical evaluation with 20 human participants was also designed and implemented, involving image recognition tests performed under a more realistic viewing environment of computer use. The statistical analysis results of the empirical experiment confirmed the effectiveness of the dynamic precompensation method, by showing significant improvement on the recognition accuracy. The merit and necessity of the dynamic precompensation were also substantiated by comparing it with the static precompensation. The visual benefit of the dynamic precompensation was further confirmed by the subjective assessments collected from the evaluation participants.

Visual outcomes after bilateral trifocal diffractive intraocular lens implantation

Background In recent years new models of intraocular lenses are appearing on the market to reduce requirements for additional optical correction. The purpose of this study is to assess visual outcomes following bilateral cataract surgery and the implant of a FineVision® trifocal intraocular lens (IOL). Methods Prospective, nonrandomized, observational study. Vision was assessed in 44 eyes of 22 patients (mean age 68.4 ± 5.5 years) before and 3 months after surgery. Aberrations were determined using the Topcon KR-1 W wave-front analyzer. LogMAR visual acuity was measured at distance (corrected distance visual acuity, CDVA 4 m), intermediate (distance corrected intermediate visual acuity, DCIVA 60 cm) and near (distance corrected near visual acuity, DCNVA 40 cm). The Pelli-Robson letter chart and the CSV-1000 test were used to estimate contrast sensitivity (CS). Defocus curve testing was performed in photopic and mesopic conditions. Adverse photic phenomena were assessed using the Halo v1.0 program. Results Mean aberration values for a mesopic pupil diameter were: total HOA RMS: 0.41 ± 0.30 μm, coma: 0.32 ± 0.22 μm and spherical aberration: 0.21 ± 0.20 μm. Binocular logMAR measurements were: CDVA −0.05 ± 0.05, DCIVA 0.15 ± 0.10, and DCNVA 0.06 ± 0.10. Mean Pelli-Robson CS was 1.40 ± 0.14 log units. Mean CSV100 CS for the 4 frequencies examined (A: 3 cycles/degree (cpd), B: 6 cpd, C: 12 cpd, D: 18 cpd) were 1.64 ± 0.14, 1.77 ± 0.18, 1.44 ± 0.24 and 0.98 ± 0.24 log units, respectively. Significant differences were observed in defocus curves for photopic and mesopic conditions (p < 0.0001). A mean disturbance index of 0.28 ± 0.22 was obtained. Conclusions Bilateral FineVision IOL implant achieved a full range of adequate vision, satisfactory contrast sensitivity, and a lack of significant adverse photic phenomena. Trial registration Eudract Clinical Trials Registry Number: 2014-003266-2.

Audio-Visual Information Processing across different age groups

People possess different sensory modalities to detect, interpret, and efficiently act upon various events in a complex and dynamic environment (Fetsch, DeAngelis, & Angelaki, 2013). Much empirical work has been done to understand the interplay of modalities (e.g. audio-visual interactions, see Calvert, Spence, & Stein, 2004). On the one hand, integration of multimodal input as a functional principle of the brain enables the versatile and coherent perception of the environment (Lewkowicz & Ghazanfar, 2009). On the other hand, sensory integration does not necessarily mean that input from modalities is always weighted equally (Ernst, 2008). Rather, when two or more modalities are stimulated concurrently, one often finds one modality dominating over another. Study 1 and 2 of the dissertation addressed the developmental trajectory of sensory dominance. In both studies, 6-year-olds, 9-year-olds, and adults were tested in order to examine sensory (audio-visual) dominance across different age groups. In Study 3, sensory dominance was put into an applied context by examining verbal and visual overshadowing effects among 4- to 6-year olds performing a face recognition task. The results of Study 1 and Study 2 support default auditory dominance in young children as proposed by Napolitano and Sloutsky (2004) that persists up to 6 years of age. For 9-year-olds, results on privileged modality processing were inconsistent. Whereas visual dominance was revealed in Study 1, privileged auditory processing was revealed in Study 2. Among adults, a visual dominance was observed in Study 1, which has also been demonstrated in preceding studies (see Spence, Parise, & Chen, 2012). No sensory dominance was revealed in Study 2 for adults. Potential explanations are discussed. Study 3 referred to verbal and visual overshadowing effects in 4- to 6-year-olds. The aim was to examine whether verbalization (i.e., verbally describing a previously seen face), or visualization (i.e., drawing the seen face) might affect later face recognition. No effect of visualization on recognition accuracy was revealed. As opposed to a verbal overshadowing effect, a verbal facilitation effect occurred. Moreover, verbal intelligence was a significant predictor for recognition accuracy in the verbalization group but not in the control group. This suggests that strengthening verbal intelligence in children can pay off in non-verbal domains as well, which might have educational implications.

A qualitative impairment in face perception in Alzheimer’s disease : evidence from a reduced face inversion effect

Prevalent face recognition difficulties in Alzheimer’s disease (AD) have typically been attributed to the underlying episodic and semantic memory impairment. The aim of the current study was to determine if AD patients are also impaired at the perceptual level for faces, more specifically at extracting a visual representation of an individual face. To address this question, we investigated the matching of simultaneously presented individual faces and of other nonface familiar shapes (cars), at both upright and inverted orientation, in a group of mild AD patients and in a group of healthy older controls matched for age and education. AD patients showed a reduced inversion effect (i.e., larger performance for upright than inverted stimuli) for faces, but not for cars, both in terms of error rates and response times. While healthy participants showed a much larger decrease in performance for faces than for cars with inversion, the inversion effect did not differ significantly for faces and cars in AD. This abnormal inversion effect for faces was observed in a large subset of individual patients with AD. These results suggest that AD patients have deficits in higher-level visual processes, more specifically at perceiving individual faces, a function that relies on holistic representations specific to upright face stimuli. These deficits, combined with their memory impairment, may contribute to the difficulties in recognizing familiar people that are often reported in patients suffering from the disease and by their caregivers.

Compétences en littératie visuelle chez les étudiantEs en biologie au niveau collégial: bilan des apprentissages selon des activités digitales ou des activités de dessins à la main

This study examines the role of visual literacy in learning biology. Biology teachers promote the use of digital images as a learning tool for two reasons: because biology is the most visual of the sciences, and the use of imagery is becoming increasingly important with the advent of bioinformatics; and because studies indicate that this current generation of teenagers have a cognitive structure that is formed through exposure to digital media. On the other hand, there is concern that students are not being exposed enough to the traditional methods of processing biological information - thought to encourage left-brain sequential thinking patterns. Theories of Embodied Cognition point to the importance of hand-drawing for proper assimilation of knowledge, and theories of Multiple Intelligences suggest that some students may learn more easily using traditional pedagogical tools. To test the claim that digital learning tools enhance the acquisition of visual literacy in this generation of biology students, a learning intervention was carried out with 33 students enrolled in an introductory college biology course. The study compared learning outcomes following two types of learning tools. One learning tool was a traditional drawing activity, and the other was an interactive digital activity carried out on a computer. The sample was divided into two random groups, and a crossover design was implemented with two separate interventions. In the first intervention students learned how to draw and label a cell. Group 1 learned the material by computer and Group 2 learned the material by hand-drawing. In the second intervention, students learned how to draw the phases of mitosis, and the two groups were inverted. After each learning activity, students were given a quiz on the material they had learned. Students were also asked to self-evaluate their performance on each quiz, in an attempt to measure their level of metacognition. At the end of the study, they were asked to fill out a questionnaire that was used to measure the level of task engagement the students felt towards the two types of learning activities. In this study, following the first testing phase, the students who learned the material by drawing had a significantly higher average grade on the associated quiz compared to that of those who learned the material by computer. The difference was lost with the second “cross-over” trial. There was no correlation for either group between the grade the students thought they had earned through self-evaluation, and the grade that they received. In terms of different measures of task engagement, there were no significant differences between the two groups. One finding from the study showed a positive correlation between grade and self-reported time spent playing video games, and a negative correlation between grade and self-reported interest in drawing. This study provides little evidence to support claims that the use of digital tools enhances learning, but does provide evidence to support claims that drawing by hand is beneficial for learning biological images. However, the small sample size, limited number and type of learning tasks, and the indirect means of measuring levels of metacognition and task engagement restrict generalisation of these conclusions. Nevertheless, this study indicates that teachers should not use digital learning tools to the exclusion of traditional drawing activities: further studies on the effectiveness of these tools are warranted. Students in this study commented that the computer tool seemed more accurate and detailed - even though the two learning tools carried identical information. Thus there was a mismatch between the perception of the usefulness of computers as a learning tool and the reality, which again points to the need for an objective assessment of their usefulness. Students should be given the opportunity to try out a variety of traditional and digital learning tools in order to address their different learning preferences.

Aplicación del modelo Discovering Hands en Argentina

Discovering Hands (DH) es un proyecto que nace en Alemania en el 2006, liderado por el doctor Frank Hoffmann. El programa se desarrolla pensando en el importante problema de salud pública en el cual se ha convertido en el cáncer de mama, pues según la Organización Mundial de la Salud es el mayor causal de muerte en mujeres, tanto en países desarrollados como en vía de desarrollo, y en Alemania esta enfermedad acaba con la vida de aproximadamente 18.000 mujeres cada año. (The Global Journal, 2014) DH entrena y capacita mujeres visualmente impedidas para detectar de manera temprana los signos de cáncer de mama, dado que estas poseen un sentido del tacto más desarrollado que el de una persona que no se encuentre limitada visualmente. Esto les permite localizar el cáncer de forma más rápida que un médico general ya que son capaces de identificar los tumores más pequeños, logrando así reducir notablemente los costos totales del tratamiento de esta enfermedad. Adicional a esto, el capacitar y preparar a mujeres con discapacidad visual para la detección temprana de cáncer de mama, incrementa la fuerza laboral del país, pues estas mujeres pasarían a ser parte de la población económicamente activa del mismo (PEA) y lograrían que las personas dejen de percibir esta condición como una discapacidad y por el contrario la vean como una ventaja. Después de unos años de prueba, el programa ha sido mejorado y extendido tanto en Alemania como en otros países (Austria), razón por la cual se realizó el estudio de factibilidad del proyecto en países como Colombia - donde se quiere llevar a cabo un proyecto piloto en la ciudad de Cali - México y Argentina. El presente trabajo se enfoca en Argentina, por medio del cual se busca proponer aportes para disminuir las causas de muertes originadas por esta enfermedad y los altos costos que estas le generan al sector de la salud de este país. Con el estudio se logró identificar la factibilidad de la implementación del modelo de negocio, evidenciando que Argentina cuenta con unas particularidades en su sistema de gobierno que pueden hacer que la puesta en práctica del proyecto sea más compleja que en otros países.

Oscillatory mechanisms of conscious perception and attention

Although the prominent role of neural oscillations in perception and cognition has been continuously investigated, some critical questions remain unanswered. My PhD thesis was aimed at addressing some of them. First, can we dissociate oscillatory underpinnings of perceptual accuracy and subjective awareness? Current work would strongly suggest that this dissociation can be drawn. While the fluctuations in alpha-amplitude decide perceptual bias and metacognitive abilities, the speed of alpha activity (i.e., alpha-frequency) dictates sensory sampling, shaping perceptual accuracy. Second, how are these oscillatory mechanisms integrated during attention? The obtained results indicate that a top-down visuospatial mechanism modulates neural assemblies in visual areas via oscillatory re-alignment and coherence in the alpha/beta range within the fronto-parietal brain network. These perceptual predictions are reflected in the retinotopically distributed posterior alpha-amplitude, while perceptual accuracy is explained by the higher alpha-frequency at the to-be-attended location. Finally, sensory input, elaborated via fast gamma oscillations, is linked to specific phases of this slower activity via oscillatory nesting, enabling integration of the feedback-modulated oscillatory activity with sensory information. Third, how can we relate this oscillatory activity to other neural markers of behaviour (i.e., event-related potentials)? The obtained results favour the oscillatory model of ERP genesis, where alpha-frequency shapes the latency of early evoked-potentials, namely P1, with both neural indices being related to perceptual accuracy. On the other hand, alpha-amplitude dictates the amplitude of later P3 evoked-response, whereas both indices shape subjective awareness. Crucially, by combining different methodological approaches, including neurostimulation (TMS) and neuroimaging (EEG), current work identified these oscillatory-behavior links as causal and not just as co-occurring events. Current work aimed at ameliorating the use of the TMS-EEG approach by explaining inter-individual differences in the stimulation outcomes, which could be proven crucial in the way we design entrainment experiments and interpret the results in both research and clinical settings.

Mind the gaps: cognitive-inspired AI for high-level visual sensemaking. Towards abstract concept image classification

The abundance of visual data and the push for robust AI are driving the need for automated visual sensemaking. Computer Vision (CV) faces growing demand for models that can discern not only what images "represent," but also what they "evoke." This is a demand for tools mimicking human perception at a high semantic level, categorizing images based on concepts like freedom, danger, or safety. However, automating this process is challenging due to entropy, scarcity, subjectivity, and ethical considerations. These challenges not only impact performance but also underscore the critical need for interoperability. This dissertation focuses on abstract concept-based (AC) image classification, guided by three technical principles: situated grounding, performance enhancement, and interpretability. We introduce ART-stract, a novel dataset of cultural images annotated with ACs, serving as the foundation for a series of experiments across four key domains: assessing the effectiveness of the end-to-end DL paradigm, exploring cognitive-inspired semantic intermediaries, incorporating cultural and commonsense aspects, and neuro-symbolic integration of sensory-perceptual data with cognitive-based knowledge. Our results demonstrate that integrating CV approaches with semantic technologies yields methods that surpass the current state of the art in AC image classification, outperforming the end-to-end deep vision paradigm. The results emphasize the role semantic technologies can play in developing both effective and interpretable systems, through the capturing, situating, and reasoning over knowledge related to visual data. Furthermore, this dissertation explores the complex interplay between technical and socio-technical factors. By merging technical expertise with an understanding of human and societal aspects, we advocate for responsible labeling and training practices in visual media. These insights and techniques not only advance efforts in CV and explainable artificial intelligence but also propel us toward an era of AI development that harmonizes technical prowess with deep awareness of its human and societal implications.

Advancing Bag-of-visual-words Representations For Lesion Classification In Retinal Images.

Diabetic Retinopathy (DR) is a complication of diabetes that can lead to blindness if not readily discovered. Automated screening algorithms have the potential to improve identification of patients who need further medical attention. However, the identification of lesions must be accurate to be useful for clinical application. The bag-of-visual-words (BoVW) algorithm employs a maximum-margin classifier in a flexible framework that is able to detect the most common DR-related lesions such as microaneurysms, cotton-wool spots and hard exudates. BoVW allows to bypass the need for pre- and post-processing of the retinographic images, as well as the need of specific ad hoc techniques for identification of each type of lesion. An extensive evaluation of the BoVW model, using three large retinograph datasets (DR1, DR2 and Messidor) with different resolution and collected by different healthcare personnel, was performed. The results demonstrate that the BoVW classification approach can identify different lesions within an image without having to utilize different algorithms for each lesion reducing processing time and providing a more flexible diagnostic system. Our BoVW scheme is based on sparse low-level feature detection with a Speeded-Up Robust Features (SURF) local descriptor, and mid-level features based on semi-soft coding with max pooling. The best BoVW representation for retinal image classification was an area under the receiver operating characteristic curve (AUC-ROC) of 97.8% (exudates) and 93.5% (red lesions), applying a cross-dataset validation protocol. To assess the accuracy for detecting cases that require referral within one year, the sparse extraction technique associated with semi-soft coding and max pooling obtained an AUC of 94.2 ± 2.0%, outperforming current methods. Those results indicate that, for retinal image classification tasks in clinical practice, BoVW is equal and, in some instances, surpasses results obtained using dense detection (widely believed to be the best choice in many vision problems) for the low-level descriptors.

Visual Navigation In The Neotropical Ant Odontomachus Hastatus (formicidae, Ponerinae), A Predominantly Nocturnal, Canopy-dwelling Predator Of The Atlantic Rainforest.

The arboreal ant Odontomachus hastatus nests among roots of epiphytic bromeliads in the sandy forest at Cardoso Island (Brazil). Crepuscular and nocturnal foragers travel up to 8m to search for arthropod prey in the canopy, where silhouettes of leaves and branches potentially provide directional information. We investigated the relevance of visual cues (canopy, horizon patterns) during navigation in O. hastatus. Laboratory experiments using a captive ant colony and a round foraging arena revealed that an artificial canopy pattern above the ants and horizon visual marks are effective orientation cues for homing O. hastatus. On the other hand, foragers that were only given a tridimensional landmark (cylinder) or chemical marks were unable to home correctly. Navigation by visual cues in O. hastatus is in accordance with other diurnal arboreal ants. Nocturnal luminosity (moon, stars) is apparently sufficient to produce contrasting silhouettes from the canopy and surrounding vegetation, thus providing orientation cues. Contrary to the plain floor of the round arena, chemical cues may be important for marking bifurcated arboreal routes. This experimental demonstration of the use of visual cues by a predominantly nocturnal arboreal ant provides important information for comparative studies on the evolution of spatial orientation behavior in ants. This article is part of a Special Issue entitled: Neotropical Behaviour.

Perception Of Oral And Maxillofacial Surgeons, Orthodontists And Laypersons In Relation To The Harmony Of The Smile.

Harmony is one of the main objectives in surgical and orthodontic treatment and this harmony must be present in the smile, as well as in the face. The aim of the present study was to assess the perceptions of professionals and laypersons in relation to the harmony of the smile of patients with or without vertical maxillary alterations. Sixty observers (oral and maxillofacial surgeons, orthodontists and laypersons) reported the degree of harmony of six smiles using an objective questionnaire and the participants indicated if there was a need for corrective surgery or not. The classification of observers was recorded on a Likert scale from 1 to 5. Mixed regression was used to determine differences between the three groups. Statistically significant differences were found only for the harmony of the smile between the oral and maxillofacial surgeons and laypersons, with laypersons being more critical when assessing the smile. There was no statistical difference between the other groups for the harmony of the smile or the indication of corrective surgery. The patterns of greater or lesser harmony determined by observers during the smile were similar to those found in the literature as the ideal standard in relation to vertical maxillary positioning. Laypersons had a tendency to be more critical in relation to facial harmony than surgeons, although no statistical differences were found in the other groups in relation to the harmony of the smile or indication for the corrective surgery. In addition, the patterns of greater or lesser harmony of the smile determined by the participants were similar to those found in the literature as the ideal standard in relation to vertical maxillary positioning. Overall, the present study demonstrates that adequate interaction between surgeons, orthodontists and laypersons is essential in order to achieve facial harmony with orthodontic and/or surgical treatment. Opinion of specialists and laypersons about the smile in relation to the vertical positioning of the maxilla.