A case study of teaching English and multimodality with ICTs: Constraints and possibilities

Current Australian policies and curricular frameworks demand that teachers and students use technology creatively and meaningfully in classrooms to develop students into 21C technological citizens. English teachers and students also have to learn new metalanguage around visual grammar since multimodal tasks often combine creative with critical General Capabilities (GC) with that of the of ICTs and literacy in the Australian Curriculum: English (AC:E). Both teachers and learners come to these tasks with varying degrees of techno-literacy, skills and access to technologies. This paper reports on case-study research following a technology based collaborative professional development (PD) program between a university Lecturer facilitator and English Teachers in a secondary Catholic school. The study found that the possibilities for creative and critical engagement are rich, but there are real grounded constraints such as lack of time, impeding teachers’ ability to master and teach new technologies in classrooms. Furthermore, pedagogical approaches are affected by technical skill levels and school infrastructure concerns which can militate against effective use of ICTs in school settings. The research project was funded by the Brisbane Catholic Education Office and focused on how teachers can be supported in these endeavours in educational contexts as they prepare students of English to be creative global citizens who use technology creatively.

Rapport från projektet Multimodala uppgifter och bedömning i matematik : Video och kollaborativa samtal som metod vid lärares bedömning av elevers matematiska kunskaper

This research will discuss some experiences from a four year school research study. It was conducted in cooperation with teachers from four municipalities in Dalarna. The aim of the research was to examine teachers´ professional development when they participated in collaborative discussions based on video recordings and video edited material from specific lessons in their own practice. The study had two foci one was to investigate methods and tools that teachers can use to develop their ability to assess their students while working on multimodal tasks. The other was to examine how video can be used by teachers wanting to obtain knowledge about assessing students. The study is based on several theories about when teachers collaborate to create new knowledge. The first is the design theoretical approach – where visual ethnography and a semiotic approach contribute to problematize the use and mixture of different modes. A basic assumption of the framework here is that meanings are made and communicated in mathematics through a wide range of semiotic modes. By using video as an essential tool in the research the framework theories concerning visual ethnography, video documentation and individuals as reflective practitioners were also needed. The findings can be divided into the following themes: the use of tasks for assessment, collaborative discussion, equipment, ethical dilemmas. Collaborative discussions were evaluated as a meaningful way of sharing knowledge. The use of video recordings in association with these discussions raised important ethical issues. Working with the assessment framework was of great interest to the teachers but it took a lot of time from their ordinary work. In this way the project highlighted more general aspects of school development. The research also concerns teachers´ use of collaborative discussions in assessment work, multimodal tasks in mathematics and video as a research tool in general.

Linear multimodal actuation through discrete coupling

Due to technological limitations, robot actuators are often designed for specific tasks with narrow performance goals, whereas a wide range of behaviors is necessary for autonomous robots in uncertain complex environments. In an effort to increase the versatility of actuators, we introduce a new concept of multimodal actuation (MMA) that employs dynamic coupling in the form of clutches and brakes to change its mode of operation. The dynamic coupling allows motors and passive elements such as springs to be engaged and disengaged within a single actuator. We apply the concept to a linear series elastic actuator which uses friction brakes controlled online for the dynamic coupling. With this prototype, we are able to demonstrate several modes of operation including stiff position control, series elastic actuation as well as the possibility to store and release energy in a controlled manner for explosive tasks such as jumping. In this paper, we model the proposed concept of actuation and show a systematic performance analysis of the physical prototype that we developed in our laboratory. © 1996-2012 IEEE.

Multimodal exercise intervention improves frontal cognitive functions and gait in Alzheimer's disease: A controlled trial

Aim: The objective of the present study was to investigate the effect of a multimodal exercise intervention on frontal cognitive functions and kinematic gait parameters in patients with Alzheimer's disease. Methods: A sample of elderly patients with Alzheimer's disease (n=27) were assigned to a training group (n=14; aged 78.0±7.3years) and a control group (n=13; aged 77.1±7.4years). Multimodal exercise intervention includes motor activities and cognitive tasks simultaneously. The participants attended a 1-h session three times a week for 16weeks, and the control participants maintained their regular daily activities during the same period. The frontal cognitive functions were evaluated using the Frontal Assessment Battery, the Clock Drawing Test and the Symbol Search Subtest. The kinematic parameters of gait-cadence, stride length and stride speed were analyzed under two conditions: (i) free gait (single task); and (ii) gait with frontal cognitive task (walking and counting down from 20 - dual task). Results and discussion: The patients in the intervention group significantly increased the scores in frontal cognitive variables, Frontal Assessment Battery (P<0.001) and Symbol Search Subtest (P<0.001) after the 16-week period. The control group decreased the scores in the Clock Drawing Test (P=0.001) and increased the number of counting errors during the dual task (P=0.008) after the same period. Conclusion: The multimodal exercise intervention improved the frontal cognitive functions in patients with Alzheimer's disease. © 2012 Japan Geriatrics Society.

Benefits of Multimodal Exercise Intervention for Postural Control and Frontal Cognitive Functions in Individuals with Alzheimer's Disease: A Controlled Trial

Objective To verify the effects of a systematized multimodal exercise intervention program on frontal cognitive function, postural control, and functional capacity components of individuals with Alzheimer's disease (AD).DesignNonrandomized controlled trial with pre- and posttraining tests in a training group and a control group.SettingKinesiotherapy program for seniors with AD, SAo Paulo State University.ParticipantsConvenience sample of older adults with AD (n=30) were assigned to a training (n=14; aged 78.67.1) and a control (n=16; aged 77.06.3) group.InterventionThe intervention program was structured with the aim of simultaneously promoting better balance and frontal cognitive capacity. The participants attended a 1-hour session three times a week for 16weeks, whereas the control group did not participate in any activity during the same period.MeasurementsFrontal cognitive function was evaluated using the Montreal Cognitive Assessment, the Clock Drawing Test, the Frontal Assessment Battery, and the Symbol Search Subtest. Postural control (center of pressure area) was analyzed under four dual-task conditions. Functional capacity components were analyzed using the Timed Up and Go Test, the 30-second sit-to-stand test, the sit-and-reach test, and the Berg Functional Balance Scale.ResultsIntervention group participants showed a significant increase in frontal cognitive function (P<.001, partial (2)=0.838), with less body sway (P=.04, partial (2)=0.04) during the dual tasks, and greater functional capacity (P=.001, partial (2)=0.676) after the 16-week period.ConclusionIntervention participants performed better on dual-task activities and had better postural balance and greater functional capacity than controls.

Semi-supervised learning for relevance feedback on image retrieval tasks

Relevance feedback approaches have been established as an important tool for interactive search, enabling users to express their needs. However, in view of the growth of multimedia collections available, the user efforts required by these methods tend to increase as well, demanding approaches for reducing the need of user interactions. In this context, this paper proposes a semi-supervised learning algorithm for relevance feedback to be used in image retrieval tasks. The proposed semi-supervised algorithm aims at using both supervised and unsupervised approaches simultaneously. While a supervised step is performed using the information collected from the user feedback, an unsupervised step exploits the intrinsic dataset structure, which is represented in terms of ranked lists of images. Several experiments were conducted for different image retrieval tasks involving shape, color, and texture descriptors and different datasets. The proposed approach was also evaluated on multimodal retrieval tasks, considering visual and textual descriptors. Experimental results demonstrate the effectiveness of the proposed approach.

Multimodal (EEG-fMRI) functional connectivity study of levodopa effect in Parkinson’s disease

Aim: To assess if the intake of levodopa in patients with Parkinson’s Disease (PD) changes cerebral connectivity, as revealed by simultaneous recording of hemodynamic (functional MRI, or fMRI) and electric (electroencephalogram, EEG) signals. Particularly, we hypothesize that the strongest changes in FC will involve the motor network, which is the most impaired in PD. Methods: Eight patients with diagnosis of PD “probable”, therapy with levodopa exclusively, normal cognitive and affective status, were included. Exclusion criteria were: moderate-severe rest tremor, levodopa induced dyskinesia, evidence of gray or white matter abnormalities on structural MRI. Scalp EEG (64 channels) were acquired inside the scanner (1.5 Tesla) before and after the intake of levodopa. fMRI functional connectivity was computed from four regions of interest: right and left supplementary motor area (SMA) and right and left precentral gyrus (primary motor cortex). Weighted partial directed coherence (w-PDC) was computed in the inverse space after the removal of EEG gradient and cardioballistic artifacts. Results and discussion: fMRI group analysis shows that the intake of levodopa increases hemodynamic functional connectivity among the SMAs / primary motor cortex and: sensory-motor network itself, attention network and default mode network. w-PDC analysis shows that EEG connectivity among regions of the motor network has the tendency to decrease after the intake the levodopa; furthermore, regions belonging to the DMN have the tendency to increase their outflow toward the rest of the brain. These findings, even if in a small sample of patients, suggest that other resting state physiological functional networks, beyond the motor one, are affected in patients with PD. The behavioral and cognitive tasks corresponding to the affected networks could benefit from the intake of levodopa.

The multiscenario multienvironment BioSecure Multimodal Database (BMDB)

A new multimodal biometric database designed and acquired within the framework of the European BioSecure Network of Excellence is presented. It is comprised of more than 600 individuals acquired simultaneously in three scenarios: 1) over the Internet, 2) in an office environment with desktop PC, and 3) in indoor/outdoor environments with mobile portable hardware. The three scenarios include a common part of audio/video data. Also, signature and fingerprint data have been acquired both with desktop PC and mobile portable hardware. Additionally, hand and iris data were acquired in the second scenario using desktop PC. Acquisition has been conducted by 11 European institutions. Additional features of the BioSecure Multimodal Database (BMDB) are: two acquisition sessions, several sensors in certain modalities, balanced gender and age distributions, multimodal realistic scenarios with simple and quick tasks per modality, cross-European diversity, availability of demographic data, and compatibility with other multimodal databases. The novel acquisition conditions of the BMDB allow us to perform new challenging research and evaluation of either monomodal or multimodal biometric systems, as in the recent BioSecure Multimodal Evaluation campaign. A description of this campaign including baseline results of individual modalities from the new database is also given. The database is expected to be available for research purposes through the BioSecure Association during 2008.

Estudio Multimodal de la Funcionalidad Cortical en ratones Transgénicos con Síndrome X Frágil y la modulación del dolor

El dolor es un síntoma frecuente en la práctica médica. En España, un estudio realizado en el año 2000 demostró que cada médico atiende un promedio de 181 pacientes con dolor por mes, la mayoría de ellos con dolor crónico moderado1. Del 7%-8% de la población europea está afectada y hasta el 5% puede ser grave2-3, se estima, que afecta a más de dos millones de españoles4. En la consulta de Atención Primaria, los pacientes con dolor neuropático tienen tasas de depresión mucho mayores 5-6-7. El dolor neuropático8 es el dolor causado por daño o enfermedad que afecta al sistema somato-sensorial, es un problema de salud pública con un alto coste laboral, debido a que existe cierto desconocimiento de sus singularidades, tanto de su diagnóstico como de su tratamiento, que al fallar, el dolor se perpetúa y se hace más rebelde a la hora de tratarlo, en la mayoría de las ocasiones pasa a ser crónico. Los mecanismos fisiopatológicos son evolutivos, se trata de un proceso progresivo e integrado que avanza si no recibe tratamiento, ocasionando graves repercusiones en la calidad de vida de los pacientes afectados9. De acuerdo a Prusiner (premio nobel de medicina 1997), en todas las enfermedades neurodegenerativas hay algún tipo de proceso anormal de la función neuronal. Las enfermedades neurodegenerativas son la consecuencia de anormalidades en el proceso de ciertas proteínas que intervienen en el ciclo celular, por lo tanto da lugar al cúmulo de las mismas en las neuronas o en sus proximidades, disminuyendo o anulando sus funciones, como la enfermedad de Alzheimer y el mismo SXF. La proteína FMRP (Fragile Mental Retardation Protein), esencial para el desarrollo cognitivo normal, ha sido relacionada con la vía piramidal del dolor10-11-12. El Síndrome de X Frágil13-14 (SXF), se debe a la mutación del Gen (FMR-1). Como consecuencia de la mutación, el gen se inactiva y no puede realizar la función de sintetizar la proteína FMRP. Por su incidencia se le considera la primera causa de Deficiencia Mental Hereditaria sólo superada por el Síndrome de Down. La electroencefalografía (EEG) es el registro de la actividad bioeléctrica cerebral que ha traído el desarrollo diario de los estudios clínicos y experimentales para el descubrimiento, diagnóstico y tratamiento de un gran número de anormalidades neurológicas y fisiológicas del cerebro y el resto del sistema nervioso central (SNC) incluyendo el dolor. El objetivo de la presente investigación es por medio de un estudio multimodal, desarrollar nuevas formas de presentación diagnóstica mediante técnicas avanzadas de procesado de señal y de imagen, determinando así los vínculos entre las evaluaciones cognitivas y su correlación anatómica con la modulación al dolor presente en patologías relacionadas con proteína FMRP. Utilizando técnicas biomédicas (funcionalestructural) para su caracterización. Para llevar a cabo esta tarea hemos utilizado el modelo animal de ratón. Nuestros resultados en este estudio multimodal demuestran que hay alteraciones en las vías de dolor en el modelo animal FMR1-KO, en concreto en la modulación encefálica (dolor neuropático), los datos se basan en los resultados del estudio estructural (imagen histología), funcional (EEG) y en pruebas de comportamiento (Laberinto de Barnes). En la Histología se muestra una clara asimetría estructural en el modelo FMR1 KO con respecto al control WT, donde el hemisferio Izquierdo tiene mayor densidad de masa neuronal en KO hembras 56.7%-60.8%, machos 58.3%-61%, en WT hembras 62.7%-62.4%, machos 55%-56.2%, hemisferio derecho-izquierdo respectivamente, esto refleja una correlación entre hemisferios muy baja en los sujetos KO (~50%) con respecto a los control WT (~90%). Se encontró correlación significativa entre las pruebas de memoria a largo plazo con respecto a la asimetría hemisférica (r = -0.48, corregido <0,05). En el estudio de comportamiento también hay diferencias, los sujetos WT tuvieron 22% un de rendimiento en la memoria a largo plazo, mientras que en los machos hay deterioro de memoria de un 28% que se corresponden con la patología en humanos. En los resultados de EEG estudiados en el hemisferio izquierdo, en el área de la corteza insular, encuentran que la latencia de la respuesta al potencial evocado es menor (22vs32 15vs96seg), la intensidad de la señal es mayor para los sujetos experimentales FMR1 KO frente a los sujetos control, esto es muy significativo dados los resultados en la histología (140vs129 145vs142 mv). Este estudio multimodal corrobora que las manifestaciones clínicas del SXF son variables dependientes de la edad y el sexo. Hemos podido corroborar en el modelo animal que en la etapa de adulto, los varones con SXF comienzan a desarrollar problemas en el desempeño de tareas que requieren la puesta en marcha de la función ejecutiva central de la memoria de trabajo (almacenamiento temporal). En el análisis del comportamiento es difícil llegar a una conclusión objetiva, se necesitan más estudios en diferentes etapas de la vida corroborados con resultados histológicos. Los avances logrados en los últimos años en su estudio han sido muy positivos, de tal modo que se están abriendo nuevas vías de investigación en un conjunto de procesos que representan un gran desafío a problemas médicos, asistenciales, sociales y económicos a los que se enfrentan los principales países desarrollados, con un aumento masivo de las expectativas de vida y de calidad. Las herramientas utilizadas en el campo de las neurociencias nos ofrecen grandes posibilidades para el desarrollo de estrategias que permitan ser utilizadas en el área de la educación, investigación y desarrollo. La genética determina la estructura del cerebro y nuestra investigación comprueba que la ausencia de FMRP también podría estar implicada en la modulación del dolor como parte de su expresión patológica siendo el modelo animal un punto importante en la investigación científica fundamental para entender el desarrollo de anormalidades en el cerebro. ABSTRACT Pain is a common symptom in medical practice. In Spain, a study conducted in 2000 each medical professional treats an average of 181 patients with pain per month, most of them with chronic moderate pain. 7% -8% of the European population is affected and up to 5% can be serious, it is estimated to affect more than two million people in Spain. In Primary Care, patients with neuropathic pain have much higher rates of depression. Neuropathic pain is caused by damage or disease affecting the somatosensory system, is a public health problem with high labor costs, there are relatively unfamiliar with the peculiarities in diagnosis and treatment, failing that, the pain is perpetuated and becomes rebellious to treat, in most cases becomes chronic. The pathophysiological mechanisms are evolutionary, its a progressive, if untreated, causing severe impact on the quality of life of affected patients. According to Prusiner (Nobel Prize for Medicine 1997), all neurodegenerative diseases there is some abnormal process of neuronal function. Neurodegenerative diseases are the result of abnormalities in the process of certain proteins involved in the cell cycle, reducing or canceling its features such as Alzheimer's disease and FXS. FMRP (Fragile Mental Retardation Protein), is essential for normal cognitive development, and has been linked to the pyramidal tract pain. Fragile X Syndrome (FXS), is due to mutation of the gene (FMR-1). As a consequence of the mutation, the gene is inactivated and can not perform the function of FMRP synthesize. For its incidence is considered the leading cause of Mental Deficiency Hereditary second only to Down Syndrome. Electroencephalography (EEG) is the recording of bioelectrical brain activity, is a advancement of clinical and experimental studies for the detection, diagnosis and treatment of many neurological and physiological abnormalities of the brain and the central nervous system, including pain. The objective of this research is a multimodal study, is the development of new forms of presentation using advanced diagnostic techniques of signal processing and image, to determine the links between cognitive evaluations and anatomic correlation with pain modulation to this protein FMRP-related pathologies. To accomplish this task have used the mouse model. Our results in this study show alterations in multimodal pain pathways in FMR1-KO in brain modulation (neuropathic pain), the data are based on the results of the structural study (histology image), functional (EEG) testing and behavior (Barnes maze). Histology In structural asymmetry shown in FMR1 KO model versus WT control, the left hemisphere is greater density of neuronal mass (KO females 56.7% -60.8%, 58.3% -61% males, females 62.7% -62.4 WT %, males 55% -56.2%), respectively right-left hemisphere, this reflects a very low correlation between hemispheres in KO (~ 50%) subjects compared to WT (~ 90%) control. Significant correlation was found between tests of long-term memory with respect to hemispheric asymmetry (r = -0.48, corrected <0.05). In the memory test there are differences too, the WT subjects had 22% yield in long-term memory, in males there memory impairment 28% corresponding to the condition in humans. The results of EEG studied in the left hemisphere, in insular cortex area, we found that the latency of the response evoked potential is lower (22vs32 15vs96seg), the signal strength is higher for the experimental subjects versus FMR1 KO control subjects, this is very significant given the results on histology (140vs129 145vs142 mv). This multimodal study confirms that the clinical manifestations of FXS are dependent variables of age and sex. We have been able to corroborate in the animal model in the adult stage, males with FXS begin developing problems in the performance of tasks that require the implementation of the central executive function of working memory (temporary storage). In behavior analysis is difficult to reach an objective conclusion, more studies are needed in different life stages corroborated with histologic findings. Advances in recent years were very positive, being opened new lines of research that represent a great challenge to physicians, health care, social and economic problems facing the major developed countries, with a massive increase in life expectancy and quality. The tools used in the field of neuroscience offer us great opportunities for the development of strategies to be used in the area of education, research and development. Genetics determines the structure of the brain and our research found that the absence of FMRP might also be involved in the modulation of pain as part of their pathological expression being an important animal model in basic scientific research to understand the development of abnormalities in brain.

Non-invasive user monitoring in daily tasks for cognitive rehabilitation

El uso de técnicas para la monitorización del movimiento humano generalmente permite a los investigadores analizar la cinemática y especialmente las capacidades motoras en aquellas actividades de la vida cotidiana que persiguen un objetivo concreto como pueden ser la preparación de bebidas y comida, e incluso en tareas de aseo. Adicionalmente, la evaluación del movimiento y el comportamiento humanos en el campo de la rehabilitación cognitiva es esencial para profundizar en las dificultades que algunas personas encuentran en la ejecución de actividades diarias después de accidentes cerebro-vasculares. Estas dificultades están principalmente asociadas a la realización de pasos secuenciales y al reconocimiento del uso de herramientas y objetos. La interpretación de los datos sobre la actitud de este tipo de pacientes para reconocer y determinar el nivel de éxito en la ejecución de las acciones, y para ampliar el conocimiento en las enfermedades cerebrales, sus consecuencias y severidad, depende totalmente de los dispositivos usados para la captura de esos datos y de la calidad de los mismos. Más aún, existe una necesidad real de mejorar las técnicas actuales de rehabilitación cognitiva contribuyendo al diseño de sistemas automáticos para crear una especie de terapeuta virtual que asegure una vida más independiente de estos pacientes y reduzca la carga de trabajo de los terapeutas. Con este objetivo, el uso de sensores y dispositivos para obtener datos en tiempo real de la ejecución y estado de la tarea de rehabilitación es esencial para también contribuir al diseño y entrenamiento de futuros algoritmos que pudieran reconocer errores automáticamente para informar al paciente acerca de ellos mediante distintos tipos de pistas como pueden ser imágenes, mensajes auditivos o incluso videos. La tecnología y soluciones existentes en este campo no ofrecen una manera totalmente robusta y efectiva para obtener datos en tiempo real, por un lado, porque pueden influir en el movimiento del propio paciente en caso de las plataformas basadas en el uso de marcadores que necesitan sensores pegados en la piel; y por otro lado, debido a la complejidad o alto coste de implantación lo que hace difícil pensar en la idea de instalar un sistema en el hospital o incluso en la casa del paciente. Esta tesis presenta la investigación realizada en el campo de la monitorización del movimiento de pacientes para proporcionar un paso adelante en términos de detección, seguimiento y reconocimiento del comportamiento de manos, gestos y cara mediante una manera no invasiva la cual puede mejorar la técnicas actuales de rehabilitación cognitiva para la adquisición en tiempo real de datos sobre el comportamiento del paciente y la ejecución de la tarea. Para entender la importancia del marco de esta tesis, inicialmente se presenta un resumen de las principales enfermedades cognitivas y se introducen las consecuencias que tienen en la ejecución de tareas de la vida diaria. Más aún, se investiga sobre las metodologías actuales de rehabilitación cognitiva. Teniendo en cuenta que las manos son la principal parte del cuerpo para la ejecución de tareas manuales de la vida cotidiana, también se resumen las tecnologías existentes para la captura de movimiento de manos. Una de las principales contribuciones de esta tesis está relacionada con el diseño y evaluación de una solución no invasiva para detectar y seguir las manos durante la ejecución de tareas manuales de la vida cotidiana que a su vez involucran la manipulación de objetos. Esta solución la cual no necesita marcadores adicionales y está basada en una cámara de profundidad de bajo coste, es robusta, precisa y fácil de instalar. Otra contribución presentada se centra en el reconocimiento de gestos para detectar el agarre de objetos basado en un sensor infrarrojo de última generación, y también complementado con una cámara de profundidad. Esta nueva técnica, y también no invasiva, sincroniza ambos sensores para seguir objetos específicos además de reconocer eventos concretos relacionados con tareas de aseo. Más aún, se realiza una evaluación preliminar del reconocimiento de expresiones faciales para analizar si es adecuado para el reconocimiento del estado de ánimo durante la tarea. Por su parte, todos los componentes y algoritmos desarrollados son integrados en un prototipo simple para ser usado como plataforma de monitorización. Se realiza una evaluación técnica del funcionamiento de cada dispositivo para analizar si es adecuada para adquirir datos en tiempo real durante la ejecución de tareas cotidianas reales. Finalmente, se estudia la interacción con pacientes reales para obtener información del nivel de usabilidad del prototipo. Dicha información es esencial y útil para considerar una rehabilitación cognitiva basada en la idea de instalación del sistema en la propia casa del paciente al igual que en el hospital correspondiente. ABSTRACT The use of human motion monitoring techniques usually let researchers to analyse kinematics, especially in motor strategies for goal-oriented activities of daily living, such as the preparation of drinks and food, and even grooming tasks. Additionally, the evaluation of human movements and behaviour in the field of cognitive rehabilitation is essential to deep into the difficulties some people find in common activities after stroke. This difficulties are mainly associated with sequence actions and the recognition of tools usage. The interpretation of attitude data of this kind of patients in order to recognize and determine the level of success of the execution of actions, and to broaden the knowledge in brain diseases, consequences and severity, depends totally on the devices used for the capture of that data and the quality of it. Moreover, there is a real need of improving the current cognitive rehabilitation techniques by contributing to the design of automatic systems to create a kind of virtual therapist for the improvement of the independent life of these stroke patients and to reduce the workload of the occupational therapists currently in charge of them. For this purpose, the use of sensors and devices to obtain real time data of the execution and state of the rehabilitation task is essential to also contribute to the design and training of future smart algorithms which may recognise errors to automatically provide multimodal feedback through different types of cues such as still images, auditory messages or even videos. The technology and solutions currently adopted in the field don't offer a totally robust and effective way for obtaining real time data, on the one hand, because they may influence the patient's movement in case of marker-based platforms which need sensors attached to the skin; and on the other hand, because of the complexity or high cost of implementation, which make difficult the idea of installing a system at the hospital or even patient's home. This thesis presents the research done in the field of user monitoring to provide a step forward in terms of detection, tracking and recognition of hand movements, gestures and face via a non-invasive way which could improve current techniques for cognitive rehabilitation for real time data acquisition of patient's behaviour and execution of the task. In order to understand the importance of the scope of the thesis, initially, a summary of the main cognitive diseases that require for rehabilitation and an introduction of the consequences on the execution of daily tasks are presented. Moreover, research is done about the actual methodology to provide cognitive rehabilitation. Considering that the main body members involved in the completion of a handmade daily task are the hands, the current technologies for human hands movements capture are also highlighted. One of the main contributions of this thesis is related to the design and evaluation of a non-invasive approach to detect and track user's hands during the execution of handmade activities of daily living which involve the manipulation of objects. This approach does not need the inclusion of any additional markers. In addition, it is only based on a low-cost depth camera, it is robust, accurate and easy to install. Another contribution presented is focused on the hand gesture recognition for detecting object grasping based on a brand new infrared sensor, and also complemented with a depth camera. This new, and also non-invasive, solution which synchronizes both sensors to track specific tools as well as recognize specific events related to grooming is evaluated. Moreover, a preliminary assessment of the recognition of facial expressions is carried out to analyse if it is adequate for recognizing mood during the execution of task. Meanwhile, all the corresponding hardware and software developed are integrated in a simple prototype with the purpose of being used as a platform for monitoring the execution of the rehabilitation task. Technical evaluation of the performance of each device is carried out in order to analyze its suitability to acquire real time data during the execution of real daily tasks. Finally, a kind of healthcare evaluation is also presented to obtain feedback about the usability of the system proposed paying special attention to the interaction with real users and stroke patients. This feedback is quite useful to consider the idea of a home-based cognitive rehabilitation as well as a possible hospital installation of the prototype.

Efeitos de um programa de exercício multimodal em pessoas idosas institucionalizadas

Objetivo: Investigar os efeitos de um programa de exercício multimodal sobre o funcionamento cognitivo e aptidão física funcional em pessoas idosas institucionalizadas. Método: Os participantes foram selecionados por conveniência entre os utentes de duas instituições de apoio a pessoas idosas. O grupo inicial foi constituído por um total de 21 pessoas de ambos os sexos (77-92 anos). Inicialmente, foi garantido um “período de controlo” de 4 semanas, em que os participantes mantiveram as suas atividades de vida quotidianas normais. Posteriormente, todos os idosos integraram um programa de exercício multimodal durante 8 semanas. Para estudar os efeitos da intervenção foram recolhidos dados em 3 momentos distintos: previamente ao período de controlo, após o período de controlo e no final do programa de intervenção. Foram efetuados testes físicos/motores, cognitivos e de dupla-tarefa (motor-cognitivo). Durante as sessões de exercício, alternaram-se períodos constituídos por tarefas motoras com períodos em que as tarefas motoras implicavam uma mobilização simultânea de recursos cognitivos. Resultados: A análise estatística dos dados recolhidos nos três momentos de avaliação, revelou efeitos positivos da intervenção ao nível da atenção, tempo de reação, força muscular, agilidade e capacidade cardiorrespiratória. Nos testes realizados em dupla-tarefa, foram encontradas melhorias no teste timed up and go, mas não se verificaram melhorias no teste de tempo de reação. A análise estatística dos dados recolhidos nos três momentos de avaliação, revelou efeitos positivos (p<0.05). da intervenção ao nível da atenção, tempo de reação, força muscular, agilidade e capacidade cardiorrespiratória. Nos testes realizados em dupla-tarefa, foram encontradas melhorias no teste timed up and go (p<0.05), mas não se verificaram melhorias no teste de tempo de reação. Conclusões: Um programa de exercícios multimodal induz melhorias no funcionamento cognitivo e motor de pessoas idosas institucionalizadas. É aconselhada a divulgação deste tipo de intervenção para pessoas idosas institucionalizadas; Effects of a Multimodal Exercise Program for Elderly Institutionalized Abstract: Objective: To investigate wthe effects of a multimodal exercise program on cognitive functioning and physical fitness of institutionalized elderly. Method: Participants were selected by convenience among two nursing home residents. Twenty-one people (77-92 years old) of both genders participated. During the first 4 weeks (control period), participants were not engaged in the exercise program and continue with their normal daily life activities. After the control period, the group was engaged in a multimodal exercise program for 8 weeks (2 times per week). To study the effects of a multimodal exercise program, data were collected at three different times: prior to the control period, after the control period, and at the end of the intervention. Several motor tests (physical fitness), cognitive tests and dual-tasks (motor-cognitive) were performed. The exercise sessions alternated between periods of motor taks and periods with motor plus cognitive tasks performed simultaneously. Results: The analysis of the data collected in the three moments of evaluation, show positive effects of the exercise program in cognitive dimensions (information processing speed and attention) and functional physical fitness components (muscle resistance, cardiorespiratory fitness and dynamic balance). In tests carried out in dual-task conditions, the exercise program promoted improvements in the timed up and go test (with mental calculations). Statistical analysis of the data collected at the three evaluation moments revealed positive effects (p <0.05). Of attention intervention, reaction time, muscle strength, agility and cardiorespiratory capacity. In the double-task tests, improvements were found in the timed up and go test (p <0.05), but there were no improvements in the reaction time test. Conclusions: The results of this study indicate that a multimodal exercise program can improve cognitive functioning and physical fitness in institutionalized older people. Thus, this type of intervention should be promoted among nursing home residents.