A Personal Agent Architecture for Task Automation in the Web of Data. Bringing intelligence to everyday tasks

Internet está evolucionando hacia la conocida como Live Web. En esta nueva etapa en la evolución de Internet, se pone al servicio de los usuarios multitud de streams de datos sociales. Gracias a estas fuentes de datos, los usuarios han pasado de navegar por páginas web estáticas a interacturar con aplicaciones que ofrecen contenido personalizado, basada en sus preferencias. Cada usuario interactúa a diario con multiples aplicaciones que ofrecen notificaciones y alertas, en este sentido cada usuario es una fuente de eventos, y a menudo los usuarios se sienten desbordados y no son capaces de procesar toda esa información a la carta. Para lidiar con esta sobresaturación, han aparecido múltiples herramientas que automatizan las tareas más habituales, desde gestores de bandeja de entrada, gestores de alertas en redes sociales, a complejos CRMs o smart-home hubs. La contrapartida es que aunque ofrecen una solución a problemas comunes, no pueden adaptarse a las necesidades de cada usuario ofreciendo una solucion personalizada. Los Servicios de Automatización de Tareas (TAS de sus siglas en inglés) entraron en escena a partir de 2012 para dar solución a esta liminación. Dada su semejanza, estos servicios también son considerados como un nuevo enfoque en la tecnología de mash-ups pero centra en el usuarios. Los usuarios de estas plataformas tienen la capacidad de interconectar servicios, sensores y otros aparatos con connexión a internet diseñando las automatizaciones que se ajustan a sus necesidades. La propuesta ha sido ámpliamante aceptada por los usuarios. Este hecho ha propiciado multitud de plataformas que ofrecen servicios TAS entren en escena. Al ser un nuevo campo de investigación, esta tesis presenta las principales características de los TAS, describe sus componentes, e identifica las dimensiones fundamentales que los defines y permiten su clasificación. En este trabajo se acuña el termino Servicio de Automatización de Tareas (TAS) dando una descripción formal para estos servicios y sus componentes (llamados canales), y proporciona una arquitectura de referencia. De igual forma, existe una falta de herramientas para describir servicios de automatización, y las reglas de automatización. A este respecto, esta tesis propone un modelo común que se concreta en la ontología EWE (Evented WEb Ontology). Este modelo permite com parar y equiparar canales y automatizaciones de distintos TASs, constituyendo un aporte considerable paraa la portabilidad de automatizaciones de usuarios entre plataformas. De igual manera, dado el carácter semántico del modelo, permite incluir en las automatizaciones elementos de fuentes externas sobre los que razonar, como es el caso de Linked Open Data. Utilizando este modelo, se ha generado un dataset de canales y automatizaciones, con los datos obtenidos de algunos de los TAS existentes en el mercado. Como último paso hacia el lograr un modelo común para describir TAS, se ha desarrollado un algoritmo para aprender ontologías de forma automática a partir de los datos del dataset. De esta forma, se favorece el descubrimiento de nuevos canales, y se reduce el coste de mantenimiento del modelo, el cual se actualiza de forma semi-automática. En conclusión, las principales contribuciones de esta tesis son: i) describir el estado del arte en automatización de tareas y acuñar el término Servicio de Automatización de Tareas, ii) desarrollar una ontología para el modelado de los componentes de TASs y automatizaciones, iii) poblar un dataset de datos de canales y automatizaciones, usado para desarrollar un algoritmo de aprendizaje automatico de ontologías, y iv) diseñar una arquitectura de agentes para la asistencia a usuarios en la creación de automatizaciones. ABSTRACT The new stage in the evolution of the Web (the Live Web or Evented Web) puts lots of social data-streams at the service of users, who no longer browse static web pages but interact with applications that present them contextual and relevant experiences. Given that each user is a potential source of events, a typical user often gets overwhelmed. To deal with that huge amount of data, multiple automation tools have emerged, covering from simple social media managers or notification aggregators to complex CRMs or smart-home Hub/Apps. As a downside, they cannot tailor to the needs of every single user. As a natural response to this downside, Task Automation Services broke in the Internet. They may be seen as a new model of mash-up technology for combining social streams, services and connected devices from an end-user perspective: end-users are empowered to connect those stream however they want, designing the automations they need. The numbers of those platforms that appeared early on shot up, and as a consequence the amount of platforms following this approach is growing fast. Being a novel field, this thesis aims to shed light on it, presenting and exemplifying the main characteristics of Task Automation Services, describing their components, and identifying several dimensions to classify them. This thesis coins the term Task Automation Services (TAS) by providing a formal definition of them, their components (called channels), as well a TAS reference architecture. There is also a lack of tools for describing automation services and automations rules. In this regard, this thesis proposes a theoretical common model of TAS and formalizes it as the EWE ontology This model enables to compare channels and automations from different TASs, which has a high impact in interoperability; and enhances automations providing a mechanism to reason over external sources such as Linked Open Data. Based on this model, a dataset of components of TAS was built, harvesting data from the web sites of actual TASs. Going a step further towards this common model, an algorithm for categorizing them was designed, enabling their discovery across different TAS. Thus, the main contributions of the thesis are: i) surveying the state of the art on task automation and coining the term Task Automation Service; ii) providing a semantic common model for describing TAS components and automations; iii) populating a categorized dataset of TAS components, used to learn ontologies of particular domains from the TAS perspective; and iv) designing an agent architecture for assisting users in setting up automations, that is aware of their context and acts in consequence.

Face, content, and construct validity of the EndoViS training system for objective assessment of psychomotor skills of laparoscopic surgeons

Background The aim of this study is to present face, content, and constructs validity of the endoscopic orthogonal video system (EndoViS) training system and determines its efficiency as a training and objective assessment tool of the surgeons’ psychomotor skills. Methods Thirty-five surgeons and medical students participated in this study: 11 medical students, 19 residents, and 5 experts. All participants performed four basic skill tasks using conventional laparoscopic instruments and EndoViS training system. Subsequently, participants filled out a questionnaire regarding the design, realism, overall functionality, and its capabilities to train hand–eye coordination and depth perception, rated on a 5-point Likert scale. Motion data of the instruments were obtained by means of two webcams built into a laparoscopic physical trainer. To identify the surgical instruments in the images, colored markers were placed in each instrument. Thirteen motion-related metrics were used to assess laparoscopic performance of the participants. Statistical analysis of performance was made between novice, intermediate, and expert groups. Internal consistency of all metrics was analyzed with Cronbach’s α test. Results Overall scores about features of the EndoViS system were positives. Participants agreed with the usefulness of tasks and the training capacities of EndoViS system (score >4). Results presented significant differences in the execution of three skill tasks performed by participants. Seven metrics showed construct validity for assessment of performance with high consistency levels. Conclusions EndoViS training system has been successfully validated. Results showed that EndoViS was able to differentiate between participants of varying laparoscopic experience. This simulator is a useful and effective tool to objectively assess laparoscopic psychomotor skills of the surgeons.

Chromatic contrast in luminance-defined images affects performance and neural activity during a shape classification task

Funded by BBSRC funded grant, BB/H019731/1.

The impact of cognitive control on children's goal monitoring in a time-based prospective memory task

Peer reviewed

FosB mutant mice: Loss of chronic cocaine induction of Fos-related proteins and heightened sensitivity to cocaine’s psychomotor and rewarding effects

Chronic exposure to cocaine leads to prominent, long-lasting changes in behavior that characterize a state of addiction. The striatum, including the nucleus accumbens and caudoputamen, is an important substrate for these actions. We previously have shown that long-lasting Fos-related proteins of 35–37 kDa are induced in the striatum by chronic cocaine administration. In the present study, the identity and functional role of these Fos-related proteins were examined using fosB mutant mice. The striatum of these mice completely lacked basal levels of the 35- to 37-kDa Fos-related proteins as well as their induction by chronic cocaine administration. This deficiency was associated with enhanced behavioral responses to cocaine: fosB mutant mice showed exaggerated locomotor activation in response to initial cocaine exposures as well as robust conditioned place preference to a lower dose of cocaine, compared with wild-type littermates. These results establish the long-lasting Fos-related proteins as products of the fosB gene (specifically ΔFosB isoforms) and suggest that transcriptional regulation by fosB gene products plays a critical role in cocaine-induced behavioral responses. This finding demonstrates that a Fos family member protein plays a functional role in behavioral responses to drugs of abuse and implicates fosB gene products as important determinants of cocaine abuse.

Blind separation of auditory event-related brain responses into independent components

Averaged event-related potential (ERP) data recorded from the human scalp reveal electroencephalographic (EEG) activity that is reliably time-locked and phase-locked to experimental events. We report here the application of a method based on information theory that decomposes one or more ERPs recorded at multiple scalp sensors into a sum of components with fixed scalp distributions and sparsely activated, maximally independent time courses. Independent component analysis (ICA) decomposes ERP data into a number of components equal to the number of sensors. The derived components have distinct but not necessarily orthogonal scalp projections. Unlike dipole-fitting methods, the algorithm does not model the locations of their generators in the head. Unlike methods that remove second-order correlations, such as principal component analysis (PCA), ICA also minimizes higher-order dependencies. Applied to detected—and undetected—target ERPs from an auditory vigilance experiment, the algorithm derived ten components that decomposed each of the major response peaks into one or more ICA components with relatively simple scalp distributions. Three of these components were active only when the subject detected the targets, three other components only when the target went undetected, and one in both cases. Three additional components accounted for the steady-state brain response to a 39-Hz background click train. Major features of the decomposition proved robust across sessions and changes in sensor number and placement. This method of ERP analysis can be used to compare responses from multiple stimuli, task conditions, and subject states.

Differences in frontal cortical activation by a working memory task after substitution of risperidone for typical antipsychotic drugs in patients with schizophrenia

Antipsychotic drug treatment of schizophrenia may be complicated by side effects of widespread dopaminergic antagonism, including exacerbation of negative and cognitive symptoms due to frontal cortical hypodopaminergia. Atypical antipsychotics have been shown to enhance frontal dopaminergic activity in animal models. We predicted that substitution of risperidone for typical antipsychotic drugs in the treatment of schizophrenia would be associated with enhanced functional activation of frontal cortex. We measured cerebral blood oxygenation changes during periodic performance of a verbal working memory task, using functional MRI, on two occasions (baseline and 6 weeks later) in two cohorts of schizophrenic patients. One cohort (n = 10) was treated with typical antipsychotic drugs throughout the study. Risperidone was substituted for typical antipsychotics after baseline assessment in the second cohort (n = 10). A matched group of healthy volunteers (n = 10) was also studied on a single occasion. A network comprising bilateral dorsolateral prefrontal and lateral premotor cortex, the supplementary motor area, and posterior parietal cortex was activated by working memory task performance in both the patients and comparison subjects. A two-way analysis of covariance was used to estimate the effect of substituting risperidone for typical antipsychotics on power of functional response in the patient group. Substitution of risperidone increased functional activation in right prefrontal cortex, supplementary motor area, and posterior parietal cortex at both voxel and regional levels of analysis. This study provides direct evidence for significantly enhanced frontal function in schizophrenic patients after substitution of risperidone for typical antipsychotic drugs, and it indicates the potential value of functional MRI as a tool for longitudinal assessment of psychopharmacological effects on cerebral physiology.

A neuronal model of a global workspace in effortful cognitive tasks

A minimal hypothesis is proposed concerning the brain processes underlying effortful tasks. It distinguishes two main computational spaces: a unique global workspace composed of distributed and heavily interconnected neurons with long-range axons, and a set of specialized and modular perceptual, motor, memory, evaluative, and attentional processors. Workspace neurons are mobilized in effortful tasks for which the specialized processors do not suffice. They selectively mobilize or suppress, through descending connections, the contribution of specific processor neurons. In the course of task performance, workspace neurons become spontaneously coactivated, forming discrete though variable spatio-temporal patterns subject to modulation by vigilance signals and to selection by reward signals. A computer simulation of the Stroop task shows workspace activation to increase during acquisition of a novel task, effortful execution, and after errors. We outline predictions for spatio-temporal activation patterns during brain imaging, particularly about the contribution of dorsolateral prefrontal cortex and anterior cingulate to the workspace.

Detection of cortical activation during averaged single trials of a cognitive task using functional magnetic resonance imaging

Functional neuroimaging studies in human subjects using positron emission tomography or functional magnetic resonance imaging (fMRI) are typically conducted by collecting data over extended time periods that contain many similar trials of a task. Here methods for acquiring fMRI data from single trials of a cognitive task are reported. In experiment one, whole brain fMRI was used to reliably detect single-trial responses in a prefrontal region within single subjects. In experiment two, higher temporal sampling of a more limited spatial field was used to measure temporal offsets between regions. Activation maps produced solely from the single-trial data were comparable to those produced from blocked runs. These findings suggest that single-trial paradigms will be able to exploit the high temporal resolution of fMRI. Such paradigms will provide experimental flexibility and time-resolved data for individual brain regions on a trial-by-trial basis.

Cellular responses to psychomotor stimulant and neuroleptic drugs are abnormal in mice lacking the D1 dopamine receptor

Stimulation of dopamine D1 receptors has profound effects on addictive behavior, movement control, and working memory. Many of these functions depend on dopaminergic systems in the striatum and D1–D2 dopamine receptor synergies have been implicated as well. We show here that deletion of the D1 dopamine receptor produces a neural phenotype in which amphetamine and cocaine, two addictive psychomotor stimulants, can no longer stimulate neurons in the striatum to express cFos or JunB or to regulate dynorphin. By contrast, haloperidol, a typical neuroleptic that acts preferentially at D2-class receptors, remains effective in inducing catalepsy and striatal Fos/Jun expression in the D1 mutants, and these behavioral and neural effects can be blocked by D2 dopamine receptor agonists. These findings demonstrate that D2 dopamine receptors can function without the enabling role of D1 receptors but that D1 dopamine receptors are essential for the control of gene expression and motor behavior by psychomotor stimulants.

The role of prefrontal cortex and posterior parietal cortex in task switching

Human ability to switch from one cognitive task to another involves both endogenous preparation without an external stimulus and exogenous adjustment in response to the external stimulus. In an event-related functional MRI study, participants performed pairs of two tasks that are either the same (task repetition) or different (task switch) from each other. On half of the trials, foreknowledge about task repetition or task switch was available. On the other half, it was not. Endogenous preparation seems to involve lateral prefrontal cortex (BA 46/45) and posterior parietal cortex (BA 40). During preparation, higher activation increases in inferior lateral prefrontal cortex and superior posterior parietal cortex were associated with foreknowledge than with no foreknowledge. Exogenous adjustment seems to involve superior prefrontal cortex (BA 8) and posterior parietal cortex (BA 39/40) in general. During a task switch with no foreknowledge, activations in these areas were relatively higher than during a task repetition with no foreknowledge. These results suggest that endogenous preparation and exogenous adjustment for a task switch may be independent processes involving different brain areas.

The neural basis of task-switching in working memory: Effects of performance and aging

We studied the performance of young and senior subjects on a well known working memory task, the Operation Span. This is a dual-task in which subjects perform a memory task while simultaneously verifying simple equations. Positron-emission tomography scans were taken during performance. Both young and senior subjects demonstrated a cost in accuracy and latency in the Operation Span compared with performing each component task alone (math verification or memory only). Senior subjects were disproportionately impaired relative to young subjects on the dual-task. When brain activation was examined for senior subjects, we found regions in prefrontal cortex that were active in the dual-task, but not in the component tasks. Similar results were obtained for young subjects who performed relatively poorly on the dual-task; however, for young subjects who performed relatively well in the dual-task, we found no prefrontal regions that were active only in the dual-task. Results are discussed as they relate to the executive component of task switching.

CA1-specific N-methyl-d-aspartate receptor knockout mice are deficient in solving a nonspatial transverse patterning task

In both humans and animals, the hippocampus is critical to memory across modalities of information (e.g., spatial and nonspatial memory) and plays a critical role in the organization and flexible expression of memories. Recent studies have advanced our understanding of cellular basis of hippocampal function, showing that N-methyl-d-aspartate (NMDA) receptors in area CA1 are required in both the spatial and nonspatial domains of learning. Here we examined whether CA1 NMDA receptors are specifically required for the acquisition and flexible expression of nonspatial memory. Mice lacking CA1 NMDA receptors were impaired in solving a transverse patterning problem that required the simultaneous acquisition of three overlapping odor discriminations, and their impairment was related to an abnormal strategy by which they failed to adequately sample and compare the critical odor stimuli. By contrast, they performed normally, and used normal stimulus sampling strategies, in the concurrent learning of three nonoverlapping concurrent odor discriminations. These results suggest that CA1 NMDA receptors play a crucial role in the encoding and flexible expression of stimulus relations in nonspatial memory.

Effect of nicotine on brain activation during performance of a working memory task

Nicotine influences cognition and behavior, but the mechanisms by which these effects occur are unclear. By using positron emission tomography, we measured cognitive activation (increases in relative regional cerebral blood flow) during a working memory task [2-back task (2BT)] in 11 abstinent smokers and 11 ex-smokers. Assays were performed both after administration of placebo gum and 4-mg nicotine gum. Performance on the 2BT did not differ between groups in either condition, and the pattern of brain activation by the 2BT was consistent with reports in the literature. However, in the placebo condition, activation in ex-smokers predominated in the left hemisphere, whereas in smokers, it occurred in the right hemisphere. When nicotine was administered, activation was reduced in smokers but enhanced in ex-smokers. The lateralization of activation as a function of nicotine dependence suggests that chronic exposure to nicotine or withdrawal from nicotine affects cognitive strategies used to perform the memory task. Furthermore, the lack of enhancement of activation after nicotine administration in smokers likely reflects tolerance.