A Personal Agent Architecture for Task Automation in the Web of Data. Bringing intelligence to everyday tasks

Internet está evolucionando hacia la conocida como Live Web. En esta nueva etapa en la evolución de Internet, se pone al servicio de los usuarios multitud de streams de datos sociales. Gracias a estas fuentes de datos, los usuarios han pasado de navegar por páginas web estáticas a interacturar con aplicaciones que ofrecen contenido personalizado, basada en sus preferencias. Cada usuario interactúa a diario con multiples aplicaciones que ofrecen notificaciones y alertas, en este sentido cada usuario es una fuente de eventos, y a menudo los usuarios se sienten desbordados y no son capaces de procesar toda esa información a la carta. Para lidiar con esta sobresaturación, han aparecido múltiples herramientas que automatizan las tareas más habituales, desde gestores de bandeja de entrada, gestores de alertas en redes sociales, a complejos CRMs o smart-home hubs. La contrapartida es que aunque ofrecen una solución a problemas comunes, no pueden adaptarse a las necesidades de cada usuario ofreciendo una solucion personalizada. Los Servicios de Automatización de Tareas (TAS de sus siglas en inglés) entraron en escena a partir de 2012 para dar solución a esta liminación. Dada su semejanza, estos servicios también son considerados como un nuevo enfoque en la tecnología de mash-ups pero centra en el usuarios. Los usuarios de estas plataformas tienen la capacidad de interconectar servicios, sensores y otros aparatos con connexión a internet diseñando las automatizaciones que se ajustan a sus necesidades. La propuesta ha sido ámpliamante aceptada por los usuarios. Este hecho ha propiciado multitud de plataformas que ofrecen servicios TAS entren en escena. Al ser un nuevo campo de investigación, esta tesis presenta las principales características de los TAS, describe sus componentes, e identifica las dimensiones fundamentales que los defines y permiten su clasificación. En este trabajo se acuña el termino Servicio de Automatización de Tareas (TAS) dando una descripción formal para estos servicios y sus componentes (llamados canales), y proporciona una arquitectura de referencia. De igual forma, existe una falta de herramientas para describir servicios de automatización, y las reglas de automatización. A este respecto, esta tesis propone un modelo común que se concreta en la ontología EWE (Evented WEb Ontology). Este modelo permite com parar y equiparar canales y automatizaciones de distintos TASs, constituyendo un aporte considerable paraa la portabilidad de automatizaciones de usuarios entre plataformas. De igual manera, dado el carácter semántico del modelo, permite incluir en las automatizaciones elementos de fuentes externas sobre los que razonar, como es el caso de Linked Open Data. Utilizando este modelo, se ha generado un dataset de canales y automatizaciones, con los datos obtenidos de algunos de los TAS existentes en el mercado. Como último paso hacia el lograr un modelo común para describir TAS, se ha desarrollado un algoritmo para aprender ontologías de forma automática a partir de los datos del dataset. De esta forma, se favorece el descubrimiento de nuevos canales, y se reduce el coste de mantenimiento del modelo, el cual se actualiza de forma semi-automática. En conclusión, las principales contribuciones de esta tesis son: i) describir el estado del arte en automatización de tareas y acuñar el término Servicio de Automatización de Tareas, ii) desarrollar una ontología para el modelado de los componentes de TASs y automatizaciones, iii) poblar un dataset de datos de canales y automatizaciones, usado para desarrollar un algoritmo de aprendizaje automatico de ontologías, y iv) diseñar una arquitectura de agentes para la asistencia a usuarios en la creación de automatizaciones. ABSTRACT The new stage in the evolution of the Web (the Live Web or Evented Web) puts lots of social data-streams at the service of users, who no longer browse static web pages but interact with applications that present them contextual and relevant experiences. Given that each user is a potential source of events, a typical user often gets overwhelmed. To deal with that huge amount of data, multiple automation tools have emerged, covering from simple social media managers or notification aggregators to complex CRMs or smart-home Hub/Apps. As a downside, they cannot tailor to the needs of every single user. As a natural response to this downside, Task Automation Services broke in the Internet. They may be seen as a new model of mash-up technology for combining social streams, services and connected devices from an end-user perspective: end-users are empowered to connect those stream however they want, designing the automations they need. The numbers of those platforms that appeared early on shot up, and as a consequence the amount of platforms following this approach is growing fast. Being a novel field, this thesis aims to shed light on it, presenting and exemplifying the main characteristics of Task Automation Services, describing their components, and identifying several dimensions to classify them. This thesis coins the term Task Automation Services (TAS) by providing a formal definition of them, their components (called channels), as well a TAS reference architecture. There is also a lack of tools for describing automation services and automations rules. In this regard, this thesis proposes a theoretical common model of TAS and formalizes it as the EWE ontology This model enables to compare channels and automations from different TASs, which has a high impact in interoperability; and enhances automations providing a mechanism to reason over external sources such as Linked Open Data. Based on this model, a dataset of components of TAS was built, harvesting data from the web sites of actual TASs. Going a step further towards this common model, an algorithm for categorizing them was designed, enabling their discovery across different TAS. Thus, the main contributions of the thesis are: i) surveying the state of the art on task automation and coining the term Task Automation Service; ii) providing a semantic common model for describing TAS components and automations; iii) populating a categorized dataset of TAS components, used to learn ontologies of particular domains from the TAS perspective; and iv) designing an agent architecture for assisting users in setting up automations, that is aware of their context and acts in consequence.

Chromatic contrast in luminance-defined images affects performance and neural activity during a shape classification task

Funded by BBSRC funded grant, BB/H019731/1.

The impact of cognitive control on children's goal monitoring in a time-based prospective memory task

Peer reviewed

Differences in frontal cortical activation by a working memory task after substitution of risperidone for typical antipsychotic drugs in patients with schizophrenia

Antipsychotic drug treatment of schizophrenia may be complicated by side effects of widespread dopaminergic antagonism, including exacerbation of negative and cognitive symptoms due to frontal cortical hypodopaminergia. Atypical antipsychotics have been shown to enhance frontal dopaminergic activity in animal models. We predicted that substitution of risperidone for typical antipsychotic drugs in the treatment of schizophrenia would be associated with enhanced functional activation of frontal cortex. We measured cerebral blood oxygenation changes during periodic performance of a verbal working memory task, using functional MRI, on two occasions (baseline and 6 weeks later) in two cohorts of schizophrenic patients. One cohort (n = 10) was treated with typical antipsychotic drugs throughout the study. Risperidone was substituted for typical antipsychotics after baseline assessment in the second cohort (n = 10). A matched group of healthy volunteers (n = 10) was also studied on a single occasion. A network comprising bilateral dorsolateral prefrontal and lateral premotor cortex, the supplementary motor area, and posterior parietal cortex was activated by working memory task performance in both the patients and comparison subjects. A two-way analysis of covariance was used to estimate the effect of substituting risperidone for typical antipsychotics on power of functional response in the patient group. Substitution of risperidone increased functional activation in right prefrontal cortex, supplementary motor area, and posterior parietal cortex at both voxel and regional levels of analysis. This study provides direct evidence for significantly enhanced frontal function in schizophrenic patients after substitution of risperidone for typical antipsychotic drugs, and it indicates the potential value of functional MRI as a tool for longitudinal assessment of psychopharmacological effects on cerebral physiology.

Detection of cortical activation during averaged single trials of a cognitive task using functional magnetic resonance imaging

Functional neuroimaging studies in human subjects using positron emission tomography or functional magnetic resonance imaging (fMRI) are typically conducted by collecting data over extended time periods that contain many similar trials of a task. Here methods for acquiring fMRI data from single trials of a cognitive task are reported. In experiment one, whole brain fMRI was used to reliably detect single-trial responses in a prefrontal region within single subjects. In experiment two, higher temporal sampling of a more limited spatial field was used to measure temporal offsets between regions. Activation maps produced solely from the single-trial data were comparable to those produced from blocked runs. These findings suggest that single-trial paradigms will be able to exploit the high temporal resolution of fMRI. Such paradigms will provide experimental flexibility and time-resolved data for individual brain regions on a trial-by-trial basis.

The role of prefrontal cortex and posterior parietal cortex in task switching

Human ability to switch from one cognitive task to another involves both endogenous preparation without an external stimulus and exogenous adjustment in response to the external stimulus. In an event-related functional MRI study, participants performed pairs of two tasks that are either the same (task repetition) or different (task switch) from each other. On half of the trials, foreknowledge about task repetition or task switch was available. On the other half, it was not. Endogenous preparation seems to involve lateral prefrontal cortex (BA 46/45) and posterior parietal cortex (BA 40). During preparation, higher activation increases in inferior lateral prefrontal cortex and superior posterior parietal cortex were associated with foreknowledge than with no foreknowledge. Exogenous adjustment seems to involve superior prefrontal cortex (BA 8) and posterior parietal cortex (BA 39/40) in general. During a task switch with no foreknowledge, activations in these areas were relatively higher than during a task repetition with no foreknowledge. These results suggest that endogenous preparation and exogenous adjustment for a task switch may be independent processes involving different brain areas.

The neural basis of task-switching in working memory: Effects of performance and aging

We studied the performance of young and senior subjects on a well known working memory task, the Operation Span. This is a dual-task in which subjects perform a memory task while simultaneously verifying simple equations. Positron-emission tomography scans were taken during performance. Both young and senior subjects demonstrated a cost in accuracy and latency in the Operation Span compared with performing each component task alone (math verification or memory only). Senior subjects were disproportionately impaired relative to young subjects on the dual-task. When brain activation was examined for senior subjects, we found regions in prefrontal cortex that were active in the dual-task, but not in the component tasks. Similar results were obtained for young subjects who performed relatively poorly on the dual-task; however, for young subjects who performed relatively well in the dual-task, we found no prefrontal regions that were active only in the dual-task. Results are discussed as they relate to the executive component of task switching.

CA1-specific N-methyl-d-aspartate receptor knockout mice are deficient in solving a nonspatial transverse patterning task

In both humans and animals, the hippocampus is critical to memory across modalities of information (e.g., spatial and nonspatial memory) and plays a critical role in the organization and flexible expression of memories. Recent studies have advanced our understanding of cellular basis of hippocampal function, showing that N-methyl-d-aspartate (NMDA) receptors in area CA1 are required in both the spatial and nonspatial domains of learning. Here we examined whether CA1 NMDA receptors are specifically required for the acquisition and flexible expression of nonspatial memory. Mice lacking CA1 NMDA receptors were impaired in solving a transverse patterning problem that required the simultaneous acquisition of three overlapping odor discriminations, and their impairment was related to an abnormal strategy by which they failed to adequately sample and compare the critical odor stimuli. By contrast, they performed normally, and used normal stimulus sampling strategies, in the concurrent learning of three nonoverlapping concurrent odor discriminations. These results suggest that CA1 NMDA receptors play a crucial role in the encoding and flexible expression of stimulus relations in nonspatial memory.

Effect of nicotine on brain activation during performance of a working memory task

Nicotine influences cognition and behavior, but the mechanisms by which these effects occur are unclear. By using positron emission tomography, we measured cognitive activation (increases in relative regional cerebral blood flow) during a working memory task [2-back task (2BT)] in 11 abstinent smokers and 11 ex-smokers. Assays were performed both after administration of placebo gum and 4-mg nicotine gum. Performance on the 2BT did not differ between groups in either condition, and the pattern of brain activation by the 2BT was consistent with reports in the literature. However, in the placebo condition, activation in ex-smokers predominated in the left hemisphere, whereas in smokers, it occurred in the right hemisphere. When nicotine was administered, activation was reduced in smokers but enhanced in ex-smokers. The lateralization of activation as a function of nicotine dependence suggests that chronic exposure to nicotine or withdrawal from nicotine affects cognitive strategies used to perform the memory task. Furthermore, the lack of enhancement of activation after nicotine administration in smokers likely reflects tolerance.

Spatially independent activity patterns in functional MRI data during the Stroop color-naming task

A method is given for determining the time course and spatial extent of consistently and transiently task-related activations from other physiological and artifactual components that contribute to functional MRI (fMRI) recordings. Independent component analysis (ICA) was used to analyze two fMRI data sets from a subject performing 6-min trials composed of alternating 40-sec Stroop color-naming and control task blocks. Each component consisted of a fixed three-dimensional spatial distribution of brain voxel values (a “map”) and an associated time course of activation. For each trial, the algorithm detected, without a priori knowledge of their spatial or temporal structure, one consistently task-related component activated during each Stroop task block, plus several transiently task-related components activated at the onset of one or two of the Stroop task blocks only. Activation patterns occurring during only part of the fMRI trial are not observed with other techniques, because their time courses cannot easily be known in advance. Other ICA components were related to physiological pulsations, head movements, or machine noise. By using higher-order statistics to specify stricter criteria for spatial independence between component maps, ICA produced improved estimates of the temporal and spatial extent of task-related activation in our data compared with principal component analysis (PCA). ICA appears to be a promising tool for exploratory analysis of fMRI data, particularly when the time courses of activation are not known in advance.

The effects of practice on the functional anatomy of task performance

The effects of practice on the functional anatomy observed in two different tasks, a verbal and a motor task, are reviewed in this paper. In the first, people practiced a verbal production task, generating an appropriate verb in response to a visually presented noun. Both practiced and unpracticed conditions utilized common regions such as visual and motor cortex. However, there was a set of regions that was affected by practice. Practice produced a shift in activity from left frontal, anterior cingulate, and right cerebellar hemisphere to activity in Sylvian-insular cortex. Similar changes were also observed in the second task, a task in a very different domain, namely the tracing of a maze. Some areas were significantly more activated during initial unskilled performance (right premotor and parietal cortex and left cerebellar hemisphere); a different region (medial frontal cortex, “supplementary motor area”) showed greater activity during skilled performance conditions. Activations were also found in regions that most likely control movement execution irrespective of skill level (e.g., primary motor cortex was related to velocity of movement). One way of interpreting these results is in a “scaffolding-storage” framework. For unskilled, effortful performance, a scaffolding set of regions is used to cope with novel task demands. Following practice, a different set of regions is used, possibly representing storage of particular associations or capabilities that allow for skilled performance. The specific regions used for scaffolding and storage appear to be task dependent.

Interocular transfer in perceptual learning of a pop-out discrimination task.

The specificity of the improvement in perceptual learning is often used to localize the neuronal changes underlying this type of adult plasticity. We investigated a visual texture discrimination task previously reported to be accomplished preattentively and for which learning-related changes were inferred to occur at a very early level of the visual processing stream. The stimulus was a matrix of lines from which a target popped out, due to an orientation difference between the three target lines and the background lines. The task was to report the global orientation of the target and was performed monocularly. The subjects' performance improved dramatically with training over the course of 2-3 weeks, after which we tested the specificity of the improvement for the eye trained. In all subjects tested, there was complete interocular transfer of the learning effect. The neuronal correlate of this learning are therefore most likely localized in a visual area where input from the two eyes has come together.

Activity of primate inferotemporal neurons related to a sought target in pair-association task.

Visual long-term memory in primates has been assessed by using the pair-association (PA) task, in which a subject retrieves and chooses the paired associate of a cue picture. Our previous studies on single neurons in the anterior inferotemporal (AIT) cortex suggested their roles in representing paired associates in the mind. To test the possibility that the delay activity of AIT neurons is related to a particular picture as a sought target, we devised the PA with color switch (PACS) task. In the PACS task, the necessity for memory retrieval and its initiation time were controlled by a color switch in the middle of the delay period. A control task, in which there is no color switch, corresponds to the conventional delayed matching-to-sample (DMS) task where the monkey chooses the same picture as a cue. We found that AIT neurons started to respond just after the color switch in the PACS task, when the cue-optimal picture's associate was presented as a cue. In contrast, they showed no response change in the DMS task. We confirmed that this effect is not due to the visual response to colors. Furthermore, when the cue-optimal picture was presented as a cue, these neurons showed suppression after the color switch in the PACS task. These results suggest that the activity of AIT neurons mediates gating mechanisms that preferentially pass information about a sought target, even when the sought target is retrieved from long-term memory.

The deferred imitation task as a nonverbal measure of declarative memory.

We tested amnesic patients, patients with frontal lobe lesions, and control subjects with the deferred imitation task, a nonverbal test used to demonstrate memory abilities in human infants. On day 1, subjects were given sets of objects to obtain a baseline measure of their spontaneous performance of target actions. Then different event sequences were modeled with the object sets. On day 2, the objects were given to the subjects again, first without any instructions to imitate the sequences, and then with explicit instructions to imitate the actions exactly as they had been modeled. Control subjects and frontal lobe patients reproduced the events under both uninstructed and instructed conditions. In contrast, performance by the amnesic patients did not significantly differ from that of a second control group who had the same opportunities to handle the objects but were not shown the modeled actions. These findings suggest that deferred imitation is dependent on the brain structures essential for declarative memory that are damaged in amnesia, and they support the view that infants who imitate actions after long delays have an early capacity for long-term declarative memory.

Memory enhancement by intrahippocampal, intraamygdala, or intraentorhinal infusion of platelet-activating factor measured in an inhibitory avoidance task.

Platelet-activating factor (PAF; 1-O-alkyl-2-acetyl-sn-glycero-3-phosphocholine), which is thought to be a retrograde messenger in long-term potentiation (LTP), enhances glutamate release and LTP through an action on presynaptic nerve endings. The PAF antagonist BN 52021 blocks CA1 LTP in hippocampal slices, and, when infused into rat dorsal hippocampus pre- or posttraining, blocks retention of inhibitory avoidance. Here we report that memory is affected by pre- or posttraining infusion of the PAF analog 1-O-hexadecyl-2-N-methylcarbamoyl-sn-glycerol-3-phosphocholine (mc-PAF) into either rat dorsal hippocampus, amygdala, or entorhinal cortex. Male Wistar rats were implanted bilaterally with cannulae in these brain regions. After recovery from surgery, the animals were trained in step-down inhibitory avoidance or in a spatial habituation task and tested for retention 24 h later. mc-PAF (1.0 microgram per side) enhanced retention test performance of the two tasks when infused into the hippocampus before training without altering training session performance. In addition, mc-PAF enhanced retention test performance of the avoidance task when infused into (i) the hippocampus 0 but not 60 min after training; (ii) the amygdala immediately after training; and (iii) the entorhinal cortex 100 but not 0 or 300 min after training. In confirmation of previous findings, BN 52021 (0.5 microgram per side) was found to be amnestic for the avoidance task when infused into the hippocampus or the amygdala immediately but not 30 or more minutes after training or into the entorhinal cortex 100 but not 0 or 300 min after training. These findings support the hypothesis that memory involves PAF-regulated events, possibly LTP, generated at the time of training in hippocampus and amygdala and 100 min later in the entorhinal cortex.