Overall evaluation of the PETS2009 results

This paper presents the results of the crowd image analysis challenge, as part of the PETS 2009 workshop. The evaluation is carried out using a selection of the metrics available in the Video Analysis and Content Extraction (VACE) program and the CLassification of Events, Activities, and Relationships (CLEAR) consortium. The evaluation highlights the strengths of the authors’ systems in areas such as precision, accuracy and robustness.

PETS2009 and Winter-PETS 2009 results: a combined evaluation

This paper presents the results of the crowd image analysis challenge of the Winter PETS 2009 workshop. The evaluation is carried out using a selection of the metrics developed in the Video Analysis and Content Extraction (VACE) program and the CLassification of Events, Activities, and Relationships (CLEAR) consortium [13]. The evaluation highlights the detection and tracking performance of the authors’systems in areas such as precision, accuracy and robustness. The performance is also compared to the PETS 2009 submitted results.

PETS2010 and PETS2009 evaluation of results using individual ground truthed single views

This paper presents the results of the crowd image analysis challenge of the PETS2010 workshop. The evaluation was carried out using a selection of the metrics developed in the Video Analysis and Content Extraction (VACE) program and the CLassification of Events, Activities, and Relationships (CLEAR) consortium. The PETS 2010 evaluation was performed using new ground truthing create from each independant two dimensional view. In addition, the performance of the submissions to the PETS 2009 and Winter-PETS 2009 were evaluated and included in the results. The evaluation highlights the detection and tracking performance of the authors’ systems in areas such as precision, accuracy and robustness.

Supplementary feeding of wild birds indirectly affects ground beetle populations in suburban gardens

Supplementary feeding of wild birds by domestic garden-holders is a globally widespread and popular form of human–wildlife interaction, particularly in urban areas. Vast amounts of energy are thus being added to garden ecosystems. However, the potential indirect effects of this activity on non-avian species have been little studied to date, with the only two previous studies taking place under experimentally manipulated conditions. Here we present the first evidence of a localised depletive effect of wild bird feeding on ground beetles (Coleoptera: Carabidae) in suburban gardens under the usual feeding patterns of the garden-holders. We trapped significantly fewer ground beetles directly under bird-feeding stations than in matched areas of habitat away from feeders. Video analysis also revealed significantly higher activity by ground-foraging birds under the feeding stations than in the control areas. Small mammal trapping revealed no evidence that these species differ in abundance between gardens with and without bird feeders. We therefore suggest that local increases in ground-foraging activity by bird species whose diets encompass arthropods as well as seed material are responsible for the reduction in ground beetle numbers. Our work therefore illustrates that providing food for wild birds can have indirect negative effects on palatable prey species under typical conditions.

PETS 2015: datasets and challenge

This paper presents the two datasets (ARENA and P5) and the challenge that form a part of the PETS 2015 workshop. The datasets consist of scenarios recorded by us- ing multiple visual and thermal sensors. The scenarios in ARENA dataset involve different staged activities around a parked vehicle in a parking lot in UK and those in P5 dataset involve different staged activities around the perimeter of a nuclear power plant in Sweden. The scenarios of each dataset are grouped into ‘Normal’, ‘Warning’ and ‘Alarm’ categories. The Challenge specifically includes tasks that account for different steps in a video understanding system: Low-Level Video Analysis (object detection and tracking), Mid-Level Video Analysis (‘atomic’ event detection) and High-Level Video Analysis (‘complex’ event detection). The evaluation methodology used for the Challenge includes well-established measures.

PETS 2014: dataset and challenge

This paper describes the dataset and vision challenges that form part of the PETS 2014 workshop. The datasets are multisensor sequences containing different activities around a parked vehicle in a parking lot. The dataset scenarios were filmed from multiple cameras mounted on the vehicle itself and involve multiple actors. In PETS2014 workshop, 22 acted scenarios are provided of abnormal behaviour around the parked vehicle. The aim in PETS 2014 is to provide a standard benchmark that indicates how detection, tracking, abnormality and behaviour analysis systems perform against a common database. The dataset specifically addresses several vision challenges corresponding to different steps in a video understanding system: Low-Level Video Analysis (object detection and tracking), Mid-Level Video Analysis (‘simple’ event detection: the behaviour recognition of a single actor) and High-Level Video Analysis (‘complex’ event detection: the behaviour and interaction recognition of several actors).

Adaptação e instrumentação de um esqui ergométrico para pessoas com deficiência motora dos membros inferiores

Pós-graduação em Engenharia Elétrica - FEIS

Assessment of Alcohol Reward in Prairie Voles (Microtus ochrogaster)

The purpose of our study was to assess whether prairie voles find alcohol rewarding. Prairie voles have recently become a species of interest for alcohol studies, which have traditionally used other rodent model species including several different strains of mice and rats. The prairie vole is one of only two known rodent species that readily administers high levels of unsweetened alcohol, implicating it as a potentially effective animal model for studying alcohol abuse. However, voluntary consumption does not necessarily imply that prairie voles find it rewarding. Therefore the purpose of our study was to investigate if alcohol has rewarding properties for prairie voles using three different approaches: place conditioning, flavor conditioning, and immunohistochemistry. Furthermore, we sought to characterize their reward profile and compare it to other commonly used rodent models ¿ C57BL/6 mice, DBA/2J mice, and Sprague-Dawley rats. Place and flavor conditioning are behavioral methods that rely on the learned association between a stimulus and the effects of a drug; the drug of interest in these studies is alcohol. To assess whether prairie voles will demonstrate a conditioned preference for alcohol-paired stimuli, seven place conditioning studies were run that investigated a range of different doses, individual conditioning session durations, and trial durations. Video analysis revealed no difference in the amount of time spent on the alcohol-paired floor, suggesting no conditioned place preference for alcohol. Two flavor conditioning tests were conducted to assess whether voles would demonstrate a preference for an alcohol-paired flavored saccharin solution. Voles demonstrated reduced consumption of the alcohol-paired flavored saccharin solution, regardless of dose or flavor, when alcohol administration occurred after conditioning sessions (p=<0.001). When alcohol was administered before conditioning sessions, no difference in consumption of the alcohol-paired and saline-paired flavored saccharin solutions was seen (p=0.545). Previous studies that have documented similar behavior have hypothesized that this is an example of an anticipatory contrast effect. This theory proposes that prairie voles reduce their intake of a hedonic solution (flavored saccharin solution) in anticipation of later drug administration (alcohol). However, conditioning-based behavioral methods of studying alcohol reward are highly sensitive to the parameters of the conditioned stimulus, thus it is possible that voles will not show preference for alcohol-related stimuli, even if they do find alcohol rewarding. Immunohistochemical analysis supplemented this behavioral data by allowing us to identify specific neural regions that were directly activated in response to the acute administration of alcohol. No difference in the number of activated c-Fos neurons in the Nucleus Accumbens (NAc) core or shell was seen (p=0.3364; p=0.6698) in animals that received an acute injection of alcohol or saline. There was a significant increase in the number of activated c-Fos neurons in the Paraventricular Nucleus of the Hypothalamus (PVN) in alcohol-treated animals compared to saline-treated animals (p=0.0034). There was no difference in the pixel count of activated c-Fos neurons or in the % area activated in the Arcuate Nucleus between alcohol and saline-treated animals (p=0.4523; p=0.3304). In conclusion, the place conditioning studies that were conducted in this thesis suggest that prairie voles do not demonstrate preference or aversion towards alcohol-paired stimuli. The flavor conditioning studies suggest that prairie voles do not demonstrate aversion but rather avoidance of the alcohol-paired flavor in anticipation of future alcohol administration. The preliminary immunohistochemical data collected is inconclusive but cannot rule out the possibility of neuronal activation patterns indicative of reward. Taken together, our data indicate that prairie voles hav

Occasional white boarding : examining the effects of physics students' understanding of motion graphs

The Modeling method of teaching has demonstrated well--‐documented success in the improvement of student learning. The teacher/researcher in this study was introduced to Modeling through the use of a technique called White Boarding. Without formal training, the researcher began using the White Boarding technique for a limited number of laboratory experiences with his high school physics classes. The question that arose and was investigated in this study is “What specific aspects of the White Boarding process support student understanding?” For the purposes of this study, the White Boarding process was broken down into three aspects – the Analysis of data through the use of Logger Pro software, the Preparation of White Boards, and the Presentations each group gave about their specific lab data. The lab used in this study, an Acceleration of Gravity Lab, was chosen because of the documented difficulties students experience in the graphing of motion. In the lab, students filmed a given motion, utilized Logger Pro software to analyze the motion, prepared a White Board that described the motion with position--‐time and velocity--‐time graphs, and then presented their findings to the rest of the class. The Presentation included a class discussion with minimal contribution from the teacher. The three different aspects of the White Boarding experience – Analysis, Preparation, and Presentation – were compared through the use of student learning logs, video analysis of the Presentations, and follow--‐up interviews with participants. The information and observations gathered were used to determine the level of understanding of each participant during each phase of the lab. The researcher then looked for improvement in the level of student understanding, the number of “aha” moments students had, and the students’ perceptions about which phase was most important to their learning. The results suggest that while all three phases of the White Boarding experience play a part in the learning process for students, the Presentations provided the most significant changes. The implications for instruction are discussed.

The temporal evolution of nonverbal synchrony in outpatient psychotherapy: An aggregation of single-case studies

Objective: The authors quantified nonverbal synchrony—the coordination of patient's and therapist's movement—in a random sample of same-sex psychotherapy dyads. The authors contrasted nonverbal synchrony in these dyads with a control condition and assessed its association with session-level and overall psychotherapy outcome. Method: Using an automated objective video analysis algorithm (Motion Energy Analysis; MEA), the authors calculated nonverbal synchrony in (n = 104) videotaped psychotherapy sessions from 70 Caucasian patients (37 women, 33 men, mean age = 36.5 years, SD = 10.2) treated at an outpatient psychotherapy clinic. The sample was randomly drawn from an archive (N = 301) of routinely videotaped psychotherapies. Patients and their therapists assessed session impact with self-report postsession questionnaires. A battery of pre- and postsymptomatology questionnaires measured therapy effectiveness. Results: The authors found that nonverbal synchrony is higher in genuine interactions contrasted with pseudointeractions (a control condition generated by a specifically designed shuffling procedure). Furthermore, nonverbal synchrony is associated with session-level process as well as therapy outcome: It is increased in sessions rated by patients as manifesting high relationship quality and in patients experiencing high self-efficacy. Higher nonverbal synchrony characterized psychotherapies with higher symptom reduction. Conclusions: The results suggest that nonverbal synchrony embodies the patients' self-reported quality of the relationship and further variables of therapy process. This hitherto overlooked facet of therapeutic relationships might prove useful as an indicator of therapy progress and outcome. (PsycINFO Database Record (c) 2015 APA, all rights reserved)

Seawater carbonate chemistry and swimming behaviors of the raphidophyte Heterosigma akashiwo in a laboratory experiment

We investigated the effects of pH on movement behaviors of the harmful algal bloom causing raphidophyte Heterosigma akashiwo. Motility parameters from >8000 swimming tracks of individual cells were quantified using 3D digital video analysis over a 6-h period in 3 pH treatments reflecting marine carbonate chemistry during the pre-industrial era, currently, and the year 2100. Movement behaviors were investigated in two different acclimation-to-target-pH conditions: instantaneous exposure and acclimation of cells for at least 11 generations. There was no negative impairment of cell motility when exposed to elevated PCO2 (i.e., low pH) conditions but there were significant behavioral responses. Irrespective of acclimation condition, lower pH significantly increased downward velocity and frequency of downward swimming cells (p < 0.001). Rapid exposure to lower pH resulted in 9% faster downward vertical velocity and up to 19% more cells swimming downwards (p < 0.001). Compared to pH-shock experiments, pre-acclimation of cells to target pH resulted in ~30% faster swimming speed and up to 46% faster downward velocities (all p < 0.001). The effect of year 2100 PCO2 levels on population diffusivity in pre-acclimated cultures was >2-fold greater than in pH-shock treatments (2.2 × 105 µm**2/s vs. 8.4 × 104 µm**2/s). Predictions from an advection-diffusion model, suggest that as PCO2 increased the fraction of the population aggregated at the surface declined, and moved deeper in the water column. Enhanced downward swimming of H. akashiwo at low pH suggests that these behavioral responses to elevated PCO2 could reduce the likelihood of dense surface slick formation of H. akashiwo through reductions in light exposure or growth independent surface aggregations. We hypothesize that the HAB alga's response to higher PCO2 may exploit the signaling function of high PCO2 as indicative of net heterotrophy in the system, thus indicative of high predation rates or depletion of nutrients.

Conceptual framework for the design, implementation and validation of psychomotor skills’ assessment systems in minimally invasive surgery

Las técnicas de cirugía de mínima invasión (CMI) se están consolidando hoy en día como alternativa a la cirugía tradicional, debido a sus numerosos beneficios para los pacientes. Este cambio de paradigma implica que los cirujanos deben aprender una serie de habilidades distintas de aquellas requeridas en cirugía abierta. El entrenamiento y evaluación de estas habilidades se ha convertido en una de las mayores preocupaciones en los programas de formación de cirujanos, debido en gran parte a la presión de una sociedad que exige cirujanos bien preparados y una reducción en el número de errores médicos. Por tanto, se está prestando especial atención a la definición de nuevos programas que permitan el entrenamiento y la evaluación de las habilidades psicomotoras en entornos seguros antes de que los nuevos cirujanos puedan operar sobre pacientes reales. Para tal fin, hospitales y centros de formación están gradualmente incorporando instalaciones de entrenamiento donde los residentes puedan practicar y aprender sin riesgos. Es cada vez más común que estos laboratorios dispongan de simuladores virtuales o simuladores físicos capaces de registrar los movimientos del instrumental de cada residente. Estos simuladores ofrecen una gran variedad de tareas de entrenamiento y evaluación, así como la posibilidad de obtener información objetiva de los ejercicios. Los diferentes estudios de validación llevados a cabo dan muestra de su utilidad; pese a todo, los niveles de evidencia presentados son en muchas ocasiones insuficientes. Lo que es más importante, no existe un consenso claro a la hora de definir qué métricas son más útiles para caracterizar la pericia quirúrgica. El objetivo de esta tesis doctoral es diseñar y validar un marco de trabajo conceptual para la definición y validación de entornos para la evaluación de habilidades en CMI, en base a un modelo en tres fases: pedagógica (tareas y métricas a emplear), tecnológica (tecnologías de adquisición de métricas) y analítica (interpretación de la competencia en base a las métricas). Para tal fin, se describe la implementación práctica de un entorno basado en (1) un sistema de seguimiento de instrumental fundamentado en el análisis del vídeo laparoscópico; y (2) la determinación de la pericia en base a métricas de movimiento del instrumental. Para la fase pedagógica se diseñó e implementó un conjunto de tareas para la evaluación de habilidades psicomotoras básicas, así como una serie de métricas de movimiento. La validación de construcción llevada a cabo sobre ellas mostró buenos resultados para tiempo, camino recorrido, profundidad, velocidad media, aceleración media, economía de área y economía de volumen. Adicionalmente, los resultados obtenidos en la validación de apariencia fueron en general positivos en todos los grupos considerados (noveles, residentes, expertos). Para la fase tecnológica, se introdujo el EVA Tracking System, una solución para el seguimiento del instrumental quirúrgico basado en el análisis del vídeo endoscópico. La precisión del sistema se evaluó a 16,33ppRMS para el seguimiento 2D de la herramienta en la imagen; y a 13mmRMS para el seguimiento espacial de la misma. La validación de construcción con una de las tareas de evaluación mostró buenos resultados para tiempo, camino recorrido, profundidad, velocidad media, aceleración media, economía de área y economía de volumen. La validación concurrente con el TrEndo® Tracking System por su parte presentó valores altos de correlación para 8 de las 9 métricas analizadas. Finalmente, para la fase analítica se comparó el comportamiento de tres clasificadores supervisados a la hora de determinar automáticamente la pericia quirúrgica en base a la información de movimiento del instrumental, basados en aproximaciones lineales (análisis lineal discriminante, LDA), no lineales (máquinas de soporte vectorial, SVM) y difusas (sistemas adaptativos de inferencia neurodifusa, ANFIS). Los resultados muestran que en media SVM presenta un comportamiento ligeramente superior: 78,2% frente a los 71% y 71,7% obtenidos por ANFIS y LDA respectivamente. Sin embargo las diferencias estadísticas medidas entre los tres no fueron demostradas significativas. En general, esta tesis doctoral corrobora las hipótesis de investigación postuladas relativas a la definición de sistemas de evaluación de habilidades para cirugía de mínima invasión, a la utilidad del análisis de vídeo como fuente de información y a la importancia de la información de movimiento de instrumental a la hora de caracterizar la pericia quirúrgica. Basándose en estos cimientos, se han de abrir nuevos campos de investigación que contribuyan a la definición de programas de formación estructurados y objetivos, que puedan garantizar la acreditación de cirujanos sobradamente preparados y promocionen la seguridad del paciente en el quirófano. Abstract Minimally invasive surgery (MIS) techniques have become a standard in many surgical sub-specialties, due to their many benefits for patients. However, this shift in paradigm implies that surgeons must acquire a complete different set of skills than those normally attributed to open surgery. Training and assessment of these skills has become a major concern in surgical learning programmes, especially considering the social demand for better-prepared professionals and for the decrease of medical errors. Therefore, much effort is being put in the definition of structured MIS learning programmes, where practice with real patients in the operating room (OR) can be delayed until the resident can attest for a minimum level of psychomotor competence. To this end, skills’ laboratory settings are being introduced in hospitals and training centres where residents may practice and be assessed on their psychomotor skills. Technological advances in the field of tracking technologies and virtual reality (VR) have enabled the creation of new learning systems such as VR simulators or enhanced box trainers. These systems offer a wide range of tasks, as well as the capability of registering objective data on the trainees’ performance. Validation studies give proof of their usefulness; however, levels of evidence reported are in many cases low. More importantly, there is still no clear consensus on topics such as the optimal metrics that must be used to assess competence, the validity of VR simulation, the portability of tracking technologies into real surgeries (for advanced assessment) or the degree to which the skills measured and obtained in laboratory environments transfer to the OR. The purpose of this PhD is to design and validate a conceptual framework for the definition and validation of MIS assessment environments based on a three-pillared model defining three main stages: pedagogical (tasks and metrics to employ), technological (metric acquisition technologies) and analytical (interpretation of competence based on metrics). To this end, a practical implementation of the framework is presented, focused on (1) a video-based tracking system and (2) the determination of surgical competence based on the laparoscopic instruments’ motionrelated data. The pedagogical stage’s results led to the design and implementation of a set of basic tasks for MIS psychomotor skills’ assessment, as well as the definition of motion analysis parameters (MAPs) to measure performance on said tasks. Validation yielded good construct results for parameters such as time, path length, depth, average speed, average acceleration, economy of area and economy of volume. Additionally, face validation results showed positive acceptance on behalf of the experts, residents and novices. For the technological stage the EVA Tracking System is introduced. EVA provides a solution for tracking laparoscopic instruments from the analysis of the monoscopic video image. Accuracy tests for the system are presented, which yielded an average RMSE of 16.33pp for 2D tracking of the instrument on the image and of 13mm for 3D spatial tracking. A validation experiment was conducted using one of the tasks and the most relevant MAPs. Construct validation showed significant differences for time, path length, depth, average speed, average acceleration, economy of area and economy of volume; especially between novices and residents/experts. More importantly, concurrent validation with the TrEndo® Tracking System presented high correlation values (>0.7) for 8 of the 9 MAPs proposed. Finally, the analytical stage allowed comparing the performance of three different supervised classification strategies in the determination of surgical competence based on motion-related information. The three classifiers were based on linear (linear discriminant analysis, LDA), non-linear (support vector machines, SVM) and fuzzy (adaptive neuro fuzzy inference systems, ANFIS) approaches. Results for SVM show slightly better performance than the other two classifiers: on average, accuracy for LDA, SVM and ANFIS was of 71.7%, 78.2% and 71% respectively. However, when confronted, no statistical significance was found between any of the three. Overall, this PhD corroborates the investigated research hypotheses regarding the definition of MIS assessment systems, the use of endoscopic video analysis as the main source of information and the relevance of motion analysis in the determination of surgical competence. New research fields in the training and assessment of MIS surgeons can be proposed based on these foundations, in order to contribute to the definition of structured and objective learning programmes that guarantee the accreditation of well-prepared professionals and the promotion of patient safety in the OR.

Adaptive neuro-fuzzy inference systems (ANFIS) for supervised classification of competence in MIS based on psychomotor skills

INTRODUCTION: Objective assessment of motor skills has become an important challenge in minimally invasive surgery (MIS) training.Currently, there is no gold standard defining and determining the residents' surgical competence.To aid in the decision process, we analyze the validity of a supervised classifier to determine the degree of MIS competence based on assessment of psychomotor skills METHODOLOGY: The ANFIS is trained to classify performance in a box trainer peg transfer task performed by two groups (expert/non expert). There were 42 participants included in the study: the non-expert group consisted of 16 medical students and 8 residents (< 10 MIS procedures performed), whereas the expert group consisted of 14 residents (> 10 MIS procedures performed) and 4 experienced surgeons. Instrument movements were captured by means of the Endoscopic Video Analysis (EVA) tracking system. Nine motion analysis parameters (MAPs) were analyzed, including time, path length, depth, average speed, average acceleration, economy of area, economy of volume, idle time and motion smoothness. Data reduction was performed by means of principal component analysis, and then used to train the ANFIS net. Performance was measured by leave one out cross validation. RESULTS: The ANFIS presented an accuracy of 80.95%, where 13 experts and 21 non-experts were correctly classified. Total root mean square error was 0.88, while the area under the classifiers' ROC curve (AUC) was measured at 0.81. DISCUSSION: We have shown the usefulness of ANFIS for classification of MIS competence in a simple box trainer exercise. The main advantage of using ANFIS resides in its continuous output, which allows fine discrimination of surgical competence. There are, however, challenges that must be taken into account when considering use of ANFIS (e.g. training time, architecture modeling). Despite this, we have shown discriminative power of ANFIS for a low-difficulty box trainer task, regardless of the individual significances between MAPs. Future studies are required to confirm the findings, inclusion of new tasks, conditions and sample population.

On-road visual vehicle tracking using Markov chain Monte Carlo with metropolis sampling

In this study, a method for vehicle tracking through video analysis based on Markov chain Monte Carlo (MCMC) particle filtering with metropolis sampling is proposed. The method handles multiple targets with low computational requirements and is, therefore, ideally suited for advanced-driver assistance systems that involve real-time operation. The method exploits the removed perspective domain given by inverse perspective mapping (IPM) to define a fast and efficient likelihood model. Additionally, the method encompasses an interaction model using Markov Random Fields (MRF) that allows treatment of dependencies between the motions of targets. The proposed method is tested in highway sequences and compared to state-of-the-art methods for vehicle tracking, i.e., independent target tracking with Kalman filtering (KF) and joint tracking with particle filtering. The results showed fewer tracking failures using the proposed method.

Variant antigenic peptide promotes cytotoxic T lymphocyte adhesion to target cells without cytotoxicity

Timelapse video microscopy has been used to record the motility and dynamic interactions between an H-2Db-restricted murine cytotoxic T lymphocyte clone (F5) and Db-transfected L929 mouse fibroblasts (LDb) presenting normal or variant antigenic peptides from human influenza nucleoprotein. F5 cells will kill LDb target cells presenting specific antigen (peptide NP68: ASNENMDAM) after “browsing” their surfaces for between 8 min and many hours. Cell death is characterized by abrupt cellular rounding followed by zeiosis (vigorous “boiling” of the cytoplasm and blebbing of the plasma membrane) for 10–20 min, with subsequent cessation of all activity. Departure of cytotoxic T lymphocytes from unkilled target cells is rare, whereas serial killing is sometimes observed. In the absence of antigenic peptide, cytotoxic T lymphocytes browse target cells for much shorter periods, and readily leave to encounter other targets, while never causing target cell death. Two variant antigenic peptides, differing in nonamer position 7 or 8, also act as antigens, albeit with lower efficiency. A third variant peptide NP34 (ASNENMETM), which differs from NP68 in both positions and yet still binds Db, does not stimulate F5 cytotoxicity. Nevertheless, timelapse video analysis shows that NP34 leads to a significant modification of cell behavior, by up-regulating F5–LDb adhesive interactions. These data extend recent studies showing that partial agonists may elicit a subset of the T cell responses associated with full antigen stimulation, by demonstrating that TCR interaction with variant peptide antigens can trigger target cell adhesion and surface exploration without activating the signaling pathway that results in cytotoxicity.