A Step in the Right Direction: Development of the Computerized Assessment for Preschool Social Emotional Learning (CAPSEL)

Invited commentary on "Computerizing Social-Emotional Assessment for School Readiness".

Computerizing Social-Emotional Assessment for School Readiness: First Steps toward an Assessment Battery for Early Childhood Settings

The transition into formal schooling is a crucial foundation that can set children on a cycle of success or failure in both academic and social domains. A child’s abilities to express healthy emotions, understand emotions of self and others, regulate emotion, attention, and behavior, make good decisions regarding social problems, and engage in a range of prosocial behaviors, all work together to promote a successful school experience. However, many children have deficits in these skills by school entry, and educators lack the requisite tools to identify, track and assess skills these children need to learn. Thus, because social-emotional learning (SEL) is so crucial, assessment tools to pinpoint children’s skills and progress are vitally necessary. Previous work by the authors and other researchers has led to the development of strong assessment tools; however, these tools are often developed solely for research use, not practitioner application. In the following, using our assessment battery as an example, we will discuss the steps necessary to adapt SEL assessment for computer-based administration and optimal utility in early childhood education programs.

The epidemiology of left ventricular outflow tract obstruction defects in Texas, 2002-2008: An update and assessment of effect heterogeneity

Left ventricular outflow tract (LVOT) defects are an important group of congenital heart defects (CHDs) because of their associated mortality and long-term complications. LVOT defects include aortic valve stenosis (AVS), coarctation of aorta (CoA), and hypoplastic left heart syndrome (HLHS). Despite their clinical significance, their etiology is not completely understood. Even though the individual component phenotypes (AVS, CoA, and HLHS) may have different etiologies, they are often "lumped" together in epidemiological studies. Though "lumping" of component phenotypes may improve the power to detect associations, it may also lead to ambiguous findings if these defects are etiologically distinct. This is due to potential for effect heterogeneity across component phenotypes. ^ This study had two aims: (1) to identify the association between various risk factors and both the component (i.e., split) and composite (i.e., lumped) LVOT phenotypes, and (2) to assess the effect heterogeneity of risk factors across component phenotypes of LVOT defects. ^ This study was a secondary data analysis. Primary data were obtained from the Texas Birth Defect Registry (TBDR). TBDR uses an active surveillance method to ascertain birth defects in Texas. All cases of non complex LVOT defects which met our inclusion criteria during the period of 2002–2008 were included in the study. The comparison groups included all unaffected live births for the same period (2002–2008). Data from vital statistics were used to evaluate associations. Statistical associations between selected risk factors and LVOT defects was determined by calculating crude and adjusted prevalence ratio using Poisson regression analysis. Effect heterogeneity was evaluated using polytomous logistic regression. ^ There were a total of 2,353 cases of LVOT defects among 2,730,035 live births during the study period. There were a total of 1,311 definite cases of non-complex LVOT defects for analysis after excluding "complex" cardiac cases and cases associated with syndromes (n=168). Among infant characteristics, males were at a significantly higher risk of developing LVOT defects compared to females. Among maternal characteristics, significant associations were seen with maternal age > 40 years (compared to maternal age 20–24 years) and maternal residence in Texas-Mexico border (compared to non-border residence). Among birth characteristics, significant associations were seen with preterm birth and small for gestation age LVOT defects. ^ When evaluating effect heterogeneity, the following variables had significantly different effects among the component LVOT defect phenotypes: infant sex, plurality, maternal age, maternal race/ethnicity, and Texas-Mexico border residence. ^ This study found significant associations between various demographic factors and LVOT defects. While many findings from this study were consistent with results from previous studies, we also identified new factors associated with LVOT defects. Additionally, this study was the first to assess effect heterogeneity across LVOT defect component phenotypes. These findings contribute to a growing body of literature on characteristics associated with LVOT defects. ^

Assessment of executive function before and after vitamin D replacement in vulnerable adults who self-neglect

Purpose: Self-neglect (SN) is the inability to maintain self-care needs. It is thought that older adults who have impaired executive function (EF) develop the inability to do self-care and to protect themselves. The specific aims were to (1) determine the feasibility of using multiple EF measures with community-dwelling elders with SN, (2) identify changes in EF between baseline and 5-months in community-dwelling elders with SN who receive 50,000 IU or 400 IU of oral vitamin D monthly and (2) explore changes in specific dimensions of EF between the groups. ^ Methods: Fifty adults, 65 years of age and older, were recruited from Adult Protective Services with confirmed SN. A research nurse administered the following tests at baseline and five-months: Delis-Kaplan Card Sort Test (D-KEFS), Executive Interview (EXIT 25), CLOX Drawing Test (CLOX I, II), Trails Making Test A and B (TMT A & B) and the Mini-Mental State Examination (MMSE). Demographic data was collected at baseline and serum 25-OHD levels were collected at baseline and five-months. ^ Results: Older adults with SN were more likely to fail the CLOX1 and D-KEFS, while passing the MMSE, CLOX II, TMT A & B and the EXIT 25. At five-months, the only statistically significant difference between groups was in the TMT A & B test scores; the control group did better than the treatment group. There was a non-significant increase in serum vitamin D levels for both groups and no difference between groups. ^ Conclusions: Results from this study provide support that individuals who SN will complete a battery of EF tests and that they exhibit the following impairments consistent with executive dysfunction: 'concept generation', 'planning', 'inhibition', and 'spatial working memory'. Utilizing only one EF measure in individuals with intact cognition may result in unidentification of individuals with executive dysfunction, thus delaying necessary treatment. Future studies should attempt to determine different etiologies of executive dysfunction and determine if early treatment can prevent or reverse SN. ^ Key Words: Self-neglect, Executive Dysfunction, Executive Function, Adult Protective Services, Community-dwelling, Vitamin D ^

Post-Permanency: An Assessment for Families’ Needs for Services and Supports

This article reports the results of a qualitative study that sought the perspectives of birth parents and adoptive parents following reunification or adoption of children from foster care. Using a participatory action design that actively involved young adults formerly in foster care and parents in the design and implementation of the study, the study focused on the consumers’ perspectives on several issues related to permanency. The article reports findings from interviews with a subset of 27 birth and adoptive families in New York City who were asked about their post-permanency experiences and from interviews with 38 child welfare professionals who were asked to respond to the parents’ perspectives. The article offers directions for child welfare practice and program development.

AN ASSESSMENT OF KNOWLEDGE AND ATTITUDES OF GENETIC COUNSELING SERVICES IN U.S. HTCs

Hemophilia is a hereditary bleeding disorder which requires lifelong specialized care. A network of Hemophilia Treatment Centers (HTCs) exists to meet the medical needs of patients affected by hemophilia. Genetic counseling services are an integral part of the HTC model of care; however, many HTCs do not have genetic counselors on staff. As a result, the duty to provide these services must fall to other healthcare providers within the HTC. To assess the knowledge and attitudes of these providers we developed a 49 question survey that was distributed electronically to hematologists and nurses at U.S. HTCs. The survey consisted of a three sections: demographic information, knowledge of hemophilia genetics, and attitudes towards genetic services. A total of 111 complete responses were received and analyzed. The average knowledge score among all participants was 74.8% with a total of 81 participants receiving a passing score of 70% or above. Thirty participants scored below 70% in the knowledge section. In general, attitude scores were high indicating that the majority of hematologists and nurses in HTCs feel confident in their ability to provide genetic counseling services. Over 90% of participants reported that they have some form of access to genetic counseling services at their center. Hematologists and nurses practicing in U.S. HTCs demonstrate sufficient knowledge of the genetics of hemophilia, and they generally feel confident in their ability to provide genetic counseling services to their patients. While their knowledge is sufficient, the average knowledge score was lower than 75%. Certain questions covering new genetic technologies and testing practices were more commonly missed than questions asking about more basic aspects of hemophilia genetics, such as inheritance and carrier testing. Finally, many clinics report having access to a counselor, but it is oftentimes a hematologist or nurse who is providing genetic counseling services to patients. Given the inconsistency in knowledge among providers coupled with the high confidence in one’s ability to counsel patients, it leaves room to question whether information about the genetics of hemophilia is being communicated to patients in the most appropriate and accurate manner.

Baseline evaluation of environmental physical activity and nutrition support of Texas Medical Center hospital worksites

Background: Obesity is a major health problem in the United States that has reached epidemic proportions. With most U.S adults spending the majority of their waking hours at work, the influence of the workplace environment on obesity is gaining in importance. Recent research implicates worksites as providing an 'obesogenic' environment as they encourage overeating and reduce the opportunity for physical activity. Objective: The aim of this study is to describe the nutrition and physical activity environment of Texas Medical Center (TMC) hospitals participating in the Shape Up Houston evaluation study to develop a scoring system to quantify the environmental data collected using the Environmental Assessment Tool (EAT) survey and to assess the inter-observer reliability of using the EAT survey. Methods: A survey instrument that was adapted from the Environmental Assessment Tool (EAT) developed by Dejoy DM et al in 2008 to measure the hospital environmental support for nutrition and physical activity was used for this study. The inter-observer reliability of using the EAT survey was measured and total percent agreement scores were computed. Most responses on the EAT survey are dichotomous (Yes and No) and these responses were coded with a '0' for a 'no' response and a '1' for a 'yes' response. A summative scoring system was developed to quantify these responses. Each hospital was given a score for each scale and subscale on the EAT survey in addition to a total score. All analyses were conducted using Stata 11 software. Results: High inter-observer reliability is observed using EAT. The percentage agreement scores ranged from 94.4%–100%. Only 2 of the 5 hospitals had a fitness facility onsite and scores for exercise programs and outdoor facilities available for hospital employees ranged from 0–62% and 0–37.5%, respectively. The healthy eating percentage for hospital cafeterias range from 42%–92% across the different hospitals while the healthy vending scores were 0%–40%. The total TMC 'healthy hospital' score was 49%. Conclusion: The EAT survey is a reliable instrument for measuring the physical activity and nutrition support environment of hospital worksites. The study results showed a large variability among the TMC hospitals in the existing physical activity and nutrition support environment. This study proposes cost effective policy changes that can increase environmental support to healthy eating and active living among TMC hospital employees.^

Development and implementation of a dynamic heterogeneous proton equivalent anthropomorphic thorax phantom for the assessment of scanned proton beam therapy

DEVELOPMENT AND IMPLEMENTATION OF A DYNAMIC HETEROGENEOUS PROTON EQUIVALENT ANTHROPOMORPHIC THORAX PHANTOM FOR THE ASSESSMENT OF SCANNED PROTON BEAM THERAPY by James Leroy Neihart, B.S. APPROVED: ______________________________David Followill, Ph.D. ______________________________Peter Balter, Ph.D. ______________________________Narayan Sahoo, Ph.D. ______________________________Kenneth Hess, Ph.D. ______________________________Paige Summers, M.S. APPROVED: ____________________________ Dean, The University of Texas Graduate School of Biomedical Sciences at Houston DEVELOPMENT AND IMPLEMENTATION OF A DYNAMIC HETEROGENEOUS PROTON EQUIVALENT ANTHROPOMORPHIC THORAX PHANTOM FOR THE ASSESSMENT OF SCANNED PROTON BEAM THERAPY A THESIS Presented to the Faculty of The University of Texas Health Science Center at Houston andThe University of TexasMD Anderson Cancer CenterGraduate School of Biomedical Sciences in Partial Fulfillment of the Requirements for the Degree of MASTER OF SCIENCE by James Leroy Neihart, B.S. Houston, Texas Date of Graduation August, 2013 Acknowledgments I would like to acknowledge my advisory committee members, chair David Followill, Ph.D., Peter Balter, Ph.D, Narayan Sahoo, Ph.D., Kenneth Hess, Ph.D., Paige Summers M.S. and, for their time and effort contributed to this project. I would additionally like to thank the faculty and staff at the PTC-H and the RPC who assisted in many aspects of this project. Falk Pӧnisch, Ph.D. for his breath hold proton therapy treatment expertise, Matt Palmer and Jaques Bluett for proton dosimetry assistance, Matt Kerr for verification plan assistance, Carrie Amador, Nadia Hernandez, Trang Nguyen, Andrea Molineu, Lynda McDonald for TLD and film dosimetry assistance. Finally, I would like to thank my wife and family for their support and encouragement during my research and studies. Development and implementation of a dynamic heterogeneous proton equivalent anthropomorphic thorax phantom for the assessment of scanned proton beam therapy By: James Leroy Neihart, B.S. Chair of Advisory Committee: David Followill, Ph.D Proton therapy has been gaining ground recently in radiation oncology. To date, the most successful utilization of proton therapy is in head and neck cases as well as prostate cases. These tumor locations do not suffer from the resulting difficulties of treatment delivery as a result of respiratory motion. Lung tumors require either breath hold or motion tracking, neither of which have been assessed with an end-to-end phantom for proton treatments. Currently, the RPC does not have a dynamic thoracic phantom for proton therapy procedure assessment. Additionally, such a phantom could be an excellent means of assessing quality assurance of the procedures of proton therapy centers wishing to participate in clinical trials. An eventual goal of this phantom is to have a means of evaluating and auditing institutions for the ability to start clinical trials utilizing proton therapy procedures for lung cancers. Therefore, the hypothesis of this study is that a dynamic anthropomorphic thoracic phantom can be created to evaluate end-to-end proton therapy treatment procedures for lung cancer to assure agreement between the measured and calculated dose within 5% / 5 mm with a reproducibility of 2%. Multiple materials were assessed for thoracic heterogeneity equivalency. The phantom was designed from the materials found to be in greatest agreement. The phantom was treated in an end-to-end treatment four times, which included simulation, treatment planning and treatment delivery. Each treatment plan was delivered three times to assess reproducibility. The dose measured within the phantom was compared to that of the treatment plan. The hypothesis was fully supported for three of the treatment plans, but failed the reproducibility requirement for the most aggressive treatment plan.

The development of poultry farms risk assessment tool for avian influenza in Imo State, Nigeria

Background: Nigeria was one of the 13 countries where avian influenza outbreak in poultry farms was reported during the 2006 avian influenza pandemic threat and was also the first country in Africa to report the presence of H5N1influenza among its poultry population. There are multiple hypotheses on how the avian influenza outbreak of 2006 was introduced to Nigeria, but the consensus is that once introduced, poultry farms and their workers were responsible for 70% of the spread of avian influenza virus to other poultry farms and the population. ^ The spread of avian influenza has been attributed to lack of compliance by poultry farms and their workers with poultry farm biosecurity measures. When poultry farms fail to adhere to biosecurity measures and there is an outbreak of infectious diseases like in 2006, epidemiological investigations usually assess poultry farm biosecurity—often with the aid of a questionnaire. Despite the importance of questionnaires in determining farm compliance with biosecurity measures, there have been few efforts to determine the validity of questionnaires designed to assess poultry farms risk factors. Hence, this study developed and validated a tool (questionnaire) that can be used for poultry farm risk stratification in Imo State, Nigeria. ^ Methods: Risk domains were generated using literature and recommendations from agricultural organizations and the Nigeria government for poultry farms. The risk domains were then used to develop a questionnaire. Both the risk domain and questionnaire were verified and modified by a group of five experts with a research interest in Nigeria's poultry industry and/or avian influenza prevention. Once a consensus was reached by the experts, the questionnaire was distributed to 30 selected poultry farms in Imo State, Nigeria that participated in this study. Survey responses were received for all the 30 poultry farms that were selected. The same poultry farms were visited one week after they completed the questionnaires for on-site observation. Agreement among survey and observation results were analyzed using a kappa test and rated as poor, fair, moderate, substantial, or nearly perfect; and internal consistency of the survey was also computed. ^ Result: Out of the 43 items on the questionnaire, 32 items were validated by this study. The agreement between the survey result and onsite observation was analyzed using kappa test and ranged from poor to nearly perfect. Most poultry farms had their best agreements in the contact section of the survey. The least agreement was noted in the farm management section of the survey. Thirty-two questions on the survey had a coefficient alpha > 0.70, which is a robust internal consistency for the survey. ^ Conclusion: This study developed 14 risk domains for poultry farms in Nigeria and validated 32 items from the original questionnaire that contained 43 items. The validated items can be used to determine the risk of introduction and spread of avian influenza virus in poultry farms in Imo State, Nigeria. After further validations in other states, regions and poultry farm sectors in Nigeria; this risk assessment tool can then be used to determine the risk profile of poultry farms across Nigeria.^

The assumptions and effects of conservative procedures in low -dose risk assessment for setting safety standards

Conservative procedures in low-dose risk assessment are used to set safety standards for known or suspected carcinogens. However, the assumptions upon which the methods are based and the effects of these methods are not well understood.^ To minimize the number of false-negatives and to reduce the cost of bioassays, animals are given very high doses of potential carcinogens. Results must then be extrapolated to much smaller doses to set safety standards for risks such as one per million. There are a number of competing methods that add a conservative safety factor into these calculations.^ A method of quantifying the conservatism of these methods was described and tested on eight procedures used in setting low-dose safety standards. The results using these procedures were compared by computer simulation and by the use of data from a large scale animal study.^ The method consisted of determining a "true safe dose" (tsd) according to an assumed underlying model. If one assumed that Y = the probability of cancer = P(d), a known mathematical function of the dose, then by setting Y to some predetermined acceptable risk, one can solve for d, the model's "true safe dose".^ Simulations were generated, assuming a binomial distribution, for an artificial bioassay. The eight procedures were then used to determine a "virtual safe dose" (vsd) that estimates the tsd, assuming a risk of one per million. A ratio R = ((tsd-vsd)/vsd) was calculated for each "experiment" (simulation). The mean R of 500 simulations and the probability R $<$ 0 was used to measure the over and under conservatism of each procedure.^ The eight procedures included Weil's method, Hoel's method, the Mantel-Byran method, the improved Mantel-Byran, Gross's method, fitting a one-hit model, Crump's procedure, and applying Rai and Van Ryzin's method to a Weibull model.^ None of the procedures performed uniformly well for all types of dose-response curves. When the data were linear, the one-hit model, Hoel's method, or the Gross-Mantel method worked reasonably well. However, when the data were non-linear, these same methods were overly conservative. Crump's procedure and the Weibull model performed better in these situations. ^

External assessment of myocardial glucose metabolism with $\sp{18}$F-2 -deoxy-2 -fluoro-D-glucose

Despite the popularity of the positron emitting glucose analog, ($\sp{18}$F) -2-deoxy-2-fluoro-D-glucose (2FDG), for the noninvasive "metabolic imaging" of organs with positron emission tomography (PET), the physiological basis for the tracer has not been tested, and the potential of 2FDG for the rapid kinetic analysis of altered glucose metabolism in the intact heart has not been fully exploited. We, therefore, developed a quantitative method to characterize metabolic changes of myocardial glucose metabolism noninvasively and with high temporal resolution.^ The first objective of the work was to provide direct evidence that the initial steps in the metabolism of 2FDG are the same as for glucose and that 2FDG is retained by the tissue in proportion to the rate of glucose utilization. The second objective was to characterize the kinetic changes in myocardial glucose transport and phosphorylation in response to changes in work load, competing substrates, acute ischemia and reperfusion, and the addition of insulin. To assess changes in myocardial glucose metabolism isolated working rat hearts were perfused with glucose and 2FDG. Tissue uptake of 2FDG and the input function were measured on-line by external detection. The steady state rate of 2FDG phosphorylation was determined by graphical analysis of 2FDG time-activity curves.^ The rate of 2FDG uptake was linear with time and the tracer was retained in its phosphorylated form. Tissue accumulation of 2FDG decreased within seconds with a reduction in work load, in the presence of competing substrates, and during reperfusion after global ischemia. Thus, most interventions known to alter glucose metabolism induced rapid parallel changes in 2FDG uptake. By contrast, insulin caused a significant increase in 2FDG accumulation only in hearts from fasted animals when perfused at a sub-physiological work load. The mechanism for this phenomenon is not known but may be related to the existence of two different glucose transporter systems and/or glycogen metabolism in the myocardial cell.^ It is concluded that (1) 2FDG traces glucose uptake and phosphorylation in the isolated working rat heart; and (2) early and transient kinetic changes in glucose metabolism can be monitored with high temporal resolution with 2FDG and a simple positron coincidence counting system. The new method has revealed transients of myocardial glucose metabolism, which would have remained unnoticed with conventional methods. These transients are not only important for the interpretation of glucose metabolic PET scans, but also provide insights into mechanisms of glucose transport and phosphorylation in heart muscle. ^

Dynamic contrast agent -enhanced magnetic resonance imaging assessment of tumor microvasculature

Dynamic contrast agent-enhanced magnetic resonance imaging (DCE MRI) data, when analyzed with the appropriate pharmacokinetic models, have been shown to provide quantitative estimates of microvascular parameters important in characterizing the angiogenic activity of malignant tissue. These parameters consist of the whole blood volume per unit volume of tissue, v b, transport constant from the plasma to the extravascular, extracellular space (EES), k1 and the transport constant from the EES to the plasma, k2. Parameters vb and k1 are expected to correlate with microvascular density (MVD) and vascular permeability, respectively, which have been suggested to serve as surrogate markers for angiogenesis. In addition to being a marker for angiogenesis, vascular permeability is also useful in estimating tumor penetration potential of chemotherapeutic agents. ^ Histological measurements of the intratumoral microvascular environment are limited by their invasiveness and susceptibility to sampling errors. Also, MVD and vascular permeability, while useful for characterizing tumors at a single time point, have shown less utility in longitudinal studies, particularly when used to monitor the efficacy of antiangiogenic and traditional chemotherapeutic agents. These limitations led to a search for a non-invasive means of characterizing the microvascular environment of an entire tumor. ^ The overall goal of this project was to determine the utility of DCE MRI for monitoring the effect of antiangiogenic agents. Further applications of a validated DCE MRI technique include in vivo measurements of tumor microvascular characteristics to aid in determining prognosis at presentation and in estimating drug penetration. DCE MRI data were generated using single- and dual-tracer pharmacokinetic models with different molecular-weight contrast agents. The resulting pharmacokinetic parameters were compared to immunohistochemical measurements. The model and contrast agent combination yielding the best correlation between the pharmacokinetic parameters and histological measures was further evaluated in a longitudinal study to evaluate the efficacy of DCE MRI in monitoring the intratumoral microvascular environment following antiangiogenic treatment. ^

DAEDALUS at ImageCLEF Medical Retrieval 2011: Textual, Visual and Multimodal Experiments

This paper describes the participation of DAEDALUS at ImageCLEF 2011 Medical Retrieval task. We have focused on multimodal (or mixed) experiments that combine textual and visual retrieval. The main objective of our research has been to evaluate the effect on the medical retrieval process of the existence of an extended corpus that is annotated with the image type, associated to both the image itself and also to its textual description. For this purpose, an image classifier has been developed to tag each document with its class (1st level of the hierarchy: Radiology, Microscopy, Photograph, Graphic, Other) and subclass (2nd level: AN, CT, MR, etc.). For the textual-based experiments, several runs using different semantic expansion techniques have been performed. For the visual-based retrieval, different runs are defined by the corpus used in the retrieval process and the strategy for obtaining the class and/or subclass. The best results are achieved in runs that make use of the image subclass based on the classification of the sample images. Although different multimodal strategies have been submitted, none of them has shown to be able to provide results that are at least comparable to the ones achieved by the textual retrieval alone. We believe that we have been unable to find a metric for the assessment of the relevance of the results provided by the visual and textual processes

Conceptual framework for the design, implementation and validation of psychomotor skills’ assessment systems in minimally invasive surgery

Las técnicas de cirugía de mínima invasión (CMI) se están consolidando hoy en día como alternativa a la cirugía tradicional, debido a sus numerosos beneficios para los pacientes. Este cambio de paradigma implica que los cirujanos deben aprender una serie de habilidades distintas de aquellas requeridas en cirugía abierta. El entrenamiento y evaluación de estas habilidades se ha convertido en una de las mayores preocupaciones en los programas de formación de cirujanos, debido en gran parte a la presión de una sociedad que exige cirujanos bien preparados y una reducción en el número de errores médicos. Por tanto, se está prestando especial atención a la definición de nuevos programas que permitan el entrenamiento y la evaluación de las habilidades psicomotoras en entornos seguros antes de que los nuevos cirujanos puedan operar sobre pacientes reales. Para tal fin, hospitales y centros de formación están gradualmente incorporando instalaciones de entrenamiento donde los residentes puedan practicar y aprender sin riesgos. Es cada vez más común que estos laboratorios dispongan de simuladores virtuales o simuladores físicos capaces de registrar los movimientos del instrumental de cada residente. Estos simuladores ofrecen una gran variedad de tareas de entrenamiento y evaluación, así como la posibilidad de obtener información objetiva de los ejercicios. Los diferentes estudios de validación llevados a cabo dan muestra de su utilidad; pese a todo, los niveles de evidencia presentados son en muchas ocasiones insuficientes. Lo que es más importante, no existe un consenso claro a la hora de definir qué métricas son más útiles para caracterizar la pericia quirúrgica. El objetivo de esta tesis doctoral es diseñar y validar un marco de trabajo conceptual para la definición y validación de entornos para la evaluación de habilidades en CMI, en base a un modelo en tres fases: pedagógica (tareas y métricas a emplear), tecnológica (tecnologías de adquisición de métricas) y analítica (interpretación de la competencia en base a las métricas). Para tal fin, se describe la implementación práctica de un entorno basado en (1) un sistema de seguimiento de instrumental fundamentado en el análisis del vídeo laparoscópico; y (2) la determinación de la pericia en base a métricas de movimiento del instrumental. Para la fase pedagógica se diseñó e implementó un conjunto de tareas para la evaluación de habilidades psicomotoras básicas, así como una serie de métricas de movimiento. La validación de construcción llevada a cabo sobre ellas mostró buenos resultados para tiempo, camino recorrido, profundidad, velocidad media, aceleración media, economía de área y economía de volumen. Adicionalmente, los resultados obtenidos en la validación de apariencia fueron en general positivos en todos los grupos considerados (noveles, residentes, expertos). Para la fase tecnológica, se introdujo el EVA Tracking System, una solución para el seguimiento del instrumental quirúrgico basado en el análisis del vídeo endoscópico. La precisión del sistema se evaluó a 16,33ppRMS para el seguimiento 2D de la herramienta en la imagen; y a 13mmRMS para el seguimiento espacial de la misma. La validación de construcción con una de las tareas de evaluación mostró buenos resultados para tiempo, camino recorrido, profundidad, velocidad media, aceleración media, economía de área y economía de volumen. La validación concurrente con el TrEndo® Tracking System por su parte presentó valores altos de correlación para 8 de las 9 métricas analizadas. Finalmente, para la fase analítica se comparó el comportamiento de tres clasificadores supervisados a la hora de determinar automáticamente la pericia quirúrgica en base a la información de movimiento del instrumental, basados en aproximaciones lineales (análisis lineal discriminante, LDA), no lineales (máquinas de soporte vectorial, SVM) y difusas (sistemas adaptativos de inferencia neurodifusa, ANFIS). Los resultados muestran que en media SVM presenta un comportamiento ligeramente superior: 78,2% frente a los 71% y 71,7% obtenidos por ANFIS y LDA respectivamente. Sin embargo las diferencias estadísticas medidas entre los tres no fueron demostradas significativas. En general, esta tesis doctoral corrobora las hipótesis de investigación postuladas relativas a la definición de sistemas de evaluación de habilidades para cirugía de mínima invasión, a la utilidad del análisis de vídeo como fuente de información y a la importancia de la información de movimiento de instrumental a la hora de caracterizar la pericia quirúrgica. Basándose en estos cimientos, se han de abrir nuevos campos de investigación que contribuyan a la definición de programas de formación estructurados y objetivos, que puedan garantizar la acreditación de cirujanos sobradamente preparados y promocionen la seguridad del paciente en el quirófano. Abstract Minimally invasive surgery (MIS) techniques have become a standard in many surgical sub-specialties, due to their many benefits for patients. However, this shift in paradigm implies that surgeons must acquire a complete different set of skills than those normally attributed to open surgery. Training and assessment of these skills has become a major concern in surgical learning programmes, especially considering the social demand for better-prepared professionals and for the decrease of medical errors. Therefore, much effort is being put in the definition of structured MIS learning programmes, where practice with real patients in the operating room (OR) can be delayed until the resident can attest for a minimum level of psychomotor competence. To this end, skills’ laboratory settings are being introduced in hospitals and training centres where residents may practice and be assessed on their psychomotor skills. Technological advances in the field of tracking technologies and virtual reality (VR) have enabled the creation of new learning systems such as VR simulators or enhanced box trainers. These systems offer a wide range of tasks, as well as the capability of registering objective data on the trainees’ performance. Validation studies give proof of their usefulness; however, levels of evidence reported are in many cases low. More importantly, there is still no clear consensus on topics such as the optimal metrics that must be used to assess competence, the validity of VR simulation, the portability of tracking technologies into real surgeries (for advanced assessment) or the degree to which the skills measured and obtained in laboratory environments transfer to the OR. The purpose of this PhD is to design and validate a conceptual framework for the definition and validation of MIS assessment environments based on a three-pillared model defining three main stages: pedagogical (tasks and metrics to employ), technological (metric acquisition technologies) and analytical (interpretation of competence based on metrics). To this end, a practical implementation of the framework is presented, focused on (1) a video-based tracking system and (2) the determination of surgical competence based on the laparoscopic instruments’ motionrelated data. The pedagogical stage’s results led to the design and implementation of a set of basic tasks for MIS psychomotor skills’ assessment, as well as the definition of motion analysis parameters (MAPs) to measure performance on said tasks. Validation yielded good construct results for parameters such as time, path length, depth, average speed, average acceleration, economy of area and economy of volume. Additionally, face validation results showed positive acceptance on behalf of the experts, residents and novices. For the technological stage the EVA Tracking System is introduced. EVA provides a solution for tracking laparoscopic instruments from the analysis of the monoscopic video image. Accuracy tests for the system are presented, which yielded an average RMSE of 16.33pp for 2D tracking of the instrument on the image and of 13mm for 3D spatial tracking. A validation experiment was conducted using one of the tasks and the most relevant MAPs. Construct validation showed significant differences for time, path length, depth, average speed, average acceleration, economy of area and economy of volume; especially between novices and residents/experts. More importantly, concurrent validation with the TrEndo® Tracking System presented high correlation values (>0.7) for 8 of the 9 MAPs proposed. Finally, the analytical stage allowed comparing the performance of three different supervised classification strategies in the determination of surgical competence based on motion-related information. The three classifiers were based on linear (linear discriminant analysis, LDA), non-linear (support vector machines, SVM) and fuzzy (adaptive neuro fuzzy inference systems, ANFIS) approaches. Results for SVM show slightly better performance than the other two classifiers: on average, accuracy for LDA, SVM and ANFIS was of 71.7%, 78.2% and 71% respectively. However, when confronted, no statistical significance was found between any of the three. Overall, this PhD corroborates the investigated research hypotheses regarding the definition of MIS assessment systems, the use of endoscopic video analysis as the main source of information and the relevance of motion analysis in the determination of surgical competence. New research fields in the training and assessment of MIS surgeons can be proposed based on these foundations, in order to contribute to the definition of structured and objective learning programmes that guarantee the accreditation of well-prepared professionals and the promotion of patient safety in the OR.

Identifying the semantics of eligibility criteria of clinical trials based on relevant medical ontologies

An important objective of the INTEGRATE project1 is to build tools that support the efficient execution of post-genomic multi-centric clinical trials in breast cancer, which includes the automatic assessment of the eligibility of patients for available trials. The population suited to be enrolled in a trial is described by a set of free-text eligibility criteria that are both syntactically and semantically complex. At the same time, the assessment of the eligibility of a patient for a trial requires the (machineprocessable) understanding of the semantics of the eligibility criteria in order to further evaluate if the patient data available for example in the hospital EHR satisfies these criteria. This paper presents an analysis of the semantics of the clinical trial eligibility criteria based on relevant medical ontologies in the clinical research domain: SNOMED-CT, LOINC, MedDRA. We detect subsets of these widely-adopted ontologies that characterize the semantics of the eligibility criteria of trials in various clinical domains and compare these sets. Next, we evaluate the occurrence frequency of the concepts in the concrete case of breast cancer (which is our first application domain) in order to provide meaningful priorities for the task of binding/mapping these ontology concepts to the actual patient data. We further assess the effort required to extend our approach to new domains in terms of additional semantic mappings that need to be developed.