A multi-method approach for the assessment of composite indices and rankings

There is growing popularity in the use of composite indices and rankings for cross-organizational benchmarking. However, little attention has been paid to alternative methods and procedures for the computation of these indices and how the use of such methods may impact the resulting indices and rankings. This dissertation developed an approach for assessing composite indices and rankings based on the integration of a number of methods for aggregation, data transformation and attribute weighting involved in their computation. The integrated model developed is based on the simulation of composite indices using methods and procedures proposed in the area of multi-criteria decision making (MCDM) and knowledge discovery in databases (KDD). The approach developed in this dissertation was automated through an IT artifact that was designed, developed and evaluated based on the framework and guidelines of the design science paradigm of information systems research. This artifact dynamically generates multiple versions of indices and rankings by considering different methodological scenarios according to user specified parameters. The computerized implementation was done in Visual Basic for Excel 2007. Using different performance measures, the artifact produces a number of excel outputs for the comparison and assessment of the indices and rankings. In order to evaluate the efficacy of the artifact and its underlying approach, a full empirical analysis was conducted using the World Bank's Doing Business database for the year 2010, which includes ten sub-indices (each corresponding to different areas of the business environment and regulation) for 183 countries. The output results, which were obtained using 115 methodological scenarios for the assessment of this index and its ten sub-indices, indicated that the variability of the component indicators considered in each case influenced the sensitivity of the rankings to the methodological choices. Overall, the results of our multi-method assessment were consistent with the World Bank rankings except in cases where the indices involved cost indicators measured in per capita income which yielded more sensitive results. Low income level countries exhibited more sensitivity in their rankings and less agreement between the benchmark rankings and our multi-method based rankings than higher income country groups.

Remédiation cognitive portant sur les aspects fluide et cristallisé de l’intelligence auprès d'adolescents présentant un fonctionnement intellectuel limite : approche par le jeu.

L’objectif principal de cette thèse était de créer, d’implanter et d’évaluer l’efficacité d’un programme de remédiation cognitive, intervenant de façon comparable sur les aspects fluide (Gf) et cristallisé (Gc) de l’intelligence, au sein d’une population d’intérêt clinique, les adolescents présentant un fonctionnement intellectuel limite (FIL). Compte tenu de la forte prévalence de ce trouble, le programme de remédiation GAME (Gains et Apprentissages Multiples pour Enfant) s’est développé autour de jeux disponibles dans le commerce afin de faciliter l’accès et l’implantation de ce programme dans divers milieux. Le premier article de cette thèse, réalisé sous forme de revue systématique de la littérature, avait pour objectif de faire le point sur les études publiées utilisant le jeu comme outil de remédiation cognitive dans la population pédiatrique. L’efficacité, ainsi que la qualité du paradigme utilisé ont été évaluées, et des recommandations sur les aspects méthodologiques à respecter lors de ce type d’étude ont été proposées. Cet article a permis une meilleure compréhension des écueils à éviter et des points forts méthodologiques à intégrer lors de la création du programme de remédiation GAME. Certaines mises en garde méthodologiques relevées dans cet article ont permis d’améliorer la qualité du programme de remédiation cognitive développé dans ce projet de thèse. Compte tenu du peu d’études présentes dans la littérature scientifique concernant la population présentant un FIL (70cognitive portant sur les aspects fluide et cristallisé de l’intelligence, champs d’intervention qui a été négligé compte tenu de la stabilité longtemps postulée de ces processus. Ce programme de remédiation, intitulé GAME, s’adressait aux adolescents présentant un FIL pur ou partiel (soit les deux indices de raisonnement étaient dans la zone limite, soit un seul des deux), et présentait deux versants, GAME-c (portant sur l’intelligence cristallisée) et GAME-f (portant sur l’intelligence fluide). Cette intervention durait seize heures réparties sur huit semaines. Les résultats indiquent que les adolescents ayant suivi GAME-f ont amélioré leur raisonnement fluide; alors que les adolescents ayant suivi GAME-c ont amélioré à la fois leur raisonnement cristallisé et fluide. Cette étude contribue à remettre en question la stabilité des processus intellectuels. C’est par contre la première fois que des améliorations de l’intelligence sont constatées dans une population d’intérêt clinique par le biais d’un entraînement direct. Enfin, les variables cognitives, adaptatives, comportementales et psychiatriques susceptibles d’influencer la qualité de l’amélioration pour chacun des programmes GAME ont fait l’objet d’analyses supplémentaires dans un dernier chapitre et permettent de conclure à la possibilité d’adapter le programme GAME à d’autres populations (ex: déficience intellectuelle). Cette thèse a donc permis de souligner la pertinence d’utiliser les jeux comme outil de remédiation cognitive de part leur versatilité dans leur utilisation, leur facilité d’accès et leur faible coût. Elle met également en avant la nécessité de développer une meilleure compréhension de la population présentant un fonctionnement intellectuel limite et d’effectuer des évaluations neuropsychologiques exhaustives auprès de cette population (cognitif, adaptatif, comportemental et psychiatrique). Enfin, elle souligne la possibilité d’améliorer par remédiation directe les intelligences fluide et cristallisée auprès d’individus avec une intelligence subnormale et suggère qu’il pourrait en être de même pour des populations présentant des déficits cognitifs, comme la déficience intellectuelle légère. Les avenues futures de recherche et les retombées cliniques de ce travail sont discutées, en lien avec les différents résultats trouvés dans ces études.

Constructing the Vulvar Pain Assessment Questionnaire Inventory

The goals of this program of research were to examine the link between self-reported vulvar pain and clinical diagnoses, and to create a user-friendly assessment tool to aid in that process. These goals were undertaken through a series of four empirical studies (Chapters 2-6): one archival study, two online studies, and one study conducted in a Women’s Health clinic. In Chapter 2, the link between self-report and clinical diagnosis was confirmed by extracting data from multiple studies conducted in the Sexual Health Research Laboratory over the course of several years. We demonstrated the accuracy of diagnosis based on multiple factors, and explored the varied gynecological presentation of different diagnostic groups. Chapter 3 was based on an online study designed to create the Vulvar Pain Assessment Questionnaire (VPAQ) inventory. Following the construct validation approach, a large pool of potential items was created to capture a broad selection of vulvar pain symptoms. Nearly 300 participants completed the entire item pool, and a series of factor analyses were utilized to narrow down the items and create scales/subscales. Relationships were computed among subscales and validated scales to establish convergent and discriminant validity. Chapters 4 and 5 were conducted in the Department of Obstetrics & Gynecology at Oregon Health & Science University. The brief screening version of the VPAQ was employed with patients of the Program in Vulvar Health at the Center for Women’s Health. The accuracy and usefulness of the VPAQscreen was determined from the perspective of patients as well as their health care providers, and the treatment-seeking experiences of patients was explored. Finally, a second online study was conducted to confirm the factor structure, internal consistency, and test-retest reliability of the VPAQ inventory. The results presented in these chapters confirm the link between targeted questions and accurate diagnoses, and provide a guideline that is useful and accessible for providers and patients.

As assessment of the Competition Commission Report and subsequent outcomes

Following the Office of Fair Trading's review of the British deregulated bus market as a whole in 2009, the issues raised were referred to the Competition Commission. Its final report was published in December 2011. Subsequently, the House of Commons Transport Committee carried out an enquiry into the Commission's report, and reactions to it by the operating industry, user groups, and other bodies, which was published in September 2012. A number of major issues have been raised, including the extent to which price competition may be effective, the appropriate rate of return on capital that would be expected within the industry (and appropriate actions where this is excessive in practice), and industry structure. The importance of competition per se, as distinct from attributes of direct concern to users (such as reliability, frequency, and fares) has also been debated. This paper reviews the issues raised, and outcomes to date, in the light of further evidence on the industry's performance. It is demonstrated similar rates of return could be attained through very different operating strategies, which in turn have very different implications for changes in consumer surplus. The alternative uses made of such profits (for example through reinvestment) may also have markedly different impacts effects on users. Rather than focussing on the dangers of excessive rates of return on capital, the outcomes for service users should be the main issue.

The potential contributions of concept maps for learning website to assessment for learning practices

The purpose of this paper is to examine the promising contributions of the Concept Maps for Learning (CMfL) website to assessment for learning practices. The CMfL website generates concept maps from relatedness degree of concepts pairs through the Pathfinder Scaling Algorithm. This website also confirms the established principles of effective assessment for learning, for it is capable of automatically assessing students' higher order knowledge, simultaneously identifying strengths and weaknesses, immediately providing useful feedback and being user-friendly. According to the default assessment plan, students first create concept maps on a particular subject and then they are given individualized visual feedback followed by associated instructional material (e.g., videos, website links, examples, problems, etc.) based on a comparison of their concept map and a subject matter expert's map. After studying the feedback and instructional material, teachers can monitor their students' progress by having them create revised concept maps. Therefore, we claim that the CMfL website may reduce the workload of teachers as well as provide immediate and delayed feedback on the weaknesses of students in different forms such as graphical and multimedia. For the following study, we will examine whether these promising contributions to assessment for learning are valid in a variety of subjects.

Aged embankment imaging and assessment using surface waves

Rapid, non-intrusive surface wave surveys provide depth profiles from which ground models can be generated for use in earthwork condition assessment. Stiffness throughout earthworks controls the behaviour under static and dynamic loads, and characterising heterogeneity is of interest in relation to the stability of engineered backfill and life-cycle deterioration in aged utility and transportation infrastructure. Continuous surface wave methods were used to identify interfaces between fine- and coarse-grained fill in an end-tipped embankment along the Great Central Railway in Nottinghamshire, UK. Multichannel analysis of surface wave (MASW) methods were used to characterise subsurface voiding in a canal embankment along the Knottingley and Goole canal near Eggborough, Yorkshire. MASW methods are currently being used to study extreme weather impacts on the stability of a highplasticity clay embankment along the Gloucestershire–Warwickshire railway near Laverton. Optimal results were obtained using equipment capable of generating and detecting over wide frequency ranges.

Situation Background Assessment Recommendation (SBAR): Undergraduate Perspectives

Situation Background Assessment and Recommendation (SBAR): Undergraduate Perspectives C Morgan, L Adams, J Murray, R Dunlop, IK Walsh. Ian K Walsh, Centre for Medical Education, Queen’s University Belfast, Mulhouse Building, Royal Victoria Hospital, Grosvenor Road, Belfast BT12 6DP Background and Purpose: Structured communication tools are used to improve team communication quality.1,2 The Situation Background Assessment and Recommendation (SBAR) tool is widely adopted within patient safety.3 SBAR effectiveness is reportedly equivocal, suggesting use is not sustained beyond initial training.4-6 Understanding perspectives of those using SBAR may further improve clinical communication. We investigated senior medical undergraduate perspectives on SBAR, particularly when communicating with senior colleagues. Methodology: Mixed methods data collection was used. A previously piloted questionnaire with 12 five point Lickert scale questions and 3 open questions was given to all final year medical students. A subgroup also participated in 10 focus groups, deploying strictly structured audio-recorded questions. Selection was by convenience sampling, data gathered by open text questions and comments transcribed verbatim. In-vivo coding (iterative, towards data saturation) preceded thematic analysis. Results: 233 of 255 students (91%) completed the survey. 1. There were clearly contradictory viewpoints on SBAR usage. A recurrent theme was a desire for formal feedback and a relative lack of practice/experience with SBAR. 2. Students reported SBAR as having variable interpretation between individuals; limiting use as a shared mental model. 3. Brief training sessions are insufficient to embed the tool. 4. Most students reported SBAR helping effective communication, especially by providing structure in stressful situations. 5. Only 18.5% of students felt an alternative resource might be needed. Sub analysis of the themes highlighted: A. Lack of clarity regarding what information to include and information placement within the acronym, B. Senior colleague negative response to SBAR C. Lack of conciseness with the tool. Discussion and Conclusions: Despite a wide range of contradictory interpretation of SBAR utility, most students wish to retain the resource. More practice opportunities/feedback may enhance user confidence and understanding. References: (1) Leonard M, Graham S, Bonacum D. The human factor: the critical importance of effective teamwork and communication in providing safe care. Quality & Safety in Health Care 2004 Oct;13(Suppl 1):85-90. (2) d'Agincourt-Canning LG, Kissoon N, Singal M, Pitfield AF. Culture, communication and safety: lessons from the airline industry. Indian J Pediatr 2011 Jun;78(6):703-708. (3) Dunsford J. Structured communication: improving patient safety with SBAR. Nurs Womens Health 2009 Oct;13(5):384-390. (4) Compton J, Copeland K, Flanders S, Cassity C, Spetman M, Xiao Y, et al. Implementing SBAR across a large multihospital health system. Jt Comm J Qual Patient Saf 2012 Jun;38(6):261-268. (5) Ludikhuize J, de Jonge E, Goossens A. Measuring adherence among nurses one year after training in applying the Modified Early Warning Score and Situation-Background-Assessment-Recommendation instruments. Resuscitation 2011 Nov;82(11):1428-1433. (6) Cunningham NJ, Weiland TJ, van Dijk J, Paddle P, Shilkofski N, Cunningham NY. Telephone referrals by junior doctors: a randomised controlled trial assessing the impact of SBAR in a simulated setting. Postgrad Med J 2012 Nov;88(1045):619-626.

Safety Assessment Tool for Construction Zone Work Phasing Plans, 2016

The Highway Safety Manual (HSM) is the compilation of national safety research that provides quantitative methods for analyzing highway safety. The HSM presents crash modification functions related to freeway work zone characteristics such as work zone duration and length. These crash modification functions were based on freeway work zones with high traffic volumes in California. When the HSM-referenced model was calibrated for Missouri, the value was 3.78, which is not ideal since it is significantly larger than 1. Therefore, new models were developed in this study using Missouri data to capture geographical, driver behavior, and other factors in the Midwest. Also, new models for expressway and rural two-lane work zones that barely were studied in the literature were developed. A large sample of 20,837 freeway, 8,993 expressway, and 64,476 rural two-lane work zones in Missouri was analyzed to derive 15 work zone crash prediction models. The most appropriate samples of 1,546 freeway, 1,189 expressway, and 6,095 rural two-lane work zones longer than 0.1 mile and with a duration of greater than 10 days were used to make eight, four, and three models, respectively. A challenging question for practitioners is always how to use crash prediction models to make the best estimation of work zone crash count. To solve this problem, a user-friendly software tool was developed in a spreadsheet format to predict work zone crashes based on work zone characteristics. This software selects the best model, estimates the work zone crashes by severity, and converts them to monetary values using standard crash estimates. This study also included a survey of departments of transportation (DOTs), Federal Highway Administration (FHWA) representatives, and contractors to assess the current state of the practice regarding work zone safety. The survey results indicate that many agencies look at work zone safety informally using engineering judgment. Respondents indicated that they would like a tool that could help them to balance work zone safety across projects by looking at crashes and user costs.

Graph analysis of verbal fluency test discriminate between patients with Alzheimer’s disease, Mild Cognitive Impairment and normal elderly controls

Verbal fluency is the ability to produce a satisfying sequence of spoken words during a given time interval. The core of verbal fluency lies in the capacity to manage the executive aspects of language. The standard scores of the semantic verbal fluency test are broadly used in the neuropsychological assessment of the elderly, and different analytical methods are likely to extract even more information from the data generated in this test. Graph theory, a mathematical approach to analyze relations between items, represents a promising tool to understand a variety of neuropsychological states. This study reports a graph analysis of data generated by the semantic verbal fluency test by cognitively healthy elderly (NC), patients with Mild Cognitive Impairment – subtypes amnestic(aMCI) and amnestic multiple domain (a+mdMCI) - and patients with Alzheimer’s disease (AD). Sequences of words were represented as a speech graph in which every word corresponded to a node and temporal links between words were represented by directed edges. To characterize the structure of the data we calculated 13 speech graph attributes (SGAs). The individuals were compared when divided in three (NC – MCI – AD) and four (NC – aMCI – a+mdMCI – AD) groups. When the three groups were compared, significant differences were found in the standard measure of correct words produced, and three SGA: diameter, average shortest path, and network density. SGA sorted the elderly groups with good specificity and sensitivity. When the four groups were compared, the groups differed significantly in network density, except between the two MCI subtypes and NC and aMCI. The diameter of the network and the average shortest path were significantly different between the NC and AD, and between aMCI and AD. SGA sorted the elderly in their groups with good specificity and sensitivity, performing better than the standard score of the task. These findings provide support for a new methodological frame to assess the strength of semantic memory through the verbal fluency task, with potential to amplify the predictive power of this test. Graph analysis is likely to become clinically relevant in neurology and psychiatry, and may be particularly useful for the differential diagnosis of the elderly.

Older Adult Injury Risk Assessment in the Driving and Occupational Environments

Thesis (Ph.D.)--University of Washington, 2016-08

The Effects of Systematic Self-Monitoring, Feedback, and Collaborative Assessment on Stress Reduction

Thesis (Ph.D.)--University of Washington, 2016-08

An assessment of data leakage in Firefox under different conditions.

Data leakage is a serious issue and can result in the loss of sensitive data, compromising user accounts and details, potentially affecting millions of internet users. This paper contributes to research in online security and reducing personal footprint by evaluating the levels of privacy provided by the Firefox browser. The aim of identifying conditions that would minimize data leakage and maximize data privacy is addressed by assessing and comparing data leakage in the four possible browsing modes: normal and private modes using a browser installed on the host PC or using a portable browser from a connected USB device respectively. To provide a firm foundation for analysis, a series of carefully designed, pre-planned browsing sessions were repeated in each of the various modes of Firefox. This included low RAM environments to determine any effects low RAM may have on browser data leakage. The results show that considerable data leakage may occur within Firefox. In normal mode, all of the browsing information is stored within the Mozilla profile folder in Firefox-specific SQLite databases and sessionstore.js. While passwords were not stored as plain text, other confidential information such as credit card numbers could be recovered from the Form history under certain conditions. There is no difference when using a portable browser in normal mode, except that the Mozilla profile folder is located on the USB device rather than the host's hard disk. By comparison, private browsing reduces data leakage. Our findings confirm that no information is written to the Firefox-related locations on the hard disk or USB device during private browsing, implying that no deletion would be necessary and no remnants of data would be forensically recoverable from unallocated space. However, two aspects of data leakage occurred equally in all four browsing modes. Firstly, all of the browsing history was stored in the live RAM and was therefore accessible while the browser remained open. Secondly, in low RAM situations, the operating system caches out RAM to pagefile.sys on the host's hard disk. Irrespective of the browsing mode used, this may include Firefox history elements which can then remain forensically recoverable for considerable time.

The influence of surface and deep cues on primary and secondary school students’ assessment of relevance in Web menus

International audience

Graph analysis of verbal fluency test discriminate between patients with Alzheimer’s disease, Mild Cognitive Impairment and normal elderly controls

Verbal fluency is the ability to produce a satisfying sequence of spoken words during a given time interval. The core of verbal fluency lies in the capacity to manage the executive aspects of language. The standard scores of the semantic verbal fluency test are broadly used in the neuropsychological assessment of the elderly, and different analytical methods are likely to extract even more information from the data generated in this test. Graph theory, a mathematical approach to analyze relations between items, represents a promising tool to understand a variety of neuropsychological states. This study reports a graph analysis of data generated by the semantic verbal fluency test by cognitively healthy elderly (NC), patients with Mild Cognitive Impairment – subtypes amnestic(aMCI) and amnestic multiple domain (a+mdMCI) - and patients with Alzheimer’s disease (AD). Sequences of words were represented as a speech graph in which every word corresponded to a node and temporal links between words were represented by directed edges. To characterize the structure of the data we calculated 13 speech graph attributes (SGAs). The individuals were compared when divided in three (NC – MCI – AD) and four (NC – aMCI – a+mdMCI – AD) groups. When the three groups were compared, significant differences were found in the standard measure of correct words produced, and three SGA: diameter, average shortest path, and network density. SGA sorted the elderly groups with good specificity and sensitivity. When the four groups were compared, the groups differed significantly in network density, except between the two MCI subtypes and NC and aMCI. The diameter of the network and the average shortest path were significantly different between the NC and AD, and between aMCI and AD. SGA sorted the elderly in their groups with good specificity and sensitivity, performing better than the standard score of the task. These findings provide support for a new methodological frame to assess the strength of semantic memory through the verbal fluency task, with potential to amplify the predictive power of this test. Graph analysis is likely to become clinically relevant in neurology and psychiatry, and may be particularly useful for the differential diagnosis of the elderly.

How teachers' perceptions affect the academic and language assessment of immigrant children

Recent research evidences inconsistencies in teachers' practice regarding skills assessment of L2 students. Scientific evidence supports that less experienced teachers have lower orientation toward multiple task-tests for non-native students. Research questions: Whether school teachers as having different teaching training and unequal teaching experience with non-native students perceive differently a four-skills scale. Purpose of the study: This study intends to analyse the importance degree between the four skills/tasks: reading, writing, speaking and listening, in the perspective of school teachers. Method: 77 teachers, aged 32-62, with (and without) experience in teaching and adapting materials for immigrant students, divided into six groups according to their scientific domain. Assessment tools included a scale for judgement of four academic tasks adapted from the original “Inventory of Undergraduate and Graduate Level: Reading, Writing, Speaking and Listening Tasks (Rosenfeld, Leung & Ottman, 2001). Main Findings: 1) different degrees of importance attributed by teachers on tasks that should be included in academic and language test for immigrant students; 2) perceptions of teachers are determined by predictors in this order: scientific domain, experience with multicultural classes and lower prediction from teaching service and age; 3) different results between american and portuguese samples answering the same questionnaire.