Pitfalls in the use of kappa when interpreting agreement between multiple raters in reliability studies

OBJECTIVE To compare different reliability coefficients (exact agreement, and variations of the kappa (generalised, Cohen's and Prevalence Adjusted and Biased Adjusted (PABAK))) for four physiotherapists conducting visual assessments of scapulae. DESIGN Inter-therapist reliability study. SETTING Research laboratory. PARTICIPANTS 30 individuals with no history of neck or shoulder pain were recruited with no obvious significant postural abnormalities. MAIN OUTCOME MEASURES Ratings of scapular posture were recorded in multiple biomechanical planes under four test conditions (at rest, and while under three isometric conditions) by four physiotherapists. RESULTS The magnitude of discrepancy between the two therapist pairs was 0.04 to 0.76 for Cohen's kappa, and 0.00 to 0.86 for PABAK. In comparison, the generalised kappa provided a score between the two paired kappa coefficients. The difference between mean generalised kappa coefficients and mean Cohen's kappa (0.02) and between mean generalised kappa and PABAK (0.02) were negligible, but the magnitude of difference between the generalised kappa and paired kappa within each plane and condition was substantial; 0.02 to 0.57 for Cohen's kappa and 0.02 to 0.63 for PABAK, respectively. CONCLUSIONS Calculating coefficients for therapist pairs alone may result in inconsistent findings. In contrast, the generalised kappa provided a coefficient close to the mean of the paired kappa coefficients. These findings support an assertion that generalised kappa may lead to a better representation of reliability between three or more raters and that reliability studies only calculating agreement between two raters should be interpreted with caution. However, generalised kappa may mask more extreme cases of agreement (or disagreement) that paired comparisons may reveal.

Odometry-driven inference to link multiple exemplars of a location

A major challenge for robot localization and mapping systems is maintaining reliable operation in a changing environment. Vision-based systems in particular are susceptible to changes in illumination and weather, and the same location at another time of day may appear radically different to a system using a feature-based visual localization system. One approach for mapping changing environments is to create and maintain maps that contain multiple representations of each physical location in a topological framework or manifold. However, this requires the system to be able to correctly link two or more appearance representations to the same spatial location, even though the representations may appear quite dissimilar. This paper proposes a method of linking visual representations from the same location without requiring a visual match, thereby allowing vision-based localization systems to create multiple appearance representations of physical locations. The most likely position on the robot path is determined using particle filter methods based on dead reckoning data and recent visual loop closures. In order to avoid erroneous loop closures, the odometry-based inferences are only accepted when the inferred path's end point is confirmed as correct by the visual matching system. Algorithm performance is demonstrated using an indoor robot dataset and a large outdoor camera dataset.

Teacher Evidence Matrix : an evaluation using multiple lines of evidence

Welcome to the Teacher evidence matrix. This matrix is designed for highly qualified discipline experts to evaluate their teaching in a systematic manner. The primary purpose of the Teacher evidence matrix is to provide a tool that an academic staff member at university can annually review their teaching. The annual review will result in you being ready for performance, planning and review; promotion; awards; or employment application. This tool is designed for individual use and will lead to an action plan for implementation.

Towards bio-inspired place recognition over multiple spatial scales

This paper presents a new multi-scale place recognition system inspired by the recent discovery of overlapping, multi-scale spatial maps stored in the rodent brain. By training a set of Support Vector Machines to recognize places at varying levels of spatial specificity, we are able to validate spatially specific place recognition hypotheses against broader place recognition hypotheses without sacrificing localization accuracy. We evaluate the system in a range of experiments using cameras mounted on a motorbike and a human in two different environments. At 100% precision, the multiscale approach results in a 56% average improvement in recall rate across both datasets. We analyse the results and then discuss future work that may lead to improvements in both robotic mapping and our understanding of sensory processing and encoding in the mammalian brain.

A recommendation approach dealing with multiple market segments

A new community and communication type of social networks - online dating - are gaining momentum. With many people joining in the dating network, users become overwhelmed by choices for an ideal partner. A solution to this problem is providing users with partners recommendation based on their interests and activities. Traditional recommendation methods ignore the users’ needs and provide recommendations equally to all users. In this paper, we propose a recommendation approach that employs different recommendation strategies to different groups of members. A segmentation method using the Gaussian Mixture Model (GMM) is proposed to customize users’ needs. Then a targeted recommendation strategy is applied to each identified segment. Empirical results show that the proposed approach outperforms several existing recommendation methods.

Play and heal : randomized controlled trial of Ditto intervention efficacy on improving re-epithelialization in pediatric burns

BACKGROUND: The relationships between pain, stress and anxiety, and their effect on burn wound re-epithelialization have not been well explored to-date. The aim of this study was to investigate the effect of the Ditto (a hand-held electronic medical device providing procedural preparation and distraction) intervention on re-epithelialization rates in acute pediatric burns. METHODS/DESIGN: From August 2011 to August 2012, children (4-12 years) with an acute burn presenting to the Royal Children's Hospital, Brisbane, Australia fulfilled the study requirements and were randomized to [1] Ditto intervention or [2] standard practice. Burn re-epithelialization, pain intensity, anxiety and stress measures were obtained at every dressing change until complete wound re-epithelialization. RESULTS: One hundred and seventeen children were randomized and 75 children were analyzed (n=40 standard group; n=35 Ditto group). Inability to predict wound management resulted in 42 participants no longer meeting the eligibility criteria. Wounds in the Ditto intervention group re-epithelialized faster than the standard practice group (-2.14 days (CI: -4.38 to 0.10), p-value=0.061), and significantly faster when analyses were adjusted for mean burn depth (-2.26 days (CI: -4.48 to -0.04), p-value=0.046). Following procedural preparation at the first change of dressing, the Ditto group reported lower pain intensity scores (-0.64 (CI: -1.28, 0.01) p=0.052) and lower anxiety ratings (-1.79 (CI: -3.59, 0.01) p=0.051). At the second and third dressing removals average pain (FPS-R and FLACC) and anxiety scores (VAS-A) were at least one point lower when Ditto intervention was received. CONCLUSIONS: The Ditto procedural preparation and distraction device is a useful tool alongside pharmacological intervention to improve the rate of burn re-epithelialization and manage pain and anxiety during burn wound care procedures.

Volcanic architecture and chemostratigraphy within the Kalkarindji Continental Flood Basalt Province, Northern Territory : implications for eruption style from multiple fissure eruptions

This thesis was the first to define individual lava flow chemical variation and a detailed definition of the Kalkarindji Continental Flood Basalt Province, a lesser known province of the Phanerozoic eon. This thesis conducted an intensive field study that yielded numerous samples for petrography and chemical analyses as well as the generation of a detailed map of a portion of the Kalkarindji province.

Performance-driven live migration of multiple virtual machines in datacenters

Live migration of multiple Virtual Machines (VMs) has become an indispensible management activity in datacenters for application performance, load balancing, server consolidation. While state-of-the-art live VM migration strategies focus on the improvement of the migration performance of a single VM, little attention has been given to the case of multiple VMs migration. Moreover, existing works on live VM migration ignore the inter-VM dependencies, and underlying network topology and its bandwidth. Different sequences of migration and different allocations of bandwidth result in different total migration times and total migration downtimes. This paper concentrates on developing a multiple VMs migration scheduling algorithm such that the performance of migration is maximized. We evaluate our proposed algorithm through simulation. The simulation results show that our proposed algorithm can migrate multiple VMs on any datacenter with minimum total migration time and total migration downtime.

Combining multiple sensor modalities for a localisation robust to smoke

This paper proposes an approach to obtain a localisation that is robust to smoke by exploiting multiple sensing modalities: visual and infrared (IR) cameras. This localisation is based on a state-of-the-art visual SLAM algorithm. First, we show that a reasonably accurate localisation can be obtained in the presence of smoke by using only an IR camera, a sensor that is hardly affected by smoke, contrary to a visual camera (operating in the visible spectrum). Second, we demonstrate that improved results can be obtained by combining the information from the two sensor modalities (visual and IR cameras). Third, we show that by detecting the impact of smoke on the visual images using a data quality metric, we can anticipate and mitigate the degradation in performance of the localisation by discarding the most affected data. The experimental validation presents multiple trajectories estimated by the various methods considered, all thoroughly compared to an accurate dGPS/INS reference.

Progesterone activates multiple innate immune pathways inChlamydia trachomatis-Infected endocervical cells

Problem Susceptibility to Chlamydia trachomatis infection is increased by oral con- traceptives and modulated by sex hormones. We therefore sought to determine the effects of female sex hormones on the innate immune response to C. trachomatis infection. Method of study ECC-1 endometrial cells, pre-treated with oestradiol or progesterone, were infected with C. trachomatis and the host transcriptome analysed by Illumina Sentrix HumanRef-8 microarray. Primary endocervical epithe- lial cells, prepared at either the proliferative or secretory phase of the menstrual cycle, were infected with C. trachomatis and cytokine gene expression determined by quantitative RT-PCR analysis. Results Chlamydia trachomatis yield from progesterone-primed ECC-1 cells was significantly reduced compared with oestradiol-treated cells. Genes upregulated in progesterone-treated and Chlamydia-infected cells only included multiple CC and CXC chemokines, IL-17C, IL-29, IL-32, TNF-a, DEFB4B, LCN2, S100A7-9, ITGAM, NOD2, JAK1, IL-6ST, type I and II interferon receptors, numerous interferon-stimulated genes and STAT6. CXCL10, CXCL11, CX3CL1 and IL-17C, which were also upregu- lated in infected secretory-stage primary cells, and there was a trend towards higher levels of immune mediators in infected secretory-phase compared with proliferative-phase cells. Conclusion Progesterone treatment primes multiple innate immune pathways in hormone-responsive epithelial cells that could potentially increase resis- tance to chlamydial infection.

E-motion diaries : blogging emotional responses to online learning in higher education

Emotions are inherently social, and are central to learning, online interaction and literacy practices (Shen, Wang, & Shen, 2009). Demonstrating the dynamic sociality of literacy practice, we used e-motion diaries or web logs to explore the emotional states of pre-service high school teachers’ experiences of online learning activities. This is because the methods of communication used by university educators in online learning and writing environments play an important role in fulfilling students’ need for social interaction and inclusion (McInnerney & Roberts, 2004). Feelings of isolation and frustration are common emotions experienced by students in many online learning environments, and are associated with the success or failure of online interactions and learning (Su, et al., 2005). The purpose of the study was to answer the research question: What are the trajectories of pre-service teachers’ emotional states during online learning experiences? This is important because emotions are central to learning, and the current trend toward Massive Open Online Courses (MOOCs) needs research about students’ emotional connections in online learning environments (Kop, 2011). The project was conducted with a graduate class of 64 high school science pre-service teachers in Science Education Curriculum Studies in a large Australian university, including males and females from a variety of cultural backgrounds, aged 22-55 years. Online activities involved the students watching a series of streamed live lectures for the first 5 weeks providing a varied set of learning experiences, such as viewing science demonstrations (e.g., modeling the use of discrepant events). Each week, students provided feedback on learning by writing and posting an e-motion diary or web log about their emotional response. Students answered the question: What emotions did you experience during this learning experience? The descriptive data set included 284 online posts, with students contributing multiple entries. Linguistic appraisal theory, following Martin and White (2005), was used to regroup the 22 different discrete emotions reported by students into the six main affect groups – three positive and three negative: unhappiness/happiness, insecurity/security, and dissatisfaction/satisfaction. The findings demonstrated that the pre-service teachers’ emotional responses to the streamed lectures tended towards happiness, security, and satisfaction within the typology of affect groups – un/happiness, in/security, and dis/satisfaction. Fewer students reported that the streamed lectures triggered negative feelings of frustration, powerlessness, and inadequacy, and when this occurred, it often pertained to expectations of themselves in the forthcoming field experience in classrooms. Exceptions to this pattern of responses occurred in relation to the fifth streamed lecture presented in a non-interactive slideshow format that compressed a large amount of content. Many students responded to the content of the lecture rather than providing their emotional responses to this lecture, and one student felt “completely disengaged”. The social practice of online writing as blogs enabled the students to articulate their emotions. The findings primarily contribute new understanding about students' wide range of differing emotional states, both positive and negative, experienced in response to streamed live lectures and other learning activities in higher education external coursework. The is important because the majority of previous studies have focused on particular negative emotions, such as anxiety in test taking. The research also highlights the potentials of appraisal theory for studying human emotions in online learning and writing.

Autonomous operation of multiple interconnected microgrids with self-healing capacity

This paper shows how multiple interconnected microgrids can operate in autonomous mode in a self–healing medium voltage network. This is possible if based on network self– healing capability, the neighbour microgrids are interconnected and a surplus generation capacity is available in some of the Distributed Energy Resources (DERs) of the interconnected microgrids. This will reduce or prevent load shedding within the microgrids with less generation capacity. Therefore, DERs in a microgrid are controlled such that they share the local load within that microgrid as well as the loads in other interconnected microgrids. Different control algorithms are proposed to manage the DERs at different operating conditions. On the other hand, a Distribution Static Compensator (DSTATCOM) is employed to regulate the voltage. The efficacy of the proposed power control, sharing and management among DERs in multiple interconnected microgrids is validated through extensive simulation studies using PSCAD/EMTDC.

A coordinated voltage support strategy for LV network with multiple DSTATCOMs

Voltage rise and drop are the main power quality challenges in Low Voltage (LV) network with Renewable Energy (RE) generators. This paper proposes a new voltage support strategy based on coordination of multiple Distribution Static Synchronous Compensators (DSTATCOMs) using consensus algorithm. The study focuses on LV network with PV as the RE source for customers. The proposed approach applied to a typical residential LV network and its advantages are shown comparing with other voltage control strategies.