The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two-parameter logistic model) and at developing a new version of the scale (the CRT-long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision-making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT-long, we report the first investigation into the development of cognitive reflection.

Realistic evaluation of EWS and ALERT: factors enabling and constraining implementation.

Realistic Evaluation of EWS and ALERT: factors enabling and constraining implementation Background The implementation of EWS and ALERT in practice is essential to the success of Rapid Response Systems but is dependent upon nurses utilising EWS protocols and applying ALERT best practice guidelines. To date there is limited evidence on the effectiveness of EWS or ALERT as research has primarily focused on measuring patient outcomes (cardiac arrests, ICU admissions) following the implementation of a Rapid Response Team. Complex interventions in healthcare aimed at changing service delivery and related behaviour of health professionals require a different research approach to evaluate the evidence. To understand how and why EWS and ALERT work, or might not work, research needs to consider the social, cultural and organisational influences that will impact on successful implementation in practice. This requires a research approach that considers both the processes and outcomes of complex interventions, such as EWS and ALERT, implemented in practice. Realistic Evaluation is such an approach and was used to explain the factors that enable and constrain the implementation of EWS and ALERT in practice [1]. Aim The aim of this study was to evaluate factors that enabled and constrained the implementation and service delivery of early warnings systems (EWS) and ALERT in practice in order to provide direction for enabling their success and sustainability. Methods The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory. This approach used a variety of mixed methods to test the programme theories including individual and focus group interviews, observation and documentary analysis in a two stage process. A purposive sample of 75 key informants participated in individual and focus group interviews. Observation and documentary analysis of EWS compliance data and ALERT training records provided further evidence to support or refute the interview findings. Data was analysed using NVIVO8 to categorise interview findings and SPSS for ALERT documentary data. These findings were further synthesised by undertaking a within and cross case comparison to explain the factors enabling and constraining EWS and ALERT. Results A cross case analysis highlighted similarities, differences and factors enabling or constraining successful implementation across the case study sites. Findings showed that personal (confidence; clinical judgement; personality), social (ward leadership; communication), organisational (workload and staffing issues; pressure from managers to complete EWS audit and targets), educational (constraints on training; no clinical educator on ward) and cultural (routine task delegated) influences impact on EWS and acute care training outcomes. There were also differences noted between medical and surgical wards across both case sites. Conclusions Realist Evaluation allows refinement and development of the RRS programme theory to explain the realities of practice. These refined RRS programme theories are capable of informing the planning of future service provision and provide direction for enabling their success and sustainability. References: 1. McGaughey J, Blackwood B, O’Halloran P, Trinder T. J. & Porter S. (2010) A realistic evaluation of Track and Trigger systems and acute care training for early recognition and management of deteriorating ward–based patients. Journal of Advanced Nursing 66 (4), 923-932. Type of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast

Aggressiveness as a component of fighting ability in pigs using a game-theoretical framework

Understanding animal contests has benefited greatly from employing the concept of fighting ability, termed resource-holding potential (RHP), with body size/weight typically used as a proxy. However, victory does not always go to the larger/heavier contestant and the existing RHP approach thereby fails to accurately predict contest outcome. Aggressiveness, typically studied as a personality trait, might explain part of this discrepancy. We investigated whether aggressiveness forms a component of RHP, examining effects on contest outcome, duration and phases, plus physiological measures of costs (lactate and glucose). Furthermore, using the correct theoretical framework, we provide the first study to investigate whether individuals gather and use information on aggressiveness as part of an assessment strategy. Pigs, Sus scrofa, were assessed for aggressiveness in resident-intruder tests whereby attack latency reflects aggressiveness. Contests were then staged between size-matched animals diverging in aggressiveness. Individuals with a short attack latency in the resident-intruder test almost always initiated the first bite and fight in the subsequent contest. However, aggressiveness had no direct effect on contest outcome, whereas bite initiation did lead to winning in contests without an escalated fight. This indirect effect suggests that aggressiveness is not a component of RHP, but rather reflects a signal of intent. Winner and loser aggressiveness did not affect contest duration or its separate phases, suggesting aggressiveness is not part of an assessment strategy. A greater asymmetry in aggressiveness prolonged contest duration and the duration of displaying, which is in a direction contrary to assessment models based on morphological traits. Blood lactate and glucose increased with contest duration and peaked during escalated fights, highlighting the utility of physiological measures as proxies for fight cost. Integrating personality traits into the study of contest behaviour, as illustrated here, will enhance our understanding of the subtleties of agonistic interactions.

Shortened Lung Clearance Index is a repeatable and sensitive test in children and adults with cystic fibrosis

Background: Lung clearance index (LCI) derived from sulfur hexafluoride (SF6) multiple breath washout (MBW) is a sensitive measure of lung disease in people with cystic fibrosis (CF). However, it can be time-consuming, limiting its use clinically. Aim: To compare the repeatability, sensitivity and test duration of LCI derived from washout to 1/30th (LCI1/30), 1/20th (LCI1/20) and 1/10th (LCI1/10) to ‘standard’ LCI derived from washout to 1/40th initial concentration (LCI1/40). Methods: Triplicate MBW test results from 30 clinically stable people with CF and 30 healthy controls were analysed retrospectively. MBW tests were performed using 0.2% SF6 and a modified Innocor device. All LCI end points were calculated using SimpleWashout software. Repeatability was assessed using coefficient of variation (CV%). The proportion of people with CF with and without abnormal LCI and forced expiratory volume in 1 s (FEV1) % predicted was compared. Receiver operating characteristic (ROC) curve statistics were calculated. Test duration of all LCI end points was compared using paired t tests. Results: In people with CF, LCI1/40 CV% (p=0.16), LCI1/30 CV%, (p=0.53), LCI1/20 CV% (p=0.14) and LCI1/10 CV% (p=0.25) was not significantly different to controls. The sensitivity of LCI1/40, LCI1/30 and LCI1/20 to the presence of CF was equal (67%). The sensitivity of LCI1/10 and FEV1% predicted was lower (53% and 47% respectively). Area under the ROC curve (95% CI) for LCI1/40, LCI1/30, LCI1/20, LCI1/10 and FEV1% predicted was 0.89 (0.80 to 0.97), 0.87 (0.77 to 0.96), 0.87 (0.78 to 0.96), 0.83 (0.72 to 0.94) and 0.73 (0.60 to 0.86), respectively. Test duration of LCI1/30, LCI1/20 and LCI1/10 was significantly shorter compared with the test duration of LCI1/40 in people with CF (p<0.0001) equating to a 5%, 9% and 15% time saving, respectively. Conclusions: In this study, LCI1/20 was a repeatable and sensitive measure with equal diagnostic performance to LCI1/40. LCI1/20 was shorter, potentially offering a more feasible research and clinical measure.

Rapid-bTB: a novel lateral flow test able to differentiate Mycobacterium bovis from Mycobacterium tuberculosis in sputum

Background: A novel lateral flow, immunochromatographic assay (LFD) specific for Mycobacterium bovis, the cause of bovine tuberculosis and zoonotic TB, was recently developed at Queen’s University Belfast. The LFD detects whole M. bovis cells, in contrast to other commercially available LFD tests (BD MGITTM TBc ID, SD Bioline TB Ag MPT 64, Capilia TB-Neo kit) which detect MPT64 antigen secreted during growth. The new LFD test has been evaluated in the veterinary context, and its specificity for M. bovis in the broadest sense (i.e. subsp. bovis, subsp. caprae and BCG) and sensitivity to detect M. bovis in positive MGIT™ liquid cultures was demonstrated comprehensively.
Methods: Preliminary work was carried out by researchers at Queen’s University Belfast to optimise sputum sample preparation, estimate the limit of detection (LOD) of the LFD with M. bovis-spiked sputum samples, and check LFD specificity by testing a broad range of non-tuberculous Mycobacterium spp. (NTM) and other bacterial genera commonly encountered in sputum samples (Haemophilus, Klebsiella, Pseudomonas, Staphylococcus). In the Cameroon laboratory direct detection of M. bovis in human sputa was attempted, and 50 positive sputum MGIT™ cultures and 33 cultures of various Mycobacterium spp. originally isolated from human sputa were tested.
Results: Sputum sample preparation consisted of digestion with 1% NALC for 30 min, centrifugation at 3000g for 20 min, PBS wash, centrifugation again, and pellet resuspended in KPL blocking buffer before 100 µl was applied to the LFD. The LOD of the LFD applied to M. bovis-spiked sputum was estimated to be 104 CFU/ml. A small number of confirmed Ziehl-Neelsen ‘3+’ M. bovis positive sputum samples were tested directly but no positive LFD results were obtained. All of the sputum MGIT™ cultures and mycobacterial cultures (including M. tuberculosis, M. africanum, M. bovis, M. intracellulare, M. scrofulaceum, M. fortuitum, M. peregrinum, M. interjectum) tested LFD negative when read after 15 min except for the M. bovis cultures, thereby confirming specificity of LFD for M. bovis in the clinical microbiology context.
Conclusions: Results indicate that the ‘Rapid-bTB’ LFD is a very specific test, able to differentiate M. bovis from M. tuberculosis, M. africanum, and a range of NTM isolated from human sputa in MGITTM liquid cultures. However, the LFD lacks sufficient sensitivity to be applied earlier in the diagnostic process to directly test human sputa.

Cybersecurity Test-Bed for IEC 61850 based Smart Substations

With the development and deployment of IEC 61850 based smart substations, cybersecurity vulnerabilities of supervisory control and data acquisition (SCADA) systems are increasingly emerging. In response to the emergence of cybersecurity vulnerabilities in smart substations, a test-bed is indispensable to enable cybersecurity experimentation. In this paper, a comprehensive and realistic cyber-physical test-bed has been built to investigate potential cybersecurity vulnerabilities and the impact of cyber-attacks on IEC 61850 based smart substations. This test-bed is close to a real production type environment, and has the ability to carry out end-to-end testing of cyber-attacks and physical consequences. A fuzz testing approach is proposed for detecting IEC 61850 based intelligent electronic devices (IEDs) and validated in the proposed test-bed.