The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two-parameter logistic model) and at developing a new version of the scale (the CRT-long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision-making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT-long, we report the first investigation into the development of cognitive reflection.

Shortened Lung Clearance Index is a repeatable and sensitive test in children and adults with cystic fibrosis

Background: Lung clearance index (LCI) derived from sulfur hexafluoride (SF6) multiple breath washout (MBW) is a sensitive measure of lung disease in people with cystic fibrosis (CF). However, it can be time-consuming, limiting its use clinically. Aim: To compare the repeatability, sensitivity and test duration of LCI derived from washout to 1/30th (LCI1/30), 1/20th (LCI1/20) and 1/10th (LCI1/10) to ‘standard’ LCI derived from washout to 1/40th initial concentration (LCI1/40). Methods: Triplicate MBW test results from 30 clinically stable people with CF and 30 healthy controls were analysed retrospectively. MBW tests were performed using 0.2% SF6 and a modified Innocor device. All LCI end points were calculated using SimpleWashout software. Repeatability was assessed using coefficient of variation (CV%). The proportion of people with CF with and without abnormal LCI and forced expiratory volume in 1 s (FEV1) % predicted was compared. Receiver operating characteristic (ROC) curve statistics were calculated. Test duration of all LCI end points was compared using paired t tests. Results: In people with CF, LCI1/40 CV% (p=0.16), LCI1/30 CV%, (p=0.53), LCI1/20 CV% (p=0.14) and LCI1/10 CV% (p=0.25) was not significantly different to controls. The sensitivity of LCI1/40, LCI1/30 and LCI1/20 to the presence of CF was equal (67%). The sensitivity of LCI1/10 and FEV1% predicted was lower (53% and 47% respectively). Area under the ROC curve (95% CI) for LCI1/40, LCI1/30, LCI1/20, LCI1/10 and FEV1% predicted was 0.89 (0.80 to 0.97), 0.87 (0.77 to 0.96), 0.87 (0.78 to 0.96), 0.83 (0.72 to 0.94) and 0.73 (0.60 to 0.86), respectively. Test duration of LCI1/30, LCI1/20 and LCI1/10 was significantly shorter compared with the test duration of LCI1/40 in people with CF (p<0.0001) equating to a 5%, 9% and 15% time saving, respectively. Conclusions: In this study, LCI1/20 was a repeatable and sensitive measure with equal diagnostic performance to LCI1/40. LCI1/20 was shorter, potentially offering a more feasible research and clinical measure.

Rapid-bTB: a novel lateral flow test able to differentiate Mycobacterium bovis from Mycobacterium tuberculosis in sputum

Background: A novel lateral flow, immunochromatographic assay (LFD) specific for Mycobacterium bovis, the cause of bovine tuberculosis and zoonotic TB, was recently developed at Queen’s University Belfast. The LFD detects whole M. bovis cells, in contrast to other commercially available LFD tests (BD MGITTM TBc ID, SD Bioline TB Ag MPT 64, Capilia TB-Neo kit) which detect MPT64 antigen secreted during growth. The new LFD test has been evaluated in the veterinary context, and its specificity for M. bovis in the broadest sense (i.e. subsp. bovis, subsp. caprae and BCG) and sensitivity to detect M. bovis in positive MGIT™ liquid cultures was demonstrated comprehensively.
Methods: Preliminary work was carried out by researchers at Queen’s University Belfast to optimise sputum sample preparation, estimate the limit of detection (LOD) of the LFD with M. bovis-spiked sputum samples, and check LFD specificity by testing a broad range of non-tuberculous Mycobacterium spp. (NTM) and other bacterial genera commonly encountered in sputum samples (Haemophilus, Klebsiella, Pseudomonas, Staphylococcus). In the Cameroon laboratory direct detection of M. bovis in human sputa was attempted, and 50 positive sputum MGIT™ cultures and 33 cultures of various Mycobacterium spp. originally isolated from human sputa were tested.
Results: Sputum sample preparation consisted of digestion with 1% NALC for 30 min, centrifugation at 3000g for 20 min, PBS wash, centrifugation again, and pellet resuspended in KPL blocking buffer before 100 µl was applied to the LFD. The LOD of the LFD applied to M. bovis-spiked sputum was estimated to be 104 CFU/ml. A small number of confirmed Ziehl-Neelsen ‘3+’ M. bovis positive sputum samples were tested directly but no positive LFD results were obtained. All of the sputum MGIT™ cultures and mycobacterial cultures (including M. tuberculosis, M. africanum, M. bovis, M. intracellulare, M. scrofulaceum, M. fortuitum, M. peregrinum, M. interjectum) tested LFD negative when read after 15 min except for the M. bovis cultures, thereby confirming specificity of LFD for M. bovis in the clinical microbiology context.
Conclusions: Results indicate that the ‘Rapid-bTB’ LFD is a very specific test, able to differentiate M. bovis from M. tuberculosis, M. africanum, and a range of NTM isolated from human sputa in MGITTM liquid cultures. However, the LFD lacks sufficient sensitivity to be applied earlier in the diagnostic process to directly test human sputa.

Cybersecurity Test-Bed for IEC 61850 based Smart Substations

With the development and deployment of IEC 61850 based smart substations, cybersecurity vulnerabilities of supervisory control and data acquisition (SCADA) systems are increasingly emerging. In response to the emergence of cybersecurity vulnerabilities in smart substations, a test-bed is indispensable to enable cybersecurity experimentation. In this paper, a comprehensive and realistic cyber-physical test-bed has been built to investigate potential cybersecurity vulnerabilities and the impact of cyber-attacks on IEC 61850 based smart substations. This test-bed is close to a real production type environment, and has the ability to carry out end-to-end testing of cyber-attacks and physical consequences. A fuzz testing approach is proposed for detecting IEC 61850 based intelligent electronic devices (IEDs) and validated in the proposed test-bed.

The time course of conflict on the Cognitive Reflection Test

Reasoning that is deliberative and reflective often requires the inhibition of intuitive responses. The Cognitive Reflection Test (CRT) is designed to assess people’s ability to suppress incorrect heuristic responses in favour of deliberation. Correct responding on the CRT predicts performance on a range of tasks in which intuitive processes lead to incorrect responses, suggesting indirectly that CRT performance is related to cognitive control. Yet little is known about the cognitive processes underlying performance on the CRT. In the current research, we employed a novel mouse tracking mjavascript:void(0);ethodology to capture the time-course of reasoning on the CRT. Analysis of mouse cursor trajectories revealed that participants were initially drawn towards the incorrect (i.e., intuitive) option even when the correct (deliberative) option was ultimately chosen. Conversely, participants were not attracted to the correct option when they ultimately chose the incorrect intuitive one. We conclude that intuitive processes are activated automatically on the CRT and must be inhibited in order to respond correctly. When participants responded intuitively, there was no evidence that deliberative reasoning had become engaged.

On Passive Intermodulation Test of Analog and Digital Systems

This paper presents initial results of evaluating suitability of the conventional two-tone CW passive intermodulation (PIM) test for characterization of modulated signal distortion by passive nonlinearities in base station antennas and RF front-end. A comprehensive analysis of analog and digitally modulated waveforms in the transmission lines with weak distributed nonlinearity has been performed using the harmonic balance analysis and X-parameters in Advanced Design System (ADS) simulator. The nonlinear distortion metrics used in the conventional two-tone CW PIM test have been compared with the respective spectral metrics applied to the modulated waveforms, such as adjacent channel power ratio (ACPR) and error vector magnitude (EVM). It is shown that the results of two-tone CW PIM tests are consistent with the metrics used for assessment of signal integrity of both analog and digitally modulated waveforms.

Temperament test for re-homed dogs validated through direct behavioral observation in shelter and home environment

This study was the first attempt to carry out a validation of a temperament test (TT) for shelter dogs that addressed the topics of inter- and intra-raters agreements, test-retest reliability, and validity. The TT consisted of 22 subtests. Each dog was approached and handled by an unfamiliar person and made to interact with a same- and an opposite-gender conspecific. Dogs were tested twice in the shelter and once in their new homes 4 months after adoption to evaluate consistency in behavioral assessment. Playfulness, trainability, problem solving abilities, food possessiveness, and reactivity to sudden stimuli were also evaluated. Testers scored dogs' responses in terms of confidence, fearfulness, and aggressiveness. Results highlighted strengths and limits of this TT that was devised to help shelter staff in matching dogs' personality and owners' expectations. Methodological constraints when working with sheltered dogs are unavoidable; however, the test proved to be overall feasible, reliable, and valid although further studies are needed to address the critical issues that emerged. © 2011 Elsevier Inc.