The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two-parameter logistic model) and at developing a new version of the scale (the CRT-long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision-making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT-long, we report the first investigation into the development of cognitive reflection.

The Value of Full Scale Prototype Data - Testing Oyster 800 at EMEC, Orkney

This paper demonstrates the unparalleled value of full scale data which has been acquired from ocean trials of Aquamarine Power’s Oyster 800 Wave Energy Converter (WEC) at the European Marine Energy Centre (EMEC), Orkney, Scotland.
High quality prototype and wave data were simultaneously recorded in over 750 distinct sea states (comprising different wave height, wave period and tidal height combinations) and include periods of operation where the hydraulic Power Take-Off (PTO) system was both pressurised (damped operation) and de-pressurised (undamped operation).
A detailed model-prototype correlation procedure is presented where the full scale prototype behaviour is compared to predictions from both experimental and numerical modelling techniques via a high temporal resolution wave-by-wave reconstruction. This unquestionably provides the definitive verification of the capabilities of such research techniques and facilitates a robust and meaningful uncertainty analysis to be performed on their outputs.
The importance of a good data capture methodology, both in terms of handling and accuracy is also presented. The techniques and procedures implemented by Aquamarine Power for real-time data management are discussed, including lessons learned on the instrumentation and infrastructure required to collect high-value data.

An overview of seismic hybrid testing of engineering structures

An overview of research on the development of the hybrid test method is presented. The maturity of the hybrid test method is mapped in order to provide context to individual research in the overall development of the test method. In the pseudo dynamic (PsD) test method, the equations of motion are solved using a time stepping numerical integration technique with the inertia and damping being numerically modelled whilst restoring force is physically measured over an extended timescale. Developments in continuous PsD testing led to the real-time hybrid test method and geographically distributed hybrid tests. A key aspect to the efficiency of hybrid testing is the substructuring technique where the critical structural subassemblies that are fundamental to the overall response of the structure are physically tested whilst the remainder of the structure whose response can be more easily predicted is numerically modelled. Much of the early research focused on developing the accuracy and efficiency of the test method, whereas more recently the method has matured to a level where the test method is applied purely as a dynamic testing technique. Developments in numerical integration methods, substructuring, experimental error reduction, delay compensation and speed of testing have led to a test method now in use as full-scale real-time dynamic testing method that is reliable, accurate, efficient and cost effective.

An evaluation of the Socrative (personal response system) app for increasing student engagement and learning in an undergraduate psychology curriculum.

Personal response systems using hardware such as 'clickers' have been around for some time, however their use is often restricted to multiple choice questions (MCQs) and they are therefore used as a summative assessment tool for the individual student. More recent innovations such as 'Socrative' have removed the need for specialist hardware, instead utilising web-based technology and devices common to students, such as smartphones, tablets and laptops. While improving the potential for use in larger classrooms, this also creates the opportunity to pose more engaging open-response questions to students who can 'text in' their thoughts on questions posed in class. This poster will present two applications of the Socrative system in an undergraduate psychology curriculum which aimed to encourage interactive engagement with course content using real-time student responses and lecturer feedback. Data is currently being collected and result will be presented at the conference.
The first application used Socrative to pose MCQs at the end of two modules (a level one Statistics module and level two Individual Differences Psychology module, class size N≈100), with the intention of helping students assess their knowledge of the course. They were asked to rate their self-perceived knowledge of the course on a five-point Likert scale before and after completing the MCQs, as well as their views on the value of the revision session and any issues that had with using the app. The online MCQs remained open between the lecture and the exam, allowing students to revisit the questions at any time during their revision.
This poster will present data regarding the usefulness of the revision MCQs, the metacognitive effect of the MCQs on student's judgements of learning (pre vs post MCQ testing), as well as student engagement with the MCQs between the revision session and the examination. Student opinions on the use of the Socrative system in class will also be discussed.
The second application used Socrative to facilitate a flipped classroom lecture on a level two 'Conceptual Issues in Psychology' module, class size N≈100). The content of this module requires students to think critically about historical and contemporary conceptual issues in psychology and the philosophy of science. Students traditionally struggle with this module due to the emphasis on critical thinking skills, rather than simply the retention of concrete knowledge. To prepare students for the written examination, a flipped classroom lecture was held at the end of the semester. Students were asked to revise their knowledge of a particular area of Psychology by assigned reading, and were told that the flipped lecture would involve them thinking critically about the conceptual issues found in this area. They were informed that questions would be posed by the lecturer in class, and that they would be asked to post their thoughts using the Socrative app for a class discussion. The level of preparation students engaged in for the flipped lecture was measured, as well as qualitative opinions on the usefulness of the session. This poster will discuss the level of student engagement with the flipped lecture, both in terms of preparation for the lecture, and engagement with questions posed during the lecture, as well as the lecturer's experience in facilitating the flipped classroom using the Socrative platform.

Selection of the most appropriate roadside vehicle restraint system – the SAVeRS project

Run Off Road (ROR) crashes are road accidents that often result in severe injuries or fatalities. To reduce the severity of ROR crashes, “forgiving roadsides” need to be designed and this includes identifying situations where there is a need for a Vehicle Restraint System (VRS) and what appropriate VRS should be selected for a specific location and traffic condition. Whilst there are standards covering testing, evaluation and classification of VRS within Europe (EN1317 parts 1 to 8), their selection, location and installation requirements are typically based upon national guidelines and standards, often produced by National Road Authorities (NRA) and/or overseeing organisations. Due to local conditions, these national guidelines vary across Europe.
The European SAVeRS project funded by CEDR has developed a practical and readily understandable VRS guidance document and a user-friendly software tool which allow designers and road administrations to select the most appropriate solution in different road and traffic conditions.
This paper describes the main outcomes of the project, the process to select the most appropriate roadside barrier, and the user friendly SAVeRS tool.

EuroClonality/BIOMED-2 guidelines for interpretation and reporting of Ig/TCR clonality testing in suspected lymphoproliferations.

PCR-based immunoglobulin (Ig)/T-cell receptor (TCR) clonality testing in suspected lymphoproliferations has largely been standardized and has consequently become technically feasible in a routine diagnostic setting. Standardization of the pre-analytical and post-analytical phases is now essential to prevent misinterpretation and incorrect conclusions derived from clonality data. As clonality testing is not a quantitative assay, but rather concerns recognition of molecular patterns, guidelines for reliable interpretation and reporting are mandatory. Here, the EuroClonality (BIOMED-2) consortium summarizes important pre- and post-analytical aspects of clonality testing, provides guidelines for interpretation of clonality testing results, and presents a uniform way to report the results of the Ig/TCR assays. Starting from an immunobiological concept, two levels to report Ig/TCR profiles are discerned: the technical description of individual (multiplex) PCR reactions and the overall molecular conclusion for B and T cells. Collectively, the EuroClonality (BIOMED-2) guidelines and consensus reporting system should help to improve the general performance level of clonality assessment and interpretation, which will directly impact on routine clinical management (standardized best-practice) in patients with suspected lymphoproliferations.

Multi-purpose utility of circulating plasma DNA testing in patients with advanced cancers.

Tumor genomic instability and selective treatment pressures result in clonal disease evolution; molecular stratification for molecularly targeted drug administration requires repeated access to tumor DNA. We hypothesized that circulating plasma DNA (cpDNA) in advanced cancer patients is largely derived from tumor, has prognostic utility, and can be utilized for multiplex tumor mutation sequencing when repeat biopsy is not feasible. We utilized the Sequenom MassArray System and OncoCarta panel for somatic mutation profiling. Matched samples, acquired from the same patient but at different time points were evaluated; these comprised formalin-fixed paraffin-embedded (FFPE) archival tumor tissue (primary and/or metastatic) and cpDNA. The feasibility, sensitivity, and specificity of this high-throughput, multiplex mutation detection approach was tested utilizing specimens acquired from 105 patients with solid tumors referred for participation in Phase I trials of molecularly targeted drugs. The median cpDNA concentration was 17 ng/ml (range: 0.5-1600); this was 3-fold higher than in healthy volunteers. Moreover, higher cpDNA concentrations associated with worse overall survival; there was an overall survival (OS) hazard ratio of 2.4 (95% CI 1.4, 4.2) for each 10-fold increase in cpDNA concentration and in multivariate analyses, cpDNA concentration, albumin, and performance status remained independent predictors of OS. These data suggest that plasma DNA in these cancer patients is largely derived from tumor. We also observed high detection concordance for critical 'hot-spot' mutations (KRAS, BRAF, PIK3CA) in matched cpDNA and archival tumor tissue, and important differences between archival tumor and cpDNA. This multiplex sequencing assay can be utilized to detect somatic mutations from plasma in advanced cancer patients, when safe repeat tumor biopsy is not feasible and genomic analysis of archival tumor is deemed insufficient. Overall, circulating nucleic acid biomarker studies have clinically important multi-purpose utility in advanced cancer patients and further studies to pursue their incorporation into the standard of care are warranted.

Field Testing and Development of Novel SHM systems at Queen’s University Belfast

Ageing and deterioration of infrastructure is a challenge facing transport authorities. In
particular, there is a need for increased bridge monitoring in order to provide adequate
maintenance and to guarantee acceptable levels of transport safety. The Intelligent
Infrastructure group at Queens University Belfast (QUB) are working on a number of aspects
of infrastructure monitoring and this paper presents summarised results from three distinct
monitoring projects carried out by this group. Firstly the findings from a project on next
generation Bridge Weight in Motion (B-WIM) are reported, this includes full scale field testing
using fibre optic strain sensors. Secondly, results from early phase testing of a computer
vision system for bridge deflection monitoring are reported on. This research seeks to exploit
recent advances in image processing technology with a view to developing contactless
bridge monitoring approaches. Considering the logistical difficulty of installing sensors on a
‘live’ bridge, contactless monitoring has some inherent advantages over conventional
contact based sensing systems. Finally the last section of the paper presents some recent
findings on drive by bridge monitoring. In practice a drive-by monitoring system will likely
require GPS to allow the response of a given bridge to be identified; this study looks at the
feasibility of using low-cost GPS sensors for this purpose, via field trials. The three topics
outlined above cover a spectrum of SHM approaches namely, wired monitoring, contactless
monitoring and drive by monitoring