SPHERE: Stormont Parliamentary Hansards: Embedded in Research and Education

SPHERE (Stormont Parliamentary Hansards: Embedded in Research and Education) was a JISC-funded project based at King’s College, London and Queen’s University, Belfast, working in Partnership with the Northern Ireland Assembly Library, and the NIA Official Report (Hansard). Its purpose was to assess the use, value and impact of The Stormont Papers digital resource, and to use the results of this assessment to make recommendations for a series of practical approaches to embed the resource within teaching, learning and research among the wider user community. The project began in November 2010 and was concluded in April 2010.

A series of formal reports on the project are published by JISC online at http://www.jisc.ac.uk/whatwedo/programmes/digitisation/impactembedding/sphere.aspx

SPHERE Impact analysis summary
Portable Document Format
SPHERE interviews report
SPHERE Outreach use case
SPHERE research use case
SPHERE teaching use_case
SPHERE web survey report
SPHERE web analysis

Supporting active learning in an undergraduate geotechnical engineering course using group-based audience response systems quizzes

The use of audience response systems (ARSs) or ‘clickers’ in higher education has increased over the recent years, predominantly owing to their ability to actively engage students, for promoting individual and group learning, and for providing instantaneous feedback to students and teachers. This paper describes how group-basedARSquizzes have been integrated into an undergraduate civil engineering course on foundation design. Overall, theARSsummary quizzes were very well received by the students. Feedback obtained from the students indicates that the majority believed the group-based quizzes were useful activities, which helped to improve their understanding of course materials, encouraged self-assessment, and assisted preparation for their summative examination. Providing students with clickers does not, however, necessarily guarantee the class will be engaged with the activity. If an ARS activity is to be successful, careful planning and design must be carried out and modifications adopted where necessary, which should be informed by the literature and relevant student feedback.

Better together: Interprofessional Education in Medication Safety

Background: The importance of actively working with other professionals, as part of a single team, is well embedded in discussions relating to effective healthcare. The need for effective teamwork specifically in relation to patient safety is also widely acknowledged; however healthcare has traditionally been poor at building teams and professional groups tend to function semi-autonomously and autocratically.1
Objective: This study aims to gain the views and experiences of students from nursing, pharmacy and medicine involved in an interprofessional workshop in medication safety.
Setting and methods: Interprofessional workshops involving students from nursing, pharmacy and medicine were delivered using case studies involving medication incidents. Focus groups were used to investigate participant’s views and experiences of the workshop.
Results: Focus groups were completed with 22 students. Five main themes were identified from the focus group data relating to medication safety; these were increasing confidence, insight into roles, improving skills, culture of responsibility and application to future practice.
Conclusions: This study represents a model for delivery of training that has demonstrated improvement in the students’ attitudes towards team working and is a first step towards introducing team working into the medication safety program. The programme continues to run using live and virtual workshops.

1. Leape LL. A systems analysis approach to medical error. J Clin Eval Clin Pract. 1997. 3, 3, 213-222.

A computational intelligent approach to multi-factor analysis of violent crime information systems

Various scientific studies have explored the causes of violent behaviour from different perspectives, with psychological tests, in particular, applied to the analysis of crime factors. The relationship between bi-factors has also been extensively studied including the link between age and crime. In reality, many factors interact to contribute to criminal behaviour and as such there is a need to have a greater level of insight into its complex nature. In this article we analyse violent crime information systems containing data on psychological, environmental and genetic factors. Our approach combines elements of rough set theory with fuzzy logic and particle swarm optimisation to yield an algorithm and methodology that can effectively extract multi-knowledge from information systems. The experimental results show that our approach outperforms alternative genetic algorithm and dynamic reduct-based techniques for reduct identification and has the added advantage of identifying multiple reducts and hence multi-knowledge (rules). Identified rules are consistent with classical statistical analysis of violent crime data and also reveal new insights into the interaction between several factors. As such, the results are helpful in improving our understanding of the factors contributing to violent crime and in highlighting the existence of hidden and intangible relationships between crime factors.

Sexual Health and Sexuality Education Needs of Young People in Care: a Survey of Service-provider Perspectives. Report No 1.

Aim: This study aims to describe the sex education and sexual health needs of young people in care, and to explore the degree to which these needs are being met by current provision.As part of the Department for Children and Youth Affairs ‘National Strategy for Data and Research on Children’s Lives, 2011-2016’, the HSE Crisis Pregnancy Programme (CPP) and HSE Children and Families Social Services Care Group have co-commissioned a team of researchers from UCD School of Nursing, Midwifery & Health Systems, Insights Health and Social Research and Queen’s University Belfast to examine the sex education and sexual health needs of young people in care in the Republic of Ireland. The project is supported by a steering group of senior personnel from both partner organisations (CPP and CFS) and external advisors. The study involves data collection with young people, care providers, birth parents and foster parents using a mixed methods approach. Findings from each stage of the study will be combined to inform recommendations for policy and practice.

Computational cancer biology: education is a natural key to many locks

Background: Oncology is a field that profits tremendously from the genomic data generated by high-throughput technologies, including next-generation sequencing. However, in order to exploit, integrate, visualize and interpret such high-dimensional data efficiently, non-trivial computational and statistical analysis methods are required that need to be developed in a problem-directed manner.

Discussion: For this reason, computational cancer biology aims to fill this gap. Unfortunately, computational cancer biology is not yet fully recognized as a coequal field in oncology, leading to a delay in its maturation and, as an immediate consequence, an under-exploration of high-throughput data for translational research.

Summary: Here we argue that this imbalance, favoring 'wet lab-based activities', will be naturally rectified over time, if the next generation of scientists receives an academic education that provides a fair and competent introduction to computational biology and its manifold capabilities. Furthermore, we discuss a number of local educational provisions that can be implemented on university level to help in facilitating the process of harmonization.

Supervisor Continuity or Co-Location: Which Matters in Residency Education? Findings From a Qualitative Study of Remote Supervisor Family Physicians in Australia and Canada

Purpose: Changes to health care systems andworking hours have fragmentedresidents’ clinical experiences withpotentially negative effects ontheir development as professionals.Investigation of off-site supervision,which has been implemented in isolatedrural practice, could reveal importantbut less overt components of residencyeducation. 

Method: Insights from sociocultural learningtheory and work-based learning provideda theoretical framework. In 2011–2012,16 family physicians in Australia andCanada were asked in-depth how theyremotely supervised residents’ workand learning, and for their reflectionson this experience. The verbatiminterview transcripts and researchers’memos formed the data set. Templateanalysis produced a description andinterpretation of remote supervision. 

Results: Thirteen Australian family physiciansfrom five states and one territory, andthree Canadians from one province,participated. The main themes werehow remoteness changed the dynamicsof care and supervision; the importanceof ongoing, holistic, nonhierarchical,supportive supervisory relationships; andthat residents learned “clinical courage”through responsibility for patients’ careover time. Distance required supervisorsto articulate and pass on their expertiseto residents but made monitoringdifficult. Supervisory continuityencouraged residents to build on pastexperiences and confront deficiencies. 

Conclusions: Remote supervision enabled residents todevelop as clinicians and professionals.This questions the supremacy of co-locationas an organizing principle forresidency education. Future specialists maybenefit from programs that give themongoing and increasing responsibilityfor a group of patients and supportive.

Early warning systems: problems, pragmatics and potential

Symposium Chair: Dr Jennifer McGaughey

Title: Early Warning Systems: problems, pragmatics and potential

Early Warning Systems (EWS) provide a mechanism for staff to recognise, refer and manage deteriorating patients on general hospital wards. Implementation of EWS in practice has required considerable change in the delivery of critical care across hospitals. Drawing their experience of these changes the authors will demonstrate the problems and potential of using EWS to improve patient outcomes.

The first paper (Dr Jennifer McGaughey: Early Warning Systems: what works?) reviews the research evidence regarding the factors that support or constrain the implementation of Early Warning System (EWS) in practice. These findings explain those processes which impact on the successful achievement of patient outcomes. In order to improve detection and standardise practice National EWS have been implemented in the United Kingdom. The second paper (Catherine Plowright: The implementation of the National EWS in a District General Hospital) focuses on the process of implementing and auditing a National EWS. This process improvement is essential to contribute to future collaborative research and collection of robust datasets to improve patient safety as recommended by the Royal College of Physicians (RCP 2012). To successfully implement NEWS in practice requires strategic planning and staff education. The practical issues of training staff is discussed in the third paper. This paper (Collette Laws-Chapman: Simulation as a modality to embed the use of Early Warning Systems) focuses on using simulation and structured debrief to enhance learning in the early recognition and management of deteriorating patients. This session emphasises the importance of cognitive and social skills developed alongside practical skills in the simulated setting.

Recognising difference while promoting cohesion: the role of collaborative networks in education

The chapter outlines various approaches taken to the challenge of divided societies through education systems and links this to debates on political approaches to conflict resolution in Northern Ireland. The education debate has structural and affective components, while the political debate revolves around the privileging of identity or commonality. Applying the principle of recognition and the importance of tolerance is seen to provide a range of policy options, but the evidence of education interventions in Northern Ireland does not highlight any one policy option as the most effective, nor did the end of the violent conflict produce a new consensus on a way forward. The chapter argues that a key additional element to effective practice might be provided through the promotion of shared education through collaborative networks of schools which allows for the continued operation of separate schools while promoting an integrated experience for pupils and teachers.

What is being taught in Religious Education classes in Northern Ireland and to what extent should states be concerned about regulation, quality and control of the subject?

This paper reports on a research project designed to discover what schools are teaching in Religious Education in Northern Ireland and what procedures are in place to maintain standards in the delivery of the subject. A search through literature shows that little research has been carried out to determine what is being taught in Religious Education in Northern Ireland. It also indicates that there are very weak systems of control to measure the effectiveness or quality of what is delivered. A survey of the websites of all Post-Primary schools in the region was used to provide some answers to the basic question of what is being taught in RE. Using content and discourse analysis of these alongside supporting documentary sources (textbooks and exam specifications), it is possible to get a clearer picture of how the Northern Ireland Core Syllabus for Religious Education and any additional curricular elements are delivered in schools. The findings show that a significant minority of schools do not publicly articulate what pupils do in religious education. In situations where the content of religious education is made clear, some definite trends are evident. Despite the existence of a statutory core syllabus, there is significant variation in what is taught in schools. The content is most divergent from the syllabus in relation to the teaching of World Religions at Key Stage 3 and at Key Stage 4 whole elements of the syllabus are neglected due to limited conformity between the syllabus and exam specifications. These results raise important questions about the systems of regulation and control of the subject in the region. In law the subject is exempt from formal inspection by the local inspection authority; instead, a form of inspection is allowed for by the Christian churches who design the syllabus, but it is a process that is either entirely neglected or entirely unreported in situations where it does occur. It is argued that these findings raise questions of more general concern for this and other regions in Europe where the teaching of religious education is largely unregulated. For example, to what extent should states take an interest in what is taught in religious education, how it is delivered, what values it promotes and how standards of teaching and learning in the subject are upheld?

Improving E-Assessment Systems With A focus On Adaptive Feedback And Marking

Institutions involved in the provision of tertiary education across Europe are feeling the pinch. European universities, and other higher education (HE) institutions, must operate in a climate where the pressure of government spending cuts (Garben, 2012) is in stark juxtaposition to the EU’s strategy to drive forward and maintain a growth of student numbers in the sector (eurostat, 2015).

In order to remain competitive, universities and HE institutions are making ever-greater use of electronic assessment (E-Assessment) systems (Chatzigavriil et all, 2015; Ferrell, 2012). These systems are attractive primarily because they offer a cost-effect and scalable approach for assessment. In addition to scalability, they also offer reliability, consistency and impartiality; furthermore, from the perspective of a student they are most popular because they can offer instant feedback (Walet, 2012).

There are disadvantages, though.

First, feedback is often returned to a student immediately on competition of their assessment. While it is possible to disable the instant feedback option (this is often the case during an end of semester exam period when assessment scores must be can be ratified before release), however, this option tends to be a global ‘all on’ or ‘all off’ configuration option which is controlled centrally rather than configurable on a per-assessment basis.

If a formative in-term assessment is to be taken by multiple groups of
students, each at different times, this restriction means that answers to each question will be disclosed to the first group of students undertaking the assessment. As soon as the answers are released “into the wild” the academic integrity of the assessment is lost for subsequent student groups.

Second, the style of feedback provided to a student for each question is often limited to a simple ‘correct’ or ‘incorrect’ indicator. While this type of feedback has its place, it often does not provide a student with enough insight to improve their understanding of a topic that they did not answer correctly.

Most E-Assessment systems boast a wide range of question types including Multiple Choice, Multiple Response, Free Text Entry/Text Matching and Numerical questions. The design of these types of questions is often quite restrictive and formulaic, which has a knock-on effect on the quality of feedback that can be provided in each case.

Multiple Choice Questions (MCQs) are most prevalent as they are the most prescriptive and therefore most the straightforward to mark consistently. They are also the most amenable question types, which allow easy provision of meaningful, relevant feedback to each possible outcome chosen.
Text matching questions tend to be more problematic due to their free text entry nature. Common misspellings or case-sensitivity errors can often be accounted for by the software but they are by no means fool proof, as it is very difficult to predict in advance the range of possible variations on an answer that would be considered worthy of marks by a manual marker of a paper based equivalent of the same question.

Numerical questions are similarly restricted. An answer can be checked for accuracy or whether it is within a certain range of the correct answer, but unless it is a special purpose-built mathematical E-Assessment system the system is unlikely to have computational capability and so cannot, for example, account for “method marks” which are commonly awarded in paper-based marking.

From a pedagogical perspective, the importance of providing useful formative feedback to students at a point in their learning when they can benefit from the feedback and put it to use must not be understated (Grieve et all, 2015; Ferrell, 2012).

In this work, we propose a number of software-based solutions, which will overcome the limitations and inflexibilities of existing E-Assessment systems.

People and places: Understanding geographical accuracy in administrative data from the census and healthcare systems

Administrative systems such as health care registration are of increasing importance in providing information for statistical, research, and policy purposes. There is thus a pressing need to understand better the detailed relationship between population characteristics as recorded in such systems and conventional censuses. This paper explores these issues using the unique Northern Ireland Longitudinal Study (NILS). It takes the 2001 Census enumeration as a benchmark and analyses the social, demographic and spatial patterns of mismatch with the health register at individual level. Descriptive comparison is followed by multivariate and multilevel analyses which show that approximately 25% of individuals are reported to be in different addresses and that age, rurality, education, and housing type are all important factors. This level of mismatch appears to be maintained over time, as earlier migrants who update their address details are replaced by others who have not yet done so. In some cases, apparent mismatches seem likely to reflect complex multi-address living arrangements rather than data error.

Assessing the evidence: Student response system versus computer based testing for undertaking multiple choice question assessment in undergraduate nursing education

There is a dearth of evidence focusing on student preferences for computer-based testing versus
testing via student response systems for summative assessment in undergraduate education.
This quantitative study compared the preference and acceptability of computer-based testing
and a student response system for completing multiple choice questions in undergraduate
nursing education. After using both computer-based testing and a student response system to
complete multiple choice questions, 192 first year undergraduate nursing students rated their
preferences and attitudes towards using computer-based testing and a student response system.
Results indicated that seventy four percent felt the student response system was easy to use.
Fifty six percent felt the student response system took more time than the computer-based testing
to become familiar with. Sixty Percent felt computer-based testing was more users friendly.
Seventy Percent of students would prefer to take a multiple choice question summative exam
via computer-based testing, although Fifty percent would be happy to take using student response
system. Results are useful for undergraduate educators in relation to student’s preference
for using computer-based testing or student response system to undertake a summative
multiple choice question exam