How Video Lecture Capture affects Student Engagement in a University Computer Programming Course: Attendance, Video Viewing Behaviours and Student Attitudes

Introduction
The use of video capture of lectures in Higher Education is not a recent occurrence with web based learning technologies including digital recording of live lectures becoming increasing commonly offered by universities throughout the world (Holliman and Scanlon, 2004). However in the past decade the increase in technical infrastructural provision including the availability of high speed broadband has increased the potential and use of videoed lecture capture. This had led to a variety of lecture capture formats including pod casting, live streaming or delayed broadcasting of whole or part of lectures.
Additionally in the past five years there has been a significant increase in the popularity of online learning, specifically via Massive Open Online Courses (MOOCs) (Vardi, 2014). One of the key aspects of MOOCs is the simulated recording of lecture like activities. There has been and continues to be much debate on the consequences of the popularity of MOOCs, especially in relation to its potential uses within established University programmes.
There have been a number of studies dedicated to the effects of videoing lectures.
The clustered areas of research in video lecture capture have the following main themes:
• Staff perceptions including attendance, performance of students and staff workload
• Reinforcement versus replacement of lectures
• Improved flexibility of learning
• Facilitating engaging and effective learning experiences
• Student usage, perception and satisfaction
• Facilitating students learning at their own pace
Most of the body of the research has concentrated on student and faculty perceptions, including academic achievement, student attendance and engagement (Johnston et al, 2012).
Generally the research has been positive in review of the benefits of lecture capture for both students and faculty. This perception coupled with technical infrastructure improvements and student demand may well mean that the use of video lecture capture will continue to increase in frequency in the next number of years in tertiary education. However there is a relatively limited amount of research in the effects of lecture capture specifically in the area of computer programming with Watkins 2007 being one of few studies . Video delivery of programming solutions is particularly useful for enabling a lecturer to illustrate the complex decision making processes and iterative nature of the actual code development process (Watkins et al 2007). As such research in this area would appear to be particularly appropriate to help inform debate and future decisions made by policy makers.
Research questions and objectives
The purpose of the research was to investigate how a series of lecture captures (in which the audio of lectures and video of on-screen projected content were recorded) impacted on the delivery and learning of a programme of study in an MSc Software Development course in Queen’s University, Belfast, Northern Ireland. The MSc is conversion programme, intended to take graduates from non-computing primary degrees and upskill them in this area. The research specifically targeted the Java programming module within the course. It also analyses and reports on the empirical data from attendances and various video viewing statistics. In addition, qualitative data was collected from staff and student feedback to help contextualise the quantitative results.
Methodology, Methods and Research Instruments Used
The study was conducted with a cohort of 85 post graduate students taking a compulsory module in Java programming in the first semester of a one year MSc in Software Development. A pre-course survey of students found that 58% preferred to have available videos of “key moments” of lectures rather than whole lectures. A large scale study carried out by Guo concluded that “shorter videos are much more engaging” (Guo 2013). Of concern was the potential for low audience retention for videos of whole lectures.
The lecturers recorded snippets of the lecture directly before or after the actual physical delivery of the lecture, in a quiet environment and then upload the video directly to a closed YouTube channel. These snippets generally concentrated on significant parts of the theory followed by theory related coding demonstration activities and were faithful in replication of the face to face lecture. Generally each lecture was supported by two to three videos of durations ranging from 20 – 30 minutes.
Attendance
The MSc programme has several attendance based modules of which Java Programming was one element. In order to assess the consequence on attendance for the Programming module a control was established. The control used was a Database module which is taken by the same students and runs in the same semester.
Access engagement
The videos were hosted on a closed YouTube channel made available only to the students in the class. The channel had enabled analytics which reported on the following areas for all and for each individual video; views (hits), audience retention, viewing devices / operating systems used and minutes watched.
Student attitudes
Three surveys were taken in regard to investigating student attitudes towards the videoing of lectures. The first was before the start of the programming module, then at the mid-point and subsequently after the programme was complete.
The questions in the first survey were targeted at eliciting student attitudes towards lecture capture before they had experienced it in the programme. The midpoint survey gathered data in relation to how the students were individually using the system up to that point. This included feedback on how many videos an individual had watched, viewing duration, primary reasons for watching and the result on attendance, in addition to probing for comments or suggestions. The final survey on course completion contained questions similar to the midpoint survey but in summative view of the whole video programme.
Conclusions and Outcomes
The study confirmed findings of other such investigations illustrating that there is little or no effect on attendance at lectures. The use of the videos appears to help promote continual learning but they are particularly accessed by students at assessment periods. Students respond positively to the ability to access lectures digitally, as a means of reinforcing learning experiences rather than replacing them. Feedback from students was overwhelmingly positive indicating that the videos benefited their learning. Also there are significant benefits to part recording of lectures rather than recording whole lectures. The behaviour viewing trends analytics suggest that despite the increase in the popularity of online learning via MOOCs and the promotion of video learning on mobile devices in fact in this study the vast majority of students accessed the online videos at home on laptops or desktops However, in part, this is likely due to the nature of the taught subject, that being programming.
The research involved prerecording the lecture in smaller timed units and then uploading for distribution to counteract existing quality issues with recording entire live lectures. However the advancement and consequential improvement in quality of in situ lecture capture equipment may well help negate the need to record elsewhere. The research has also highlighted an area of potentially very significant use for performance analysis and improvement that could have major implications for the quality of teaching. A study of the analytics of the viewings of the videos could well provide a quick response formative feedback mechanism for the lecturer. If a videoed lecture either recorded live or later is a true reflection of the face to face lecture an analysis of the viewing patterns for the video may well reveal trends that correspond with the live delivery.

Is Our Students Learning - QuestionMark: Extending E-Assessment Systems for Adapative Marking and Feedback

Our key contribution is a flexible, automated marking system that adds desirable functionality to existing E-Assessment systems. In our approach, any given E-Assessment system is relegated to a data-collection mechanism, whereas marking and the generation and distribution of personalised per-student feedback is handled separately by our own system. This allows content-rich Microsoft Word feedback documents to be generated and distributed to every student simultaneously according to a per-assessment schedule.

The feedback is adaptive in that it corresponds to the answers given by the student and provides guidance on where they may have gone wrong. It is not limited to simple multiple choice which are the most prescriptive question type offered by most E-Assessment Systems and as such most straightforward to mark consistently and provide individual per-alternative feedback strings. It is also better equipped to handle the use of mathematical symbols and images within the feedback documents which is more flexible than existing E-Assessment systems, which can only handle simple text strings.

As well as MCQs the system reliably and robustly handles Multiple Response, Text Matching and Numeric style questions in a more flexible manner than Questionmark: Perception and other E-Assessment Systems. It can also reliably handle multi-part questions where the response to an earlier question influences the answer to a later one and can adjust both scoring and feedback appropriately.

New question formats can be added at any time provided a corresponding marking method conforming to certain templates can also be programmed. Indeed, any question type for which a programmatic method of marking can be devised may be supported by our system. Furthermore, since the student’s response to each is question is marked programmatically, our system can be set to allow for minor deviations from the correct answer, and if appropriate award partial marks.

The immediate Life support course: implementation into an undergraduate nursing programme

This paper outlines how the immediate life support (ILS) course was incorporated into an undergraduate-nursing curriculum in a university in Northern Ireland. It also reports on how the students perceived the impact of this course on their clinical practice. The aim was to develop the student’s ability to recognise the acutely ill patient and to determine the relevance of this to clinical practice. Prior to this the ILS course was only available to qualified nurses and this paper reports on the first time students were provided with an ILS course in an undergraduate setting. The ILS course was delivered to 89 third year nursing students (Adult Branch) and comprised one full teaching day per week over two weeks. Recognised Advanced Life Support (ALS) instructors, in keeping with the United Kingdom Resuscitation Council guidelines, taught the students. Participants completed a 17 item questionnaire which comprised an open-ended section for student comment. Questionnaire data was analysed descriptively using SSPSS version 15.0. Open-ended responses from the questionnaire data was analysed by content and thematic analysis. Results Student feedback reported that the ILS course helped them understand what constituted the acutely ill patient and the role of the nurse in managing a deteriorating situation. Students also reported that they valued the experience as highlighting gaps in their knowledge Conclusion. The inclusion of the ILS course provides students with necessary skills to assess and manage the deteriorating patient. In addition the data from this study suggest the ILS course should be delivered in an inter-professional setting – i.e taught jointly with medical students. References: Department of Health & Quality Assurance Agency (2006). Department of Health Phase 2 benchmarking project – final report. Gloucester: Department of Health, London and Quality Assurance Agency for Higher Education

The Design Process- Making It Relevant For Students

Within the ever-changing arenas of architectural design and education, the core element of architectural education remains: that of the design process. The consideration of how to design in addition to what to design presents architectural educators with that most constant and demanding challenge of how do we best teach the design process?

This challenge is arguably most acute at a student's early stages of their architectural education. In their first years in architecture, students will commonly concentrate on the end product rather than the process. This is, in many ways, understandable. A great deal of time, money and effort go into their final presentations. They believe that it is what is on the wall that is going to be assessed. Armed with new computer skills, they want to produce eye-catching graphics that are often no more than a celebration of a CAD package. In an era of increasing speed, immediacy of information and powerful advertising it is unsurprising that students want to race quickly to presenting an end-product.

Recognising that trend, new teaching methods and models were introduced into the second year undergraduate studio over the past two years at Queen's University Belfast, aimed at promoting student self-reflection and making the design process more relevant to the students. This paper will first generate a critical discussion on the difficulties associated with the design process before outlining some of the methods employed to help promote the following; an understanding of concept, personalisation of the design process for the individual student; adding realism and value to the design process and finally, getting he students to play to their strengths in illustrating their design process like an element of product. Frameworks, examples, outcomes and student feedback will all be presented to help illustrate the effectiveness of the new strategies employed in making the design process firstly, more relevant and therefore secondly, of greater value, to the architecture student.

Supporting active learning in an undergraduate geotechnical engineering course using group-based audience response systems quizzes

The use of audience response systems (ARSs) or ‘clickers’ in higher education has increased over the recent years, predominantly owing to their ability to actively engage students, for promoting individual and group learning, and for providing instantaneous feedback to students and teachers. This paper describes how group-basedARSquizzes have been integrated into an undergraduate civil engineering course on foundation design. Overall, theARSsummary quizzes were very well received by the students. Feedback obtained from the students indicates that the majority believed the group-based quizzes were useful activities, which helped to improve their understanding of course materials, encouraged self-assessment, and assisted preparation for their summative examination. Providing students with clickers does not, however, necessarily guarantee the class will be engaged with the activity. If an ARS activity is to be successful, careful planning and design must be carried out and modifications adopted where necessary, which should be informed by the literature and relevant student feedback.

Report from the 2nd Summer School in Computational Biology organized by the Queen's University of Belfast

In this paper, we present a meeting report for the 2nd Summer School in Computational Biology organized by the Queen's University of Belfast. We describe the organization of the summer school, its underlying concept and student feedback we received after the completion of the summer school.

Evaluation of creative problem solving abilities in undergraduate structural engineers through interdisciplinary problem based learning

For a structural engineer, effective communication and interaction with architects cannot be underestimated as a key skill to success throughout their professional career. Structural engineers and architects have to share a common language and understanding of each other in order to achieve the most desirable architectural and structural designs. This interaction and engagement develops during their professional career but needs to be nurtured during their undergraduate studies. The objective of this paper is to present the strategies employed to engage higher order thinking in structural engineering students in order to help them solve complex problem-based learning (PBL) design scenarios presented by architecture students. The strategies employed were applied in the experimental setting of an undergraduate module in structural engineering at Queen’s University Belfast in the UK. The strategies employed were active learning to engage with content knowledge, the use of physical conceptual structural models to reinforce key concepts and finally, reinforcing the need for hand sketching of ideas to promote higher order problem-solving. The strategies employed were evaluated through student survey, student feedback and module facilitator (this author) reflection. The strategies were qualitatively perceived by the tutor and quantitatively evaluated by students in a cross-sectional study to help interaction with the architecture students, aid interdisciplinary learning and help students creatively solve problems (through higher order thinking). The students clearly enjoyed this module and in particular interacting with structural engineering tutors and students from another discipline

The Evolution of 'Design Build Fly' Led Teaching in Aerospace Engineering

This paper describes the evolution of a ‘Design - Build-Fly’ (DBF) approach to the delivery and assessment of a Stage Three Aircraft Design module. It focuses on the primary learning outcomes around the design and manufacturing functions associated with the development of a remotely controlled aircraft. The work covers a six year period from 2011 to present mapping the transformation of the module from report based assessment to a more hands on approach resulting in a fully functioning remotely controlled aircraft. Results show that both the staff and student experience improved across key performance metrics including student feedback, learning and competency development. Challenges still remain in methods of placing students within teams and maintaining technical rigour in reporting as students develop vocational skills and more reflective writing styles.

Bespoke Radiology e-Learning

Introduction: Foundation doctors are expected to assess and interpret plain x-ray studies of the chest/abdomen before a definitive report is issued by senior staff. The Royal College of Radiologists have published guidelines (RCR curriculum) on the scope of plain film findings medical students should be familiar with.1 Studies have shown that the x-ray interpretation without feedback does not significantly improve diagnostic ability. 2 Queen’s University, Belfast Trust Radiology and Experior Medical developed an online system to assess individual student ability to interpret X-ray findings. Over a series of assessments each student’s profile is built up, identifying strengths and weakness. The system can then create bespoke individual assessments re-evaluating previously identified weak areas and quantifying interpretative skill improvement. Aim: To determine how readily an online system is adopted by senior medical students, investigating if increasing exposure to x-ray interpretation combined with cyclical formative feedback enhances performance. Methods: The system was offered to all 270 final year medical students as an online resource. The system comprised a series of 20 weekly 30 minute assessments, containing normal and abnormal x-rays within the RCR curriculum. After each assessment students were given formative feedback, including their own result, annotated answers, peer group comparison and a breakdown of areas of strength and weakness. Focus groups of 4-5 students addressed student perspectives of the system, including ease of use, image resolution, system performance across different operating platforms, perceived value of formative feedback loops, breakdown of performance and the value of bespoke personalised assessments. Research Ethics Approval was granted for the study. Data analysis was via two-sided one-sample t-test; initial minimal recruitment was estimated as 60 students, to detect a mean 10% change in performance, with a standard deviation of 20%. Results and Discussion: Over 80% (n = XXX/270) of the student cohort engaged with the study. Student baseline average was 39%, increasing to 62% by the exit test. The steadily sustained improvement (57% relative performance in interpretative diagnostic accuracy) was despite increasing test difficulty. Student feedback via focus groups was universally positive throughout the examined domains. Conclusion: The online resource proved to be valuable, with high levels of student engagement, improving performance despite increasingly difficulty testing and positive learner experience with the system. References: 1. Undergraduate Radiology Curriculum, The Royal College of Ra, April 2012. Ref No. BFCR(12)4 The Royal College of Radiologists, April 2012 2. I Satia, S Bashagha, A Bibi, R Ahmed, S Mellor, F Zaman. Assessing the accuracy and certainty in interpretating chest x-rays in the medical division. Clin Med August 2013 Vol.13 no. 4 349-352

Understanding Student and Staff Perceptions of Feedback in Architecture: Summary Report

This report presents the results of a collaborative project between Queens University, Belfast and the Robert Gordon University, Aberdeen, and builds on a dialogue initiated during Session 2009-10 through which course guidance and feedback received by students was identified as an area requiring deeper understanding in order to enhance current practice