How Video Lecture Capture affects Student Engagement in a University Computer Programming Course: Attendance, Video Viewing Behaviours and Student Attitudes

Introduction
The use of video capture of lectures in Higher Education is not a recent occurrence with web based learning technologies including digital recording of live lectures becoming increasing commonly offered by universities throughout the world (Holliman and Scanlon, 2004). However in the past decade the increase in technical infrastructural provision including the availability of high speed broadband has increased the potential and use of videoed lecture capture. This had led to a variety of lecture capture formats including pod casting, live streaming or delayed broadcasting of whole or part of lectures.
Additionally in the past five years there has been a significant increase in the popularity of online learning, specifically via Massive Open Online Courses (MOOCs) (Vardi, 2014). One of the key aspects of MOOCs is the simulated recording of lecture like activities. There has been and continues to be much debate on the consequences of the popularity of MOOCs, especially in relation to its potential uses within established University programmes.
There have been a number of studies dedicated to the effects of videoing lectures.
The clustered areas of research in video lecture capture have the following main themes:
• Staff perceptions including attendance, performance of students and staff workload
• Reinforcement versus replacement of lectures
• Improved flexibility of learning
• Facilitating engaging and effective learning experiences
• Student usage, perception and satisfaction
• Facilitating students learning at their own pace
Most of the body of the research has concentrated on student and faculty perceptions, including academic achievement, student attendance and engagement (Johnston et al, 2012).
Generally the research has been positive in review of the benefits of lecture capture for both students and faculty. This perception coupled with technical infrastructure improvements and student demand may well mean that the use of video lecture capture will continue to increase in frequency in the next number of years in tertiary education. However there is a relatively limited amount of research in the effects of lecture capture specifically in the area of computer programming with Watkins 2007 being one of few studies . Video delivery of programming solutions is particularly useful for enabling a lecturer to illustrate the complex decision making processes and iterative nature of the actual code development process (Watkins et al 2007). As such research in this area would appear to be particularly appropriate to help inform debate and future decisions made by policy makers.
Research questions and objectives
The purpose of the research was to investigate how a series of lecture captures (in which the audio of lectures and video of on-screen projected content were recorded) impacted on the delivery and learning of a programme of study in an MSc Software Development course in Queen’s University, Belfast, Northern Ireland. The MSc is conversion programme, intended to take graduates from non-computing primary degrees and upskill them in this area. The research specifically targeted the Java programming module within the course. It also analyses and reports on the empirical data from attendances and various video viewing statistics. In addition, qualitative data was collected from staff and student feedback to help contextualise the quantitative results.
Methodology, Methods and Research Instruments Used
The study was conducted with a cohort of 85 post graduate students taking a compulsory module in Java programming in the first semester of a one year MSc in Software Development. A pre-course survey of students found that 58% preferred to have available videos of “key moments” of lectures rather than whole lectures. A large scale study carried out by Guo concluded that “shorter videos are much more engaging” (Guo 2013). Of concern was the potential for low audience retention for videos of whole lectures.
The lecturers recorded snippets of the lecture directly before or after the actual physical delivery of the lecture, in a quiet environment and then upload the video directly to a closed YouTube channel. These snippets generally concentrated on significant parts of the theory followed by theory related coding demonstration activities and were faithful in replication of the face to face lecture. Generally each lecture was supported by two to three videos of durations ranging from 20 – 30 minutes.
Attendance
The MSc programme has several attendance based modules of which Java Programming was one element. In order to assess the consequence on attendance for the Programming module a control was established. The control used was a Database module which is taken by the same students and runs in the same semester.
Access engagement
The videos were hosted on a closed YouTube channel made available only to the students in the class. The channel had enabled analytics which reported on the following areas for all and for each individual video; views (hits), audience retention, viewing devices / operating systems used and minutes watched.
Student attitudes
Three surveys were taken in regard to investigating student attitudes towards the videoing of lectures. The first was before the start of the programming module, then at the mid-point and subsequently after the programme was complete.
The questions in the first survey were targeted at eliciting student attitudes towards lecture capture before they had experienced it in the programme. The midpoint survey gathered data in relation to how the students were individually using the system up to that point. This included feedback on how many videos an individual had watched, viewing duration, primary reasons for watching and the result on attendance, in addition to probing for comments or suggestions. The final survey on course completion contained questions similar to the midpoint survey but in summative view of the whole video programme.
Conclusions and Outcomes
The study confirmed findings of other such investigations illustrating that there is little or no effect on attendance at lectures. The use of the videos appears to help promote continual learning but they are particularly accessed by students at assessment periods. Students respond positively to the ability to access lectures digitally, as a means of reinforcing learning experiences rather than replacing them. Feedback from students was overwhelmingly positive indicating that the videos benefited their learning. Also there are significant benefits to part recording of lectures rather than recording whole lectures. The behaviour viewing trends analytics suggest that despite the increase in the popularity of online learning via MOOCs and the promotion of video learning on mobile devices in fact in this study the vast majority of students accessed the online videos at home on laptops or desktops However, in part, this is likely due to the nature of the taught subject, that being programming.
The research involved prerecording the lecture in smaller timed units and then uploading for distribution to counteract existing quality issues with recording entire live lectures. However the advancement and consequential improvement in quality of in situ lecture capture equipment may well help negate the need to record elsewhere. The research has also highlighted an area of potentially very significant use for performance analysis and improvement that could have major implications for the quality of teaching. A study of the analytics of the viewings of the videos could well provide a quick response formative feedback mechanism for the lecturer. If a videoed lecture either recorded live or later is a true reflection of the face to face lecture an analysis of the viewing patterns for the video may well reveal trends that correspond with the live delivery.

Use of eye care services among diabetic patients in urban and rural China.

OBJECTIVE: To assess the use of eye care and its predictors among diabetic patients in China. DESIGN: Cross-sectional, clinic-based study. PARTICIPANTS: Diabetic patients 18 years of age or older were recruited consecutively from an urban tertiary and community hospitals and from a rural clinic in Guangdong, China. METHODS: Information obtained by questionnaire and chart review included: demographic and socioeconomic status, knowledge about diabetic retinopathy (DR), and ocular and medical history. MAIN OUTCOME MEASURES: Self-reported or chart history of an eye examination ever or within the preceding 12 months. RESULTS: The participation rate among 889 eligible subjects was 92.7%. Among 824 participants (mean age, 62.6+/-12.9 years; 58.8% female), 550 (66.7%) had not been examined in the last year as recommended by the American Academy of Ophthalmology, and 356 (43.2%) had never been examined. For the rural hospital, these figures were 81.1% and 68.7%, respectively. In regression analyses, factors associated with having an eye examination in the last year were: attendance at urban hospitals (odds ratio [OR], 3.46 [P<0.001] and 1.76 [P = 0.021] for the tertiary and community hospitals, respectively, compared with the rural clinic), higher DR knowledge score (OR, 1.24; P = 0.001), greater concern about vision loss (OR, 1.22; P = 0.007), and recommendation of regular eye examinations by the provider (OR, 2.36; P = 0.011). Predictors of ever having an eye examination were similar. Monthly income and health insurance status were not predictive of being examined. CONCLUSIONS: These results suggest that the low proportion of diabetic receiving recommended annual eye examinations in China may be improved through patient and physician education. Copyright © 2010 American Academy of Ophthalmology. Published by Elsevier Inc. All rights reserved.

Wishful Thinking: Lessons from the internal and external evaluations of an innovatory education project in Northern Ireland

From March 1999 to August 2000, the authors were involved in simultaneous internal and external evaluations of the social civic and political education (SCaPE) project in Northern Ireland. This project was a major initiative established by the Citizenship Foundation, the Northern Ireland Council for the Curriculum, Examination and Assessment (CCEA), and the School of Education at the University of Ulster at Coleraine. It was a 2-year project in 25 secondary schools established to design, develop, pilot and evaluate a new programme of social, civic and political education for Northern Ireland. It also aimed to serve as a model for future Citizenship curriculum developments throughout Northern Ireland and elsewhere. This paper describes the background to the project, the design and conduct of the two evaluations, and the links between them. It outlines the main conclusions of each evaluation and describes the way SCaPE has since evolved into a mainstream curriculum development project. The final part of the paper analyses the key opportunities, tensions and challenges involved in running such evaluations at a critical time in the history of Northern Ireland – a time when innovation is both necessary and controversial. It argues that, especially in such circumstances, evaluation cannot be conducted from a neutral, objective standpoint, and that it is incumbent on evaluators to recognise the emotional, personal and political commitment they make to the projects in which they are engaged.

Improving E-Assessment Systems With A focus On Adaptive Feedback And Marking

Institutions involved in the provision of tertiary education across Europe are feeling the pinch. European universities, and other higher education (HE) institutions, must operate in a climate where the pressure of government spending cuts (Garben, 2012) is in stark juxtaposition to the EU’s strategy to drive forward and maintain a growth of student numbers in the sector (eurostat, 2015).

In order to remain competitive, universities and HE institutions are making ever-greater use of electronic assessment (E-Assessment) systems (Chatzigavriil et all, 2015; Ferrell, 2012). These systems are attractive primarily because they offer a cost-effect and scalable approach for assessment. In addition to scalability, they also offer reliability, consistency and impartiality; furthermore, from the perspective of a student they are most popular because they can offer instant feedback (Walet, 2012).

There are disadvantages, though.

First, feedback is often returned to a student immediately on competition of their assessment. While it is possible to disable the instant feedback option (this is often the case during an end of semester exam period when assessment scores must be can be ratified before release), however, this option tends to be a global ‘all on’ or ‘all off’ configuration option which is controlled centrally rather than configurable on a per-assessment basis.

If a formative in-term assessment is to be taken by multiple groups of
students, each at different times, this restriction means that answers to each question will be disclosed to the first group of students undertaking the assessment. As soon as the answers are released “into the wild” the academic integrity of the assessment is lost for subsequent student groups.

Second, the style of feedback provided to a student for each question is often limited to a simple ‘correct’ or ‘incorrect’ indicator. While this type of feedback has its place, it often does not provide a student with enough insight to improve their understanding of a topic that they did not answer correctly.

Most E-Assessment systems boast a wide range of question types including Multiple Choice, Multiple Response, Free Text Entry/Text Matching and Numerical questions. The design of these types of questions is often quite restrictive and formulaic, which has a knock-on effect on the quality of feedback that can be provided in each case.

Multiple Choice Questions (MCQs) are most prevalent as they are the most prescriptive and therefore most the straightforward to mark consistently. They are also the most amenable question types, which allow easy provision of meaningful, relevant feedback to each possible outcome chosen.
Text matching questions tend to be more problematic due to their free text entry nature. Common misspellings or case-sensitivity errors can often be accounted for by the software but they are by no means fool proof, as it is very difficult to predict in advance the range of possible variations on an answer that would be considered worthy of marks by a manual marker of a paper based equivalent of the same question.

Numerical questions are similarly restricted. An answer can be checked for accuracy or whether it is within a certain range of the correct answer, but unless it is a special purpose-built mathematical E-Assessment system the system is unlikely to have computational capability and so cannot, for example, account for “method marks” which are commonly awarded in paper-based marking.

From a pedagogical perspective, the importance of providing useful formative feedback to students at a point in their learning when they can benefit from the feedback and put it to use must not be understated (Grieve et all, 2015; Ferrell, 2012).

In this work, we propose a number of software-based solutions, which will overcome the limitations and inflexibilities of existing E-Assessment systems.

The Changing Context for Planning Education in the UK and the Prospects for Research-Led, Practice-Engaged Teaching

The UK’s Royal Town Planning Institute (RTPI) has celebrated its centenary in 2014, marking 100 years of close relationships between university-based planning schools and a professional body focused on planning practice. During this period, the context for university education and the very idea of planning have changed dramatically contributing to a continual renegotiation of the relationships between the planning profession and the educational institutions it accredits. These changes have been particularly pronounced in the last 10 years where a number of factors have forced a rapid change in the nature of planjavascript:void(0);ning education in the UK. This has included a boom and then slump in the number of planning students linked to the dynamics of national economic situation, a reorganization of many planning school curricula, and their merger with cognate disciplines such as geography and an increased focus on research output, rather than professional engagement as the key indicator of institutional success. This last factor adds a particularly new dimension to the profession-university relationship, which could potentially lead to either straining of tensions or a synergy through research-led teaching that could significantly benefit both. This chapter will briefly review the evolution of UK planning schools and of the main ideas informing planning education. It will then describe the current profile of UK planning schools, based on an extensive national survey conducted on behalf of the Royal Town Planning Institute. The paper will then critically review the main challenges and opportunities facing UK planning schools in the context of changes in both planning practice and higher education. It will then move on to the concept of research-led teaching, drawing on current practice in the UK and review how well this concept serves students and the idea of developing reflective planning practitioners. Finally, the paper will seek to draw broad lessons from the experience of the UK and reflect on the type of planning education that can best serve planning professions in a variety of international contexts in the future.