Designing for learner engagement with computer-based testing

The issues influencing student engagement with high-stakes computer-based exams were investigated, drawing on feedback from two cohorts of international MA Education students encountering this assessment method for the first time. Qualitative data from surveys and focus groups on the students’ examination experience were analysed, leading to the identification of engagement issues in the delivery of high-stakes computer-based assessments.The exam combined short-answer open-response questions with multiple-choice-style items to assess knowledge and understanding of research methods. The findings suggest that engagement with computer-based testing depends, to a lesser extent, on students’ general levels of digital literacy and, to a greater extent, on their information technology (IT) proficiency for assessment and their ability to adapt their test-taking strategies, including organisational and cognitive strategies, to the online assessment environment. The socialisation and preparation of students for computer-based testing therefore emerge as key responsibilities for instructors to address, with students requesting increased opportunities for practice and training to develop the IT skills and test-taking strategies necessary to succeed in computer-based examinations. These findings and their implications in terms of instructional responsibilities form the basis of a proposal for a framework for Learner Engagement with e-Assessment Practices.

Participant association and emergent curriculum in a MOOC: can the community be the curriculum?

We investigated how participants associated with each other and developed community in a Massive Open Online Course (MOOC) about Rhizomatic Learning (Rhizo14). We compared learner experiences in two social networking sites (SNSs), Facebook and Twitter. Our combination of thematic analysis of qualitative survey data with analysis of participant observation, activity data, archives and visualisation of SNS data enabled us to reach a deeper understanding of participant perspectives and explore SNS use. Community was present in the course title and understood differently by participants. In the absence of explanation or discussion about community early in the MOOC, a controversy between participants about course expectations emerged that created oppositional discourse. Fall off in activity in MOOCs is common and was evident in Rhizo14. As the course progressed, fewer participants were active in Facebook and some participants reported feelings of exclusion. Despite this, activity in Facebook increased overall. The top 10 most active participants were responsible for 47% of total activity. In the Rhizo14 MOOC, both community and curriculum were expected to emerge within the course. We suggest that there are tensions and even contradictions between ‘Community Is the Curriculum’ and Deleuze and Guattari's principles of the rhizome, mainly focussed on an absence of heterogeneity. These tensions may be exacerbated by SNSs that use algorithmic streams. We propose the use of networking approaches that enable negotiation and exchange to encourage heterogeneity rather than emergent definition of community.