An experiment in group learning technology: evaluating critical thinking in face-to-face and computer-supported seminars

Can learning quality be maintained in the face of increasing class size by the use of Computer Supported Co-operative Learning (CSCL) technologies? In particular, can Computer-Mediated Communication promote critical thinking in addition to surface information transfer? We compared face-to-face seminars with asynchronous computer conferencing in the same Information Management class. From Garrison's theory of critical thinking and Henri's critical reasoning skills, we developed two ways of evaluating critical thinking: a student questionnaire and a content analysis technique. We found evidence for critical thinking in both situations, with some subtle differences in learning style. This paper provides an overview of this work.

A content analysis method to measure critical thinking in face-to-face and computer supported group learning

This paper gives a detailed account of the content analysis method developed at Queen's University Belfast to measure critical thinking during group learning, as used in our controlled comparisons between learning in face-to-face and computer conference seminars. From Garrison's 5 stages of critical thinking, and Henri's cognitive skills needed in CMC, we have developed two research instruments: a student questionnaire and this content analysis method. The content analysis relies on identifying, within transcripts, examples of indicators of obviously critical and obviously uncritical thinking, from which several critical thinking ratios can be calculated.

An evaluation of the Socrative (personal response system) app for increasing student engagement and learning in an undergraduate psychology curriculum.

Personal response systems using hardware such as 'clickers' have been around for some time, however their use is often restricted to multiple choice questions (MCQs) and they are therefore used as a summative assessment tool for the individual student. More recent innovations such as 'Socrative' have removed the need for specialist hardware, instead utilising web-based technology and devices common to students, such as smartphones, tablets and laptops. While improving the potential for use in larger classrooms, this also creates the opportunity to pose more engaging open-response questions to students who can 'text in' their thoughts on questions posed in class. This poster will present two applications of the Socrative system in an undergraduate psychology curriculum which aimed to encourage interactive engagement with course content using real-time student responses and lecturer feedback. Data is currently being collected and result will be presented at the conference.
The first application used Socrative to pose MCQs at the end of two modules (a level one Statistics module and level two Individual Differences Psychology module, class size N≈100), with the intention of helping students assess their knowledge of the course. They were asked to rate their self-perceived knowledge of the course on a five-point Likert scale before and after completing the MCQs, as well as their views on the value of the revision session and any issues that had with using the app. The online MCQs remained open between the lecture and the exam, allowing students to revisit the questions at any time during their revision.
This poster will present data regarding the usefulness of the revision MCQs, the metacognitive effect of the MCQs on student's judgements of learning (pre vs post MCQ testing), as well as student engagement with the MCQs between the revision session and the examination. Student opinions on the use of the Socrative system in class will also be discussed.
The second application used Socrative to facilitate a flipped classroom lecture on a level two 'Conceptual Issues in Psychology' module, class size N≈100). The content of this module requires students to think critically about historical and contemporary conceptual issues in psychology and the philosophy of science. Students traditionally struggle with this module due to the emphasis on critical thinking skills, rather than simply the retention of concrete knowledge. To prepare students for the written examination, a flipped classroom lecture was held at the end of the semester. Students were asked to revise their knowledge of a particular area of Psychology by assigned reading, and were told that the flipped lecture would involve them thinking critically about the conceptual issues found in this area. They were informed that questions would be posed by the lecturer in class, and that they would be asked to post their thoughts using the Socrative app for a class discussion. The level of preparation students engaged in for the flipped lecture was measured, as well as qualitative opinions on the usefulness of the session. This poster will discuss the level of student engagement with the flipped lecture, both in terms of preparation for the lecture, and engagement with questions posed during the lecture, as well as the lecturer's experience in facilitating the flipped classroom using the Socrative platform.

Design-Build Experiences and Student Safety

Design-build experiences (DBEs) are an essential element of any programme based on the CDIO methodology. They enable students to develop practical hands-on skills, they enable the learning of theory by stealth and they provide a forum for developing professional skills such as team working and project management. The hands-on aspect of certain DBEs has significant risk associated with it, which must be addressed through the formal evaluation of risks and the development of a methodology for controlling them. This paper considers the aspects of design-build experiences that may impact on student safety. In particular, it examines the risk associated with each of the four stages of CDIO and gives examples of risks which may commonly apply across engineering disciplines. A system for assessing and controlling the risks in any particular DBE is presented and the paper finishes by discussing the significance of health and safety in the educational environment.

Evaluating the quality of learning in Computer Supported Co-operative Learning

Can learning quality be maintained in the face of increasing class size by the use of Computer Supported Co-operative Learning (CSCL) technologies? In particular, can Computer-Mediated Communication promote critical thinking in addition to surface information transfer? We compared face-to-face seminars with asynchronous computer conferencing in the same Information Management class. From Garrison's theory of critical thinking and Henri's critical reasoning skills, we developed two ways of evaluating critical thinking: a student questionnaire and a content analysis technique. We found evidence for critical thinking in both situations, with some subtle differences in learning style. This paper provides an overview of this work.

Caged birds and cloning machines: how student imagery 'speaks' to us about cultures of schooling and student participation

With the advent of the United Nations Convention on the Rights of the Child (CRC), there is an increasing requirement that schools ensure children and young people's views are voiced, listened to and taken seriously on matters of significance. Encouraging these shifts by law is one thing; changing the culture in schools is another. For a significant proportion of schools, actively engaging students' voices on how they experience education poses a significant challenge and crucial gaps may exist between the rhetoric espoused and a school's readiness for genuine student involvement. This ethnographic study illuminates tensions that persist between headteachers' espoused views of how students are valued and students' creative images of their actual post-primary schooling experience. If cultures of schooling are to nurture the true spirit of democratic pupil participation implied by changes in the law, there is a need to develop genuine processes of student engagement in which students and staff can collaborate towards greater shared understandings of a school's priorities.