Peer Rating for Feedback in Group Projects

The National Student Survey (NSS) in the UK has since 2005 questioned final year
undergraduate students on a broad range of issues relating to their university experience.
Across disciplines and universities students have expressed least satisfaction in the areas of
assessment and feedback. In response to these results many educational practitioners have
reviewed and revised their procedures and the UK Higher Education Academy (HEA) has
produced guidelines of best practice to assist academics in improving these specific areas.
The Product Design and Development (PDD) degree at Queen’s University Belfast is
structured with an integrated curriculum with group Design Build Test (DBT) projects as the
core of each year of the undergraduate programme. Based on the CDIO syllabus and
standards the overall learning outcomes for the programme are defined and developed in a
staged manner, guided by Bloom’s taxonomy of learning domains.
Feedback in group DBT projects, especially in relation to the development of personal and
professional skills, represents a different challenge to that of individual assignment feedback.
A review of best practice was carried out to establish techniques which could be applied to
the particular context of the PDD degree without modification and also to identify areas
where a different approach would need to be applied.
A revised procedure was then developed which utilised the structure of the PDD degree to
provide a mechanism for enhanced feedback in group project work, while at the same time
increasing student development of self and peer evaluation skills. Key to this improvement
was the separation of peer ratings from assessment in the perception of the students and the
introduction of more frequent face to face feedback interviews.
This paper details the new procedures developed and additional issues which have been
raised and addressed, with reference to the published literature, during 3 years of operation.

Fairness in assessing group projects: a conceptual framework for higher education

Group projects form a large and possibly growing component of the work undertaken for assessing students in higher education, and especially in post-graduate work in business. Yet the assessments sources, methods and purposes result in an array of combinations that the literature fails to capture in its full complexity. Tutors may be able to assess the work of the group as well as they might the work of any individual. But grades - and degrees - are awarded to individuals. Writers on higher education speak of using self- and peer-assessment as a way of qualifying the evaluation of group work so as to differentiate between individuals. But these commonly used terms - drawn from approaches to assessing individual work - are ambiguous or even misleading in the context of group work. This paper proposes a framework for discussing the assessment of group projects in an effort to help identify how the benefits of group learning and be translated into fairer summative assessments.

The link between self-managed work teams and learning organisations using performance indicators

Both the learning organization literature and the self-managed work team literature have alluded to the potential links between teamwork and learning. However, as yet the link between these two concepts remains undeveloped. This study uses a survey of a random sample of 200 Australian organizations to empirically examine the relationships between self-managed work teams and the learning organization using performance indicators as a medium. It was found that the learning organization concept displays a moderate to strong link with three measures of performance used in this study: knowledge performance, financial performance and customer satisfaction. Although the self-managed work team concept did not display any significant relationship with performance, the qualitative component of the survey did emphasize that there is a common belief that self-managed teams can increase performance in the right setting. While an insignificant relationship between self-managed teams and the learning organization was also found, this study suggests some methodological concerns for future research into the relationship between self-managed teams and the learning organization.

Individual differences in cognitive style and their effects on task and social orientations of self-managed work teams

When assembling self-managing work teams, the personalities of team members are often overlooked. One personality variable known to be critical for effective decision making in teams is cognitive style. This study sought to examine how differences and similarities in analytic/intuitive cognitive styles affected the behavior of team members on the task/emotionally expressive dimension identified by Bales. As hypothesized, intuitive individuals and homogeneous intuitive teams were found to initiate more social-emotional acts. Contrary to expectations, intuitive rather than analytic individuals and homogeneous intuitive rather than analytic teams engaged in more task-oriented behaviors. Teams also tended to select intuitive individuals as leaders. The possibility that different combinations of styles may be important for overall team effectiveness was subsequently discussed, and it was suggested that this may depend on whether the nature of the work environment is relatively well structured and mechanistic or relatively unstructured and organic.

Challenges in improving chronic disease survivorship outcomes using tele-health and self-managed online solutions

The advances in modern information and communication (ICT) technology continue to address the challenges and improve` health outcomes for the survivors of chronic disease such as prostate cancer. The management of survivorship is increasingly becoming an important need for the survivors to manage their chronic conditions. The technology interventions such as tele-health as well as self-managed technology applications have shown a potential to improve survivorship outcomes. However, the application of these tools should be supported by strong health economics evidence. This work discusses the challenges of technology led survivorship care models and presents an integrated approach to address these challenges.

Peer Feedback for Group Projects - Kenji Takeda

This is one of a series of short case studies describing how academic tutors at the University of Southampton have made use of learning technologies to support their students.

Obsessive Compulsive Treatment Efficacy Trial (OCTET) comparing the clinical and cost effectiveness of self-managed therapies: study protocol for a randomised controlled trial

Background: UK National Institute of Health and Clinical Excellence guidelines for obsessive compulsive disorder (OCD) specify recommendations for the treatment and management of OCD using a stepped care approach. Steps three to six of this model recommend treatment options for people with OCD that range from low-intensity guided self-help (GSH) to more intensive psychological and pharmacological interventions. Cognitive behavioural therapy (CBT), including exposure and response prevention, is the recommended psychological treatment. However, whilst there is some preliminary evidence that self-managed therapy packages for OCD can be effective, a more robust evidence base of their clinical and cost effectiveness and acceptability is required. Methods/Design: Our proposed study will test two different self-help treatments for OCD: 1) computerised CBT (cCBT) using OCFighter, an internet-delivered OCD treatment package; and 2) GSH using a book. Both treatments will be accompanied by email or telephone support from a mental health professional. We will evaluate the effectiveness, cost and patient and health professional acceptability of the treatments. Discussion: This study will provide more robust evidence of efficacy, cost effectiveness and acceptability of self-help treatments for OCD. If cCBT and/or GSH prove effective, it will provide additional, more accessible treatment options for people with OCD.

A comparative study of effectiveness of peer assessment of individuals’ contributions to group projects in undergraduate construction management core units

In recent years, various forms of group work have been introduced in university courses across various subject domains, including construction management courses. Although the use of group work in higher education has sound pedagogical reasons and advantages, group work has its own drawbacks. Therefore, the acceptance by students and the success of group work critically depend on a fair and credible assessment of the group process. In this paper, the implementation of different approaches to peer assessment (PA) of individuals’ contributions to group projects in two core units in an undergraduate construction management course in an Australian university is reported. The effectiveness of the adopted PA approaches have been evaluated and validated by students. It has been found that contrary to doubts of the sufficiency of a simplistic approach to PAs, the fairness of a PA approach does not necessarily depend on its complexity. Besides, voluntary group discussions, learning and collaboration are found to aid in improving each of the group’s camaraderie. Hence, it is recommended that academics should develop both a structured methodology to progressively encourage group members to work cohesively in teams and effective PA approaches that measure individual member’s contribution.