Assessing self- and peer-assessment: The students' views

Self- and peer-assessment are being used increasingly in higher education, to help assign grades to students' work and to help students to learn more effectively. However, in spite of this trend there is little in the published literature on how students view these methods. In this paper we present an analysis of the views of a large number of students (N = 233) who had just experienced self- and peer-feedback as part of one of their subjects. It is a rarely questioned commonplace in the literature that in order to gain benefit from peer and self-assessment schemes students first need training in the specific scheme being used; ideally they will play a role in devising the scheme. The intervention reported here, which involved a large (N = 233) group of students, included no such measures. The results show that students felt, nonetheless, that they benefited from the intervention. The results also present prima facie evidence that training or other measures to further involve the students in the peer and self-assessment scheme might be beneficial. Our analysis of students' views revealed eight general dimensions under which are grouped twenty higher order themes. The results both support and extend previous research and give a more detailed picture than previously available. The general dimensions found were: Difficult; Gained Better Understanding of Marking; Discomfort; Productive (including learning benefits and improved work); Problems with Implementation; Read Others' Work; Develop Empathy (with assessing staff); and, Motivation (especially motivation to impress peers). The practical implications of these findings are discussed.

Peer Assessment and Self-assessment: Effective Learning Tools in Higher Education.

When used appropriately, self- and peer-assessment are very effective learning tools. In the present work, instructor formative assessment and feedback, self-assessment (SA), and peer-assessment (PA) have been compared. During the first part of a semester, the students followed a continuous formative assessment. Subsequently, they were divided into two subgroups based on similar performances. One subgroup performed SAs, and the other followedPAduring the last part of the course. The performances of the two groups in solving problems were compared. Results suggest that PA is a more effective learning tool than SA, and both are more effective than instructor formative assessment. However, a survey that was conducted at the end of the experiment showed higher student confidence in instructor assessment than in PA. The students recognized the usefulness of acting as peer assessors, but believed that SA helped them more than PA.

Using multimedia and peer assessment to promote collaborative e-learning

Collaborative e-learning is increasingly appealing as a pedagogical approach that can positively affect student learning. We propose a didactical model that integrates multimedia with collaborative tools and peer assessment to foster collaborative e-learning. In this paper, we explain it and present the results of its application to the “International Seminars on Materials Science” online course. The proposed didactical model consists of five educational activities. In the first three, students review the multimedia resources proposed by the teacher in collaboration with their classmates. Then, in the last two activities, they create their own multimedia resources and assess those created by their classmates. These activities foster communication and collaboration among students and their ability to use and create multimedia resources. Our purpose is to encourage the creativity, motivation, and dynamism of the learning process for both teachers and students.

Emotional Intelligence, emotional Self-Awareness, and Team Effectiveness

An issue at the forefront of recent emotional intelligence debates revolves around whether emotional intelligence can be linked to work performance. Although many authors continue to develop new and improved measures of emotional intelligence (e.g. Mayer, Caruso, & Salovey, 2001) to give us a better understanding of emotional intelligence, the links to performance in work settings, especially in the context of group effectiveness, have received much less attention. In this chapter, we present the results of a study in which we examined the role of emotional self-awareness and emotional intelligence as a predictor of group effectiveness. The study also addresses the utility of self- and peer assessment in measureing emotional self-awareness and emotional intelligence.

Assessment and Feedback for the CIP: educational issues

This 11-minute video focuses on how self and peer assessment could be used as an integral part of CIP modules, and discusses some innovative methods for assessing written work. The first link is to the native Panopto podcast, which requires the Silverlight player to be installed. The second link is the MP4 video version of the podcast, which should play on all PCs, Macs and suitable mobile devices. This share also includes links to the papers discussed in the video - these are also provided at the end of the script.

Capitalism in the classroom : the impact of self-enhancement values and normative assessment on student motivation, goals and attitudes towards cheating

Abstract The neo-liberal capitalist ideology has come under heavy fire with anecdotal evidence indicating a link between these same values and unethical behavior. Academic institutions reflect social values and act as socializing agents for the young. Can this explain the high and increasing rates of cheating that currently prevail in education? Our first chapter examines the question of whether self-enhancement values of power and açhievement, the individual level equivalent of neo-liberal capitalist values, predict positive attitudes towards cheating. Furthermore, we explore the mediating role of motivational factors. Results of four studies reveal that self-enhancement value endorsement predicts the adoption of performance-approach goals, a relationship mediated by introjected regulation, namely desire for social approval and that self-enhancement value endorsement also predicts the condoning of cheating, a relationship mediated by performance-approach goal adoption. However, self-transcendence values prescribed by a normatively salient source have the potential to reduce the link between self-enhancement value endorsément and attitudes towards cheating. Normative assessment constitutes a key tool used by academic institutions to socialize young people to accept the competitive, meritocratic nature of a sociéty driven by a neo-liberal capitalist ideology. As such, the manifest function of grades is to motivate students to work hard and to buy into the competing ethos. Does normative assessment fulfill these functions? Our second chapter explores the reward-intrinsic motivation question in the context of grading, arguably a high-stakes reward. In two experiments, the relative capacity of graded high performance as compared to the task autonomy experienced in an ungraded task to predict post-task intrinsic motivation is assessed. Results show that whilst the graded task performance predicts post-task appreciation, it fails to predict ongoing motivation. However, perceived autonomy experienced in non-graded condition, predicts both post-task appreciation and ongoing motivation. Our third chapter asks whether normative assessment inspires the spirit of competition in students. Results of three experimental studies reveal that expectation of a grade for a task, compared to no grade, induces greater adoption of performance-avoidance, but not performance-approach, goals. Experiment 3 provides an explanatory mechanism for this, showing that reduced autonomous motivation experienced in previous graded tasks mediates the relationship between grading and adoption of performance avoidance goals in a subsequent task. The above results, when combined, provide evidence as to the deleterious effects of self enhancement values and the associated practice of normative assessment in school on student motivation, goals and ethics. We conclude by using value and motivation theory to explore solutions to this problem.

Identifying the unmet health needs of patients with congenital hypogonadotropic hypogonadism using a web-based needs assessment: implications for online interventions and peer-to-peer support.

BACKGROUND: Patients with rare diseases such as congenital hypogonadotropic hypogonadism (CHH) are dispersed, often challenged to find specialized care and face other health disparities. The internet has the potential to reach a wide audience of rare disease patients and can help connect patients and specialists. Therefore, this study aimed to: (i) determine if web-based platforms could be effectively used to conduct an online needs assessment of dispersed CHH patients; (ii) identify the unmet health and informational needs of CHH patients and (iii) assess patient acceptability regarding patient-centered, web-based interventions to bridge shortfalls in care. METHODS: A sequential mixed-methods design was used: first, an online survey was conducted to evaluate health promoting behavior and identify unmet health and informational needs of CHH men. Subsequently, patient focus groups were held to explore specific patient-identified targets for care and to examine the acceptability of possible online interventions. Descriptive statistics and thematic qualitative analyses were used. RESULTS: 105 male participants completed the online survey (mean age 37 ± 11, range 19-66 years) representing a spectrum of patients across a broad socioeconomic range and all but one subject had adequate healthcare literacy. The survey revealed periods of non-adherence to treatment (34/93, 37%) and gaps in healthcare (36/87, 41%) exceeding one year. Patient focus groups identified lasting psychological effects related to feelings of isolation, shame and body-image concerns. Survey respondents were active internet users, nearly all had sought CHH information online (101/105, 96%), and they rated the internet, healthcare providers, and online community as equally important CHH information sources. Focus group participants were overwhelmingly positive regarding online interventions/support with links to reach expert healthcare providers and for peer-to-peer support. CONCLUSION: The web-based needs assessment was an effective way to reach dispersed CHH patients. These individuals often have long gaps in care and struggle with the psychosocial sequelae of CHH. They are highly motivated internet users seeking information and tapping into online communities and are receptive to novel web-based interventions addressing their unmet needs.

Faculty Instructional Quality Assessment Practices Incorporating Teaching Portfolios and Peer Review with Student Course Evaluations

Program directors and department chairs require different means of assessing faculty quality due to the unreliability of student course evaluation data. This report outlines alternative strategies for review committees to assess faculty instructional quality. This report also details incorporation of annual performance reviews for tenure-track faculty into tenure decisions.

Depressive symptoms from kindergarten to early school age: longitudinal associations with social skills deficits and peer victimization

BACKGROUND: Depressive symptoms in children are associated with social skills deficits and problems with peers. We propose a model which suggests different mechanisms for the impact of deficits in self-oriented social skills (assertiveness and social participation) and other-oriented social skills (pro-social, cooperative and non-aggressive behaviors) on children's depressive symptoms. We hypothesized that deficits in self-oriented social skills have a direct impact on children's depressive symptoms because these children have non-rewarding interactions with peers, whereas the impact of deficits in other-oriented social skills on depressive symptoms is mediated through negative reactions from peers such as peer victimization. METHOD: 378 kindergarten children (163 girls) participated at two assessments (Age at T1: M = 5.8, T2: M = 7.4). Teachers completed questionnaires on children's social skills at T1. Teacher reports on peer victimization and depressive symptoms were assessed at both assessment points. RESULTS: Our study partially confirmed the suggested conceptual model. Deficits in self-oriented social skills significantly predicted depressive symptoms, whereas deficits in other-oriented social skills were more strongly associated with peer victimization. Longitudinal associations between other-oriented social skills and depressive symptoms were mediated through peer victimization. CONCLUSION: The study emphasizes the role of deficits in self-oriented social skills and peer victimization for the development of internalizing disorders.

The Spanish version of the Prenatal Breast-feeding Self-efficacy Scale: Reliability and validity assessment

Background: Only a minority of infants are exclusively breastfed for the recommended 6 months postpartum. Breast-feeding self-efficacy is a mother's confidence in her ability to breastfeed and is predictive of breastfeeding behaviors. The Prenatal Breast-feeding Self-efficacy Scale (PBSES) was developed among English-speaking mothers to measure breastfeeding self-efficacy before delivery. Objectives: To translate the PBSES into Spanish and assess its psychometric properties. Design: Reliability and validity assessment. Setting: A public hospital in Yecla, Spain. Participants: A convenience sample of 234 pregnant women in their third trimester of pregnancy. Methods: The PBSES was translated into Spanish using forward and back translation. A battery of self-administered questionnaires was completed by participants, including a questionnaire on sociodemographic variables, breastfeeding experience and intention, as well as the Spanish version of the PBSES. Also, data on exclusive breastfeeding at discharge were collected from hospital database. Dimensional structure, internal consistency and construct validity of the Spanish version of PBSES were assessed. Results: Confirmatory factor analysis suggested the presence of one construct, self-efficacy, with four dimensions or latent variables. Cronbach's alpha coefficient for internal consistency was 0.91. Response patterns based on decision to breastfeed during pregnancy provided evidence of construct validity. In addition, the scores of the Spanish version of the PBSES significantly predicted exclusive breastfeeding at discharge. Conclusions: The Spanish version of PBSES shows evidences of reliability, and contrasting group and predictive validity. Confirmatory factor analysis indicated marginal fit and further studies are needed to provide new evidence on the structure of the scale. The Spanish version of the PBSES can be considered a reliable measure and shows validity evidences.

The Effects of Systematic Self-Monitoring, Feedback, and Collaborative Assessment on Stress Reduction

Thesis (Ph.D.)--University of Washington, 2016-08

Using online peer assessment tools to provide feedback and promote learning

A set of slides used for the RAP SIG event on 19 Jan 2017

Are a health advocacy diary and health assessment welcomed by those who use them?

Aim: To determine acceptability of a health advocacy intervention, the Ask Diary and the comprehensive health assessment program (CHAP). Method: We performed a two by two designed randomised controlled trial of the Ask Diary and the CHAP tool in  adults with intellectual disability. Results of interviews of self-advocates and caregiver advocates, both families and paid carers, will be presented. Results: The interviews found strong support for the Ask Diary and the CHAP tool among selfadvocates and family caregivers. There was clear indication that the Ask Diary improved advocacy, aided in the organisation of health matters and was easy to use. It was reported that the health assessment resulted in benefits for the person’s health and high acceptability by carers. There was less support for the interventions where the person was supported through government services. Conclusions: Self-advocates and family caregivers welcome and use a personalised health advocacy diary and also a health assessment. However paid carers used the diary less but were supportive of the health assessment.