Developing Frameworks for School Self-Evaluation to Improve School Effectiveness for Peace in Northern Ireland

This article contributes towards redefining school improvement more broadly than conventional outcomes sometimes imply, and describes original and practical applications of school self-evaluation models. The significance of the work has been acknowledged by reviewers in the school improvement and peacebuilding and development fields. As a result of the research reported here, Smith was invited to support the work of the Department for Education Northern Ireland Schools Community Relations Panel and the Community Relations officers representing the five Education and Library Boards. The latter used the self-evaluation framework as a model for developing a regional whole-school self-evaluation document. Smith was the lead author of the paper.

Organisational Self-Evaluation and Teacher Education for Community Relations in a Transforming Society?

During 2004, the School of Education at the University of Ulster embarked on an innovative three-year project designed to embed community relations objectives within initial teacher education. With the advent of more peaceful times in Northern Ireland, this was a precipitous time for initial teacher educators to review the preparation given to beginner teachers for teaching in an increasingly pluralist society emerging from conflict. The present paper reports on one very specific and time-limited element of the broader project. That is, development work designed to investigate the possibilities of using processes of self-review and evaluation as a lever for improvements in initial teacher education for community relations. Following a brief contextualisation, the background to, and the development of, a set of materials designed to support rigorous and systematic self-review of all aspects of provision in a university-based initial teacher education department is described. The Community Relations Index for Initial Teacher Education (Cr-ITE) was envisaged as being of use to initial teacher education establishments in order to help teacher educators take responsibility for rigorous learning from their practice, whilst placing inclusive values at the centre of organisational development. The final section includes further critical reflection on the role of organisational self-review in transforming teacher education for inclusion in a society emerging from longstanding communal conflict.

Is low self-esteem an inevitable consequence of stigma? An example from women with chronic mental health problems

It is often assumed that membership in a stigmatized group has negative consequences for the self-concept. However, this relationship is neither straightforward nor inevitable, and there is evidence suggesting that negative consequences may not necessarily occur (Psychol. Rev. 96(4) (1989) 608). This paper argues that the relationship has not been sufficiently theorized, and that a more detailed analysis is called for in order to understand the relationship between stigma and the self. The paper presents a critical examination of modified labeling theory (Am. Sociol. Rev. 52 (1987) 96), with examples from a study examining perceptions of stigma and their relationship to self-evaluation in women with chronic mental health problems. Open-ended interviews and qualitative analyses were used in preference to global measures of self-esteem. It was found that although the women were aware of society's unfavorable representations of mental illness, and the effects this had on their lives, they did not accept these representations as valid and therefore rejected them as applicable to the self. The participants did not deny their mental health problems, but their acceptance of labels was critical and pragmatic. Labels were rejected when they were perceived as carrying an unrealistic and negative stereotype, or when the women felt that their symptoms did not fit with the diagnostic criteria. The research illustrates the importance of considering people's subjective understandings of stigmatized conditions and societal reactions in order to understand the relation between stigma and the self. (C) 2002 Elsevier Science Ltd. All rights reserved.

How Good Am I? Crude Self-Assessment vs. Examination

With the new academic year structure encouraging more in-term assessment to replace end-of-year examinations one of the problems we face is assessing students and keeping track of individual student learning without overloading the students and staff with excessive assessment burdens.
In the School of Electronics, Electrical Engineering and Computer Science, we have constructed a system that allows students to self-assess their capability on a simple Yes/No/Don’t Know scale against fine grained learning outcomes for a module. As the term progresses students update their record as appropriately, including selecting a Learnt option to reflect improvements they have gained as part of their studies.
In the system each of the learning outcomes are linked to the relevant teaching session (lectures and labs) and to online resources that students can access at any time. Students can structure their own learning experience to their needs and preferences in order to attain the learning outcomes.
The system keeps a history of the student’s record, allowing the lecturer to observe how the students’ abilities progress over the term and to compare it to assessment results. The system also keeps of any of the resource links that student has clicked on and the related learning outcome.
The initial work is comparing the accuracy of the student self-assessments with their performance in the related questions in the traditional end-of-year examination.

The Design Process- Making It Relevant For Students

Within the ever-changing arenas of architectural design and education, the core element of architectural education remains: that of the design process. The consideration of how to design in addition to what to design presents architectural educators with that most constant and demanding challenge of how do we best teach the design process?

This challenge is arguably most acute at a student's early stages of their architectural education. In their first years in architecture, students will commonly concentrate on the end product rather than the process. This is, in many ways, understandable. A great deal of time, money and effort go into their final presentations. They believe that it is what is on the wall that is going to be assessed. Armed with new computer skills, they want to produce eye-catching graphics that are often no more than a celebration of a CAD package. In an era of increasing speed, immediacy of information and powerful advertising it is unsurprising that students want to race quickly to presenting an end-product.

Recognising that trend, new teaching methods and models were introduced into the second year undergraduate studio over the past two years at Queen's University Belfast, aimed at promoting student self-reflection and making the design process more relevant to the students. This paper will first generate a critical discussion on the difficulties associated with the design process before outlining some of the methods employed to help promote the following; an understanding of concept, personalisation of the design process for the individual student; adding realism and value to the design process and finally, getting he students to play to their strengths in illustrating their design process like an element of product. Frameworks, examples, outcomes and student feedback will all be presented to help illustrate the effectiveness of the new strategies employed in making the design process firstly, more relevant and therefore secondly, of greater value, to the architecture student.

QA and Enhancement Marketplace for HEIs – An Erasmus+ project

Improving European education and training system quality has been set as a key target in Europe’s strategy to become a smart, sustainable and inclusive economy by 2020 (European Commission, 2010). These objectives are more specifically defined in the so called Modernisation Agenda (European Commission, 2011). More specifically it sets a goal to improve the quality and relevance of higher education. In this process external evaluation and
Proceedings of the 11th International CDIO Conference, Chengdu University of Information Technology,
Chengdu, Sichuan, P.R. China, June 8-11, 2015.
self-assessment are seen in a key role! In the CDIO approach the 12 CDIO standards provide a framework for continuous improvement. Each institution/institutional department are encouraged to regularly do the self-evaluation using the CDIO Standards. Eight European universities identified a need for further enhancement of the self-evaluations and creation of processes with peers to reduce the inertia of heavy accreditations/evaluations in HEIs. In September 2014 these universities started an Erasmus+ project (QAEMarketPlace4HEI) aiming at
1. Developing a collaborative, comprehensive and accessible evaluation process model, methods and tools for HEIs to complement the accreditation systems.
2. Promoting, increasing and exploiting further the European collaboration in the evaluation processes and the exchange of best practices.
3. Disseminating the model, best practices and widen the cooperation to new HEIs in Europe through the partner networks.

A Preliminary Case Study for Collaborative Quality Enhancement

Eight universities have collaborated in an Erasmus+ funded project to create a lean process to enhance self-evaluation and accreditation through peer alliance and cooperation. Central to this process is the partnering of two institutions as critical friends, based on prior selfevaluations of specific programmes to identify particular criteria for improvement. A pairing algorithm matches two institutions based on their respective self-evaluation scores. It ensures there are significant differences in key criteria that are mutually beneficial for future programme development and enhancement. The ensuing meetings between critical friends have been designated as ‘cross-sparring’. This paper focuses on a case-study of the crosssparring and resulting enhancement outcomes between Umeå University and Queen’s University Belfast, and their respective Masters programmes in Software Engineering and Mechanical Engineering. The collaborative experiences of the process are evaluated, reported, discussed and conclusions provided on the efficacy of this particular application of cross-sparring.

An evaluation of the Socrative (personal response system) app for increasing student engagement and learning in an undergraduate psychology curriculum.

Personal response systems using hardware such as 'clickers' have been around for some time, however their use is often restricted to multiple choice questions (MCQs) and they are therefore used as a summative assessment tool for the individual student. More recent innovations such as 'Socrative' have removed the need for specialist hardware, instead utilising web-based technology and devices common to students, such as smartphones, tablets and laptops. While improving the potential for use in larger classrooms, this also creates the opportunity to pose more engaging open-response questions to students who can 'text in' their thoughts on questions posed in class. This poster will present two applications of the Socrative system in an undergraduate psychology curriculum which aimed to encourage interactive engagement with course content using real-time student responses and lecturer feedback. Data is currently being collected and result will be presented at the conference.
The first application used Socrative to pose MCQs at the end of two modules (a level one Statistics module and level two Individual Differences Psychology module, class size N≈100), with the intention of helping students assess their knowledge of the course. They were asked to rate their self-perceived knowledge of the course on a five-point Likert scale before and after completing the MCQs, as well as their views on the value of the revision session and any issues that had with using the app. The online MCQs remained open between the lecture and the exam, allowing students to revisit the questions at any time during their revision.
This poster will present data regarding the usefulness of the revision MCQs, the metacognitive effect of the MCQs on student's judgements of learning (pre vs post MCQ testing), as well as student engagement with the MCQs between the revision session and the examination. Student opinions on the use of the Socrative system in class will also be discussed.
The second application used Socrative to facilitate a flipped classroom lecture on a level two 'Conceptual Issues in Psychology' module, class size N≈100). The content of this module requires students to think critically about historical and contemporary conceptual issues in psychology and the philosophy of science. Students traditionally struggle with this module due to the emphasis on critical thinking skills, rather than simply the retention of concrete knowledge. To prepare students for the written examination, a flipped classroom lecture was held at the end of the semester. Students were asked to revise their knowledge of a particular area of Psychology by assigned reading, and were told that the flipped lecture would involve them thinking critically about the conceptual issues found in this area. They were informed that questions would be posed by the lecturer in class, and that they would be asked to post their thoughts using the Socrative app for a class discussion. The level of preparation students engaged in for the flipped lecture was measured, as well as qualitative opinions on the usefulness of the session. This poster will discuss the level of student engagement with the flipped lecture, both in terms of preparation for the lecture, and engagement with questions posed during the lecture, as well as the lecturer's experience in facilitating the flipped classroom using the Socrative platform.