Student response to a pub quiz style first year psychology assessment

The deterioration in staff-student ratios in UK higher education has had a disproportionate impact on assessment and feedback, meaning that contemporary students may have fewer assessments and much less feedback than a generation ago (Gibbs, 2006). Early use of a quiz assessment may offer a blend of social benefits (social comparison, shared problem solving leading to engagement, belonging and continuation), academic benefits (early formative assessment, immediate feedback) and administrative benefits (on-the-spot verbal marking and feedback to 230 students simultaneously). This study sought student views on the acceptability and contribution to learning of the quiz. Social benefits were apparent but difficulties in creating questions to elicit deeper reasoning and problem solving are discussed and the quiz had limited pedagogic value in the eyes of participants. The use of assertion-reason questions are considered as a way of taking the table quiz to a higher level and extending its pedagogic value.

Assessment in primary education in Ireland

This doctoral study examines assessment in primary education in the Republic of Ireland. The nature and purpose of assessment offer an insight into the values which are prioritised by an education system. In 2011, in the Republic of Ireland, the Department of Education and Skills (DES) published a strategy aiming to improve standards of literacy and numeracy. The document, entitled, Literacy and numeracy for learning and life: the national strategy to improve literacy and numeracy for children and young people 2011-2020, contains improvement targets as measured by standardised tests. It also mandates the increased use of standardised tests in primary education, and directs that aggregated scores should be reported to both Boards of Management and the DES. The study is framed by the theoretical perspectives of Michel Foucault and Pierre Bourdieu. Both of these commentators examine social policy and practice in an effort to provide insight into the history and operation of social institutions. This study is especially influenced by Foucault’s archaeology and genealogy of knowledge, and his notion of governmentality. It is also particularly cognisant of Bourdieu’s thoughts on habitus, doxa and capital. The study contains reviews of literature in the areas of assessment, assessment policy, and assessment policy in Ireland. These reviews highlight current debate in each of these areas while also grounding this debate in an historical context. The dissertation contains four empirical sections. 1) It analyses policy documents prepared in the development of the published strategy as well as investigating the strategy itself. In so doing it is aware of the burgeoning influence of pan-national bodies on policy development. 2) A number of high profile policy makers were interviewed as part of the study and their views are interpreted in light of the findings of the literature reviews. 3) The perspective of teachers was sought through a questionnaire survey. This gathered data on these teachers’ views on the purpose of assessment as well as their actual practice. 4) Finally, children were also included as participants in this study. They were interviewed in focus groups and encouraged to contribute drawings as well on their views of assessment in primary school. Literacy and numeracy for learning and life is seen as a seminal document in Irish education. This study is significant in its analysis of original data from high profile policy makers, including two Ministers for Education and Skills. It is also significant in its inclusion of the perspectives of primary school pupils. Finally, the study considers the nature and role of assessment in a holistic manner by including the views of policy makers, teachers and pupils. The study notes that policy development in Ireland underwent a change in the preparation of Literacy and numeracy for learning and life and that international influences, while present, are also mediated to suit the local context. It also highlights a lack of clarity in the definition of assessment in primary education and argues that there is a lack of balance in the approaches that are prioritised. The study demonstrates that teachers are impacted by the strategy but that they also change it by focusing on their own concerns while using assessment tools. The children provide compelling evidence of the impact of assessment on the learner. The study shows how assessment tools (and school subjects) are valued with differing levels of importance by a variety of stakeholders.

A literature review to Examine the Validity and Reliability of group poster presentations as an assessment method of a module in an undergraduate nursing degree programme

The introduction of a poster presentation as a formative assessment method over a multiple choice examination after the first phase of a three phase “health and well-being” module in an undergraduate nursing degree programme was greeted with a storm of criticism from fellow lecturers stating that poster presentations are not valid or reliable and totally irrelevant to the assessment of learning in the module. This paper seeks to investigate these criticisms by investigating the literature regarding producing nurses fit for practice, nurse curriculum development and wider nurse education, the purpose of assessment, validity and reliability to critically evaluate the poster presentation as a legitimate assessment method for these aims.

Finding order in chaos : a problem based collaborative assignment for 1300 students across 19 disciplines

The use of collaborative assignments for assessment is a risky undertaking for students and course designers. Yet the benefits, in terms of core learning outcomes, competencies, collaborative sense making and student involvement, suggest that the effort is worthwhile. Formal descriptions and rules do little to ameliorate the perception of risk and increased anxiety by students. (Ryan, 2007). BEB100 Introducing Professional Learning is a faculty-wide foundation unit with over 1300 students from 19 disciplines across the Faculty of the Built Environment and Engineering (“BEE”) at the Queensland University of Technology (“QUT”), Brisbane, Australia. Finding order in chaos outlines the approach and justification, assessment criteria, learning resources, teamwork tools, tutorial management, communication strategies, 2007-09 Student Learning Experience Survey results, annual improvements, findings and outcomes.

Moderation as judgement practice: Reconciling system level accountability and local level practice

Internationally, recognition of the role of assessment to inform the learning process has received much attention in recent years. Assessment for learning, not just of learning is being supported by an increasing body of literature providing strategies that teachers and their students can incorporate to support the learning process (Assessment Reform Group, 2002; Broadfoot & Black, 2004; James, 2006). Concurrently there has been an increase internationally in systemic accountability requirements of schools in terms of student results. The convergence of these two movements has resulted in some education systems promoting standards-driven reform involving authentic assessment and a re-examination of the relationship between the teacher and the student in the learning process. In this context standards are intended to be used as the basis for judgements of student achievement; while the results from assessment tasks are meant to both inform the teaching/learning process, and to report and track student progress. In such system, the role and reliability of teacher judgement takes centre stage.

Developing authentic achievement for disengaged young people using an electronic portfolio system

Credentials are a salient form of cultural capital and if a student’s learning and productions are not assessed, they are invisible in current social systems of education and employment. In this field, invisible equals non-existent. This paper arises from the context of an alternative education institution where conventional educational assessment techniques currently fail to recognise the creativity and skills of a cohort of marginalised young people. In order to facilitate a new assessment model an electronic portfolio system (EPS) is being developed and trialled to capture evidence of students’ learning and their productions. In so doing a dynamic system of arranging, exhibiting, exploiting and disseminating assessment data in the form of coherent, meaningful and valuable reports will be maintained. The paper investigates the notion of assessing development of creative thinking and skills through the means of a computerised system that operates in an area described as the efield. A model of the efield is delineated and is explained as a zone existing within the internet where free users exploit the cloud and cultivate social and cultural capital. Drawing largely on sociocultural theory and Bourdieu’s concepts of field, habitus and capitals, the article positions the efield as a potentially productive instrument in assessment for learning practices. An important aspect of the dynamics of this instrument is the recognition of teachers as learners. This is seen as an integral factor in the sociocultural approach to assessment for learning practices that will be deployed with the EPS. What actually takes place is argued to be assessment for learning as a field of exchange. The model produced in this research is aimed at delivering visibility and recognition through an engaging instrument that will enhance the prospects of marginalised young people and shift the paradigm for assessment in a creative world.

Critique groups : a technique for the author’s toolbox?

With a lack of places to gain an education in the craft of romance writing, novelists have few places to turn to gain real feedback. This paper investigates an alternative to textbooks, conferences, and workshops through an examination of the role provided to the writer by critique groups. How these groups work, how they benefit an author, and the critique groups as a whole are discussed. This work studies the form of Peer Assessment and Learning (PAL) and compares the technique used by educational institutions all over the world with the practice of author groups critiquing their own work. The research shows how a critique group can assist a writer to learn, grow and develop, helping to enhance the writer’s skills through constructive feedback, which gives them confidence to sell their work.

Building bridges to participation : sociocultural case studies of AfL

Assessment for Learning(AfL) case studies in a North Queensland school highlight the significance of the teacher-student relationship in creating a supportive culture within which students can negotiate new learner identities. AfL practices are school based evaluative practices that occur within the regular flow of teaching and learning with the purpose of informing and improving student learning to enhance learner autonomy. The identity of an autonomous learner is socially negotiated through participation in the community of practice of the class. Underpinned by a sociocultural perspective this research shows how AfL is manifested in action in its complexity and how positive teacher-student interactions can build bridges for students to move towards full participation.

Engaging operations management students by designing the unit with industry focus

Operations management is an area concerned with the production of goods and services ensuring that business operations are efficient in utilizing resource and effective to meet customer requirements. It deals with the design and management of products, processes, services and supply chains and considers the acquisition, development, and effective and efficient utilization of resources. Unlike other engineering subjects, content of these units could be very wide and vast. It is therefore necessary to cover the content that is most related to the contemporary industries. It is also necessary to understand what engineering management skills are critical for engineers working in the contemporary organisations. Most of the operations management books contain traditional Operations Management techniques. For example ‘inventory management’ is an important topic in operations management. All OM books deal with effective method of inventory management. However, new trend in OM is Just in time (JIT) delivery or minimization of inventory. It is therefore important to decide whether to emphasise on keeping inventory (as suggested by most books) or minimization of inventory. Similarly, for OM decisions like forecasting, optimization and linear programming most organisations now a day’s use software. Now it is important for us to determine whether some of these software need to be introduced in tutorial/ lab classes. If so, what software? It is established in the Teaching and Learning literature that there must be a strong alignment between unit objectives, assessment and learning activities to engage students in learning. Literature also established that engaging students is vital for learning. However, engineering units (more specifically Operations management) is quite different from other majors. Only alignment between objectives, assessment and learning activities cannot guarantee student engagement. Unit content must be practical oriented and skills to be developed should be those demanded by the industry. Present active learning research, using a multi-method research approach, redesigned the operations management content based on latest developments in Engineering Management area and the necessity of Australian industries. The redesigned unit has significantly helped better student engagement and better learning. It was found that students are engaged in the learning if they find the contents are helpful in developing skills that are necessary in their practical life.

Evaluation of the year 1 literacy and numeracy checkpoints assessments trial - 2010

The draft Year 1 Literacy and Numeracy Checkpoints Assessments were in open and supported trial during Semester 2, 2010. The purpose of these trials was to evaluate the Year 1 Literacy and Numeracy Checkpoints Assessments (hereafter the Year 1 Checkpoints) that were designed in 2009 as a way to incorporate the use of the Year 1 Literacy and Numeracy Indicators as formative assessment in Year 1 in Queensland Schools. In these trials there were no mandated reporting requirements. The processes of assessment were related to future teaching decisions. As such the trials were trials of materials and the processes of using those materials to assess students, plan and teach in year 1 classrooms. In their current form the Year 1 Checkpoints provide assessment resources for teachers to use in February, June and October. They aim to support teachers in monitoring children's progress and making judgments about their achievement of the targeted P‐3 Literacy and Numeracy Indicators by the end of Year 1 (Queensland Studies Authority, 2010 p. 1). The Year 1 Checkpoints include support materials for teachers and administrators, an introductory statement on assessment, work samples, and a Data Analysis Assessment Record (DAAR) to record student performance. The Supported Trial participants were also supported with face‐to‐face and on‐line training sessions, involvement in a moderation process after the October Assessments, opportunities to participate in discussion forums as well as additional readings and materials. The assessment resources aim to use effective early years assessment practices in that the evidence is gathered from hands‐on teaching and learning experiences, rather than more formal assessment methods. They are based in a model of assessment for learning, and aim to support teachers in the “on‐going process of determining future learning directions” (Queensland Studies Authority, 2010 p. 1) for all students. Their aim is to focus teachers on interpreting and analysing evidence to make informed judgments about the achievement of all students, as a way to support subsequent planning for learning and teaching. The Evaluation of the Year 1 Literacy and Numeracy Checkpoints Assessments Supported Trial (hereafter the Evaluation) aimed to gather information about the appropriateness, effectiveness and utility of the Year 1 Checkpoints Assessments from early years’ teachers and leaders in up to one hundred Education Queensland schools who had volunteered to be part of the Supported Trial. These sample schools represent schools across a variety of Education Queensland regions and include schools with:  - A high Indigenous student population; - Urban, rural and remote school locations; - Single and multi‐age early phase classes; - A high proportion of students from low SES backgrounds. The purpose of the Evaluation was to: Evaluate the materials and report on the views of school‐based staff involved in the trial on the process, materials, and assessment practices utilised. The Evaluation has reviewed the materials, and used surveys, interviews, and observations of processes and procedures to collect relevant data to help present an informed opinion on the Year 1 Checkpoints as assessment for the early years of schooling. Student work samples and teacher planning and assessment documents were also collected. The evaluation has not evaluated the Year 1 Checkpoints in any other capacity than as a resource for Year 1 teachers and relevant support staff.

Assessing performance capability in the work place

As universities worldwide begin to appreciate the value of authentic learning experiences, so they struggle with methods of assessing the outcomes from such experiences. This chapter describes the application of an assessment matrix developed by Queensland University of Technology(QUT) in Australia, to the assessment requirements and practices relating to work integrated learning at the University of Surrey in the UK. Despite the very different institutional contexts and independent way in which the assessment regimes have developed, it was found that the values and outcomes being assessed and the methods used to assess them were similar. The most important feature of assessing work integrated learning experiences is fitness for purpose, hence the learning objectives and assessment of outcomes for a WIL experience must be explicitly aligned to this objective.As universities worldwide begin to appreciate the value of authentic learning experiences, so they struggle with methods of assessing the outcomes from such experiences. This chapter describes the application of an assessment matrix developed by Queensland University of Technology (QUT) in Australia, to the assessment requirements and practices relating to work integrated learning at the University of Surrey in the UK. Despite the very different institutional contexts and independent way in which the assessment regimes have developed, it was found that the values and outcomes being assessed and the methods used to assess them were similar. The most important feature of assessing work integrated learning experiences is fitness for purpose, hence the learning objectives and assessment of outcomes for a WIL experience must be explicitly aligned to this objective.

Capstones : transitions and professional identity

The literature identifies transition as a key objective for capstone experiences. Capstones should take account of the particular needs of final year students by assisting them to transition from their student to their professional identity. The authors are currently completing an Australian Learning and Teaching Council (ALTC) funded project, “Curriculum Renewal in Legal Education: articulating final year curriculum design principles and a final year program”, which seeks to achieve curriculum renewal for legal education in the Australian context through the articulation of a set of curriculum design principles for the final year and the design of a transferable model for an effective final year program. The project has investigated the contemporary role of capstones in assisting transition out by reviewing the relevant literature and considering feedback from a project reference group, a final year student focus group and a recent graduate’s focus group. Analysis of this extensive research- and evidence-base suggests that capstone experiences should support transition through: • Assisting students to develop a sense of professional identity; • Consolidating students’ lifelong learning skills; • Providing opportunities for consolidation of career development and planning processes; • Enabling students to enhance professional skills and competencies; and • Preparing students as ethical citizens and leaders. This paper will examine the role of capstones in assisting students to transition to their professional identity and will propose learning and teaching approaches and assessment of learning methods that support transition out.

Introductions to the profession : curricular approach

In 2008, extra-curricular career development programs developed for psychology undergraduates at the Queensland University of Technology were incorporated into the formal curriculum. While a whole of course approach has been adopted, this session will explore the impact of a new introductory unit, Psychology in Professional Contexts, which adopts a constructivist approach to student career exploration. First-year students are introduced to key theories, models, and processes of career development, and the diversity of contexts in which their psychological knowledge can be applied, while developing and highlighting the value of important generic abilities such as critical thinking, team communication, critical reflection, and information literacy. Materials are drawn from the media, guest speakers’ professional profiles, the students’ own experiences, and traditional and emerging areas of psychology. Assessment and learning activities involve case analysis, problem-based learning, and discussion-based classes. The content of these professional development classes is also aligned with that of the core discipline units studied concurrently, to encourage the transfer of career development skills and knowledge across the psychology curriculum. This presentation will focus on 4 years of curriculum development in Psychology in Professional Contexts, and discuss changes initiated in 2011 which incorporate interactive online environments and extend the role of problem-based learning.

Literacy in Early Childhood and Primary Education : Issues, Challenges and Solutions

Literacy in Early Childhood and Primary Education provides a comprehensive introduction to literacy teaching and learning. The book explores the continuum of literacy learning and children’s transitions from early childhood settings to junior primary classrooms, and then to senior primary and beyond. Reader-friendly and accessible, this book equips pre-service teachers with the theoretical underpinnings and practical strategies and skills needed to teach literacy. It places the ‘reading wars’ firmly in the past as it examines contemporary research and practices. The book covers important topics such as literacy acquisition, family literacies and multiliteracies, foundation skills for literacy learning, reading difficulties, assessment, and supporting diverse literacy learners in early childhood and primary classrooms. It also addresses some of the challenges that teachers may face in the classroom and provides solutions to these. Each chapter includes learning objectives, reflective questions and definitions to key terms to engage and assist readers. Further resources are also available at www.cambridge.edu.au/academic/literacy. Written by an expert author team and featuring real-world examples from literacy teachers and learners. Literacy in Early Childhood and Primary Education will help pre-service teachers feel confident teaching literacy to diverse age groups and abilities.

Action research and unit improvement in higher education : a case study approach

Student satisfaction data has been collected on a national basis in Australia since 1972. In recent years this data has been used by federal government agencies to allocate funding, and by students in selecting their universities of choice. The purpose of this paper is to present the findings of an action research project designed to identify and implement unit improvement initiatives over a three year period for an underperforming unit. This research utilises student survey data and teacher reflections to identify areas of unit improvement, with a view to aligning learning experiences, teaching and assessment to learning outcomes and improved student satisfaction. This research concludes that whilst a voluntary student survey system may be imperfect, it nevertheless provides important data that can be utilised to the benefit of the unit, learning outcomes and student satisfaction ratings, as well as wider course related outcomes. Extrapolation of these findings is recommended to other underperforming units.