Elements of Better Assessment for the Improvement of Learning

Building a community of shared practice at the classroom level calls for clarity about the important assessment capabilities and dispositions of teachers, especially when teachers are expected to take a direct focus on learning. In this chapter, we present new ways of thinking about teachers’ assessment literacies, offering a formulation of better assessment for the improvement of learning, including three elements, namely (i) assessment criteria and standards; (ii) the teacher’s professional judgment; and (iii) social moderation. The potential of the first element lies in teachers’ classroom practices that deliberately embed assessment criteria and standards in pedagogy in productive ways. The second element involves the engagement of teachers and students in judgment practice, that develops the understanding that judgment involves more than the application of explicit or stated criteria. More fundamental is the matter of how teachers bring to bear stated features of quality and other intellectual and experiential resources in arriving at judgment. That is to say, they range across and orient to explicit (stated), tacit (unstated) and meta-criteria in judgment making. These insights have direct relevance to teachers’ efforts to develop students’ own evaluative experience, especially as this involves students working with stated features of quality for self-assessment and peer-assessment purposes. Further, practices for social moderation are discussed, giving examples of good practice in moderation, how teachers experience moderation and the potential benefits of various types.

The association between adolescent self-reported physical activity and wellness : the missing piece for youth wellness programs

Purpose Potential positive associations between youth physical activity and wellness scores could emphasize the value of youth physical activity engagement and promotion interventions, beyond the many established physiological and psychological benefits of increased physical activity. The purpose of this study was to explore the associations between adolescents' self-reported physical activity and wellness. Methods This investigation included 493 adolescents (165 males and 328 females) aged between 12 and 15 years. The participants were recruited from six secondary schools of varying socioeconomic status within a metropolitan area. Students were administered the Five-Factor Wellness Inventory and the International Physical Activity Questionnaire for Adolescents to assess both wellness and physical activity, respectively. Results Data indicated that significant associations between physical activity and wellness existed. Self-reported physical activity was shown to be positively associated with four dimensions including friendship, gender identity, spirituality, and exercise—the higher order factor physical self and total wellness, and negatively associated with self-care, self-worth, love, and cultural identity. Conclusion This study suggests that relationships exist between self-reported physical activity and various elements of wellness. Future research should use controlled trials of physical activity and wellness to establish causal links among youth populations. Understanding the nature of these relationships, including causality, has implications for the justification of youth physical activity promotion interventions and the development of youth physical activity engagement programs.

The role of radiotherapy patients in provision of student interpersonal skills feedback

Background At Queensland University of Technology, student radiation therapists receive regular feedback from clinical staff relating to clinical interpersonal skills. Although this is of great value, there is anecdotal evidence that students communicate differently with patients when under observation. Purpose The aim of this pilot was to counter this perceived observer effect by allowing patients to provide students with additional feedback. Materials and methods Radiotherapy patients from two departments were provided with anonymous feedback forms relating to aspects of student interpersonal skills. Clinical assessors, mentors and students were also provided with feedback forms, including questions about the role of patient feedback. Patient perceptions of student performance were correlated with staff feedback and assessment scores. Results Results indicated that the feedback was valued by both students and patients. Students reported that the additional dimension focused them on communication, set goals for development and increased motivation. These changes derived from both feedback and study participation, suggesting that the questionnaires could be a useful teaching tool. Patients scored more generously than mentors, although there was agreement in relative grading. Conclusions The anonymous questionnaire is a convenient and valuable method of gathering patient feedback on students. Future iterations will determine the optimum timing for this method of feedback.

Psychological health of medical and dental students in Saudi Arabia : a longitudinal study

Introduction: Many studies have indicated the poor psychological health of medical and dental students. However, few studies have assessed the longitudinal trajectory of that psychological health at different times in an academic year. Aim: To evaluate the positive and negative aspects of psychological health among preclinical medical and dental students in Saudi Arabia prospectively. Methods: A total of 317 preclinical medical and dental students were recruited for a longitudinal study design from second and third-year students at Umm Al-Qura University in the 2012-2013 academic year. The students were assessed at the middle of the first term and followed up after 3-monthes at the beginning of the second term. Questionnaires included assessment of depression, anxiety, stress, self-efficacy, and satisfaction with life. Results: Depression, anxiety, stress, and satisfaction with life were improved significantly at the beginning of the second term, whereas self-efficacy did not change significantly. The medical, female, and third-year student subgroups had the most significant changes. Depression and stress were significantly changed at the beginning of the second term in most demographic subgroups. Conclusion: Preclinical medical and dental students have different psychological health levels at different times of the same academic year. It is recommended to consider time of data collection when analyzing the results of such studies.

How can partnerships between the universities and schools exploit new opportunities for pedagogies at the intersection of the arts/design and the sciences?

Driven by information accessibility-on-demand provided by the internet, education modes are changing from a teacher-led approach focused on content delivery and assessible outcomes, to a learner-based approach encouraging self-directed, peer-tutored, and cooperative learning. New pedagogies are required to extend learning beyond the classroom and traditional subject areas such as contemporary arts, in alignment with the cross disciplinary priorities of the Australian Curriculum and values of the International Baccalaureate Organisation. This research explores how partnerships with universities and cultural organisations are implicated in the generation of these new forms of pedagogy and contribute to the field of educational research within the context of Education Queensland’s Framework For Gifted Education. In particular, this paper explores a new pedagogical framework for highly capable year five to nine Queensland state school students at the intersection of arts, design and the sciences, which has arisen from an explicit secondary/ tertiary partnership between the Queensland University of Technology Creative Industries Faculty and Precincts and the Queensland Academies Young Scholars Program. The Young Scholars Program offers experiences in the International Baccalaureate and Australian Curriculum contexts to enhance outcomes via global understanding, unique industry partnerships and 21st century pedagogical innovation based not on 'content' but tacit/experiential learning concepts including immersive, creative, intellectual and social strategies. These strategies for highly capable students are centred around authentic opportunities, primary resources, transdisciplinary learning and relationships with likeminded peers including tertiary arts, design and STEM educators and students, professionals and researchers. The presentation details case studies which are hands-on real time workshops involving inquiry based challenges in the arts, design and sciences, mathematics, history, creative writing and other disciplines, with content drawn from collections from public institutions, academic research and tertiary pedagogy. Both programs implicate student collaboration and creative production as methodology/data capture for ongoing action research, in alignment with the Framework For Gifted Education’s emphasis on evidence-based practices. They also challenge gifted students “to continue their development through curricular activities that require depth of study, complexity of thinking, fast pace of learning, high-level skills development and/or creative and critical thinking (e.g. through independent investigations, tiered tasks, diverse real-world applications, mentors)”(Education Queensland, 2011:3). This presentation highlights the strengths of the ongoing collaboration between QUT Creative industries Faculty and Queensland Academies, which not only provides successful extra curricular activities for gifted students towards a place in the International Baccalaureate Program, but also provides mentoring opportunities for tertiary students in their field of endeavor to assist with their own learning, and unique research opportunities for the Faculty as it focuses on excellence in arts, design and creative education and research. Education Queensland.(2011). Framework For Gifted Education Revised Edition 2011 (accessed Nov 19 2011)

Teachers using annotations to engage students in assessment conversations : recontextualising knowledge

Assessment for Learning practices with students such as feedback, and self- and peer assessment are opportunities for teachers and students to develop a shared understanding of how to create quality learning performances. Quality is often represented through achievement standards. This paper explores how primary school teachers in Australia used the process of annotating work samples to develop shared understanding of achievement standards during their curriculum planning phase, and how this understanding informed their teaching so that their students also developed this understanding. Bernstein's concept of the pedagogic device is used to identify the ways teachers recontextualised their assessment knowledge into their pedagogic practices. Two researchers worked alongside seven primary school teachers in two schools over a year, gathering qualitative data through focus groups and interviews. Three general recontextualising approaches were identified in the case studies; recontextualising standards by reinterpreting the role of rubrics, recontextualising by replicating the annotation process with the students and recontextualising by reinterpreting practices with students. While each approach had strengths and limitations, all of the teachers concluded that annotating conversations in the planning phase enhanced their understanding, and informed their practices in helping students to understand expectations for quality.

Language and literacy in mathematics: stepping stones or stumbling blocks in accelerating junior-secondary students

The authors have collaborated in the development and initial evaluation of a curriculum for mathematics acceleration. This paper reports upon the difficulties encountered with documenting student understanding using pen-and-paper assessment tasks. This leads to a discussion of the impact of students’ language and literacy on mathematical performance and the consequences for motivation and engagement as a result of simplifying the language in the tests, and extending student work to algebraic representations. In turn, implications are drawn for revisions to assessment used within the project and the language and literacy focus included within student learning experiences.

Geography and international assessment: Opportunity or distraction

Assessments of students in primary and secondary education are debated among practitioners, policy-makers, and parents. In some countries, assessment scores serve a criterion for passage between levels of education, for example, from secondary school to post-secondary education. Those practices are often traditions and while they come under criticism, they are a long-accepted part of the educational practices within a country. In those countries, the students’ assessment and examination scores are posted in public places or published in local news media. In other countries, assessments are used for the periodic checks on individual student progress. The results of assessments may be used for rating schools, and in some cases, they are used for evaluating the performance of teachers. Assessments are used less often to analyze student performance and make judgments regarding the performance of the curriculum. Even less often, assessments serve to critically establish strategies for the improvement of student learning and educational practices. The ends on the continuum of the assessment debate often focus on the opportunities that assessments present to improve education on one end. The other end is that assessments serve as a major distraction from the important work of teachers by removing classroom room time from instruction. The debate on those issues continues.

A longitudinal study of employee adaptation to organizational change: The role of change-related information and change-related self-efficacy

This study examined the role of information, efficacy, and 3 stressors in predicting adjustment to organizational change. Participants were 589 government employees undergoing an 18-month process of regionalization. To examine if the predictor variables had long-term effects on adjustment, the authors assessed psychological well-being, client engagement, and job satisfaction again at a 2-year follow-up. At Time 1, there was evidence to suggest that information was indirectly related to psychological well-being, client engagement, and job satisfaction, via its positive relationship to efficacy. There also was evidence to suggest that efficacy was related to reduced stress appraisals, thereby heightening client engagement. Last, there was consistent support for the stress-buffering role of Time 1 self-efficacy in the prediction of Time 2 job satisfaction.

Enriching architectural design education through interactive displays and local community engagement

Designers have a social responsibility to deal with the needs, issues, and problems that their clients and communities are confronted with. Students of design require opportunities to reflect on their role as social facilitators to develop an attitude towards community engagement through different phases and aspects of their careers. However, current design courses are challenged by compressed timeframes and fragmented scenarios of different academic requirements that do not actively teach community engagement. This paper outlines a participatory and technological approach that was employed to address these issues within the teaching of Architecture and Urban Design at the Queensland University of Technology, Brisbane, Australia. A multi-phase community based research project with actual stakeholders was implemented over a two-year period. Approximately 150 students in the final year of the Bachelor of Design-Architecture; 10 students in the Master of Architecture and 15 students in the Master of Design-Urban Design have informed and influenced each others’ learning through the teaching and research nexus facilitated by this project. The technical approach was implemented in form of a bespoke digital platform that supported the display and discussion of digital media on a series of interactive touch walls. The platform allowed students to easily upload their final designs onto large interactive surfaces, where visitors could explore the media and provide comments. Through the use of this technical platform and the introduction of neogeography, students have been able to broaden their level of interaction and support their learning experience through external structured and unstructured feedback from the local community. Students have not only been exposed to community representatives, but they also have been working in parallel on a specific case study providing each other, across different years and courses, material for reflection and data to structure their design activities.

Combining unsupervised and invigilated assessment of introductory programming

We compared student performance on large-scale take-home assignments and small-scale invigilated tests that require competency with exactly the same programming concepts. The purpose of the tests, which were carried out soon after the take home assignments were submitted, was to validate the students' assignments as individual work. We found widespread discrepancies between the marks achieved by students between the two types of tasks. Many students were able to achieve a much higher grade on the take-home assignments than the invigilated tests. We conclude that these paired assessments are an effective way to quickly identify students who are still struggling with programming concepts that we might otherwise assume they understand, given their ability to complete similar, yet more complicated, tasks in their own time. We classify these students as not yet being at the neo-Piagetian stage of concrete operational reasoning.

Promoting and providing expert guidance in work-intensive clinical settings

This paper discusses how expert guidance can be best provided in work intensive clinical settings. The adequacy for supporting learning in the clinical practicum for health care disciplines is often complicated by the intensive work practices in healthcare settings. Often, clinicians' work is so intense that the scope for providing close guidance for students is quite restricted. The case advanced here draws on a range of empirical work to propose how clinician-student interactions might be optimized through the provision of a clinical ccn guided learning such as demonstrating and role-modeling. These roles can contribute in essential ways to the development of learning environments where clinicians have the opportunity to facilitate the learning of others as part of their workload, and without being burdened by the requirements of teaching and assessment processes. It differs from other approaches because although clinicians partner students and provide feedback to them, clinicians are not expected to formally assess or award a grade for student performance. Assessment and remedial action, when required, is undertaken by the role of a designated clinical supervisor qualified to perform such activities. © 2010 Springer Science+Business Media B.V.

MiLK: Transforming everyday places into dynamic learning spaces with mobile and web technologies

This paper explores how game authoring tools can teach processes that transform everyday places into engaging learning spaces. It discusses the motivation inherent in playing games and creating games for others, and how this stimulates an iterative process of creation and reflection and evokes a natural desire to engage in learning. The use of MiLK at the Adelaide Botanic Gardens is offered as a case in point. MiLK is an authoring tool that allows students and teachers to create and share SMS games for mobile phones. A group of South Australian high school students used MiLK to play a game, create their own games and play each other’s games during a day at the gardens. This paper details the learning processes involved in these activities and how the students, without prompting, reflected on their learning, conducted peer assessment, and engaged in a two-way discussion with their teacher about new technologies and their implications for learning. The paper concludes with a discussion of the needs and requirements of 21st century learners and how MiLK can support constructivist and connectivist teaching methods that engage learners and will produce an appropriately skilled future workforce.

Multidisciplinary students on Property core units : comparative analysis of introductory and advanced units

The composition of many professional services firms in the Urban Development area has moved away from a discipline specific ‘silo’ structure to a more multidisciplinary environment. The benefits of multidisciplinarity have been seen in industry by providing synergies across many of the related disciplines. Similarly, the Queensland University of Technology, Bachelor of Urban Development degree has sought to broaden the knowledge base of students and achieve a greater level of synergy between related urban development disciplines through the introduction of generic and multidisciplinary units. This study aims to evaluate the effectiveness of delivering core property units in a multidisciplinary context. A comparative analysis has been undertaken between core property units and more generic units offered in a multidisciplinary context from introductory, intermediate and advanced years within the property program. This analysis was based on data collected from course performance surveys, student performance results, a student focus group and was informed by a reflective process from the student perspective and lecturer/ tutor feedback. The study showed that there are many benefits associated with multidisciplinary unit offerings across the QUT Urban Development program particularly in the more generic units. However, these units require a greater degree of management. It is more difficult to organise, teach and coordinate multidisciplinary student cohorts due to a difference in prior knowledge and experience between each of the discipline groups. In addition, the interaction between lecturers/ tutors and the students frequently becomes more limited. A perception exists within the student body that this more limited face to face contact with academic staff is not valuable which may be exacerbated by the quality of complimentary online teaching materials. For many academics, non-attendance at lectures was coupled with an increase in email communication. From the limited data collected during the study there appears to be no clear correlation between large multidisciplinary student classes and student academic performance or satisfaction.

Boys 'doing' and 'undoing' media education : new possibilities for theory and practice

The purpose of this study is to investigate how secondary school media educators might best meet the needs of students who prefer practical production work to ‘theory’ work in media studies classrooms. This is a significant problem for a curriculum area that claims to develop students’ media literacies by providing them with critical frameworks and a metalanguage for thinking about the media. It is a problem that seems to have become more urgent with the availability of new media technologies and forms like video games. The study is located in the field of media education, which tends to draw on structuralist understandings of the relationships between young people and media and suggests that students can be empowered to resist media’s persuasive discourses. Recent theoretical developments suggest too little emphasis has been placed on the participatory aspects of young people playing with, creating and gaining pleasure from media. This study contributes to this ‘participatory’ approach by bringing post structuralist perspectives to the field, which have been absent from studies of secondary school media education. I suggest theories of media learning must take account of the ongoing formation of students’ subjectivities as they negotiate social, cultural and educational norms. Michel Foucault’s theory of ‘technologies of the self’ and Judith Butler’s theories of performativity and recognition are used to develop an argument that media learning occurs in the context of students negotiating various ‘ethical systems’ as they establish their social viability through achieving recognition within communities of practice. The concept of ‘ethical systems’ has been developed for this study by drawing on Foucault’s theories of discourse and ‘truth regimes’ and Butler’s updating of Althusser’s theory of interpellation. This post structuralist approach makes it possible to investigate the ways in which students productively repeat and vary norms to creatively ‘do’ and ‘undo’ the various media learning activities with which they are required to engage. The study focuses on a group of year ten students in an all boys’ Catholic urban school in Australia who undertook learning about video games in a three-week intensive ‘immersion’ program. The analysis examines the ethical systems operating in the classroom, including formal systems of schooling, informal systems of popular cultural practice and systems of masculinity. It also examines the students’ use of semiotic resources to repeat and/or vary norms while reflecting on, discussing, designing and producing video games. The key findings of the study are that students are motivated to learn technology skills and production processes rather than ‘theory’ work. This motivation stems from the students’ desire to become recognisable in communities of technological and masculine practice. However, student agency is not only possible through critical responses to media, but through performative variation of norms through creative ethical practices as students participate with new media technologies. Therefore, the opportunities exist for media educators to create the conditions for variation of norms through production activities. The study offers several implications for media education theory and practice including: the productive possibilities of post structuralism for informing ways of doing media education; the importance of media teachers having the autonomy to creatively plan curriculum; the advantages of media and technology teachers collaborating to draw on a broad range of resources to develop curriculum; the benefits of placing more emphasis on students’ creative uses of media; and the advantages of blending formal classroom approaches to media education with less formal out of school experiences.