Designing online assessment tools for disengaged youth

This article reports on the development of online assessment tools for disengaged youth in flexible learning environments. Sociocultural theories of learning and assessment and Bourdieu’s sociological concepts of capital and exchange were used to design a purpose-built content management system. This design experiment engaged participants in assessment that led to the exchange of self, peer and teacher judgements for credentialing. This collaborative approach required students and teachers to adapt and amend social networking practices for students to submit and judge their own and others’ work using comments, ratings, keywords and tags. Students and teachers refined their evaluative expertise across contexts, and negotiated meanings and values of digital works, which gave rise to revised versions and emergent assessment criteria. By combining social networking tools with sociological models of capital, assessment activities related to students’ digital productions were understood as valuations and judgements within an emergent, negotiable social field of exchange.

A matrix for appropriate assessment of workplace learning in stem disciplines

With increasing interest shown by Universities in workplace learning, especially in STEM disciplines, an issue has arisen amongst educators and industry partners regarding authentic assessment tasks for work integrated learning (WIL) subjects. This paper describes the use of a matrix, which is also available as a decision-tree, based on the features of the WIL experience, in order to facilitate the selection of appropriate assessment strategies. The matrix divides the WIL experiences into seven categories, based on such factors as: the extent to which the experience is compulsory, required for membership of a professional body or elective; whether the student is undertaking a project, or embedding in a professional culture; and other key aspects of the WIL experience. One important variable is linked to the fundamental purpose of the assessment. This question revolves around the focus of the assessment: whether on the person (student development); the process (professional conduct/language); or the product (project, assignment, literature review, report, software). The matrix has been trialed at QUT in the Faculty of Science and Technology, and also at the University of Surrey, UK, and has proven to have good applicability in both universities.

Development of an electronic role-play assessment initiative in bioscience for nursing students

Devising authentic assessments for subjects with large enrolments is a challenge. This study describes an electronic role-play assessment for approximately 600 first-year nursing students to learn and apply pathophysiology (bioscience) concepts to nursing practice. Students used Microsoft Office PowerPoint® to prepare electronic role-plays both between a nurse and patient, and between two nurses, thus simulating workplace scenarios. Student feedback demonstrated that respondents found this assessment useful for learning pathophysiology, and for applying pathophysiology to a nursing clinical setting. This electronic presentation circumvented issues associated with a traditional oral presentation such as embarrassment and logistics of scheduling groups, and rated well with students of non-English speaking background. The electronic role-play assessment initiative encouraged students to apply their bioscience knowledge to a clinical setting, and allowed students to conceptualise the importance of bioscience within both the nursing degree and the profession.

Evaluation of collaborative assessment of work integrated learning

The international trend towards an increasingly standards-based approach to higher education and the resultant focus on the assurance of learning in tertiary programs have generated a strong emphasis on the assessment of outcomes across the higher education sector. In legal education, curriculum reform is highly prevalent internationally as a result of various reviews of legal education. As legal education focuses more on the attainment of a broader set of outcomes encompassing soft skills, capabilities and attributes, more authentic assessment will need to be developed appropriate to this new environment, meaning that modes of assessment with strong application in real-life settings should be preferred.

From profiles to rich tasks : the situated nature of 'authenticity' in the context of reforming curriculum and assessment practices

Outcome based education that has dominated Australian education in the 1990s is under review in the early years of the twenty first century. The available historical 'texts' produced during the first half of the 1990s, which include the national Statements and Profiles, and the state Curriculum and Standards Frameworks, provide us with documents that we can engage with not simply for 'history's sake', but with an opportunity to, in the words of the feminist author Dorothy Smith, 'displace[s] the analysis from the text as originating in writer or thinker, to the discourse itself as an ongoing intertextual process' bringing into view the social relations in which texts are embedded and which they organise' (1990, p. 161-2). Most Australian states and territories have now commenced significant situated, local curriculum renewal and reform. This renewed interest in curriculum offers insights into the character of recent assessment practices in Australia, recognising the tensions inherent in assessment practices and authentic assessment models. This paper explores, by way of an overview of the broad curriculum and assessment practices adopted in Australia over the past twenty-five years, the situated nature of 'authenticity' in the context of curriculum and assessment practices and how as teacher educators we are responding through our everyday work.

Pre-service visual art teachers’ perceptions of assessment in online learning

This paper reports on a study conducted into how one cohort of Master of Teaching pre-service visual art teachers perceived their learning in a fully online learning environment. Located in an Australian urban university, this qualitative study provided insights into a number of areas associated with higher education online learning, including that of assessment, the focus of this paper. Authentic assessment tasks were designed within the University’s learning and teaching framework of constructive alignment and were sequenced across the three semesters of the visual art program. Analysis of data collected through a questionnaire and semi-structured interviews revealed that participants largely held very positive attitudes about the suite of online assessment tasks, particularly in light of (a) the collaborative learning that took place, (b) the nature, structure and sequence of the tasks, and (c) the ways in which the tasks contributed to their workplace readiness.

Culturally Appropriate Authentic Assessments: Exploring the Use of Authentic Assessments for African American Children at Risk for Special Education in Urban Settings

Authentic assessments provide an alternative to informal and formal assessments which may reduce the number of African Americans in special education programs. This literature review will explore the use of authentic assessment for at risk students in special education programs in urban settings.

Moderation as judgement practice: Reconciling system level accountability and local level practice

Internationally, recognition of the role of assessment to inform the learning process has received much attention in recent years. Assessment for learning, not just of learning is being supported by an increasing body of literature providing strategies that teachers and their students can incorporate to support the learning process (Assessment Reform Group, 2002; Broadfoot & Black, 2004; James, 2006). Concurrently there has been an increase internationally in systemic accountability requirements of schools in terms of student results. The convergence of these two movements has resulted in some education systems promoting standards-driven reform involving authentic assessment and a re-examination of the relationship between the teacher and the student in the learning process. In this context standards are intended to be used as the basis for judgements of student achievement; while the results from assessment tasks are meant to both inform the teaching/learning process, and to report and track student progress. In such system, the role and reliability of teacher judgement takes centre stage.

Frock paper scissors : a comparative case study

This paper discusses the ways in which synergies across design disciplines can be developed through student engagement on authentic design projects. The paper focuses on a comparative case study where students from the Fashion, and Communication Design discipline areas in the Creative Industries Faculty at Queensland University of Technology (QUT) work on the production of the Frock Paper Scissors magazine and web site. The Frock Paper Scissors magazine has been the focus of assessment in a Fashion and Style Journalism class for the last three years, and for the last two years, students from an Advanced Web Design class have been involved in the production of the accompanying web site, http://frockpapersissors.com/. In this paper we focus on how this authentic assessment task has been integrated into the two design (and communication) classes; discussing the different approaches taken by teaching staff, the challenges faced, and the ways in which student learning outcomes have been improved through interactions between design disciplines. The paper concludes by outlining a set of observations on how to successfully engage students from different design (and creative industries) fields on an authentic design project within their studies.

How can preservice teachers be measured against advocated professional teaching standards?

Australia has had many inquiries into teaching and teacher education over the last decade. Standards for teaching have been produced by national education systems with many state systems following suit. The Queensland College of Teachers (QCT) advocates ten professional teaching standards for teachers and preservice teachers. How can preservice teachers be measured against advocated professional standards? This study investigated 106 second-year preservice teachers’ perceptions of their development against the QCT standards. A pretest-posttest survey instrument was developed based on the QCT standards and administered to these preservice teachers before and after their science education coursework. Percentages, ANOVAs and t-tests were generated to analyse the results. Findings indicated that 22 of the 24 paired pretest-posttest items were highly significant (p<.001). Percentage increases ranged from as low as 27% in the pretest to as high as 97% in the posttest, yet, there were two items with lower significance (i.e., working in professional science education teams and supporting students’ participation in society). Understanding preservice teachers’ perceptions of their abilities to implement these standards may be a step towards the process of determining the achievement of teaching standards; however, more rigorous measurements will need to be developed for both teachers and preservice teachers. University coursework and related assessments can provide an indication of achieving these standards, especially authentic assessment of preservice teachers’ practices.

The ‘Get Marketer Challenge’: Engaging first year students in an introductory marketing course

Research on student engagement suggests courses that involve students in challenging, authentic tasks linking students to their peers and educators are associated with high levels of engagement. This paper presents an assessment innovation within a first year marketing course that was designed to promote student engagement. Currently in its pilot stage, the ‘Get Marketer Challenge’ is a constructively aligned, authentic assessment task; requiring student teams to solve a real-world marketing problem as part of a course-wide competition. Student enrolment data suggests the Get Marketer Challenge is an attractive assessment option that encourages students to enrol in the Marketing course. Educators have been surprised by the consistency and high level of effort expended by student teams. Students report the Get Marketer Challenge is an enjoyable assessment task that helped them to understand some of the challenges faced by marketers.

Connecting pre-service teachers to 'real world' teaching practices through microteaching

Action research proved a useful strategy for monitoring the evolution of microteaching task as an authentic assessment for post-graduate pre-service teachers. Through four iterations of continually reflecting on the structure, purpose and outcomes of utilising microteaching as assessment, unit coordinators implemented an authentic assessment task that simulated real world experience.

Frock Paper Scissors [website]

Frock Paper Sissors (http://www.frockpaperscissors.com): curated web based fashion work. Research has focussed on creating a professional and ‘real world’ website (available in the international/public arena) while producing a high quality design and journalistic fashion medium. The hard copy Frock Paper Scissors magazine has been the focus of assessment in a Fashion and Style Journalism class for the last five years, and for the last three years, students from an Advanced Web Design class have been involved in the production of the accompanying web site, http://www.frockpapersissors.com. This project researches the ways in which synergies across design disciplines can be developed through student engagement on authentic design projects. The Frock Paper Scissors website is a curated collaboration of work from the Fashion,Journalism, Creative Industries and Communication Design discipline areas in the Creative Industries Faculty at Queensland University of Technology (QUT). Research focusses on how this authentic assessment task has been integrated into the two design (and communication)classes; discussing the different approaches taken by teaching staff, the challenges faced, and the ways in which student learning outcomes have been improved through interactions between design disciplines. The final curated work is a public/international website which successfully displays student work and engages students from different design (and creative industries) fields on an authentic design project within their studies.

Frock Paper Scissors [annual hard copy fashion magazine editions]

The Frock Paper Scissors magazine (and accompanying web site, www.frockpapersissors.com ) has been the focus of assessment in a Fashion and Style Journalism unit from 2006 to 2011 (current). The research has focused on the ways in which synergies across disciplines can be developed through student engagement on authentic projects (with a public audience). Up to 80 students from the Fashion Design, Journalism, Media Communication, Creative Industries, Business, Creative Writing and Communication Design discipline areas in the Creative Industries Faculty at Queensland University of Technology (QUT) work on the content, production, layout and funding for the Frock Paper Scissors magazine (and web site). Research focusses on how this authentic assessment task has been integrated into the classes; discussing the approaches taken by teaching staff, the challenges faced, and the ways in which student learning outcomes have been improved and their career outcomes enhanced. The final output requires staff to curate a professional hard copy fashion magazine(and website) where 5,000 copies are distributed annually throughout south east Queensland, Sydney, Melbourne, London, New York and Amsterdam.

Les croyances des enseignants et leurs pratiques relativement à l’évaluation de l’oral : étude de cas de deux enseignants de français de 3e secondaire

Depuis quelques années, plusieurs didacticiens du français se penchent sur l’enseignement et l’évaluation de l’oral, mais peu d’informations sont encore disponibles concernant les pratiques effectives des enseignants à cet égard. Notre recherche vise à décrire les croyances de deux enseignants de français au secondaire et leurs pratiques au sujet de l’évaluation de l’oral, plus particulièrement de l’oral dans une situation d’interaction entre pairs. Une entrevue dirigée a permis d’avoir accès à leurs croyances et à leurs pratiques déclarées, alors que le think-aloud a été employé pour observer leur pratique d’évaluation, à l’étape du jugement, d’une situation d’interaction entre pairs. Nos résultats montrent que, du point de vue de leurs croyances, les enseignants ont tous deux des préoccupations concernant les tâches et les instruments d’évaluation, et que leurs pratiques d’évaluation déclarées sont assez semblables en ce qui a trait aux tâches retenues, à leur fréquence et à l’intention poursuivie. Du côté de leurs pratiques d’évaluation observées à l’étape du jugement, nous exposons de façon détaillée les gestes d’enseignants en situation authentique, en identifiant les principaux processus cognitifs et métacognitifs impliqués dans cette tâche complexe. Des divergences entre les deux enseignants ont été observées relativement à leurs croyances, pratiques déclarées et pratiques observées durant le jugement. Tout d’abord, les critères retenus pour l’évaluation (pratique déclarée) ne tiennent pas toujours compte de ce qu’ils croient important d’enseigner en classe (croyance). De plus, malgré une pratique déclarée positive concernant l’autoévaluation, ces enseignants n’y ont peu ou pas eu recours durant leur jugement. Enfin, les gestes de l’un, durant le jugement, tendaient vers la posture d’instructeur-contrôleur, alors que ceux de l’autre s’inscrivaient davantage dans la posture de conseiller-didacticien. De façon générale, nous constatons que les pratiques de ces enseignants sont plus influencées par les situations rencontrées en tant qu’élèves et les traditions d’enseignement de la discipline que par le programme en vigueur.