Assessment for learning in the accountability era : Queensland, Australia

Developments in school education in Australia over the past decade have witnessed the rise of national efforts to reform curriculum, assessment and reporting. Constitutionally the power to decide on curriculum matters still resides with the States. Higher stakes in assessment, brought about by national testing and international comparative analyses of student achievement data, have challenged State efforts to maintain the emphasis on assessment to promote learning while fulfilling accountability demands. In this article lessons from the Queensland experience indicate that it is important to build teachers' assessment capacity and their assessment literacy for the promotion of student learning. It is argued that teacher assessment can be a source of dependable results through moderation practice. The Queensland Studies Authority has recognised and supported the development of teacher assessment and moderation practice in the context of standards-driven, national reform. Recent research findings explain how the focus on learning can be maintained by avoiding an over-interpretation of test results in terms of innate ability and limitations and by encouraging teachers to adopt more tailored diagnosis of assessment data to address equity through focus on achievement for all. Such efforts are challenged as political pressures related to the Australian government’s implementation of national testing and national partnership funding arrangements tied to the performance of students at or below minimum standards become increasingly apparent.

Grounding action in visuo-haptic space using experience networks

Traditional approaches to the use of machine learning algorithms do not provide a method to learn multiple tasks in one-shot on an embodied robot. It is proposed that grounding actions within the sensory space leads to the development of action-state relationships which can be re-used despite a change in task. A novel approach called an Experience Network is developed and assessed on a real-world robot required to perform three separate tasks. After grounded representations were developed in the initial task, only minimal further learning was required to perform the second and third task.

Assurance of learning : the role of work integrated learning and industry partners

In the partnering with students and industry it is important for universities to recognize and value the nature of knowledge and learning that emanates from work integrated learning experiences is different to formal university based learning. Learning is not a by-product of work rather learning is fundamental to engaging in work practice. Work integrated learning experiences provide unique opportunities for students to integrate theory and practice through the solving of real world problems. This paper reports findings to date of a project that sought to identify key issues and practices faced by academics, industry partners and students engaged in the provision and experience of work integrated learning within an undergraduate creative industries program at a major metropolitan university. In this paper, those findings are focused on some of the particular qualities and issues related to the assessment of learning at and through the work integrated experience. The findings suggest that the assessment strategies needed to better value the knowledges and practices of the Creative Industries. The paper also makes recommendations about how industry partners might best contribute to the assessment of students’ developing capabilities and to continuous reflection on courses and the assurance of learning agenda.

Investigating the process of teaching and learning principles through practice : a case study on collegiate action by media practitioners and teachers, designing a skills-based learning program

This paper in the journalism education field reports on the construction of a new subject as part of a postgraduate coursework degree. The subject, or unit1 will offer both Journalism students and other students an introductory experience of creating media, using common ‘new media’ tools, with exercises that will model the learning of communication principles through practice. It has been named ‘Fundamental Media Skills for the Workplace’. The conceptualisation and teaching of it will be characteristic of the Journalism academic discipline that uses the ‘inside perspective’—understanding mass media by observing from within. Proposers for the unit within the Journalism discipline have sought to extend the common teaching approach, based on training to produce start-ready recruits for media jobs, backed by a study of contexts, e.g. journalistic ethics, or media audiences. In this proposal, students would then examine the process to elicit additional knowledge about their learning. The paper draws on literature of journalism and its pedagogy, and on communication generally. It also documents a ‘community of practice’ exercise conducted among practitioners as teachers for the subject, developing exercises and models of media work. A preliminary conclusion from that exercise is that it has taken a step towards enhancing skills-based learning for media work, as a portal to more generalised knowledge.

Acknowledging social justice and equity through good practice for monitoring student learning engagement in FYE

As higher education institutions respond to government targets to widen participation, their student populations will become increasingly diverse, and the issues around student success and retention will be more closely scrutinised. The concept of student engagement is a key factor in student achievement and retention and Australasian institutions have a range of initiatives aimed at monitoring and intervening with students who are at risk of disengaging. Within the widening participation agenda, it is absolutely critical that these initiatives are designed to enable success for all students, particularly those for whom social and cultural disadvantage have been a barrier. Consequently, for the sector, initiatives of this type must be consistent with the concept of social justice and a set of principles would provide this foundation. This session will provide an opportunity for participants to examine a draft set of principles and to discuss their potential value for the participants’ institutional contexts.

Scaffolding large units for small group collaborative learning : a case study.

Undergraduates working in teams can be a problematic endeavour, sometimes exacerbated for the student by poor prior experiences, a predisposition to an individual orientation of assessment, and simply the busyness that now typifies the life of a student. But effort in pedagogical design is worthwhile where team work is often a prerequisite in terms of graduate capabilities, robust learning, increased motivation, and indeed in terms of equipping individuals for emergent knowledge-age work practice, often epitomised by collaborative effort in both blended and virtual contexts. Through an iterative approach, based extensively on the established literature, we have developed a successful scaffold which is workable with a large cohort group (n >800), such that it affords students the lived experience of being a part of a learning network. Individuals within teams work together, to develop individual components that are subsequently aggregated and reified to an overall team knowledge artefact. We describe our case and propose a pedagogical model of scaffolding based on three perspectives: conceptual, rule-based and community-driven. This model provides designers with guidelines for producing and refining assessment tasks for team-based learning.

The role of digressive learning and uniqueness on performance : longitudinal evidence from young firms

The ability to differentiate from competitors through the selection of unique offerings is an important cornerstone of competitive performance. Developing unique products and services to offer in the marketplace is not only important for established firms, but also an important strategic choice for young firms (Baum and Haveman, 1997). Unlike large and established firms, young firms tend to have less access to adequate resources, well-developed sources of information, contact networks, and considerable experience and management know-how. That is, these firms differ significantly in their attributes and performance from larger and well-established firms (c.f. Miller and Chen, 1994). Although young firms are disadvantaged by the paucity of resources in putting together its unique product offering(s), they develop different pathways in advancing their assortment of capabilities that enables them to stay ahead of competitors.

Wellness education : an integrated theoretical framework for fostering transformative learning

Optimum Wellness involves the development, refinement and practice of lifestyle choices which resonate with personally meaningful frames of reference. Personal transformations are the means by which our frames of reference are refined across the lifespan. It is through critical reflection, supportive relationships and meaning making of our experiences that we construct and reconstruct our life paths. When individuals are able to be what they are destined to be or reach their higher purpose, then they are able to contribute to the world in positive and meaningful ways. Transformative education facilitates the changes in perspective that enable one to contemplate and travel a path in life that leads to self-actualisation. This thesis argues for an integrated theoretical framework for optimum Wellness Education. It establishes a learner centred approach to Wellness education in the form of an integrated instructional design framework derived from both Wellness and Transformative education constructs. Students’ approaches to learning and their study strategies in a Wellness education context serve to highlight convergences in the manner in which students can experience perspective transformation. As they learn to critically reflect, pursue relationships and adapt their frames of reference to sustain their pursuit of both learning and Wellness goals, strengthening the nexus between instrumental and transformative learning is a strategically important goal for educators. The aim of this exploratory research study was to examine those facets that serve to optimise the learning experiences of students in a Wellness course. This was accomplished through three research issues: 1) What are the relationships between Wellness, approaches to learning and academic success? 2) How are students approaching learning in an undergraduate Wellness subject? Why are students approaching their learning in the ways they do? 3) What sorts of transformations are students experiencing in their Wellness? How can transformative education be formulated in the context of an undergraduate Wellness subject? Subsequent to a thorough review of the literature pertaining to Wellness education, a mixed method embedded case study design was formulated to explore the research issues. This thesis examines the interrelationships between student, content and context in a one semester university undergraduate unit (a coherent set of learning activities which is assigned a unit code and a credit point value). The experiences of a cohort of 285 undergraduate students in a Wellness course formed the unit of study and seven individual students from a total of sixteen volunteers whose profiles could be constructed from complete data sets were selected for analysis as embedded cases. The introductory level course required participants to engage in a personal project involving a behaviour modification plan for a self-selected, single dimension of Wellness. Students were given access to the Standard Edition Testwell Survey to assess and report their Wellness as a part of their personal projects. To identify relationships among the constructs of Self-Regulated Learning (SRL), Wellness and Student Approaches to Learning (SAL) a blend of quantitative and qualitative methods to collect and analyse data was formulated. Surveys were the primary instruments for acquiring quantitative data. Sources included the Wellness data from Testwell surveys, SAL data from R-SPQ surveys, SRL data from MSLQ surveys and student self-evaluation data from an end of semester survey. Students’ final grades and GPA scores were used as indicators of academic performance. The sources of qualitative data included subject documentation, structured interview transcripts and open-ended responses to survey items. Subsequent to a pilot study in which survey reliability and validity were tested in context, amendments to processes for and instruments of data collection were made. Students who adopted meaning oriented (deep/achieving) approaches tended to assess their Wellness at a higher level, seek effective learning strategies and perform better in formal study. Posttest data in the main study revealed that there were significant positive statistical relationships between academic performance and total wellness scores (rs=.297, n=205, p<.01). Deep (rs=.343, n=137, p<.01) and achieving (rs=.286, n=123, p<.01) approaches to learning also significantly correlated with Wellness whilst surface approaches had negative correlations that were not significant. SRL strategies including metacognitive selfregulation, effort, help-seeking and critical thinking were increasingly correlated with Wellness. Qualitative findings suggest that while all students adopt similar patterns of day to day activities for example attending classes, taking notes, working on assignments the level of care with which these activities is undertaken varies considerably. The dominant motivational trigger for students in this cohort was the personal relevance and associated benefits of the material being learned and practiced. Students were inclined to set goals that had a positive impact on affect and used “sense of happiness” to evaluate their achievement status. Students who had a higher drive to succeed and/or understand tended to have or seek a wider range of strategies. Their goal orientations were generally learning rather than performance based and barriers presented a challenge which could be overcome as opposed to a blockage which prevented progress. Findings from an empirical analysis of the Testwell data suggest that a single third order Wellness construct exists. A revision of the instrument is necessary in order to juxtapose it with the chosen six dimensional Wellness model that forms the foundation construct in the course. Further, redevelopment should be sensitive to the Australian context and culture including choice of language, examples and scenarios used in item construction. This study concludes with an heuristic for use in Wellness education. Guided by principles of Transformative education theory and behaviour change theory, and informed by this representative case study the “CARING” heuristic is proposed as an instructional design tool for Wellness educators seeking to foster transformative learning. Based upon this study, recommendations were made for university educators to provide authentic and personal experiences in Wellness curricula. Emphasis must focus on involving students and teachers in a partnership for implementing Wellness programs both in the curriculum and co-curricularly. The implications of this research for practice are predicated on the willingness of academics to embrace transformative learning at a personal level and a professional one. To explore students’ profiles in detail is not practical however teaching students how to guide us in supporting them through the “pain” of learning is a skill which would benefit them and optimise the learning and teaching process. At a theoretical level, this research contributes to an ecological theory of Wellness education as transformational change. By signposting the wider contexts in which learning takes place, it seeks to encourage changing paradigms to ones which harness the energy of each successive contextual layer in which students live. Future research which amplifies the qualities of individuals and groups who are “Well” and seeks the refinement and development of instruments to measure Wellness constructs would be desirable for both theoretical and applied knowledge bases. Mixed method Wellness research derived and conducted by teams that incorporate expertise from multiple disciplines such as psychology, anthropology, education, and medicine would enable creative and multi-perspective programs of investigation to be designed and implemented. Congruences and inconsistencies in health promotion and education would provide valuable material for strengthening the nexus between transformational learning and behaviour change theories. Future development of and research on the effectiveness of the CARING heuristic would be valuable in advancing the understanding of pedagogies which advance rather than impede learning as a transformative process. Exploring pedagogical models that marry with transformative education may render solutions to the vexing challenge of teaching and learning in diverse contexts.

Ezine and iRadio as knowledge creation metaphors for scaffolding learning in physical and virtual learning spaces

eZine and iRadio represent metaphors for multimedia communication on the Internet. Participating students experience a simulated Internet publishing environment in both their classroom and virtual learning environment. This chapter presents an autoethnographic account highlighting the voices of the learning designer and the teacher and provides evidence of the planning and implementation of two tertiary music elective courses over three iterations of each course. A blended learning environment was incorporated within each elective music course and a collaborative approach to development between lecturers, tutors, learning and technological designers using an iterative research design. The research suggests that learning design which provides real world examples and resources integrating authentic task design into their unit can provide meaningful and engaging experiences for students. The dialogue between learning designers and teachers and iterative review of the learning process and student outcomes, we believe, has engaged students meaningfully to achieve transferable learning outcomes.

Emergent task-specific object semantics through distributed experience networks

Autonomous development of sensorimotor coordination enables a robot to adapt and change its action choices to interact with the world throughout its lifetime. The Experience Network is a structure that rapidly learns coordination between visual and haptic inputs and motor action. This paper presents methods which handle the high dimensionality of the network state-space which occurs due to the simultaneous detection of multiple sensory features. The methods provide no significant increase in the complexity of the underlying representations and also allow emergent, task-specific, semantic information to inform action selection. Experimental results show rapid learning in a real robot, beginning with no sensorimotor mappings, to a mobile robot capable of wall avoidance and target acquisition.

The challenge of assessing professional competence in work integrated learning

A fundamental aspect of work integrated learning (WIL) is the development of professional competence, the ability of students to perform in the work place. Alignment theory therefore suggests that the assessment of WIL should include an assessment of students’ demonstration of professional competence in the workplace. The assessment of professional competence in WIL is, however, problematic. It may be impractical for the academic supervisor to directly assess professional competence if there is a large number of students in external placements. If evidence of professional competence is provided by the student, the student’s ability to articulate his or her own capabilities will interfere with the validity of the assessment. If evidence of professional competency is provided by the supervisor then the assessment is heavily dependent on the individual supervisor and may be unreliable. This paper will examine the literature relating to the assessment of professional competence in WIL. The paper will be informed by the author’s experience in coordinating a WIL subject in an undergraduate law course. It will recommend that a mix of evidence provided by the student, the workplace supervisor and the academic supervisor should be used to assess professional competence in WIL.

Interactive peer-based learning in a comparative case study : what do students gain?

As English increasingly becomes one of the most commonly spoken languages in the world today for a variety of economic, social and cultural reasons, education is impacted by globalisation, the internationalisation of universities and the diversity of learners in classrooms. The challenge for educators is to find more effective ways of teaching English language so that students are better able to create meaning and communicate in the target language as well as to transform knowledge and understanding into relevant skills for a rapidly changing world. This research focuses broadly on English language education underpinned by social constructivist principles informing communicative language teaching and in particular, interactive peer learning approaches. An intervention of interactive peer-based learning in two case study contexts of English as Foreign Language (EFL) undergraduates in a Turkish university and English as Second Language (ESL) undergraduates in an Australian university investigates what students gain from the intervention. Methodology utilising qualitative data gathered from student reflective logs, focus group interviews and researcher field notes emphasises student voice. The cross case comparative study indicates that interactive peer-based learning enhances a range of learning outcomes for both cohorts including engagement, communicative competence, diagnostic feedback as well as assisting development of inclusive social relationships, civic skills, confidence and self efficacy. The learning outcomes facilitate better adaptation to a new learning environment and culture. An iterative instructional matrix tool is a useful product of the research for first year university experiences, teacher training, raising awareness of diversity, building learning communities, and differentiating the curriculum. The study demonstrates that English language learners can experience positive impact through peer-based learning and thus holds an influential key for Australian universities and higher education.

The Global Youth Media Council : young people speaking and learning about media reform

The 5th World Summit on Media for Children and Youth held in Karlstad, Sweden in June 2010 provided a unique media literacy experience for approximately thirty young people from diverse backgrounds through participation in the Global Youth Media Council. This article focuses on the Summit’s aim to give young people a ‘voice’ through intercultural dialogue about media reform. The accounts of four young Australians are discussed in order to consider how successful the Summit was in achieving this goal. The article concludes by making recommendations for future international media literacy conferences involving young people. It also advocates for the expansion of the Global Youth Media Council concept as a grass roots movement to involve more young people in discussions about media reform.

The experience of being a peer outreach volunteer: Benefits and challenges

Peer outreach is an emerging form of non-professional consumer-delivered service in the context of psychiatric rehabilitation. This study identified the benefits and challenges of outreach provision as identified by a group of volunteer outreach workers. One on one semi-structured interviews were carried out with twelve members trained as peer outreach volunteers. Interview transcripts were analysed using a consensual qualitative research approach. Outreach workers typically experienced peer outreach as a positive experience both for themselves and for the recipients. Most found the training and support provided to be appropriate and sufficient. Nonetheless, peer outreach workers did encounter difficulties and sometimes felt need for more training and support. The findings have implications for the development of future peer outreach programs. There is scope for enhanced training and/or supervision and a need for further research to investigate ways to optimise peer outreach.