Designing Assessment for Quality Learning

- Considers broad-scale assessment approaches and how they impact on educational opportunity and outcomes. - Brings together internationally recognised scholars providing new insights into assessment for learning improvement and accountability. - Presents different theoretical and methodological perspectives influential in the field of assessment, learning and social change. - Contributes to the theorising of assessment in contexts characterised by heightened accountability requirements and constant change. This book brings together internationally recognised scholars with an interest in how to use the power of assessment to improve student learning and to engage with accountability priorities at both national and global levels. It includes distinguished writers who have worked together for some two decades to shift the assessment paradigm from a dominant focus on assessment as measurement towards assessment as central to efforts to improve learning. These writers have worked with the teaching profession and, in so doing, have researched and generated key insights into different ways of understanding assessment and its relationship to learning. The volume contributes to the theorising of assessment in contexts characterised by heightened accountability requirements and constant change. The book’s structure and content reflect already significant and growing international interest in assessment as contextualised practice, as well as theories of learning and teaching that underpin and drive particular assessment approaches. Learning theories and practices, assessment literacies, teachers’ responsibilities in assessment, the role of leadership, and assessment futures are the organisers within the book’s structure and content. The contributors to this book have in common the view that quality assessment, and quality learning and teaching are integrally related. Another shared view is that the alignment of assessment with curriculum, teaching and learning is linchpin to efforts to improve both learning opportunities and outcomes for all. Essentially, the book presents new perspectives on the enabling power of assessment. In so doing, the writers recognise that validity and reliability - the traditional canons of assessment – remain foundational and therefore necessary. However, they are not of themselves sufficient for quality education. The book argues that assessment needs to be radically reconsidered in the context of unprecedented societal change. Increasingly, communities are segregating more by wealth, with clear signs of social, political, economic and environmental instability. These changes raise important issues relating to ethics and equity, taken to be core dimensions in enabling the power of assessment to contribute to quality learning for all. This book offers readers new knowledge about how assessment can be used to re/engage learners across all phases of education.

A new approach to understanding readings for design students

In this paper I describe an innovative technique for helping design students to approach and understand reading tasks. There is ample literature on design students’ use of visual thinking for design tasks, but less on how they can use their visual skills to apply to their learning in other areas, particularly those that challenge them such as academic reading and writing. I set a cartooning task as a way to get students motivated and involved in doing set readings for a design history course. This has been successful in enhancing students’ involvement and understanding, and they have been able to apply their improved understanding to writing tasks based on the cartoons.

Comparison of high level FPGA hardware design for solving tri-diagonal linear systems

Reconfigurable computing devices can increase the performance of compute intensive algorithms by implementing application specific co-processor architectures. The power cost for this performance gain is often an order of magnitude less than that of modern CPUs and GPUs. Exploiting the potential of reconfigurable devices such as Field-Programmable Gate Arrays (FPGAs) is typically a complex and tedious hardware engineering task. Re- cently the major FPGA vendors (Altera, and Xilinx) have released their own high-level design tools, which have great potential for rapid development of FPGA based custom accelerators. In this paper, we will evaluate Altera’s OpenCL Software Development Kit, and Xilinx’s Vivado High Level Sythesis tool. These tools will be compared for their per- formance, logic utilisation, and ease of development for the test case of a Tri-diagonal linear system solver.

Technology : A mobilising force for a radical design pedagogy [Editorial - Special Issue]

This special issue of the Journal of Learning Design, led by Jill Franz and Lindy Osborne, from the School of Design in the Creative Industries Faculty at the Queensland University of Technology, is grounded in Design Education. Its papers are drawn from differing fields of design: digital media, architecture, and environmental design. Each makes use of technologies in differing ways but all share the singular purpose of achieving enhanced learning outcomes from students.

Teaching games level design using the StarCraft II editor

Level design is often characterised as “where the rubber hits the road” in game development. It is a core area of games design, alongside design of game rules and narrative. However, there is a lack of literature dedicated to documenting teaching games design, let alone the more specialised topic of level design. Furthermore, there is a lack of formal frameworks for best practice in level design, as professional game developers often rely on intuition and previous experience. As a result, there is little for games design teachers to draw on when presented with the opportunity to teach a level design unit. In this paper, we discuss the design and implementation of a games level design unit in which students use the StarCraft II Galaxy Editor. We report on two cycles of an action research project, reflecting upon our experiences with respect to student feedback and peer review, and outlining our plans for improving the unit in years to come.

Learning information literacy

Introduction This paper reports on university students' experiences of learning information literacy. Method Phenomenography was selected as the research approach as it describes the experience from the perspective of the study participants, which in this case is a mixture of undergraduate and postgraduate students studying education at an Australian university. Semi-structured, one-on-one interviews were conducted with fifteen students. Analysis The interview transcripts were iteratively reviewed for similarities and differences in students' experiences of learning information literacy. Categories were constructed from an analysis of the distinct features of the experiences that students reported. The categories were grouped into a hierarchical structure that represents students' increasingly sophisticated experiences of learning information literacy. Results The study reveals that students experience learning information literacy in six ways: learning to find information; learning a process to use information; learning to use information to create a product; learning to use information to build a personal knowledge base; learning to use information to advance disciplinary knowledge; and learning to use information to grow as a person and to contribute to others. Conclusions Understanding the complexity of the concept of information literacy, and the collective and diverse range of ways students experience learning information literacy, enables academics and librarians to draw on the range of experiences reported by students to design academic curricula and information literacy education that targets more powerful ways of learning to find and use information.

A prospective cohort study examining the preferred learning styles of acute care registered nurses

Objectives This paper reports on the preferred learning styles of Registered Nurses practicing in acute care environments and relationships between gender, age, post-graduate experience and the identified preferred learning styles. Methods A prospective cohort study design was used. Participants completed a demographic questionnaire and the Felder-Silverman Index of Learning Styles (ILS) questionnaire to determine preferred learning styles. Results Most of the Registered Nurse participants were balanced across the Active-Reflective (n = 77, 54%), and Sequential-Global (n = 96, 68%) scales. Across the other scales, sensing (n = 97, 68%) and visual (n = 76, 53%) were the most common preferred learning style. There were only a small proportion who had a preferred learning style of reflective (n = 21, 15%), intuitive (n = 5, 4%), verbal (n = 11, 8%) or global learning (n = 15, 11%). Results indicated that gender, age and years since undergraduate education were not related to the identified preferred learning styles. Conclusions The identification of Registered Nurses’ learning style provides information that nurse educators and others can use to make informed choices about modification, development and strengthening of professional hospital-based educational programs. The use of the Index of Learning Styles questionnaire and its ability to identify ‘balanced’ learning style preferences may potentially yield additional preferred learning style information for other health-related disciplines.

Developing a culture to support peer review of teaching in higher education

This presentation addresses issues related to leadership, academic development and scholarship of teaching and learning, and highlights research funded by the Australian Office of Learning and Teaching (OLT) designed to embed and sustain peer review of teaching within the culture of 5 Australian universities: Queensland University of Technology, University of Technology, Sydney, University of Adelaide, Curtin University, and Charles Darwin University. Peer review of teaching in higher education will be emphasised as a professional process for providing feedback on teaching and learning practice, which if sustained, can become an effective ongoing strategy for academic development (Barnard et al, 2011; Bell, 2005; Bolt and Atkinson, 2010; McGill & Beaty 2001, 1992; Kemmis & McTaggart, 2000). The research affirms that using developmental peer review models (Barnard et al, 2011; D'Andrea, 2002; Hammersley-Fletcher & Orsmond, 2004) can bring about successful implementation, especially when implemented within a distributive leadership framework (Spillane & Healey, 2010). The project’s aims and objectives were to develop leadership capacity and integrate peer review as a cultural practice in higher education. The research design was a two stage inquiry process over 2 years. The project began in July 2011 and encompassed a development and pilot phase followed by a cascade phase with questionnaire and focus group evaluation processes to support ongoing improvement and measures of outcome. Leadership development activities included locally delivered workshops complemented by the identification and support of champions. To optimise long term sustainability, the project was implemented through existing learning and teaching structures and processes within the respective partner universities. Research outcomes highlight the fundamentals of peer review of teaching and the broader contextual elements of integration, leadership and development, expressed as a conceptual model for embedding peer review of teaching within higher education. The research opens a communicative space about introduction of peer review that goes further than simply espousing its worth and introduction. The conceptual model highlights the importance of development of distributive leadership capacity, integration of policies and processes, and understanding the values, beliefs, assumptions and behaviors embedded in an organizational culture. The presentation overviews empirical findings that demonstrate progress to advance peer review requires an ‘across-the-board’ commitment to embed change, and inherently demands a process that co-creates connection across colleagues, discipline groups, and the university sector. Progress toward peer review of teaching as a cultural phenomenon can be achieved and has advantages for academic staff, scholarship, teaching evaluation and an organisation, if attention is given to strategies that influence the contexts and cultures of teaching practice. Peer review as a strategy to develop excellence in teaching is considered from a holistic perspective that by necessity encompasses all elements of an educational environment and has a focus on scholarship of teaching. The work is ongoing and has implication for policy, research, teaching development and student outcomes, and has potential application world-wide.

Physicality and cooperative design

CSCW researchers have increasingly come to realize that the material work setting and its population of artefacts play a crucial part in coordination of distributed or co-located work. This paper uses the notion of physicality as a basis to understand cooperative work. Using examples from an ongoing fieldwork on cooperative design practices, it provides a conceptual understanding of physicality and shows that material settings and co-workers’ working practices play an important role in understanding the physicality of cooperative design.

Using biomimicry to inform urban infrastructure design that addresses 21st century needs

The design of society’s major infrastructure systems are generally based on anthropogenic learnings and seldom encapsulate learning from nature. This results from a pervading attitude of superiority of human-designed systems, particularly since the Industrial Revolution. Problems created by such behaviours have previously not been thought to present a serious threat to humanity. However, many built environment professionals are now reconsidering the impact of such systems on the environment and their vulnerability to issues such as climate change. This paper presents an approach to delivering sustainable urban infrastructure that addresses 21st Century needs by emulating natural form, function and process - biomimicry – in infrastructure design. The analysis reveals the context for infrastructure change and the need for sustainable solutions, detailing the current inquiry into biomimicry informed design and highlighting potential applications from literature that demonstrate precedence for nature to inspire the design of urban infrastructure, in particular water and energy systems.

Design Minds Refresh Toolkit

The Design Minds Refresh Toolkit was one of six K7-12 secondary school design toolkits commissioned by the State Library of Queensland (SLQ) Asia Pacific Design Library (APDL), to facilitate the delivery of the Stage 1 launch of its Design Minds online platform (www.designminds.org.au) partnership initiative with Queensland Government Arts Queensland and the Smithsonian Cooper-Hewitt National Design Museum, on June 29, 2012. Design Minds toolkits are practical guides, underpinned by a combination of one to three of the Design Minds model phases of ‘Inquire’, ‘Ideate’ and ‘Implement’ (supported by at each stage with structured reflection), to enhance existing school curriculum and empower students with real life design exercises, within the classroom environment. Toolkits directly identify links to Naplan, National Curriculum, C2C and Professional Standards benchmarks, as well as the student capabilities of successful and creative 21st century citizens they seek to engender through design thinking. Inspired by ideas from a design project for second year Interior Design students at QUT School of Design, this toolkit explores, through five distinct exercises, different design tools and ways to approach the future design of environments (bathrooms) to facilitate the daily washing ritual, while addressing diverse and changing social, cultural, technological and environmental challenges. The Design Minds Refresh Toolkit particularly aims to promote ‘Lateral Thinking’ attitudes and empathy as an approach to create unusual and sustainable solutions to future problems that may affect our daily behavioural routines, and the spaces that facilitate them. More generally, it aims to facilitate awareness in young people, of the role of design in society and the value of design thinking skills in generating strategies to solve basic to complex systemic challenges, as well as to inspire post-secondary pathways and idea generation for education. The toolkit encourages students and teachers to develop sketching, making, communication, presentation and collaboration skills to improve their design process, as well as explore further inquiry (background research) to enhance the ideation exercises. Exercise 1 focuses on the ‘Inquire’ and ‘Ideate’ phases, Exercise 2 and 3 build on ideation skills, and Exercise 4 and 5 concentrate on the ‘Implement’ phase. Depending on the intensity of the focus, the unit of work could be developed over a 4-5 week program (approximately 10-12 x 60 minute lessons/workshops) or as smaller workshops treated as discrete learning experiences. The toolkit is available for public download from http://designminds.org.au/refresh/ on the Design Minds website. Exercise 2 (Other People’s Shoes) and Exercise 3 (The Future Bathroom) of the toolkit were used as content for the inaugural Design Minds Professional Development Workshop on June 28, 2012 to pre-launch the website to Queensland teachers.

Design Minds The Big Picture Toolkit

The Design Minds The Big Picture Toolkit was one of six K7-12 secondary school design toolkits commissioned by the State Library of Queensland (SLQ) Asia Pacific Design Library (APDL), to facilitate the delivery of the Stage 1 launch of its Design Minds online platform (www.designminds.org.au) partnership initiative with Queensland Government Arts Queensland and the Smithsonian Cooper-Hewitt National Design Museum, on June 29, 2012. Design Minds toolkits are practical guides, underpinned by a combination of one to three of the Design Minds model phases of ‘Inquire’, ‘Ideate’ and ‘Implement’ (supported by at each stage with structured reflection), to enhance existing school curriculum and empower students with real life design exercises, within the classroom environment. Toolkits directly identify links to Naplan, National Curriculum, C2C and Professional Standards benchmarks, as well as the student capabilities of successful and creative 21st century citizens they seek to engender through design thinking. Inspired by the Unlimited: Designing for the Asia Pacific Generation Workshop 2010 (http://eprints.qut.edu.au/47762/), this toolkit explores, through three distinct exercises, ‘design for the other 90%’, addressing tools and approaches to diverse and changing social, cultural, technological and environmental challenges. The Design Minds The Big Picture Toolkit challenges students to be active agents for change and to think creatively and optimistically about solutions to future global issues that deliver social, economic and environmental benefits. More generally, it aims to facilitate awareness in young people, of the role of design in society and the value of design thinking skills in generating strategies to solve basic to complex systemic challenges, as well as to inspire post-secondary pathways and idea generation for education. The toolkit encourages students and teachers to develop sketching, making, communication, presentation and collaboration skills to improve their design process, as well as explore further inquiry (background research) to enhance the ideation exercises. Exercise 1 focuses on the ‘Inquire’ phase, Exercise 2 the ‘Inquire’ and ‘Ideate’ phases, and Exercise 3 concentrates on the ‘Implement’ phase. Depending on the intensity of the focus, the unit of work could be developed over a 4-5 week program (approximately 4-6 x 60 minute lessons/workshops) or as smaller workshops treated as discrete learning experiences. The toolkit is available for public download from http://designminds.org.au/the-big-picture/ on the Design Minds website.

Design Minds Tomorrow's Classroom Toolkit

The Design Minds Tomorrow’s Classroom Toolkit was one of six K7-12 secondary school design toolkits commissioned by the State Library of Queensland (SLQ) Asia Pacific Design Library (APDL), to facilitate the delivery of the Stage 1 launch of its Design Minds online platform (www.designminds.org.au) partnership initiative with Queensland Government Arts Queensland and the Smithsonian Cooper-Hewitt National Design Museum, on June 29, 2012. Design Minds toolkits are practical guides, underpinned by a combination of one to three of the Design Minds model phases of ‘Inquire’, ‘Ideate’ and ‘Implement’ (supported by at each stage with structured reflection), to enhance existing school curriculum and empower students with real life design exercises, within the classroom environment. Toolkits directly identify links to Naplan, National Curriculum, C2C and Professional Standards benchmarks, as well as the student capabilities of successful and creative 21st century citizens they seek to engender through design thinking. This toolkit explores, through four distinct exercises, different design tools and ways to approach the future design of environments (classrooms/schools) to facilitate the Reggio Emilia philosophy of learning, while addressing diverse and changing social, cultural, technological and environmental challenges. The Design Minds Tomorrow’s Classroom Toolkit encourages students to explore architecture and interior design, and to think about their (life-long) learning as a product of inspiring interactions with people and the environments around them, and that their potential role in contributing to both delightful and functional design solutions requires a deep understanding of the user experience. More generally, it aims to facilitate awareness in young people, of the role of design in society and the value of design thinking skills in generating strategies to solve basic to complex systemic challenges, as well as to inspire post-secondary pathways and idea generation for education. The toolkit encourages students and teachers to develop sketching, making, communication, presentation and collaboration skills to improve their design process, as well as explore further inquiry (background research) to enhance the ideation exercises. Exercise 1 focuses on the ‘Inquire’ and ‘Ideate’ phases, Exercise 2 on the ‘Inquire’, Exercise 3 builds on ideation skills, and Exercise 4 concentrates on the ‘Implement’ phase. Depending on the intensity of the focus, the unit of work could be developed over a 2-5 week program (approximately 4-10 x 60 minute lessons/workshops) or as smaller workshops treated as discrete learning experiences. The toolkit is available for public download from http://designminds.org.au/tomorrows-classroom/ on the Design Minds website. This toolkit inspired the authorship and facilitation of a 2-day design workshop entitled Learning Environment 2050 at John Paul College, Daisy Hill, Brisbane on the 15-16 August 2013. 120 Grade 7 students and their teachers, under the mentorship of two design academics, 3 QUT design students and a professional architect, as part of a QUT School of Design Project Week community engagement activity, explored the formulation of a participatory design brief for the redesign of the school’s Wesley Precinct (including classrooms, a sustainable farm and recreation areas).

Developing learning cohorts for postgraduate research degrees

Development of researchers through higher degree research studies is a high priority in most universities. Yet, research about supervision as pedagogy and models of supervision is only recently gained increasing attention. Charged with producing good researchers within very limited resources, academics are constantly looking for more efficient models of supervision for higher degree research students. A cohort model of supervision promises several efficiencies, but we argue that its success lies importantly on how well the cohort is developed specifically for higher degree research studies. We drew on a growing body of literature on higher degree research supervision to design, implement and evaluate our approach to developing a cohort of seven students enrolled in the Master of Education (Research) degree. Our approach included four provisions: initial residential workshop, development of a learning community, nourishing scholarship, and ongoing learning opportunities. The four provisions resulted in gradually developing an environment and culture that students found very supportive and nurturing. This paper is based on the findings from data collected from student evaluations in the first year of studies, feedback from the cohort’s sponsor, and our reflective notes. The evaluation substantiated the value in investing time and resources for purposely developing a cohort for higher degree research studies. Whether the cohorts are sponsored or not, universities will still need to invest time and resources for cohort development if a cohort model is intended to gain wider efficiencies in supervision of higher degree research students.

Turning points in narratives of research design : research innovation stimulating unique responses to existing challenges for beginning rural teachers

This paper explores methodological turning points in researching narratives of early career resilience mediated by the complexities of remote teaching. Innovative, flexible and discursive research design facilitated exploration of emerging narratives using digital technologies. Data were regularly interrogated with participant-researchers to reveal the undercurrents of imbued meaning. Dialogue with participant-researchers enhanced interpretations of data plots and text-based explanations of narrative turning points, providing valuable insights throughout analysis. Reflections on the affordances and tensions in this process illustrate the significance of innovation but also the complexities associated with online collaboration. Consequently, empowering the participant-researchers throughout the life of the research was critical in understanding their narratives of teaching.