Does the summative assessment of real world learning using criterion-referenced assessment need to be discipline specific?

This paper synthesises the existing literature on the contemporary conception of ‘real world’ and compares it with similar notions such as ‘authentic’ and ‘work integrated learning’. While the term ‘real world’ may be partly dependent on the discipline, it does not necessarily follow that the criterion-referenced assessment of ‘real world’ assessment must involve criteria and performance descriptors that are discipline specific. Two examples of summative assessment (court report and trial process exercise) from a final year core subject at the Queensland University of Technology, LWB432 Evidence, emphasise real world learning, are authentic, innovative and better prepare students for the transition into the workplace than more generic forms of assessment such as tutorial participation or oral presentations. The court report requires students to attend a criminal trial in a Queensland Court and complete a two page report on what they saw in practice compared with what they learned in the classroom. The trial process exercise is a 50 minute written closed book activity conducted in tutorials, where students plan questions that they would ask their witness in examination-in-chief, plan questions that they would ask their opponent’s witness in cross-examination, plan questions that they would ask in reexamination given what their opponent asked in cross-examination, and prepare written objections to their opponent’s questions. The trial process exercise simulates the real world, whereas the court report involves observing the real world, and both assessment items are important to the role of counsel. The design of the criterion-referenced assessment rubrics for the court report and trial process exercise is justified by the literature. Notably, the criteria and performance descriptors are not necessarily law specific and this paper highlights the parts that may be easily transferred to other disciplines.

Work integrated learning for design : a scholarship of integration

Within an action research framework, this paper describes the conceptual basis for developing a crossdisciplinary pedagogical model of higher education/industry engagement for the built environment design disciplines including architecture, interior design, industrial design and landscape architecture. Aiming to holistically acknowledge and capitalize on the work environment as a place of authentic learning, problems arising in practice are understood as the impetus, focus and ‘space’ for a process of inquiry and discovery that, in the spirit of Boyer’s ‘Scholarship of Integration’, provides for generic as well as discipline-specific learning.

So what do Design students really think? Exploring perceptions of Learning Landscapes

This paper investigates learning environments from the view of the key users - students. Recent literature on designing Learning Landscapes indicates a near absence of the student voice, assuming that the majority of students are either uninterested or unable to express what they want or need, in a learning environment. The focus of this research is to reveal Architecture and Fashion Design students’ perceptions of their learning environments. Furthermore, this study questions the appropriateness of usual design of learning spaces for Design students, or if the environment needs to be specifically catered for the learning of different disciplines of Design, such as Architecture and Fashion Design. Senior Architecture and Fashion Design students were invited to participate in a qualitative mixed method study, including investigation into existing literature, questionnaires, focus groups and spontaneous participatory research. Through the analysis of data it was found that students’ perceptions validate discipline specific learning environments and contribute towards the development of a framework for the design of future Learning Landscapes, for Design education.

Psycho-educational assessment of specific learning disabilities: Views and practices of Australian psychologists and guidance counsellors

This paper reports an investigation of the views and practices of 203 Australian psychologists and guidance counsellors with respect to psycho-educational assessment of students with Specific Learning Disabilities (SLDs). Results from an online survey indicated that practitioners draw upon a wide-range of theoretical perspectives when conceptualising and identifying SLDs, including both response to intervention and IQ – achievement discrepancy models. Intelligence tests (particularly the Wechsler scales) are commonly employed, with the main stated reasons for their use being ‘traditional’ perspectives (including IQ-achievement discrepancy-based definitions of SLDs), to exclude a diagnosis of intellectual disability, and to guide further assessment and intervention. In contrast participants reported using measures of academic achievement and tests of specific cognitive deficits known to predict SLDs (e.g., phonological awareness) relatively infrequently.

Scoping work integrated learning purposes, practices and issues

A range of terms is used in Australian higher education institutions to describe learning approaches and teaching models that provide students with opportunities to engage in learning connected to the world of work. The umbrella term currently being used widely is Work Integrated Learning (WIL). The common aim of approaches captured under the term WIL is to integrate discipline specific knowledge learnt in university setting with that learnt in the practice of work through purposefully designed curriculum. In endeavours to extend WIL opportunities for students, universities are currently exploring authentic learning experiences, both within and outside of university settings. Some universities describe these approaches as ‘real world learning’ or ‘professional learning’. Others refer to ‘social engagement’ with the community and focus on building social capital and citizenship through curriculum design that enables students to engage with the professions through a range of learning experiences. This chapter discusses the context for, the scope, purposes, characteristics and effectiveness of WIL across Australian universities as derived from a national scoping study. This study, undertaken in response to a high level of interest in WIL, involved data collection from academic and professional staff, and students at nearly all Australian universities. Participants in the study consistently reported the benefits, especially in relation to the student learning experience. Responses highlight the importance of strong partnerships between stakeholders to facilitate effective learning outcomes and a range of issues that shape the quality of approaches and models being adopted, in promoting professional learning.

Intercultural usability of language learning websites

Website usability can be defined as the ease of use of websites. General usability, pedagogical usability, technical usability and intercultural usability can be considered and examined for the understanding of the usability of language learning websites, which requires a discipline-specific approach. In the field of computer-assisted language learning, usability issues have been addressed mainly in terms of evaluation criteria and have been commonly discussed in relation to user expectations and user experiences. In spite of a growing interest in intercultural language learning, however, little research on intercultural usability of language learning websites has been published yet. There is a need to answer the question of how language learning websites integrate the target language and culture for the development of intercultural sensitivity and competence. This article explores intercultural aspects of language learning websites and presents usability guidelines for designing intercultural language learning websites.

Changing relationships : Re-activating student and staff engagement in the design studio learning environment

QUT Teaching and Learning Support Services 'Revisiting University Teaching’program for mid-career academics. 'Innovations in Teaching at QUT' presentations. Presentations were part of a 2 day program that provides opportunities for experienced academic staff with responsibilities for teaching to review their current teaching practices and explore innovations in teaching that will assist them to enhance student learning and develop their own scholarship of teaching. The presenter responded to the following: 1.What is the innovation you have incorporated into your teaching? - give a brief overview/ description/ demonstration of the innovation 2.What challenges/issues prompted you to make changes in your approach? Were they discipline specific? Operational? Opportunistic? 3.What factors did you need to consider in implementing these changes? Which factors enabled success or hindered? 4.What has this innovation achieved so far? How have learners responded? How have the broader teaching team and academic staff from other units in your course responded? 5.How could this innovation be used by other academics in their teaching? What do you see as the possibilities for further expansion of this innovation? (NB. This question could be answered as part of a final sharing of group discussion). Presenter: Shannon Satherley

Enhancing student learning in the workplace through developing the leadership capabilities of clinical supervisors in the nursing discipline

The purpose of this project was to build the leadership capacity of clinical supervisors in the nursing discipline by developing, implementing and systematically embedding a leadership model into the structure and practice of student supervision. The University worked in partnership with three major metropolitan hospitals in Queensland to develop a framework and professional development program incorporating leadership and clinical supervision. The Leadership and Clinical Education (LaCE) program consisted of two structured workshops complemented by individual personal development projects undertaken by participants. Participants were supported in these activities with a purpose-built website that provides access to a wide variety of information and other learning resources. Quantitative and qualitative evaluations indicated that the approach was highly valued by participants, as it promoted useful peer dialogue, sharing of experiences and personal development in relation to assisting leadership development and student learning in the workplace. The LaCE program provides an ideal springboard for introducing the development of welltrained leaders into the clinical workplace. The resources developed have the potential to provide ongoing support for clinical supervisors to improve the learning of undergraduate nursing student. The challenge will be to achieve continued innovation within clinical education through sustainable leadership programs.

Standards that we can 'own' : Threshold Learning Outcomes for Journalism, Public Relations, and Media & Communication Studies

This paper outlines the progress by the JoMeC (Journalism, Media & Communication) Network in developing TLO (Threshold Learning Outcome) statements for Bachelor-level university programs in the disciplines of Journalism, Public Relations and Media & Communications Studies. The paper presents the finalised TLO statement for Journalism, and outlines moves to engage discipline-based groups to further develop preliminary TLOs for Public Relations and Media & Communication Studies. The JoMeC Network was formed in 2011, in response to requirements that from 2014 all degrees and qualifications at Australian universities would be able to demonstrate that they comply with the threshold learning standards set by the Australian Qualifications Framework (AQF). The AQF’s threshold standards define the minimum types and levels of knowledge, skills and capabilities that a student must demonstrate in order to graduate. The Tertiary Education Quality and Standards Agency (TEQSA) will use the AQF’s threshold standards as a key tool in recording and assessing the performance of higher educational institutions, and determining whether they should be registered as Australian Higher Education Providers under the Higher Education Standards Framework. The Office of Learning & Teaching (OLT) places the onus on discipline communities to collaborate in order to develop and ‘own’ the threshold learning standards that can be considered the minimum learning outcomes of university-level programs in that field. With the support of an OLT Grant, the JoMeC Network’s prime goal has been to develop three sets of discipline-specific TLOs – one each for the Journalism, Public Relations, and Media & Communications Studies disciplines. This paper describes the processes of research, consultation, drafting and ongoing revision of the TLO for Journalism. It outlines the processes that the JoMeC Network has taken in developing a preliminary TLO draft to initiate discussion of Public Relations and Media & Communication Studies. The JoMeC Network plans to hand management of further development of these TLOs to scholars within the discipline who will engage with academics and other stakeholders to develop statements that the respective disciplines can embrace and ‘own’.

Sustainable Pedagogical Change for Embedding Reflective Learning Across Higher Education Programs

For pedagogical change to be sustained over time, and over the span of higher education courses, it needs to be framed widely, rather than ‘tacked on’. The framing includes curriculum reform and resource provision alongside staff pedagogical development. This is especially true for initiatives (such as reflective writing and assessment) that target broad-based, high-level skills and dispositions. For various reasons, such initiatives can easily become lost because of the discipline-specific focus of a syllabus outweighs the initiative, or because lack of resources compromises a desired approach. Course improvement in higher education contexts is typically difficult and episodic. In such circumstances, we argue that a strategic and trustworthy approach is necessary where practitioner-lead pedagogic development is fostered through trust and communication and is purposefully embedded within key dimensions of curriculum integration and resource provision. This chapter describes an approach to pedagogical change where curriculum, pedagogy and resources are simultaneously and collaboratively orchestrated to provide an effective framework for sustainable and effective change. A robust conceptual model is proposed to guide the implementation of such change.

Rethinking the notion of culture in the national history curriculum

Major global changes are placing new demands on the Australian education system. Recent statements by the Prime Minister, together with current education policy and national curriculum documents available in the public domain, look to education’s role in promoting economic prosperity and social cohesion. Collectively, they emphasise the need to equip young Australians with the knowledge, understandings and skills required to compete in the global economy and participate as engaged citizens in a culturally diverse world. However, the decision to prioritise discipline-based learning in the forthcoming Australian history curriculum without specifically encompassing culture as a referent, raises the following question. How will students acquire the cultural knowledge, understandings and skills necessary for this process? This paper addresses this question by situating the current push for a national history curriculum, with specific reference to the study of Indigenous history and the study of Asia in Australia.

The ability of economic thinking : the “nature” versus “nurture” debate

In their studies, Eley and Meyer (2004) and Meyer and Cleary (1998) found that there are sources of variation in the affective and process dimensions of learning in mathematics and clinical diagnosis specific to each of these disciplines. Meyer and Shanahan (2002) argue that: General purpose models of student learning that are transportable across different discipline contexts cannot, by definition, be sensitive to sources of variation that may be subject-specific (2002. p. 204). In other words, to explain the differences in learning approaches and outcomes in a particular discipline, there are discipline-specific factors, which cannot be uncovered in general educational research. Meyer and Shanahan (2002) argue for a need to "seek additional sources of variation that are perhaps conceptually unique ... within the discourse of particular disciplines" (p. 204). In this paper, the development of an economics-specific construct (called economic thinking ability) is reported. The construct aims to measure discipline-sited ability of students that has important influence on learning in economics. Using this construct, economic thinking abilities of introductory and intermediate level economics students were measured prior to the commencement, and at the end, of their study over one semester. This enabled factors associated with students' pre-course economic thinking ability and their development in economic thinking ability to be investigated. The empirical findings will address the 'nature' versus 'nurture' debate in economics education (Frank, et aI., 1993; Frey et al., 1993; Haucap and Tobias 2003). The implications for future research in economics education will also be discussed.

Digital design communication : measuring learner technological prowess and self-efficacy in problem resolution

Currently the Bachelor of Design is the generic degree offered to the four disciplines of Architecture, Landscape Architecture, Industrial Design, and Interior Design within the School of Design at the Queensland University of Technology. Regardless of discipline, Digital Communication is a core unit taken by the 600 first year students entering the Bachelor of Design degree. Within the design disciplines the communication of the designer's intentions is achieved primarily through the use of graphic images, with written information being considered as supportive or secondary. As such, Digital Communication attempts to educate learners in the fundamentals of this graphic design communication, using a generic digital or software tool. Past iterations of the unit have not acknowledged the subtle difference in design communication of the different design disciplines involved, and has used a single generic software tool. Following a review of the unit in 2008, it was decided that a single generic software tool was no longer entirely sufficient. This decision was based on the recognition that there was an increasing emergence of discipline specific digital tools, and an expressed student desire and apparent aptitude to learn these discipline specific tools. As a result the unit was reconstructed in 2009 to offer both discipline specific and generic software instruction, if elected by the student. This paper, apart from offering the general context and pedagogy of the existing and restructured units, will more importantly offer research data that validates the changes made to the unit. Most significant of this new data is the results of surveys that authenticate actual student aptitude versus desire in learning discipline specific tools. This is done through an exposure of student self efficacy in problem resolution and technological prowess - generally and specifically within the unit. More traditional means of validation is also presented that includes the results of the generic university-wide Learning Experience Survey of the unit, as well as a comparison between the assessment results of the restructured unit versus the previous year.