Exploring the conditions to support assessment for more equitable learning outcomes

NAPLAN RESULTS HAVE gained socio-political prominence and have been used as indicators of educational outcomes for all students, including Indigenous students. Despite the promise of open and in-depth access to NAPLAN data as a vehicle for intervention, we argue that the use of NAPLAN data as a basis for teachers and schools to reduce variance in learning outcomes is insufficient. NAPLAN tests are designed to show statistical variance at the level of the school and the individual, yet do not factor in the sociocultural and cognitive conditions Indigenous students’ experience when taking the tests. We contend that further understanding of these influences may help teachers understand how to develop their classroom practices to secure better numeracy and literacy outcomes for all students. Empirical research findings demonstrate how teachers can develop their classroom practices from an understanding of the extraneous cognitive load imposed by test taking. We have analysed Indigenous students’ experience of solving mathematical test problems to discover evidence of extraneous cognitive load. We have also explored conditions that are more supportive of learning derived from a classroom intervention which provides an alternative way to both assess and build learning for Indigenous students. We conclude that conditions to support assessment for more equitable learning outcomes require a reduction in cognitive load for Indigenous students while maintaining a high level of expectation and participation in problem solving.

Learning in and out of university : Aboriginal and Torres Strait Islander students’ conceptions and strategies used to learn

Research suggests that students’ approaches to learning and learning outcomes are closely related to their conceptions of learning. This paper describes a phenomenographically inspired investigation into conceptions of formal learning held by 22 Aboriginal and Torres Strait Islander students from three Australian universities in Queensland; experiences of informal learning, reasons for studying and strategies used to learn were also investigated. The attrition rate for these students in tertiary education is higher than that of any other group of students. It was hoped that information gained may delineate factors that contribute to high attrition rates and therefore inform courses of action that may lead to improved teaching and learning practices for these students. Additionally, success in tertiary education for Aboriginal and Torres Strait Islander students may increase their involvement in mainstream society. Results showed that they view and approach university learning in much the same way as other university students. It was also apparent that, generally, the strategies these students used did not match the conceptions of learning they held. An interesting result was the difference between the conceptions of formal learning and explanations of informal learning

Scaffolding multimodal literacies: Learning in and out of the classroom

This chapter presents data produced by a research project that looked at pedagogy for print and digital literacies in a high poverty, high diversity primary school. The student population included refugee, immigrant and Aboriginal and Torres Strait Islander young people. In an environment in which schools, such as the study site, are under pressure to narrow the curriculum to ‘the basics’, the project sought to support teachers as they worked to create a rich curriculum for all students. The chapter will focus on pedagogy in an after-school media club. The aim of the club, which ran weekly for several years, was to build students’ media literacy skills. The data suggest that established ways of scaffolding linguistic texts cannot be simply transferred to multimodal text production. The chapter will also address implications from the research outcomes for other teachers working with At Risk EAL students.

Valuable learning, unwelcome assessment : what LLB and JD students really think about group work

This article contributes to current debates about the appropriate role of group work in legal curricula by providing insights into the attitudes of Bachelor of Laws (‘LLB’) and Juris Doctor (‘JD’) students towards such tasks. It begins by reviewing arguments for incorporating group work in legal education, both as a result of the recognition of its educational benefits, and as a response to increasing regulatory expectations regarding student collaboration skills. The article then reports the findings of a UNSW Law School Student Assessment Survey designed to determine how law students perceive group work and its assessment in law. One of the most striking findings is that many of the law students surveyed recognise and appreciate the learning and skills development benefits of group tasks, but are resistant to summative assessment of group work. Moreover, there are marked differences in attitude between LLB and JD students, and across year cohorts within those degrees. These findings suggest that further thought needs to be directed towards the specific purposes underpinning the choice of group work as a pedagogical tool, and assessment that is congruent with those purposes, taking into account the varying needs and experiences of different cohorts of students. The article concludes by considering whether meaningful group work can exist without summative assessment.

Co-creating stories in social learning systems : The role of community media and cultural organisations in disseminating knowledge

This paper investigates how community based media organisations are co-creative storytelling institutions, and how they learn to disseminate knowledge in a social learning system. Organisations involved in story co-creation are learning to create in fluid environments.They are project based, with a constant turnover of volunteers or staff. These organisations have to meet the needs of their funding bodies and their communities to remain sustainable. Learning is seen as dialogical, and this is also reflected in the nature of storytelling itself. These organisations must learn to meet the needs of their communities, who in turn learn from the organisation’s expertise in a facilitated setting. This learning is participatory and collaborative, and is often a mix of virtual and offline interaction. Such community-based organisations sit in the realm of a hybrid-learning environment; they are neither a formal educational institution like a college, nor do their volunteers produce outcomes in a professional capacity. Yet, they must maintain a certain level of quality outcomes from their contributors to be of continued value in their communities. Drawing from a larger research study, one particular example is that of the CitizenJ project. CitizenJ is hosted by a state cultural centre, and partnered with publishing partners in the community broadcasting sector. This paper explores how this project is a Community of Practice, and how it promotes ethical and best practice, meets contributors’ needs, emphasises the importance of facilitation in achieving quality outcomes, and the creation of projects for wider community and public interest.

“Success in (Surviving) Bioscience and Pharmacology” – an eBook to improve the retention of diploma nurses transitioning to a Bachelor of Nursing course

Diploma students transitioning into the NS40 BNursing (BN) course at QUT withdraw from the bioscience and pharmacology units, and leave the university at higher rates than traditional students. The diploma students, entering in second year, have missed out on 2 units of bioscience taught to the traditional students in their first year, and miss out on a 3rd unit of bioscience taught to the traditional students in their 2nd year. Instead the diploma students receive one specialized unit in bioscience only i.e. a bridging unit. As a consequence, the diploma students may not have the depth of bioscience knowledge to be able to successfully study the bridging unit (LSB111) or the pharmacology unit (LSB384). Our plan was to write an eBook which refreshed and reinforced diploma students’ knowledge of bioscience aiming to prepare them with the concepts and terminology, and to build a level of confidence to support their transition to the BN. We have previously developed an intervention associated with reduced attrition of diploma nursing students, and this was our starting point. The study skills part of the initial intervention was addressed in the eBook, by links to the specialist services and resources available from our liaison librarian and academic skills adviser. The introductory bioscience/pharmacology information provided by the previous intervention involved material from standard textbooks. However, we considered this material too difficult for diploma students. Thus, we created simplified diagrams to go with text as part of our eBook. The outcome is an eBook, created and made available to the diploma students via the Community Website: “Surviving Bioscience and Pharmacology”. Using simplified diagrams to illustrate the concise text, definition to explain the concepts, the focus has been on encouraging self-awareness and help-seeking strategies and building students who take responsibility for their learning. All the nursing students in the second semester LSB384 Pharmacology Unit have been surveyed face-to-face to get feedback on their engagement with the eBook resource. The data has not been analysed to date. An important consideration is that the website be evaluated by the diploma students as they come into bioscience in first semester (LSB111), the student population for whom the eBook is primarily intended. To get a good response rate we need to do a face-to-face survey. However, we have not been able to do this, as the co-ordinator of the unit has changed since we started the project, and the present co-ordinator will not allow us access to these students.

Designing rich information experiences to shape learning outcomes

Students in higher education typically learn to use information as part of their course of study, which is intended to support ongoing academic, personal and professional growth. Informing the development of effective information literacy education, this research uses a phenomenographic approach to investigate the experiences of a teacher and students engaged in lessons focused on exploring language and gender topics by tracing and analyzing their evolution through scholarly discourse. The findings suggest that the way learners use information influences content-focused learning outcomes, and reveal how teachers may enact lessons that enable students to learn to use information in ways that foster a specific understanding of the topic they are investigating.

Journalism, media & communication network: Final report 2015

The JoMeC Network project had three key objectives. These were to: 1. Benchmark the pedagogical elements of journalism, media and communication (JoMeC) programs at Australian universities in order to develop a set of minimum academic standards, to be known as Threshold Learning Outcomes (TLOs), which would applicable to the disciplines of Journalism, Communication and/or Media Studies, and Public Relations; 2. Build a learning and teaching network of scholars across the JoMeC disciplines to support collaboration, develop leadership potential among educators, and progress shared priorities; 3. Create an online resources hub to support learning and teaching excellence and foster leadership in learning and teaching in the JoMeC disciplines. In order to benchmark the pedagogical elements of the JoMeC disciplines, the project started with a comprehensive review of the disciplinary settings of journalism, media and communication-related programs within Higher Education in Australia plus an analysis of capstone units (or subjects) offered in JoMeC-related degrees. This audit revealed a diversity of degree titles, disciplinary foci, projected career outcomes and pedagogical styles in the 36 universities that offered JoMeC-related degrees in 2012, highlighting the difficulties of classifying the JoMeC disciplines collectively or singularly. Instead of attempting to map all disciplines related to journalism, media and communication, the project team opted to create generalised TLOs for these fields, coupled with detailed TLOs for bachelor-level qualifications in three selected JoMeC disciplines: Journalism, Communication and/or Media Studies, and Public Relations. The initial review’s outcomes shaped the methodology that was used to develop the TLOs. Given the complexity of the JoMeC disciplines and the diversity of degrees across the network, the project team deployed an issue-framing process to create TLO statements. This involved several phases, including discussions with an issue-framing team (an advisory group of representatives from different disciplinary areas); research into accreditation requirements and industry-produced materials about employment expectations; evaluation of learning outcomes from universities across Australia; reviews of scholarly literature; as well as input from disciplinary leaders in a variety of forms. Draft TLOs were refined after further consultation with industry stakeholders and the academic community via email, telephone interviews, and meetings and public forums at conferences. This process was used to create a set of common TLOs for JoMeC disciplines in general and extended TLO statements for the specific disciplines of Journalism and Public Relations. A TLO statement for Communication and/or Media Studies remains in draft form. The Australian and New Zealand Communication Association (ANZCA) and Journalism Education and Research Association of Australian (JERAA) have agreed to host meetings to review, revise and further develop the TLOs. The aim is to support the JoMeC Network’s sustainability and the TLOs’ future development and use.

The relationship between clinical outcomes and quality of life for residents of aged care facilities

Objectives It is widely assumed improving care in residential facilities will improve quality of life (QoL), but little research has explored this relationship. The Clinical Care Indicators (CCI) Tool was developed to fill an existing gap in quality assessment within Australian residential aged care facilities and it was used to explore potential links between clinical outcomes and QoL. Design and Setting Clinical outcome and QoL data were collected within four residential facilities from the same aged care provider. Subjects Subjects were 82 residents of four facilities. Outcome Measures Clinical outcomes were measured using the CCI Tool and QoL data was obtained using the Australian WHOQOL‑100. Results Independent t‑test analyses were calculated to compare individual CCIs with each domain of the WHOQOL‑100, while Pearson’s product moment coefficients (r) were calculated between the total number of problem indicators and QoL scores. Significant results suggested poorer clinical outcomes adversely affected QoL. Social and spiritual QoL were particularly affected by clinical outcomes and poorer status in hydration, falls and depression were most strongly associated with lower QoL scores. Poorer clinical status as a whole was also significantly correlated with poorer QoL. Conclusions Hydration, falls and depression were most often associated with poorer resident QoL and as such appear to be key areas for clinical management in residential aged care. However, poor clinical outcomes overall also adversely affected QoL, which suggests maintaining optimum clinical status through high quality nursing care, would not only be important for resident health but also for enhancing general life quality.

A model of teacher professional development based on the principles of lesson study

The researcher’s professional role as an Education Officer was the impetus for this study. Designing and implementing professional development activities is a significant component of the researcher’s position description and as a result of reflection and feedback from participants and colleagues, the creation of a more effective model of professional development became the focus for this study. Few studies have examined all three links between the purposes of professional development that is, increasing teacher knowledge, improving teacher practice, and improving student outcomes. This study is significant in that it investigates the nature of the growth of teachers who participated in a model of professional development which was based upon the principles of Lesson Study. The research provides qualitative and empirical data to establish some links between teacher knowledge, teacher practice, and student learning outcomes. Teacher knowledge in this study refers to mathematics content knowledge as well as pedagogical-content knowledge. The outcomes for students include achievement outcomes, attitudinal outcomes, and behavioural outcomes. As the study was conducted at one school-site, existence proof research was the focus of the methodology and data collection. Developing over the 2007 school year, with five teacher-participants and approximately 160 students from Year Levels 6 to 9, the Lesson Study-principled model of professional development provided the teacher-participants with on-site, on-going, and reflective learning based on their classroom environment. The focus area for the professional development was strategising the engagement with and solution of worded mathematics problems. A design experiment was used to develop the professional development as an intervention of prevailing teacher practice for which data were collected prior to and after the period of intervention. A model of teacher change was developed as an underpinning framework for the development of the study, and was useful in making decisions about data collection and analyses. Data sources consisted of questionnaires, pre-tests and post-tests, interviews, and researcher observations and field notes. The data clearly showed that: content knowledge and pedagogical-content knowledge were increased among the teacher-participants; teacher practice changed in a positive manner; and that a majority of students demonstrated improved learning outcomes. The positive changes to teacher practice are described in this study as the demonstrated use of mixed pedagogical practices rather than a polarisation to either traditional pedagogical practices or contemporary pedagogical practices. The improvement in student learning outcomes was most significant as improved achievement outcomes as indicated by the comparison of pre-test and post-test scores. The effectiveness of the Lesson Study-principled model of professional development used in this study was evaluated using Guskey’s (2005) Five Levels of Professional Development Evaluation.

Learning approach and perception of learning context in economics education : a causality test

In the study of student learning literature, the traditional view holds that when students are faced with heavy workload, poor teaching, and content that they cannot relate to – important aspects of the learning context, they will more likely utilise the surface approach to learning due to stresses, lack of understanding and lack of perceived relevance of the content (Kreber, 2003; Lizzio, Wilson, & Simons, 2002; Ramdsen, 1989; Ramsden, 1992; Trigwell & Prosser, 1991; Vermunt, 2005). For example, in studies involving health and medical sciences students, courses that utilised student-centred, problem-based approaches to teaching and learning were found to elicit a deeper approach to learning than the teacher-centred, transmissive approach (Patel, Groen, & Norman, 1991; Sadlo & Richardson, 2003). It is generally accepted that the line of causation runs from the learning context (or rather students’ self reported data on the learning context) to students’ learning approaches. That is, it is the learning context as revealed by students’ self-reported data that elicit the associated learning behaviour. However, other research studies also found that the same teaching and learning environment can be perceived differently by different students. In a study of students’ perceptions of assessment requirements, Sambell and McDowell (1998) found that students “are active in the reconstruction of the messages and meanings of assessment” (p. 391), and their interpretations are greatly influenced by their past experiences and motivations. In a qualitative study of Hong Kong tertiary students, Kember (2004) found that students using the surface learning approach reported heavier workload than students using the deep learning approach. According to Kember if students learn by extracting meanings from the content and making connections, they will more likely see the higher order intentions embodied in the content and the high cognitive abilities being assessed. On the other hand, if they rote-learn for the graded task, they fail to see the hierarchical relationship in the content and to connect the information. These rote-learners will tend to see the assessment as requiring memorising and regurgitation of a large amount of unconnected knowledge, which explains why they experience a high workload. Kember (2004) thus postulate that it is the learning approach that influences how students perceive workload. Campbell and her colleagues made a similar observation in their interview study of secondary students’ perceptions of teaching in the same classroom (Campbell et al., 2001). The above discussions suggest that students’ learning approaches can influence their perceptions of assessment demands and other aspects of the learning context such as relevance of content and teaching effectiveness. In other words, perceptions of elements in the teaching and learning context are endogenously determined. This study attempted to investigate the causal relationships at the individual level between learning approaches and perceptions of the learning context in economics education. In this study, students’ learning approaches and their perceptions of the learning context were measured. The elements of the learning context investigated include: teaching effectiveness, workload and content. The authors are aware of existence of other elements of the learning context, such as generic skills, goal clarity and career preparation. These aspects, however, were not within the scope of this present study and were therefore not investigated.