Aligning assessment with long‐term learning

Assessment in higher education is commonly held to contribute to feedback to students on their learning and the certification of their achievement. This paper argues that this short‐term focus must be balanced against a longer‐term emphasis for learning‐oriented assessment to foster future learning after graduation. The paper proposes that students need to become assessors within the context of participation in practice, that is, the kinds of highly contextualised learning faced in life and work. It discusses the kinds of practices that are needed to refocus assessment within higher education courses to this end.

Sustainable assessment: rethinking assessment for the learning society

Assessment practices in higher education institutions tend not to equip students well for the processes of effective learning in a learning society. The purposes of assessment should be extended to include the preparation of students for sustainable assessment. Sustainable assessment encompasses the abilities required to undertake those activities that necessarily accompany learning throughout life in formal and informal settings. Characteristics of effective formative assessment identified by recent research are used to illustrate features of sustainable assessment. Assessment acts need both to meet the specific and immediate goals of a course as well as establishing a basis for students to undertake their own assessment activities in the future. To draw attention to the importance of this, the idea that assessment always has to do double duty is introduced.

Lecturing and other face-to-face teaching – too much or too little? An assessment based on student feedback and fail rates

Institutes of higher learning are tending to reduce the amount of face-to-face teaching that they offer, and particularly through the traditional pedagogical method of lecturing. There is ongoing debate about the educational value of lectures as a teaching approach, in terms of both whether they facilitate understanding of subject material and whether they augment the student educational experience. In this study, student evaluation of teaching scores plus academic outcome (percentage of students who fail) was assessed for 236 course units offered by a science faculty at an Australian university over the course of one year. These measures were related to the degree to which lectures and other face-to-face teaching were used in these units, controlling for factors such as class size, school and year level. An information-theoretic model selection approach was employed to identify the best models and predictors of student assessments and fail rates. All the top models of student feedback included a measure reflecting amount of face-to-face teaching, with the evaluation of quality of teaching being higher in units with higher proportions of lectures. However, these models explained only 12–20% of the variation in student evaluation scores, suggesting that many other factors come into play. By contrast, units with fewer lectures have lower failure rates. These results suggest that moving away from lectures and face-to-face teaching may not harm, and indeed may improve the number of students who pass the subject, but that this may be incurred at the expense of greater dissatisfaction in students' learning experience.

Evaluation of nurses' perceptions of the impact of targeted depression education and a screening and referral tool in an acute cardiac setting.

AIMS AND OBJECTIVES: The aim of this study was to evaluate nurses' perceptions of an education programme and screening and referral tool designed for cardiac nurses to facilitate depression screening and referral procedures for patients with coronary heart disease. BACKGROUND: There is a high prevalence of depression in patients with coronary heart disease that is often undetected. It is important therefore that nurses working with cardiac patients are equipped with the knowledge and skills to recognise the signs and symptoms of depression and refer appropriately. DESIGN: A qualitative approach with purposive sampling and semi-structural interviews was implemented within the Donabedian 'Structure-Process-Outcome' evaluation framework. METHODS: Semi-structured interviews were conducted with 14 cardiac nurses working in a major metropolitan hospital six weeks post-attending an education programme on depression and coronary heart disease. Thematic data analysis was implemented, specifically adhering to Halcomb and Davidson's (2006) pragmatic data analysis, to examine nurse knowledge and experience of depression assessment and referral in an acute cardiac ward. RESULTS: The key findings of this study were that the education programme: (1) increased the knowledge base of nurses working with cardiac patients on comorbid depression and coronary heart disease, and (2) assisted in the identification of depression and the referral of 'at risk' patients. CONCLUSIONS: Emphasis was placed on the translational significance of educating cardiac nurses about depression via the introduction of a depression screening and referral instrument designed specifically for use in the cardiac ward. As a result, participants found they were better equipped to identify depressive symptoms and, guided by the screening instrument, to confidently instigate referral procedures. RELEVANCE TO CLINICAL PRACTICE: Much complexity lies in caring for cardiac patients with depression, including issues such as misdiagnosis. Targeted education, including use of appropriate instruments, has the potential to facilitate early recognition of the signs and symptoms of depression in the acute cardiac setting.

What is good practice in the development, assessment and evaluation of digital literacy for graduate employability?

This report seeks to identify the features of good practice in the development, assessment and evaluation of digital literacy for graduate employability.

The report forms Stage 2 of a two-stage literature review. The results of the first stage of the review are reported in: Towards an understanding of ‘Digital Literacy(ies)’. The current report draws on some of the same literature to that of the Stage 1 report and covers the same time period – up to the end of 2012. In addition, the current report covers literature that provides discussion and accounts of good practice in digital literacy – particularly practice that is embedded in course curricula.

The literature provides numerous examples of standalone digital literacy practices. While such practices may be effective for some purposes, they may be less effective than course-integrated practices in contributing to graduate employability. However, there are few accounts of course-integrated practices in the literature and fewer still that provide a compelling case for their positive contribution to graduate outcomes. Accordingly, the report identifies eight criteria of good practice in digital literacy for the assurance of graduate learning outcomes. It then identifies types of broad teaching and learning practices that appear to best encompass these criteria and which provide meaningful contexts in which to develop the digital literacy competencies of students.

Stepping out of our comfort zones: pre-service teachers' responses to a critical analysis of gender/power relations in sexuality education

This paper discusses pre-service teachers' responses to a critical analysis of gender/power relations using examples from a final assessment for an intensive elective unit called Teaching Sexuality in the Middle Years. This unit critically examines gender/ power relations, the production of difference, heteronormativity and pleasure and desire, employing a feminist post-structural framework. Despite the focus on critical thinking, reflection and interrogating structural inequalities in this unit some students were resistant or unable to engage with this approach in their assessments, although appearing to do so in workshops. We consider the broad range of sexuality education discourses mobilised by this unit to try to make sense of what looks like resistance but may be something more complex and difficult to negotiate. The paper ends with a consideration of some of the implications of this approach for practice.

A tailored, supportive care intervention using systematic assessment designed for people with inoperable lung cancer: a randomised controlled trial

Objective : People with inoperable lung cancer experience higher levels of distress, more unmet needs and symptoms than other cancer patients. There is an urgent need to test innovative approaches to improve psychosocial and symptom outcomes in this group. This study tested the hypothesis that a tailored, multidisciplinary supportive care programme based on systematic needs assessment would reduce perceived unmet needs and distress and improve quality of life.

Methods : A randomised controlled trial design was used. The tailored intervention comprised two sessions at treatment commencement and completion. Sessions included a self-completed needs assessment, active listening, self-care education and communication of unmet psychosocial and symptom needs to the multidisciplinary team for management and referral. Outcomes were assessed with the Needs Assessment for Advanced Lung Cancer Patients, Hospital Anxiety and Depression Scale, Distress Thermometer and European Organization of Research and Treatment of Cancer Quality of Life Q-C30 V2.0.

Results : One hundred and eight patients with a diagnosis of inoperable lung or pleural cancer (including mesothelioma) were recruited from a specialist facility before the trial closed prematurely (original target 200). None of the primary contrasts of interest were significant (all p > 0.10), although change score analysis indicated a relative benefit from the intervention for unmet symptom needs at 8 and 12 weeks post-assessment (effect size = 0.55 and 0.40, respectively).

Conclusion : Although a novel approach, the hypothesis that the intervention would benefit perceived unmet needs, psychological morbidity, distress and health-related quality of life was not supported overall.

Incorporating new technology into the delivery of property education

Property education has changed substantially in Australia in recent years. Whilst there has been an increase in the number of courses being offered in property education, the profile of a typical student has also changed. Property students are under increasing pressure to balance study and work due to the higher cost of living and the associated cost of education. This in turn has placed pressure on the education system to deliver property in a manner which meets the needs of the industry and the students. At the same time, there has been a marked increase in the use of technology in the business and corporate world which has resulted in increased efficiencies. This paper critiques the potential for a property education course to embrace new technology rather than 100% face-to-face teaching and only paper-based assignments. The focus is placed on the delivery of material and the interaction between the students, the lecturing staff and the wider community. Using the new Deakin property course as a case study approach, the emphasis is placed on pushing the boundaries of the conventional property education process, including the delivery of property lectures, assignment submission and assessment, as well as the overall communication process. The findings conclude that by embracing technology in a property course, there can be a 'win-win' scenario for the students, the staff and the industry stakeholders. Whilst different property courses embrace varying levels of technology, it seems inevitable that we must continue to evolve the delivery of property education in order to become efficient and effective over the long-term.

Formalising industry feedback in assessment practice for work integrated learning

Work Integrated Learning (WIL) programs, such as co-operative education programs, offer students a learning environment which exists outside the traditional classroom and specific discipline boundaries. This necessitates assessment practices that go beyond traditional practices and relationships. Work placement supervisors are best located to observe the students' learning and development and offer feedback on performance and improvement. An investigation was carried out in order to articulate the role of supervisors and work colleagues in facilitating learning in the workplace environment and their involvement in assessment practices. Interviews were conducted with academics and industry representatives on their perceptions of assessment task validity in terms of professional and generic skill development. A synthesis of the findings formed the basis of the research described in this paper. Key findings highlighted the need for better preparation of industry supervisors as to their role in providing feedback and assessment; better preparation of students for transition from the classroom to the workplace; and the importance of ongoing involvement of the three stakeholders (academic, supervisor and student) to maximise learning and professional development. Recommendations for assessment practices include suggestions on how to involve employers in appraising workplace performance; how to measure the real life application of learning; and the development of generic employability skills. © Common Ground, Kathy Henschke, Joan Richardson.

Widening and expanding participation in Australian higher education: in the absence of sociological imagination

Social inclusion in Australian higher education was high on the agenda of the recent Rudd/Gillard Australian Government. This paper offers an assessment of that agenda, particularly the extent to which it worked in favour of under-represented groups. It argues that the Government’s widening and expansion policies and its equity and aspiration strategies lacked sociological imagination, projecting deficits onto individuals who refused to be taken in by its ambitions for higher education participation. The paper concludes that in the absence of a sociological imagination in government policy, the freedoms of disadvantaged groups continued to be curtailed: not just to choose futures in keeping with their goals but also the freedom to formulate choices.

Young children learning about well-being and environmental education in the early years: a funds of knowledge approach

Early childhood educators currently provide content focused learning opportunities for children in the areas of well-being and environmental education. However, these are usually seen as discrete content areas and educators are challenged with responding to children’s interests in popular-culture inspired food products given these influence their consumption of energy-dense, nutrient-poor and highly packaged food in the early childhood setting. This paper reports preliminary findings from a pilot randomised trial examining the interconnectedness of sustainability, well-being and popular-culture in early childhood education. Planning, assessment documentation and summaries from twenty-four learning experiences implemented by six educators over a six-week period were analysed using a deductive approach. Twenty well-being and environmental education topics were identified and shown to be generated by the educators when considering the children’s ‘funds of knowledge’ on popular-culture inspired food products. We argue that topics derived from children’s engagement with popular-culture may help educators to create an integrated approach to curriculum provision. This may impact child weight and facilitate obesity prevention and environmental sustainability as children create stronger connections between these content areas and their everyday choices and practices.

Studying mathematics teacher education: analysing the process of task variation on learning

Self-study of variations to task design offers a way of analysing how learning takes place. Over several years, variations were made to improve an assessment task completed by final-year teacher candidates in a primary mathematics teacher education subject. This article describes how alterations to a task informed on-going developments in self-study of one assessment task employed in an online subject. Analysis of my journal, notes from conversations with colleagues, teacher candidates’ work on the task and responses to online forums, and survey data inspired variations focused on better exploration of key concepts involved in the task, raising of focal awareness, developing a stronger professional eye in the students and the author, adaptations for multiple curriculum levels, and explorations of dual teacher–student perspectives. The overall challenge has been to support teacher candidates to learn to design effective open-ended tasks with a critical professional eye. Descriptions of the changes made to the task and the development of my own professional eye as a consequence of the application of self-study are included. Data show that variations to the task increased teacher candidates’ understanding of mathematics problem posing and generated pedagogical insights for task design.

Evaluating a standardised clinical assessment tool for pre-registration midwifery students: a cross-sectional survey of midwifery students and midwives in Australia

Abstract
Background: Assessment of clinical competence is a core component of midwifery education. Clinical assessment tools have been developed to help increase consistency and overcome subjectivity of assessment.
Aim: The study had two main aims. The first was to explore midwifery students and educators/clinical midwives’ views and experiences of a common clinical assessment tool used for all preregistration midwifery programmes in Victoria and the University of South Australia. The Second was to assess the need for changes to the tool to align with developments in clinical practice and evidence-based care.
Methods: A cross-sectional, web-based survey including Likert-type scales and open-ended questions was utilised.
Setting: Students enrolled in all four entry pathways to midwifery at seven Victorian and one South Australian University and educators/clinical midwives across both states.
Findings: One hundred and ninety-one midwifery students’ and 86 educators/clinical midwives responded.
Overall, students and educators/clinical midwives were positive about the Clinical Assessment Tool with over 90% reporting that it covered the necessary midwifery skills. Students and educators/clinical midwives reported high levels of satisfaction with the content of the learning tools. Only 4% of educators/clinical midwives and 6% of students rated the Clinical Assessment Tool as poor overall. Changes to some learning tools were necessary in order to reflect recent practice and evidence.
Key conclusions and implications for practice: A common clinical assessment tool for evaluating midwifery students’ clinical practice may facilitate the provision of consistent, reliable and objective assessment of student skills and competency.

Online interprofessional education in dietetic students

Aim: The need for dietetic students to develop interprofessional collaborative practice capabilities is well recognised. The aim of this study was to examine the ability of an online interprofessional education (IPE) unit (using asynchronous and synchronous media) to improve dietetic students' confidence in understanding professional roles and attitudes associated with interprofessional practice along with exploring their experience in the unit. Methods: Final year master of dietetic students undertaking a compulsory online unit in IPE were invited to complete a questionnaire examining their confidence in understanding professional roles and their interprofessional attitudes both pre- and post-delivery of the unit, and to participate in semi-structured telephone interviews to explore their experience in the unit. Results: Thirty-five dietetic students completed the questionnaire pre- and post-unit, along with seven students undertaking a telephone interview. Their confidence in understanding the roles of other health professions (P = 0.000 to 0.014), self-assessment of interprofessional communication and teamwork skills (P = 0.002) and attitudes towards interprofessional interaction (P = 0.001) and interprofessional relationships (P = 0.002) increased significantly from pre- to post-unit. The students articulated positives about the experience (flexibility of the delivery, opportunity to reflect on personal factors related to teamwork, increasing their knowledge of other professions) and some challenges (lack of body language, some technological difficulties, the need for regular contribution to the teams' asynchronous discussion boards). Conclusions: This study suggests that although there can be some challenges in online IPE, it can be a positive experience and can improve dietetic students' collaborative practice attitudes and confidence in understanding other professional roles.

Improving laboratory learning through self and peer assessment of laboratory reports

The laboratory provides an opportunity for students to achieve many learning outcomes including to critically evaluate information, interpret and draw conclusions from scientific data, and communicate scientific results, information, or arguments. This paper describes a laboratory-writing task that involves self and peer evaluation. After discussion of the expectations of laboratory report writing during class, students self and peer evaluate reports. In a process similar to double-blind journal refereeing, students practise critically evaluating the quality of academic writing using a rubric. The summative assessment is based on how consistent their evaluations are with the evaluations of the same reports performed by their peers. The formative assessment is that students receive peer evaluations and feedback via a rubric on reports that they have written. The skill of critically evaluating their own reports is used to improve the laboratory reports in subsequent assessment tasks.