What is good practice in the development, assessment and evaluation of digital literacy for graduate employability?

This report seeks to identify the features of good practice in the development, assessment and evaluation of digital literacy for graduate employability.

The report forms Stage 2 of a two-stage literature review. The results of the first stage of the review are reported in: Towards an understanding of ‘Digital Literacy(ies)’. The current report draws on some of the same literature to that of the Stage 1 report and covers the same time period – up to the end of 2012. In addition, the current report covers literature that provides discussion and accounts of good practice in digital literacy – particularly practice that is embedded in course curricula.

The literature provides numerous examples of standalone digital literacy practices. While such practices may be effective for some purposes, they may be less effective than course-integrated practices in contributing to graduate employability. However, there are few accounts of course-integrated practices in the literature and fewer still that provide a compelling case for their positive contribution to graduate outcomes. Accordingly, the report identifies eight criteria of good practice in digital literacy for the assurance of graduate learning outcomes. It then identifies types of broad teaching and learning practices that appear to best encompass these criteria and which provide meaningful contexts in which to develop the digital literacy competencies of students.

Stepping out of our comfort zones: pre-service teachers' responses to a critical analysis of gender/power relations in sexuality education

This paper discusses pre-service teachers' responses to a critical analysis of gender/power relations using examples from a final assessment for an intensive elective unit called Teaching Sexuality in the Middle Years. This unit critically examines gender/ power relations, the production of difference, heteronormativity and pleasure and desire, employing a feminist post-structural framework. Despite the focus on critical thinking, reflection and interrogating structural inequalities in this unit some students were resistant or unable to engage with this approach in their assessments, although appearing to do so in workshops. We consider the broad range of sexuality education discourses mobilised by this unit to try to make sense of what looks like resistance but may be something more complex and difficult to negotiate. The paper ends with a consideration of some of the implications of this approach for practice.

A tailored, supportive care intervention using systematic assessment designed for people with inoperable lung cancer: a randomised controlled trial

Objective : People with inoperable lung cancer experience higher levels of distress, more unmet needs and symptoms than other cancer patients. There is an urgent need to test innovative approaches to improve psychosocial and symptom outcomes in this group. This study tested the hypothesis that a tailored, multidisciplinary supportive care programme based on systematic needs assessment would reduce perceived unmet needs and distress and improve quality of life.

Methods : A randomised controlled trial design was used. The tailored intervention comprised two sessions at treatment commencement and completion. Sessions included a self-completed needs assessment, active listening, self-care education and communication of unmet psychosocial and symptom needs to the multidisciplinary team for management and referral. Outcomes were assessed with the Needs Assessment for Advanced Lung Cancer Patients, Hospital Anxiety and Depression Scale, Distress Thermometer and European Organization of Research and Treatment of Cancer Quality of Life Q-C30 V2.0.

Results : One hundred and eight patients with a diagnosis of inoperable lung or pleural cancer (including mesothelioma) were recruited from a specialist facility before the trial closed prematurely (original target 200). None of the primary contrasts of interest were significant (all p > 0.10), although change score analysis indicated a relative benefit from the intervention for unmet symptom needs at 8 and 12 weeks post-assessment (effect size = 0.55 and 0.40, respectively).

Conclusion : Although a novel approach, the hypothesis that the intervention would benefit perceived unmet needs, psychological morbidity, distress and health-related quality of life was not supported overall.

Incorporating new technology into the delivery of property education

Property education has changed substantially in Australia in recent years. Whilst there has been an increase in the number of courses being offered in property education, the profile of a typical student has also changed. Property students are under increasing pressure to balance study and work due to the higher cost of living and the associated cost of education. This in turn has placed pressure on the education system to deliver property in a manner which meets the needs of the industry and the students. At the same time, there has been a marked increase in the use of technology in the business and corporate world which has resulted in increased efficiencies. This paper critiques the potential for a property education course to embrace new technology rather than 100% face-to-face teaching and only paper-based assignments. The focus is placed on the delivery of material and the interaction between the students, the lecturing staff and the wider community. Using the new Deakin property course as a case study approach, the emphasis is placed on pushing the boundaries of the conventional property education process, including the delivery of property lectures, assignment submission and assessment, as well as the overall communication process. The findings conclude that by embracing technology in a property course, there can be a 'win-win' scenario for the students, the staff and the industry stakeholders. Whilst different property courses embrace varying levels of technology, it seems inevitable that we must continue to evolve the delivery of property education in order to become efficient and effective over the long-term.

Formalising industry feedback in assessment practice for work integrated learning

Work Integrated Learning (WIL) programs, such as co-operative education programs, offer students a learning environment which exists outside the traditional classroom and specific discipline boundaries. This necessitates assessment practices that go beyond traditional practices and relationships. Work placement supervisors are best located to observe the students' learning and development and offer feedback on performance and improvement. An investigation was carried out in order to articulate the role of supervisors and work colleagues in facilitating learning in the workplace environment and their involvement in assessment practices. Interviews were conducted with academics and industry representatives on their perceptions of assessment task validity in terms of professional and generic skill development. A synthesis of the findings formed the basis of the research described in this paper. Key findings highlighted the need for better preparation of industry supervisors as to their role in providing feedback and assessment; better preparation of students for transition from the classroom to the workplace; and the importance of ongoing involvement of the three stakeholders (academic, supervisor and student) to maximise learning and professional development. Recommendations for assessment practices include suggestions on how to involve employers in appraising workplace performance; how to measure the real life application of learning; and the development of generic employability skills. © Common Ground, Kathy Henschke, Joan Richardson.

Widening and expanding participation in Australian higher education: in the absence of sociological imagination

Social inclusion in Australian higher education was high on the agenda of the recent Rudd/Gillard Australian Government. This paper offers an assessment of that agenda, particularly the extent to which it worked in favour of under-represented groups. It argues that the Government’s widening and expansion policies and its equity and aspiration strategies lacked sociological imagination, projecting deficits onto individuals who refused to be taken in by its ambitions for higher education participation. The paper concludes that in the absence of a sociological imagination in government policy, the freedoms of disadvantaged groups continued to be curtailed: not just to choose futures in keeping with their goals but also the freedom to formulate choices.

Young children learning about well-being and environmental education in the early years: a funds of knowledge approach

Early childhood educators currently provide content focused learning opportunities for children in the areas of well-being and environmental education. However, these are usually seen as discrete content areas and educators are challenged with responding to children’s interests in popular-culture inspired food products given these influence their consumption of energy-dense, nutrient-poor and highly packaged food in the early childhood setting. This paper reports preliminary findings from a pilot randomised trial examining the interconnectedness of sustainability, well-being and popular-culture in early childhood education. Planning, assessment documentation and summaries from twenty-four learning experiences implemented by six educators over a six-week period were analysed using a deductive approach. Twenty well-being and environmental education topics were identified and shown to be generated by the educators when considering the children’s ‘funds of knowledge’ on popular-culture inspired food products. We argue that topics derived from children’s engagement with popular-culture may help educators to create an integrated approach to curriculum provision. This may impact child weight and facilitate obesity prevention and environmental sustainability as children create stronger connections between these content areas and their everyday choices and practices.

Studying mathematics teacher education: analysing the process of task variation on learning

Self-study of variations to task design offers a way of analysing how learning takes place. Over several years, variations were made to improve an assessment task completed by final-year teacher candidates in a primary mathematics teacher education subject. This article describes how alterations to a task informed on-going developments in self-study of one assessment task employed in an online subject. Analysis of my journal, notes from conversations with colleagues, teacher candidates’ work on the task and responses to online forums, and survey data inspired variations focused on better exploration of key concepts involved in the task, raising of focal awareness, developing a stronger professional eye in the students and the author, adaptations for multiple curriculum levels, and explorations of dual teacher–student perspectives. The overall challenge has been to support teacher candidates to learn to design effective open-ended tasks with a critical professional eye. Descriptions of the changes made to the task and the development of my own professional eye as a consequence of the application of self-study are included. Data show that variations to the task increased teacher candidates’ understanding of mathematics problem posing and generated pedagogical insights for task design.

Evaluating a standardised clinical assessment tool for pre-registration midwifery students: a cross-sectional survey of midwifery students and midwives in Australia

Abstract
Background: Assessment of clinical competence is a core component of midwifery education. Clinical assessment tools have been developed to help increase consistency and overcome subjectivity of assessment.
Aim: The study had two main aims. The first was to explore midwifery students and educators/clinical midwives’ views and experiences of a common clinical assessment tool used for all preregistration midwifery programmes in Victoria and the University of South Australia. The Second was to assess the need for changes to the tool to align with developments in clinical practice and evidence-based care.
Methods: A cross-sectional, web-based survey including Likert-type scales and open-ended questions was utilised.
Setting: Students enrolled in all four entry pathways to midwifery at seven Victorian and one South Australian University and educators/clinical midwives across both states.
Findings: One hundred and ninety-one midwifery students’ and 86 educators/clinical midwives responded.
Overall, students and educators/clinical midwives were positive about the Clinical Assessment Tool with over 90% reporting that it covered the necessary midwifery skills. Students and educators/clinical midwives reported high levels of satisfaction with the content of the learning tools. Only 4% of educators/clinical midwives and 6% of students rated the Clinical Assessment Tool as poor overall. Changes to some learning tools were necessary in order to reflect recent practice and evidence.
Key conclusions and implications for practice: A common clinical assessment tool for evaluating midwifery students’ clinical practice may facilitate the provision of consistent, reliable and objective assessment of student skills and competency.

Online interprofessional education in dietetic students

Aim: The need for dietetic students to develop interprofessional collaborative practice capabilities is well recognised. The aim of this study was to examine the ability of an online interprofessional education (IPE) unit (using asynchronous and synchronous media) to improve dietetic students' confidence in understanding professional roles and attitudes associated with interprofessional practice along with exploring their experience in the unit. Methods: Final year master of dietetic students undertaking a compulsory online unit in IPE were invited to complete a questionnaire examining their confidence in understanding professional roles and their interprofessional attitudes both pre- and post-delivery of the unit, and to participate in semi-structured telephone interviews to explore their experience in the unit. Results: Thirty-five dietetic students completed the questionnaire pre- and post-unit, along with seven students undertaking a telephone interview. Their confidence in understanding the roles of other health professions (P = 0.000 to 0.014), self-assessment of interprofessional communication and teamwork skills (P = 0.002) and attitudes towards interprofessional interaction (P = 0.001) and interprofessional relationships (P = 0.002) increased significantly from pre- to post-unit. The students articulated positives about the experience (flexibility of the delivery, opportunity to reflect on personal factors related to teamwork, increasing their knowledge of other professions) and some challenges (lack of body language, some technological difficulties, the need for regular contribution to the teams' asynchronous discussion boards). Conclusions: This study suggests that although there can be some challenges in online IPE, it can be a positive experience and can improve dietetic students' collaborative practice attitudes and confidence in understanding other professional roles.

Improving laboratory learning through self and peer assessment of laboratory reports

The laboratory provides an opportunity for students to achieve many learning outcomes including to critically evaluate information, interpret and draw conclusions from scientific data, and communicate scientific results, information, or arguments. This paper describes a laboratory-writing task that involves self and peer evaluation. After discussion of the expectations of laboratory report writing during class, students self and peer evaluate reports. In a process similar to double-blind journal refereeing, students practise critically evaluating the quality of academic writing using a rubric. The summative assessment is based on how consistent their evaluations are with the evaluations of the same reports performed by their peers. The formative assessment is that students receive peer evaluations and feedback via a rubric on reports that they have written. The skill of critically evaluating their own reports is used to improve the laboratory reports in subsequent assessment tasks.

A novel approach to needs assessment in curriculum development: going beyond consensus methods

BACKGROUND: Needs assessment should be the starting point for curriculum development. In medical education, expert opinion and consensus methods are commonly employed. AIM: This paper showcases a more practice-grounded needs assessment approach. METHODS: A mixed-methods approach, incorporating a national survey, practice audit, and expert consensus, was developed and piloted in thrombosis medicine; Phase 1: National survey of practicing consultants, Phase 2: Practice audit of consult service at a large academic centre and Phase 3: Focus group and modified Delphi techniques vetting Phase 1 and 2 findings. RESULTS: Phase 1 provided information on active curricula, training and practice patterns of consultants, and volume and variety of thrombosis consults. Phase 2's practice audit provided empirical data on the characteristics of thrombosis consults and their associated learning issues. Phase 3 generated consensus on a final curricular topic list and explored issues regarding curriculum delivery and accreditation. CONCLUSIONS: This approach offered a means of validating expert and consensus derived curricular content by incorporating a novel practice audit. By using this approach we were able to identify gaps in training programs and barriers to curriculum development. This approach to curriculum development can be applied to other postgraduate programs.

How do postgraduate qualifications in medical education impact on health professionals?

Background and Purpose: The number of degree-awarding programmes in medical education is steadily increasing. Despite the popularity and extensive investment in these courses, there is little research into their impact. This study investigated the perceived impact of an internationally-renowned postgraduate programme in medical education on health professionals’ development as educators.

Methods: An online survey of the 2008–12 graduates from the Centre for Medical Education, University of Dundee was carried out. Their self-reported shifts in various educational competencies and scholarship activities were analysed using non-parametric statistics. Qualitative data were also collected and analysed to add depth to the quantitative findings.

Results: Of the 504 graduates who received the online questionnaire 224 responded. Participants reported that a qualification in medical education had significantly (p < 0.001) improved their professional educational practices and engagement in scholarly activities. Masters graduates reported greater impact compared to Certificate graduates on all items, including ability to facilitate curriculum reforms, and in assessment and feedback practices. Masters graduates also reported more engagement in scholarship activities, with significantly greater contributions to journals. These qualifications equally benefited all participants regardless of age. International graduates reported greater impact of the qualification than their UK counterparts.

Conclusion: A postgraduate medical education programme can significantly impact on the practices and behaviours of health professionals in education, improving self-efficacy and instilling an increased sense of belonging to the educational community.

Realising the potential: assessing professional learning through the integration of ePortfolios in Australian business education

This project will enable academic leadership of Australian Business and Management education programs to design into the curriculum, and best use, ePortfolios and associated technologies in assessing students' learning of highly valued professionally-based capabilities. The project will investigate and support the best ways of broadly and deeply embedding ePortfolios across entire undergraduate business and management education curricula. ePortfolios for enabling and assessing student learning is seen as a key means for integrating student learning across the curriculum and, therefore, creating a holistic learning experience. The project will work with Program Leaders across the sector through liaison with the Australian Business Deans Council (ABDC), Teaching and Learning Network to both draw in better practices and disseminate project findings as the project progresses through its key phases. These planned actions will lead to the progressive development of a Business Education ePortfolio Professional Learning Capabilities Assessment Framework.

In search of academic identity : physical education, sport science and the field of human movement studies

This thesis addresses the problem of the academic identity of the area traditionally referred to as physical education. The study is a critical examination of the argu ments for the justi cation of this area as an autonomous branch of knowledge. The investigation concentrates on a selected number of arguments. The data collection comprised articles books and proceedings of conferences. The preliminary assessment of these materials resulted in a classi cation of the arguments into three groups. The rst group comprises the arguments in favour of physical education as an academic discipline. The second includes the arguments supporting a science of sport. The third consists of the arguments in favour of to a eld of human movement study. The examination of these arguments produced the following results. (a) The area of physical education does not satisfy the conditions presupposed by the de nition of academic discipline. This is so because the area does not form an integrated system of scienti c theories. (b) The same di culty emerges from the examination of the ar guments for sport science. There is no science of sport because there is no integrated system of scienti c theories related to sport. (c) The arguments in favour of a eld of study yielded more productive results. However di culties arise from the de nition of human movement. The analysis of this concept showed that its limits are not well demarcated. This makes it problematic to take human movement as the focus of a eld of studies. These aspects led to the conclusion that such things as an academic discipline of physical education sport science and eld of human movement studies do not exist. At least there are not such things in the sense of autonomous branches of knowledge. This does not imply that a more integrated inquiry based on several disciplines is not possible and desirable. This would enable someone entering phys ical education to nd a more organised structure of knowledge with some generally accepted problem situations procedures and theories on which to base professional practice.