Evaluation of assessment in the context of work-based learning: Qualitative perspectives of new graduates

Aim Evaluation or assessment of competence is an important step to ensure the safety and efficacy of health professionals, including dietitians. Most competency-based assessment studies are focussed on valid and reliable methods of assessment for the preparation of entry-level dietitians, few papers have explored student dietitians’ perceptions of these evaluations. This study aimed to explore the perceptions of recent graduates from accredited nutrition and dietetics training programs in Australia. It also aimed to establish the relevance of competency-based assessment to adequately prepare them for entry-level work roles. Methods A purposive sample of newly-graduated dietitians with a range of assessment experiences and varied employment areas was recruited. A qualitative approach, using in-depth interviews with 13 graduates, with differing assessment experiences was undertaken. Graduates were asked to reflect upon their competency-based assessment experiences whilst a student. Data was thematically analysed by multiple authors. Results Four themes emerged from the data analysis: (i) Transparency and consistency are critical elements of work-based competency assessment. (ii) Students are willing to take greater responsibility in their assessment process. (iii) Work-based competency assessment prepares students for employment. (iv) The relationship between students and their assessors can impact on the student experience and their assessment performance. Conclusions Understanding this unique perspective of students can improve evaluation of future health professionals and assist in designing valid competency-based assessment approaches.

Teaching new dogs old tricks. How the move to 24/7 interactive, integrated multimedia, multi-platform news and feature delivery is not really changing the skills employers demand of graduates

The journalism revolution is upon us. In a world where we are constantly being told that everyone can be a publisher and challenges are emerging from bloggers, Twitterers and podcasters, journalism educators are inevitably reassessing what skills we now need to teach to keep our graduates ahead of the game. QUT this year tackled that question head-on as a curriculum review and program restructure resulted in a greater emphasis on online journalism. The author spent a week in the online newsrooms of each of two of the major players – ABC online news and thecouriermail.com to watch, listen and interview some of the key players. This, in addition to interviews with industry leaders from Fairfax and news.com, lead to the conclusion that while there are some new skills involved in new media much of what the industry is demanding is in fact good old fashioned journalism. Themes of good spelling, grammar, accuracy and writing skills and a nose for news recurred when industry players were asked what it was that they would like to see in new graduates. While speed was cited as one of the big attributes needed in online journalism, the conclusion of many of the players was that the skills of a good down-table sub or a journalist working for wire service were not unlike those most used in online newsrooms.

60Sox and the 2bobmob : mentoring in an online learning community for creative industries graduates

Knowledge intensive services are the fastest growing segment of the international economy and the digital creative industries are a key segment therein. Australia is well positioned to exploit this opportunity but has a skills shortage in the digital content industries in terms of commercial ready graduates. We report on a solution to this problem, in the form of an online creative community of practice – www.60Sox.org - where new graduates are mentored by Australian industry leaders - the 2bobmob. We describe this community of practice as a virtual creative ecology and discuss networks, peer feedback and mentoring as key elements of post-tertiary learning, in the context of portfolio career progression.

Australian new graduate experiences during their transition program in a rural/regional acute setting

The transition process from student to Registered Nurse has been recognised as an important yet challenging time for newly graduated nurses. Knowledge about this experience from the nurse’s perspective, particularly in a rural setting, is limited. This paper reports the findings of a qualitative study of the experiences of newly graduated nurses working in a rural acute care facility in New South Wales. The study examined, from the perspective of the new nurse, the orientation and support which can help to facilitate the transition from student to registered nurse. Four themes emerged which were being supported, being challenged, reflections on being a new graduate, and reflections on a rural new graduate program. These findings contribute to what is know about the transition of new graduates in a rural facility and have implications for program improvements, specifically within the rural acute care environment. The findings are also relevant to students considering rural employment on graduation and for the recruitment and retention of New Graduate Registered Nurses in rural areas.

New graduate occupational therapists feelings of preparedness for practice in Australia and Aotearoa/New Zealand

Aim The development of competent future allied health professionals through academic programmes, professional support and practical education is continually evolving. The aim of this study was to explore the feelings of newly graduated occupational therapists in Australia and Aotearoa/New Zealand regarding their education and work preparedness. Methods Newly graduated occupational therapists from Australia (n = 178) and Aotearoa/New Zealand (n = 53) who had completed their occupational therapy studies in 2007 were recruited. Participants completed an online survey which explored their preparedness for work; based on professional competencies. Results Most newly graduated occupational therapists felt somewhat prepared for practice. However, only 17.1% of Australian new graduates, and even fewer (8.5%) of Aotearoa/New Zealand new graduates felt very well prepared. Participants felt more prepared for the competencies required for ‘managing inwards’ (including interpersonal skills) and less prepared for those required for ‘managing outwards’ (including evidence-based practice). Conclusions This study provides the first international comparison into the feelings of competence and preparedness for practice of new graduates of occupational therapy from Australia and Aotearoa/New Zealand. Given the importance of competencies, such as evidence-based practice to the progress of the profession, there is a need to further explore methods to increase feelings of preparedness in these areas.

Australian paramedic graduates transitioning into UK NHS ambulance services: what are the potential challenges?

With United Kingdom (UK) Ambulance National Health Service (NHS) Trusts and Foundation Trusts actively recruiting Australian paramedic graduates, this article seeks to stimulate discussion by identifying differences existing between the two ambulance systems, as well as highlighting potential challenges that Australian graduates may face when transitioning to the UK ambulance service. It also identifies similarities between Australian and UK ambulance systems, which may assist new graduates to overcome the transition shock. This article suggests that transition shock is not solely related to Australian graduates moving to the UK, and may well be present for graduates moving to comparable international ambulance services in Canada, the Middle East, Ireland and South Africa.

Identifying educational priorities for occupational therapy students to prepare for mental health practice in Australia and New Zealand: opinions of practising occupational therapists

BACKGROUND: The effective preparation of occupational therapy students for mental health practice is critical to facilitate positive consumer outcomes, underpin optimal practice and support new graduates' professional identity. This project was established to determine a set of 'educational priorities' for occupational therapy students to prepare them for current (and future) entry-level practice in mental health, from the perspective of mental health occupational therapists in Australia and New Zealand. METHODS: The study included two phases. In Phase One, participants identified what they considered to be important educational priorities for occupational therapy students to prepare them for practice in mental health. For Phase Two, an 'expert panel' was assembled to review and rank these using a Policy Delphi approach. RESULTS: Eighty-five participants provided educational priorities in Phase One. These were grouped into a total of 149 educational themes. In Phase Two, the expert panel (consisting of 37 occupational therapists from diverse locations and practice settings) prioritised these themes across three Delphi rounds. A final priority list was generated dividing educational themes into three prioritised categories: 29 'Essential', 25 'Important' and 44 'Optional' priorities. Highest-ranked priorities were: clinical reasoning, client-centred practice, therapeutic use of self, functional implications of mental illness, therapeutic use of occupation and mental health fieldwork experience. CONCLUSION: The priority list developed as part of this project provides additional information to support the review of occupational therapy curricula across Australia and New Zealand to ensure that new graduates are optimally prepared for mental health practice.

A survey of e-mentoring among New Zealand midwives

Mentoring is a strategy that may assist the midwifery profession to support new graduates and midwives working in rural and remote areas. We conducted a survey of 1577 New Zealand midwives about their opinions and experiences of mentoring. The questionnaire comprised 33 questions, nine of which were open questions. There was a 44% response rate. While the telephone was commonly utilized by mentors (37%) and mentored midwives (37%), the Internet and email played only a small part. Participants acknowledged the potential of these avenues for communication, but midwives felt that mentoring could be provided only by immediate, face-to-face contact. Nevertheless, e-mentoring could be a viable option and requires further investigation. About one-third of midwives identified geographical isolation as a barrier to being a mentor (38%) and being mentored (36%). The use of e-mentoring could remove the barrier of location and allow the midwife to chose a mentor who meets her needs, rather than because she is the only mentor available.

How new graduate nurses experience patient death : a systematic review and qualitative meta-synthesis

Background

Patient death is an emotional and demanding experience for nurses, especially for new graduate nurses who are unprepared to deliver end-of-life care. Understanding new graduate nurses’ experience of death and dying will inform the design of training programs and interventions for improvements in the quality of care and support of new graduates.

Objective

To summarize new graduate nurses’ experience with patient death by examining the findings of existing qualitative studies.

Design

Systematic review methods incorporating meta-synthesis were used.

Methods

A comprehensive search was conducted in 12 databases from January 1990 to December 2014. All qualitative and mixed-method studies in English and Chinese that explored new graduate nurses’ experience of patient death were included. Two independent reviewers selected the studies for inclusion and assessed each study quality. Meta-aggregation was performed to synthesize the findings of the included studies.

Results

Five primary qualitative studies and one mix-method study met inclusion and quality criteria. Six key themes were identified from the original findings: emotional experiences, facilitating a good death, support for family, inadequacy on end-of-life care issues, personal and professional growth and coping strategies. New graduate nurses expressed a variety of feelings when faced with patient death, but still they tried to facilitate a good death for dying patients and provide support for their families. The nurses benefited from this challenging encounter though they lacked of coping strategies.

Adaptation and validation of a survey instrument measuring perceived preparedness of nursing graduates

BACKGROUND: In Australia, a significant percentage of bachelor of nursing students are employed in the aged care sector, or in aged care settings, as assistants in nursing (AINs) or personal care assistants. However the value of aged care in nursing education is often overlooked. AIM: To outline the adaptation and validation of a survey, originally developed for medical graduates, for use with nursing graduates. DISCUSSION: Adaptation of the instrument was undertaken as part of a doctoral study that aimed to explore whether employment as an undergraduate assistant in nursing (AIN) in aged care prepares new graduates for clinical work. CONCLUSION: Outlining each step of the modification process can help nurse researchers who want to adapt existing instruments to meet their research objectives. IMPLICATIONS FOR PRACTICE: Undergraduate AIN employment has the potential to supplement clinical learning without the restrictions inherent in the student role. Furthermore, it has the potential to enhance recruitment and retention in the aged care sector.

Impeding good governance implementation in Indonesian regional government : the effect of a bureaucratic generation gap

The implementation of ‘good governance’ in Indonesia’s regional government sector became a central tenet in governance research following the introduction of the national code for governance in 2006. The code was originally drafted in 1999 as a response to the Asian financial crises and many cases of unearthed corruption, collusion, and nepotism. It was reviewed in 2001 and again in 2006 to incorporate relevant political, economical, and social developments. Even though the national code exists along with many regional government decrees on good governance, the extent of implementation of the tenets of good governance in Indonesia’s regional government is still questioned. Previous research on good governance implementation in Indonesian regional government (Mardiasmo, Barnes and Sakurai, 2008) identified differences in the nature and depth of implementation between various Indonesian regional governments. This paper analyses and extends this recent work and explores key factors that may impede the implementation and sustained application of governance practices across regional settings. The bureaucratic culture of Indonesian regional government is one that has been shaped for over approximately 30 years, in particular during that of the Soeharto regime. Previous research on this regime suggests a bureaucratic culture with a mix of positive and negative aspects. On one hand Soeharto’s regime resulted in strong development growth and strong economic fundamentals, resulting in Indonesia being recognised as one of the Asian economic tigers prior to the 1997 Asian financial crises. The financial crises however revealed a bureaucratic culture that was rife with corruption, collusion, and nepotism. Although subsequent Indonesian governments have been committed to eradicating entrenched practices it seems apparent that the culture is ingrained within the bureaucracy and eradication of it will take time. Informants from regional government agree with this observation, as they identify good governance as an innovative mechanism and to implement it will mean a deviation from the “old ways.” Thus there is a need for a “changed” mind set in order to implement sustained governance practices. Such an exercise has proven to be challenging so far, as there is “hidden” resistance from within the bureaucracy to change its ways. The inertia of such bureaucratic cultures forms a tension against the opportunity for the implementation of good governance. From this context an emergent finding is the existence of a ‘bureaucratic generation gap’ as an impeding variable to enhanced and more efficient implementation of governance systems. It was found that after the Asian financial crises the Indonesian government (both at national and regional level) drew upon a wider human resources pool to fill government positions – including entrants from academia, the private sector, international institutions, foreign nationals and new graduates. It suggested that this change in human capital within government is at the core of this ‘inter-generational divide.’ This divergence is exemplified, at one extreme, by [older] bureaucrats who have been in-position for long periods of time serving during the extended Soeharto regime. The “new” bureaucrats have only sat in their positions since the end of Asian financial crisis and did not serve during Soeharto’s regime. It is argued that the existence of this generation gap and associated aspects of organisational culture have significantly impeded modernising governance practices across regional Indonesia. This paper examines the experiences of government employees in five Indonesian regions: Solok, Padang, Gorontalo, Bali, and Jakarta. Each regional government is examined using a mixed methodology comprising of on-site observation, document analysis, and iterative semi-structured interviewing. Drawing from the experiences of five regional governments in implementing good governance this paper seeks to better understand the causal contexts of variable implementation governance practices and to suggest enhancements to the development of policies for sustainable inter-generational change in governance practice across regional government settings.

The relationship between construction firm strategies and innovation outcomes

Survey results provide a preliminary assessment of the relative contribution of a range of tactical business strategies to innovation performance by firms in the Australian construction industry. Over 1,300 firms were surveyed in 2004, resulting in a response rate of 29%. Respondents were classified as high, medium or low innovators according to an innovation index based on the novelty and impact of their innovations and their adoption of listed technological and organizational advances. The relative significance of 23 business strategies concerning (1) employees, (2) marketing, (3) technology, (4) knowledge and (5) relationships was examined by determining the extent to which they distinguished high innovators from low innovators. The individual business strategies that most strongly distinguished high innovators were (1) ‘investing in R&D’, (2) ‘participating in partnering and alliances on projects’, (3) ‘ensuring project learnings are transferred into continuous business processes’, (4) ‘monitoring international best practice’, and (5) ‘recruiting new graduates’. Of the five types of strategies assessed, marketing strategies were the least significant in supporting innovation. The results provide practical guidance to managers in project-based industries wishing to improve their innovation performance.

The development and evaluation of an innovative nursing practice model to improve undergraduate nursing students' competence in paediatric physical assessment

Introduction The purpose of this study was to develop, implement and evaluate the impact of an educational intervention, comprising an innovative model of clinical decisionmaking and educational delivery strategy for facilitating nursing students‘ learning and development of competence in paediatric physical assessment practices. Background of the study Nursing students have an undergraduate education that aims to produce graduates of a generalist nature who demonstrate entry level competence for providing nursing care in a variety of health settings. Consistent with population morbidity and health care roles, paediatric nursing concepts typically form a comparatively small part of undergraduate curricula and students‘ exposure to paediatric physical assessment concepts and principles are brief. However, the nursing shortage has changed traditional nursing employment patterns and new graduates form the majority of the recruitment pool for paediatric nursing speciality staff. Paediatric nursing is a popular career choice for graduates and anecdotal evidence suggests that nursing students who select a clinical placement in their final year intend to seek employment in paediatrics upon graduation. Although concepts of paediatric nursing are included within undergraduate curriculum, students‘ ability to develop the required habits of mind to practice in what is still regarded as a speciality area of practice is somewhat limited. One of the areas of practice where this particularly impacts is in paediatric nursing physical assessment. Physical assessment is a fundamental component of nursing practice and competence in this area of practice is central to nursing students‘ development of clinical capability for practice as a registered nurse. Timely recognition of physiologic deterioration of patients is a key outcome of nurses‘ competent use of physical assessment strategies, regardless of the practice context. In paediatric nursing contexts children‘s physical assessment practices must specifically accommodate the child‘s different physiological composition, function and pattern of clinical deterioration (Hockenberry & Barrera, 2007). Thus, to effectively manage physical assessment of patients within the paediatric practice setting nursing students need to integrate paediatric nursing theory into their practice. This requires significant information processing and it is in this process where students are frequently challenged. The provision of rules or models can guide practice and assist novice-level nurses to develop their capabilities (Benner, 1984; Benner, Hooper-Kyriakidis & Stannard, 1999). Nursing practice models are cognitive tools that represent simplified patterns of expert analysis employing concepts that suit the limited reasoning of the inexperienced, and can represent the =rules‘ referred to by Benner (1984). Without a practice model of physical assessment students are likely to be uncertain about how to proceed with data collection, the interpretation of paediatric clinical findings and the appraisal of findings. These circumstances can result in ad hoc and unreliable nursing physical assessment that forms a poor basis for nursing decisions. The educational intervention developed as part of this study sought to resolve this problem and support nursing students‘ development of competence in paediatric physical assessment. Methods This study utilised the Context Input Process Product (CIPP) Model by Stufflebeam (2004) as the theoretical framework that underpinned the research design and evaluation methodology. Each of the four elements in the CIPP model were utilised to guide discrete stages of this study. The Context element informed design of the clinical decision-making process, the Paediatric Nursing Physical Assessment model. The Input element was utilised in appraising relevant literature, identifying an appropriate instructional methodology to facilitate learning and educational intervention delivery to undergraduate nursing students, and development of program content (the CD-ROM kit). Study One employed the Process element and used expert panel approaches to review and refine instructional methods, identifying potential barriers to obtaining an effective evaluation outcome. The Product element guided design and implementation of Study Two, which was conducted in two phases. Phase One employed a quasiexperimental between-subjects methodology to evaluate the impact of the educational intervention on nursing students‘ clinical performance and selfappraisal of practices in paediatric physical assessment. Phase Two employed a thematic analysis and explored the experiences and perspectives of a sample subgroup of nursing students who used the PNPA CD-ROM kit as preparation for paediatric clinical placement. Results Results from the Process review in Study One indicated that the prototype CDROM kit containing the PNPA model met the predetermined benchmarks for face validity and the impact evaluation instrumentation had adequate content validity in comparison with predetermined benchmarks. In the first phase of Study Two the educational intervention did not result in statistically significant differences in measures of student performance or self-appraisal of practice. However, in Phase Two qualitative commentary from students, and from the expert panel who reviewed the prototype CD-ROM kit (Study One, Phase One), strongly endorsed the quality of the intervention and its potential for supporting learning. This raises questions regarding transfer of learning and it is likely that, within this study, several factors have influenced students‘ transfer of learning from the educational intervention to the clinical practice environment, where outcomes were measured. Conclusion In summary, the educational intervention employed in this study provides insights into the potential e-learning approaches offer for delivering authentic learning experiences to undergraduate nursing students. Findings in this study raise important questions regarding possible pedagogical influences on learning outcomes, issues within the transfer of theory to practice and factors that may have influenced findings within the context of this study. This study makes a unique contribution to nursing education, specifically with respect to progressing an understanding of the challenges faced in employing instructive methods to impact upon nursing students‘ development of competence. The important contribution transfer of learning processes make to students‘ transition into the professional practice context and to their development of competence within the context of speciality practice is also highlighted. This study contributes to a greater awareness of the complexity of translating theoretical learning at undergraduate level into clinical practice, particularly within speciality contexts.