A survey to evaluate the implementation of a national clinical assessment form

Purpose: The Australian Universities Radiation Therapy Student Clinical Assessment Form (AURTSCAF) was designed to assess the clinical skills of radiation therapy (RT) students from the six universities that offer entry level RT programs. Given the AURTSCAF has now been in use for over two years, the Radiation Therapy Program Coordinators (RTPC) group initiated a post implementation evaluation survey. This formed the final phase of the AURTSCAF project and was funded by the Radiation Oncology Division of the Department of Health and Ageing. Methods: A cross-sectional designed survey using purposive sampling was distributed via email to all RT clinical sites. The survey asked questions about the requirements of a pass grade for students at different stages of their program, and the addition of a new category of assessment related to fitness to practise. Response types included both forced choice closed ended responses and open ended responses. There was also a section for open comments about the AURTSCAF. Results: There were 100 responses (55%) from clinicians who had utilised the assessment form over the previous 12 month period. Responses highlighted several positives with regard to the utility and implementation of the form. Comments regarding areas for improvement with the standardisation of the grading of students and consensus for the addition of a new domain in fitness for practise have informed the recommended changes proposed for 2012. Conclusion: This evaluation has provided a representative sample of the views of clinicians involved in assessing students on clinical placement. Recommendations include the addition of the sixth domain of assessment: Fitness for practise, the addition of descriptors and prompts for this domain in the user guide, the addition of a consensus statement about the use of the rating scale and dissemination of the proposed changes nationally.

Work-based assessment : qualitative perspectives of novice nutrition and dietetics educators

Background The assessment of competence for health professionals including nutrition and dietetics professionals in work-based settings is challenging. The present study aimed to explore the experiences of educators involved in the assessment of nutrition and dietetics students in the practice setting and to identify barriers and enablers to effective assessment. Methods A qualitative research approach using in-depth interviews was employed with a convenience sample of inexperienced dietitian assessors. Interviews explored assessment practices and challenges. Data were analysed using a thematic approach within a phenomenological framework. Twelve relatively inexperienced practice educators were purposefully sampled to take part in the present study. Results Three themes emerged from these data. (i) Student learning and thus assessment is hindered by a number of barriers, including workload demands and case-mix. Some workplaces are challenged to provide appropriate learning opportunities and environment. Adequate support for placement educators from the university, managers and their peers and planning are enablers to effective assessment. (ii) The role of the assessor and their relationship with students impacts on competence assessment. (iii) There is a lack of clarity in the tasks and responsibilities of competency-based assessment. Conclusions The present study provides perspectives on barriers and enablers to effective assessment. It highlights the importance of reflective practice and feedback in assessment practices that are synonymous with evidence from other disciplines, which can be used to better support a work-based competency assessment of student performance.

Balancing the books : an assessment of financial stress associated with social work and human service student placements

This report presents the findings from a study of the financial impact of work-integrated learning commonly referred to as 'placement' among social work and human services students. Based on a survey of 214 respondants, 14 in-depth interviews and two focus groups, the findings indicate that two thirds of the surveyed group felt tired and anxious about their experience of balancing paid work and placement, with 2 in 5 reporting their learning experience was compromised as a result. The significant implications and potential solutions are also discussed.

Trapping to monitor tephritid movement: Results, best practice, and assessment of alternatives

Movement of tephritid flies underpins their survival, reproduction, and ability to establish in new areas and is thus of importance when designing effective management strategies. Much of the knowledge currently available on tephritid movement throughout landscapes comes from the use of direct or indirect methods that rely on the trapping of individuals. Here, we review published experimental designs and methods from mark-release-recapture (MRR) studies, as well as other methods, that have been used to estimate movement of the four major tephritid pest genera (Bactrocera, Ceratitis, Anastrepha, and Rhagoletis). In doing so, we aim to illustrate the theoretical and practical considerations needed to study tephritid movement. MRR studies make use of traps to directly estimate the distance that tephritid species can move within a generation and to evaluate the ecological and physiological factors that influence dispersal patterns. MRR studies, however, require careful planning to ensure that the results obtained are not biased by the methods employed, including marking methods, trap properties, trap spacing, and spatial extent of the trapping array. Despite these obstacles, MRR remains a powerful tool for determining tephritid movement, with data particularly required for understudied species that affect developing countries. To ensure that future MRR studies are successful, we suggest that site selection be carefully considered and sufficient resources be allocated to achieve optimal spacing and placement of traps in line with the stated aims of each study. An alternative to MRR is to make use of indirect methods for determining movement, or more correctly, gene flow, which have become widely available with the development of molecular tools. Key to these methods is the trapping and sequencing of a suitable number of individuals to represent the genetic diversity of the sampled population and investigate population structuring using nuclear genomic markers or non-recombinant mitochondrial DNA markers. Microsatellites are currently the preferred marker for detecting recent population displacement and provide genetic information that may be used in assignment tests for the direct determination of contemporary movement. Neither MRR nor molecular methods, however, are able to monitor fine-scale movements of individual flies. Recent developments in the miniaturization of electronics offer the tantalising possibility to track individual movements of insects using harmonic radar. Computer vision and radio frequency identification tags may also permit the tracking of fine-scale movements by tephritid flies by automated resampling, although these methods come with the same problems as traditional traps used in MRR studies. Although all methods described in this chapter have limitations, a better understanding of tephritid movement far outweighs the drawbacks of the individual methods because of the need for this information to manage tephritid populations.

Approach for the use of MSW settlement predictions in the assessment of landfill capacity based on reliability analysis

In the analysis and design of municipal solid waste (MSW) landfills, there are many uncertainties associated with the properties of MSW during and after MSW placement. Several studies are performed involving different laboratory and field tests to understand the complex behavior and properties of MSW, and based on these studies, different models are proposed for the analysis of time dependent settlement response of MSW. For the analysis of MSW settlement, it is very important to account for the variability of model parameters that reflect different processes such as primary compression under loading, mechanical creep and biodegradation. In this paper, regression equations based on response surface method (RSM) are used to represent the complex behavior of MSW using a newly developed constitutive model. An approach to assess landfill capacities and develop landfill closure plans based on prediction of landfill settlements is proposed. The variability associated with model parameters relating to primary compression, mechanical creep and biodegradation are used to examine their influence on MSW settlement using reliability analysis framework and influence of various parameters on the settlement of MSW are estimated through sensitivity analysis. (C) 2013 Elsevier Ltd. All rights reserved.

Geomorphological considerations for the introduction of boulders and groynes for fisheries enhancement: assessment of River Eden at Carhead

This report seeks to briefly provide geomorphological guidance over the introduction of 'habitat enhancement' features for fisheries improvement which is an expanding area of interest throughout the region. This document is a primary attempt to draw together the salient details from the large quantity of literature published in recent years with reference to boulder introduction and to groyne/deflector placement in NW rivers. Secondly the potential introduction of such features is assessed, with reference to the proposed works at Carhead on the Eden.

A classification of data quality assessment methods

Data quality (DQ) assessment can be significantly enhanced with the use of the right DQ assessment methods, which provide automated solutions to assess DQ. The range of DQ assessment methods is very broad: from data profiling and semantic profiling to data matching and data validation. This paper gives an overview of current methods for DQ assessment and classifies the DQ assessment methods into an existing taxonomy of DQ problems. Specific examples of the placement of each DQ method in the taxonomy are provided and illustrate why the method is relevant to the particular taxonomy position. The gaps in the taxonomy, where no current DQ methods exist, show where new methods are required and can guide future research and DQ tool development.

Socialising young literacy learners into a discourse of failure: Dominant discourses in literacy teaching and assessment and their impact on the progression of young literacy learners into employment

This paper argues that contemporary literacy programmes are a mismatch for the expectations of both the government and employers as well as the goals of learners. It submits that the dominant discourses in literacy provision have led to the emergence of a learning culture which not only fails the learners but is also incapable of meeting the aspirations of both the government and employers. To support this argument, the paper reports a small scale research project that analyses the perceptions of learners, teachers and employers who were involved in a work placement scheme for young literacy learners in a college of further education. Data for the study were collected through focus group and face to face interviews and analysed using the framework of discourse analysis provided by Gill (2000) with findings codified and analysed thematically. The study found that teachers were aware that their learners were not adequately prepared for the world of work because of the demands of the dominant discourses of quality and performance measurement which were most obviously manifested in their assessment, teaching methods and the attitudes of learners. It found that employers perceive young learners as inadequate in terms of the workplace expectations. Learners in the study revealed that their workplace culture and expectations were totally different from the culture to which they had been socialised in their studies. The study concludes that unless the dominance of these discourses is ameliorated, young literacy learners will continue to be socialised into a discourse of failure.

Reliability of a quantitative clinical posture assessment tool among persons with idiopathic scoliosis

Objective To determine overall, test–retest and inter-rater reliability of posture indices among persons with idiopathic scoliosis. Design A reliability study using two raters and two test sessions. Setting Tertiary care paediatric centre. Participants Seventy participants aged between 10 and 20 years with different types of idiopathic scoliosis (Cobb angle 15 to 60°) were recruited from the scoliosis clinic. Main outcome measures Based on the XY co-ordinates of natural reference points (e.g. eyes) as well as markers placed on several anatomical landmarks, 32 angular and linear posture indices taken from digital photographs in the standing position were calculated from a specially developed software program. Generalisability theory served to estimate the reliability and standard error of measurement (SEM) for the overall, test–retest and inter-rater designs. Bland and Altman's method was also used to document agreement between sessions and raters. Results In the random design, dependability coefficients demonstrated a moderate level of reliability for six posture indices (ϕ = 0.51 to 0.72) and a good level of reliability for 26 posture indices out of 32 (ϕ ≥ 0.79). Error attributable to marker placement was negligible for most indices. Limits of agreement and SEM values were larger for shoulder protraction, trunk list, Q angle, cervical lordosis and scoliosis angles. The most reproducible indices were waist angles and knee valgus and varus. Conclusions Posture can be assessed in a global fashion from photographs in persons with idiopathic scoliosis. Despite the good reliability of marker placement, other studies are needed to minimise measurement errors in order to provide a suitable tool for monitoring change in posture over time.

Direct patient contacts of dietetic students during their final clinical placement

Direct student-patient contacts, during the professional clinical placement of a Master of Nutrition and Dietetics course, were collected and analysed for the first time using a computerised method. In the final eight-week hospital placement, 26 dietetic students submitted data on direct patient contacts which included: dietetic activities (e.g. assessing, counselling and reviewing); the primary nutritional condition of the patient (e.g. type 2 diabetes and liver disease); and the time spent in contact with patients. The most common dietetic activities were reviews, followed by collection of dietary information and counselling. The most common nutritional condition encountered by students was an inadequate nutrient intake, followed by patients receiving enteral nutrition. Contact time with patients increased over the placement, with proportionately more time spent by students seeing patients independently than when being observed by supervising dietitians. The data collected provided valuable informa tion on the amount of time spent by students in direct patient contacts, the range of dietetic activities undertaken and the amount of time student activities were directly observed. This information will be useful in the development of benchmarks for clinical skill development, hospital and university staff planning and the assessment of the impact of any changes to the format of student placement experience in the clinical setting.

Student peer and self assessment in the context of work integrated learning : making it work

Students are now experiencing opportunities in practice education where their learning is facilitated by professionals of varied backgrounds thus leading to issues of how to assess student performance while on placement. Educators have had to re-think the way in which students’ performance is assessed and to integrate the key graduate attributes of critical reflection, self and peer assessments and feedback. Using recommendations by Mason (1999) in relation to a collaborative group model for workplace learning and ‘The Self-Directed Learning Model’ by Gaiptman and Anthony (1989) the Occupational Wellness and Life Satisfaction (OWLS) program encourages students to reflect on their experiences in an environment of self and peer evaluation, focussing on the process of learning rather than purely on outcomes. Students are required to complete a self and peer assessment of their learning using a nationally recognised fieldwork evaluation instrument and develop a practice portfolio consisting of learning contract and supporting evidence for their self-assessment. Qualitative and quantitative data was collected via a questionnaire to alumni. The most frequently identified skills that were valued by respondents were autonomy and independence. Other benefits identified were facilitation of self directed learning, and ability to problem solve with colleagues and to share learning. In a higher education environment where lifelong learning and the ability to work collaboratively are valued graduate attributes, a focus on peer and self assessment within the context of work integrated learning contributes to graduates who are well placed to work in both traditional and newer and emerging areas of practice.

Formalising industry feedback in assessment practice for work integrated learning

Work Integrated Learning (WIL) programs, such as co-operative education programs, offer students a learning environment which exists outside the traditional classroom and specific discipline boundaries. This necessitates assessment practices that go beyond traditional practices and relationships. Work placement supervisors are best located to observe the students' learning and development and offer feedback on performance and improvement. An investigation was carried out in order to articulate the role of supervisors and work colleagues in facilitating learning in the workplace environment and their involvement in assessment practices. Interviews were conducted with academics and industry representatives on their perceptions of assessment task validity in terms of professional and generic skill development. A synthesis of the findings formed the basis of the research described in this paper. Key findings highlighted the need for better preparation of industry supervisors as to their role in providing feedback and assessment; better preparation of students for transition from the classroom to the workplace; and the importance of ongoing involvement of the three stakeholders (academic, supervisor and student) to maximise learning and professional development. Recommendations for assessment practices include suggestions on how to involve employers in appraising workplace performance; how to measure the real life application of learning; and the development of generic employability skills. © Common Ground, Kathy Henschke, Joan Richardson.

Developing a collaborative model of industry feedback for work placement of business students

Work-integrated learning (WIL) is a signature feature of study in many higher education institutions. In business degrees, industry feedback is recognized as an integral part of the assessment of WIL, yet the role played by industry in appraising student performance in the workplace has not been clearly defined. Based on interviews with industry supervisors and academic mentors, this paper addresses the integration of academic and industry supervisor assessment practices designed to maximize student learning outcomes and capture the depth of the learning experiences during a work placement. A model of industry feedback was developed to incorporate planned assessment practices that achieve the learning outcomes agreed to at the start of the placement by all stakeholders: the student, the academic mentor and the industry supervisor.

Supporting culturally and linguistically diverse students during clinical placement: strategies from both sides of the table

Background: Increasing proportions of Culturally and Linguistically Diverse (CALD) students within health professional courses at universities creates challenges in delivering inclusive training and education. Clinical placements are a core component of most health care degrees as they allow for applied learning opportunities. A research gap has been identified in regard to understanding challenges and strategies for CALD students in health professional placements.

Methods: A key stakeholder approach was used to examine barriers and enablers experienced by CALD students in clinical placement. Semi-structured focus groups with healthcare students (n = 13) and clinical placement supervisors (n = 12) were employed. The focus groups were analysed using open coding and thematic analysis.

Results: Three main barrier areas were identified: placement planning and preparation; teaching, assessment and feedback; and cultural and language issues. Potential solutions included addressing placement planning and preparation barriers, appropriate student placement preparation, pre-placement identification of higher risk CALD students, and diversity training for supervisors. For the barrier of teaching, assessment & feedback, addressing strategies were to: adapt student caseloads, encourage regular casual supervisor-student conversations, develop supportive placement delivery modes and structures, set expectations early, model the constructive feedback process, use visual aids, and tailor the learning environment to individual student needs. The enablers for cultural & language issues were to: build language and practical approaches for communication, raise awareness of the healthcare system (how it interacts with healthcare professions and how patients access it), and initiate mentoring programs.

Conclusions: The findings suggest that teaching and learning strategies should be student-centred, aiming to promote awareness of difference and its impacts then develop appropriate responses by both student and teacher. Universities and partnering agencies, such as clinical training providers, need to provide an inclusive learning environment for students from multiple cultural backgrounds.

An assessment of existing bicycle advisory pavement marking on urban roads

Bicycle advisory treatments are used to advise road users of the potential presence of cyclists and of the location where cyclists may be expected to ride on a road. They include pavement markings, warning signs, guide signs, and as such have no regulatory function. The most common type of bicycle advisory pavement markings is the shared lane marking. Other forms of bicycle advisory pavement marking have also been trialled and used in several local jurisdictions. The bicycle awareness zone is an example of such facility which has been trialled and used in southeast Queensland, Australia since the late 1990s. A bicycle awareness zone is similar to shared lane marking in principle but differs in the type of logo and, in some cases, location of its placement on the road. This study assesses the operational and safety issues at three bicycle awareness zone sites by analysing video-assisted observation data collected in 2011 by Queensland Department of Transport and Main Roads, Australia. Of the several applications of bicycle awareness zones, this study only covers a particular application where the centre of the bicycle symbol is placed exactly over the parking edge line. Unlike previous studies, which mostly covered before-and-after evaluations of bicycle advisory pavement markings, the focus of this study is to assess whether the placement of bicycle awareness zone symbols has been successful. The aggregated results from video-assisted observational data show that the cyclists did not always track themselves over the centre of the symbols. Rather, both the cyclists' lateral tracking positions and road user interactions varied with the widths of kerbside parallel parking space. Since the bicycle awareness zone symbols are not positioned on the cyclists' desired line of ride on some roads, their operational effectiveness and safety value are questioned.