Overcoming inconsistencies in placement assessment : the case for developmental assessment centers

Placements are integral to many university courses and to increasing student employability skills. Nevertheless, several complications, such as the assessment of placement experiences which often go against the principles of procedural justice, may limit placement effectiveness. For example, procedures are not applied uniformly across students; and evaluations of intangible qualities are susceptible to biases. As a result, effort and learning can be compromised. This paper advocates the use of developmental assessment centers to help solve these shortcomings. Developmental assessment centers are often used in organizations to evaluate capabilities of individuals and to facilitate development. Participants complete a series of work related and standardized tasks. Multiple raters then utilize a systematic approach to evaluate participants on a range of competencies, and consequently present constructive feedback to facilitate learning. Therefore, developmental assessment center principles match the key determinants of procedural justice and thus overcome many problems with traditional placement assessments.

Potential utilisation of assessment centre methodology to enhance student placement outcomes, experiences and employability

Background: Placements are of particular importance due to the richness of learning associated with placement experiences and the wider links they represent to industry and the community. Students often refer to placements as the most significant, productive and memorable component of their training. Importantly, placements also provide the opportunity for students to become work ready, i.e., integrate their knowledge into a new set of employable skills and personal qualities. There is now increased emphasis on employability by employers and universities alike; in fact, it now represents a critical performance measure for Australian universities. Despite these key points, there appears to be inconsistencies in approaches to maximising work placements across and within Universities. Assessment centre methodology may represent a useful approach to standardise and optimise work placements for all stakeholders. Assessment centre methodology has been used successfully for selection purposes in industry for the past 50 years. However, their use as a developmental tool is less prominent. Furthermore, their application in the higher education setting, particularly in the context of placements and student development appears under researched.
Overview of issue: Only one published study was found that reported the use of a developmental assessment centre with a post-graduate sample. That study took place over 10 years ago when the concept of employability was still gaining recognition and work placements were less common. The current paper reviews this unique concept in the context of the existing literature and the current needs of Universities, employers and students.
Discussion: It is argued that the reconsideration of assessment centre methodology for development represents an innovative approach to consistently maximising work placement outcomes, experiences and employability.
Conclusions: Given the importance and increased use of placements, the application of assessment centre methodology within the placement curriculum warrants further research. This methodology represents a standardised approach for implementation within a range of placement programs to enhance student development, placement outcomes and employability.

Evaluation of the use of Assessment Centre methodology to enhance development planning, work placement outcomes and work readiness for postgraduate students : a pilot

Background: Placements as a form of Work Integrated Learning are widely recognised for the positive impact they have on improving student employability and work readiness. Students can maximise strengths, improve areas of weakness, and develop a strong understanding of the requirements of their chosen field within the confines of a well monitored and rich learning environment. Assessment Centres (ACs) are commonly used in corporate settings for recruitment, selection and more recently to provide developmental feedback to participants. Based on a recent literature review, the present the present project evaluates the application of AC methodology as a developmental tool within the placement milieu. The review, which is also included the current conference proceedings details the benefits of utilising the AC process forming the impetus for the present pilot (Sturre; von Treuer & Keele 2010).
Aims: The primary aim of the paper was to evaluate the application of AC methodology as a tool for measuring and subsequently enhancing professional competencies in a sample of postgraduate students in organisational psychology (n=15).
Method: A longitudinal design was utilised with numerous evaluation points from placement stakeholders. This paper presents the first wave of findings. Students undertook a range of activities, including an in-tray exercise, role play, written report, leaderless group discussion and a personality assessment. Comprehensive feedback was provided by organisational psychologists who also fulfil the role of placement co-ordinators. With the assistance of Placement Co-ordinators, students prepared development plans relating to the competencies identified as requiring development. These plans were to be addressed and progress monitored during consecutive placements.
Results: Initial perceptions gathered from students regarding the AC process were very encouraging. Performance
evaluations collected to date, as measured by behaviourally based ratings scales completed by the students themselves and their workplace supervisors illustrate the positive effect of this methodology. The rigour and comprehensive techniques offered by the methodology enabled students to focus on and improve areas identified for development.
Conclusions: It is important to note that the present design formed a pilot study and as mentioned was undertaken with a limited sample. Future implementation is planned with larger samples, enabling a more comprehensive analysis of the methodology. Nevertheless, the methodology appears to provide a much needed strategy for the assessment and ongoing development of students prior to and during work placements. The application provides early intervention enabling students to address development needs with input from both university and organisational stakeholders based on an established, standardised process.

Direct patient contacts of dietetic students during their final clinical placement

Direct student-patient contacts, during the professional clinical placement of a Master of Nutrition and Dietetics course, were collected and analysed for the first time using a computerised method. In the final eight-week hospital placement, 26 dietetic students submitted data on direct patient contacts which included: dietetic activities (e.g. assessing, counselling and reviewing); the primary nutritional condition of the patient (e.g. type 2 diabetes and liver disease); and the time spent in contact with patients. The most common dietetic activities were reviews, followed by collection of dietary information and counselling. The most common nutritional condition encountered by students was an inadequate nutrient intake, followed by patients receiving enteral nutrition. Contact time with patients increased over the placement, with proportionately more time spent by students seeing patients independently than when being observed by supervising dietitians. The data collected provided valuable informa tion on the amount of time spent by students in direct patient contacts, the range of dietetic activities undertaken and the amount of time student activities were directly observed. This information will be useful in the development of benchmarks for clinical skill development, hospital and university staff planning and the assessment of the impact of any changes to the format of student placement experience in the clinical setting.

Student peer and self assessment in the context of work integrated learning : making it work

Students are now experiencing opportunities in practice education where their learning is facilitated by professionals of varied backgrounds thus leading to issues of how to assess student performance while on placement. Educators have had to re-think the way in which students’ performance is assessed and to integrate the key graduate attributes of critical reflection, self and peer assessments and feedback. Using recommendations by Mason (1999) in relation to a collaborative group model for workplace learning and ‘The Self-Directed Learning Model’ by Gaiptman and Anthony (1989) the Occupational Wellness and Life Satisfaction (OWLS) program encourages students to reflect on their experiences in an environment of self and peer evaluation, focussing on the process of learning rather than purely on outcomes. Students are required to complete a self and peer assessment of their learning using a nationally recognised fieldwork evaluation instrument and develop a practice portfolio consisting of learning contract and supporting evidence for their self-assessment. Qualitative and quantitative data was collected via a questionnaire to alumni. The most frequently identified skills that were valued by respondents were autonomy and independence. Other benefits identified were facilitation of self directed learning, and ability to problem solve with colleagues and to share learning. In a higher education environment where lifelong learning and the ability to work collaboratively are valued graduate attributes, a focus on peer and self assessment within the context of work integrated learning contributes to graduates who are well placed to work in both traditional and newer and emerging areas of practice.

Formalising industry feedback in assessment practice for work integrated learning

Work Integrated Learning (WIL) programs, such as co-operative education programs, offer students a learning environment which exists outside the traditional classroom and specific discipline boundaries. This necessitates assessment practices that go beyond traditional practices and relationships. Work placement supervisors are best located to observe the students' learning and development and offer feedback on performance and improvement. An investigation was carried out in order to articulate the role of supervisors and work colleagues in facilitating learning in the workplace environment and their involvement in assessment practices. Interviews were conducted with academics and industry representatives on their perceptions of assessment task validity in terms of professional and generic skill development. A synthesis of the findings formed the basis of the research described in this paper. Key findings highlighted the need for better preparation of industry supervisors as to their role in providing feedback and assessment; better preparation of students for transition from the classroom to the workplace; and the importance of ongoing involvement of the three stakeholders (academic, supervisor and student) to maximise learning and professional development. Recommendations for assessment practices include suggestions on how to involve employers in appraising workplace performance; how to measure the real life application of learning; and the development of generic employability skills. © Common Ground, Kathy Henschke, Joan Richardson.

Developing a collaborative model of industry feedback for work placement of business students

Work-integrated learning (WIL) is a signature feature of study in many higher education institutions. In business degrees, industry feedback is recognized as an integral part of the assessment of WIL, yet the role played by industry in appraising student performance in the workplace has not been clearly defined. Based on interviews with industry supervisors and academic mentors, this paper addresses the integration of academic and industry supervisor assessment practices designed to maximize student learning outcomes and capture the depth of the learning experiences during a work placement. A model of industry feedback was developed to incorporate planned assessment practices that achieve the learning outcomes agreed to at the start of the placement by all stakeholders: the student, the academic mentor and the industry supervisor.

Supporting culturally and linguistically diverse students during clinical placement: strategies from both sides of the table

Background: Increasing proportions of Culturally and Linguistically Diverse (CALD) students within health professional courses at universities creates challenges in delivering inclusive training and education. Clinical placements are a core component of most health care degrees as they allow for applied learning opportunities. A research gap has been identified in regard to understanding challenges and strategies for CALD students in health professional placements.

Methods: A key stakeholder approach was used to examine barriers and enablers experienced by CALD students in clinical placement. Semi-structured focus groups with healthcare students (n = 13) and clinical placement supervisors (n = 12) were employed. The focus groups were analysed using open coding and thematic analysis.

Results: Three main barrier areas were identified: placement planning and preparation; teaching, assessment and feedback; and cultural and language issues. Potential solutions included addressing placement planning and preparation barriers, appropriate student placement preparation, pre-placement identification of higher risk CALD students, and diversity training for supervisors. For the barrier of teaching, assessment & feedback, addressing strategies were to: adapt student caseloads, encourage regular casual supervisor-student conversations, develop supportive placement delivery modes and structures, set expectations early, model the constructive feedback process, use visual aids, and tailor the learning environment to individual student needs. The enablers for cultural & language issues were to: build language and practical approaches for communication, raise awareness of the healthcare system (how it interacts with healthcare professions and how patients access it), and initiate mentoring programs.

Conclusions: The findings suggest that teaching and learning strategies should be student-centred, aiming to promote awareness of difference and its impacts then develop appropriate responses by both student and teacher. Universities and partnering agencies, such as clinical training providers, need to provide an inclusive learning environment for students from multiple cultural backgrounds.

An assessment of existing bicycle advisory pavement marking on urban roads

Bicycle advisory treatments are used to advise road users of the potential presence of cyclists and of the location where cyclists may be expected to ride on a road. They include pavement markings, warning signs, guide signs, and as such have no regulatory function. The most common type of bicycle advisory pavement markings is the shared lane marking. Other forms of bicycle advisory pavement marking have also been trialled and used in several local jurisdictions. The bicycle awareness zone is an example of such facility which has been trialled and used in southeast Queensland, Australia since the late 1990s. A bicycle awareness zone is similar to shared lane marking in principle but differs in the type of logo and, in some cases, location of its placement on the road. This study assesses the operational and safety issues at three bicycle awareness zone sites by analysing video-assisted observation data collected in 2011 by Queensland Department of Transport and Main Roads, Australia. Of the several applications of bicycle awareness zones, this study only covers a particular application where the centre of the bicycle symbol is placed exactly over the parking edge line. Unlike previous studies, which mostly covered before-and-after evaluations of bicycle advisory pavement markings, the focus of this study is to assess whether the placement of bicycle awareness zone symbols has been successful. The aggregated results from video-assisted observational data show that the cyclists did not always track themselves over the centre of the symbols. Rather, both the cyclists' lateral tracking positions and road user interactions varied with the widths of kerbside parallel parking space. Since the bicycle awareness zone symbols are not positioned on the cyclists' desired line of ride on some roads, their operational effectiveness and safety value are questioned.

Clinical placement before or after simulated learning environments? A naturalistic study of clinical skills acquisition among early-stage paramedicine students

BACKGROUND: There is conflicting evidence surrounding the merit of clinical placements (CPs) for early-stage health-profession students. Some contend that early-stage CPs facilitate contextualization of a subsequently learned theory. Others argue that training in simulated-learning experiences (SLEs) should occur before CP to ensure that students possess at least basic competency. We sought to investigate both claims. METHODS: First-year paramedicine students (n = 85) undertook 3 days of CP and SLEs as part of course requirements. Students undertook CP either before or after participation in SLEs creating 2 groups (Clin → Sim/Sim → Clin). Clinical skills acquisition was measured via direct scenario-based clinical assessments with expert observers conducted at 4 intervals during the semester. Perceptions of difficulty of CP and SLE were measured via the National Aeronautics and Space Administration Task Load Index. RESULTS: Students' clinical assessment scores in both groups improved significantly from beginning to end of semester (P < 0.001). However, at semester's end, clinical assessment scores for the Sim → Clin group were statistically significantly greater than those of the Clin → Sim group (P = 0.021). Both groups found SLEs more demanding than CP (P < 0.001). However, compared with the Sim → Clin group, the Clin → Sim group rated SLE as substantially more time-demanding than CP (P = 0.003). CONCLUSIONS: Differences in temporal demand suggest that the Clin → Sim students had fewer opportunities to practice clinical skills during CP than the Sim → Clin students due to a more limited scope of practice. The Sim → Clin students contextualized SLE within subsequent CP resulting in greater improvement in clinical competency by semester's end in comparison with the Clin → Sim students who were forced to contextualize skills retrospectively.

Assessment of simulated clinical skills and distance students: can we do it better?

Australian universities have traditionally been able to supplement clinical education, for undergraduate nursing courses, delivered on placement with weekly clinical teaching in the simulated environment. The Objective Structured Clinical Assessment (OSCA) tool has been used in this simulated environment to assess clinical skills. Recently, however, online delivery of undergraduate nursing courses has become more common. The move from an internal mode of teaching to an online external mode is seen worldwide and poses challenges to staff and students as well as changing the teaching and learning culture of institutions (Philip and Wozniak, 2009). This cultural shift and the resulting diminishing timeframe for students to acquire and practice simulated clinical skills imply that it may become necessary to rethink assessment forms such as the OSCA assessment. This study examines whether or not the OSCA tool developed by Bujack et al. (1991a) is the best tool to be used in this new context, where online teaching is supplemented by very short, annual, intensive periods of study. Skills acquisition theories dictate that time is required to produce an ideal skills acquisition environment (Quinn, 2000) but the time constraints placed on students in such intensive periods of study could influence skills acquisition. This cross-sectional qualitative study used semi-structured interviews and focus groups to collect data. 65% of the nursing faculty participated in the study. The teaching of the Bachelor of Nursing (BN) occurred on two campuses and staff from both areas participated. This group of nurse academics was employed across the range of academic levels (from lecturer to professor) at the University. Data analysis followed a generic thematic analysis framework. Findings in this study show that there are a variety of attitudes and underpinning beliefs amongst staff in relation to the OSCAs. Doubts were raised in regard to the suitability of the use of the OSCA tool in this setting. It also became apparent during this study that the OSCA tool possibly serves purposes other than an assessment tool.

Analytical assessment of optimum magnet pole-arc for PMSM under influence of different magnetization patterns

Permanent magnet synchronous machines (PMSMs) are popular in both industrial and domestic applications because of its high efficiency, power density, and reliability as compared with the conventional types of electrical machines. Generally, the analytical models and their field solutions are preferable to provide an accurate insight of the PMSM performances, instead of using the finite element models, because the former takes a considerably shorter computational time. PMSM design could have different properties of either slotted or slotless, or varieties of magnet placement on the rotor. By focusing on semi-closed surface-mounted PMSMs, the 2D analytical subdomain model in [1] demonstrates an accurate prediction of the magnetic fields that can facilitate the evaluation of the global quantities of PMSMs, such as cogging torque (Tcog), back-EMF, and total harmonic distortion (THDv). Previously, researchers investigated the influences of the machine performance by a single factor, e.g., the variation of Tcog during changes of magnet pole-arc (αP) [2, 3], or slot-opening [2, 3]. These investigations normally considered two types of magnetization patterns, i.e., parallel (PaM) and radial magnetization (RM). Therefore, the motivation of our work hinges on predicting the optimum value of αP in designing a surface-mounted PMSM under influence of four different magnetization patterns, using the analytical subdomain model.