Evaluation of the use of Assessment Centre methodology to enhance development planning, work placement outcomes and work readiness for postgraduate students : a pilot

Background: Placements as a form of Work Integrated Learning are widely recognised for the positive impact they have on improving student employability and work readiness. Students can maximise strengths, improve areas of weakness, and develop a strong understanding of the requirements of their chosen field within the confines of a well monitored and rich learning environment. Assessment Centres (ACs) are commonly used in corporate settings for recruitment, selection and more recently to provide developmental feedback to participants. Based on a recent literature review, the present the present project evaluates the application of AC methodology as a developmental tool within the placement milieu. The review, which is also included the current conference proceedings details the benefits of utilising the AC process forming the impetus for the present pilot (Sturre; von Treuer & Keele 2010).
Aims: The primary aim of the paper was to evaluate the application of AC methodology as a tool for measuring and subsequently enhancing professional competencies in a sample of postgraduate students in organisational psychology (n=15).
Method: A longitudinal design was utilised with numerous evaluation points from placement stakeholders. This paper presents the first wave of findings. Students undertook a range of activities, including an in-tray exercise, role play, written report, leaderless group discussion and a personality assessment. Comprehensive feedback was provided by organisational psychologists who also fulfil the role of placement co-ordinators. With the assistance of Placement Co-ordinators, students prepared development plans relating to the competencies identified as requiring development. These plans were to be addressed and progress monitored during consecutive placements.
Results: Initial perceptions gathered from students regarding the AC process were very encouraging. Performance
evaluations collected to date, as measured by behaviourally based ratings scales completed by the students themselves and their workplace supervisors illustrate the positive effect of this methodology. The rigour and comprehensive techniques offered by the methodology enabled students to focus on and improve areas identified for development.
Conclusions: It is important to note that the present design formed a pilot study and as mentioned was undertaken with a limited sample. Future implementation is planned with larger samples, enabling a more comprehensive analysis of the methodology. Nevertheless, the methodology appears to provide a much needed strategy for the assessment and ongoing development of students prior to and during work placements. The application provides early intervention enabling students to address development needs with input from both university and organisational stakeholders based on an established, standardised process.

A preliminary evaluation of the use of graphic novels in teaching information systems

As a result of declining student numbers, and poor satisfaction ratings, an introductory information systems unit was completely redeveloped. A number of innovative initiatives were designed and implemented and the unit has seen a significant improvement in student satisfaction rates. This paper describes the development of a series of graphic novels as a strategy to both increase student engagement with the unit content and enhance the attainment of learning outcomes. It also discusses how the graphic novels were used in lectures, workshops, and competitions to increase student engagement (with varying degrees of success). Students have generally found the graphic novels to be a valuable learning resource. There is a paucity of studies on the impact of graphic novels as a teaching tool, particularly within the context of higher education, and this research is a contribution to this evident gap in the literature.

Evaluation of the YWCA NSW Aboriginal women's wellbeing education program 2010-2011

An evaluation of the effectiveness of the YWCA NSW Aboriginal Women's Wellbeing Program which sought to collaborate with and support local communities to further develop the knowledge, skills and practical strategies of Aboriginal women in establishing healthier living practices for themselves and their families.

Evaluation of the intercultural understanding field trial

In 2011, the Innovation and Next Practice Division (INP) of the Department of Education and Early Childhood Development (DEECD) conducted a field trial on intercultural understanding in partnership with a research and evaluation team from the University of Melbourne and La Trobe University. The field trial was sponsored by the Languages, English as another Language (EAL) and Multicultural Education Division of DEECD.

Performance evaluation of the concurrent execution of NAS parallel benchmarks with BYTE sequential benchmarks on a cluster

Computers of a non-dedicated cluster are often idle (users attend meetings, have lunch or coffee breaks) or lightly loaded (users carry out simple computations). These underutilized computers can be employed to execute parallel applications not only during weekends and at nights but also during office hours. Thus, they have to be shared by parallel and sequential applications which could lead to the improvement of their execution performance. However, there is a lack of experimental study showing the behavior and performance of parallel and sequential applications executing concurrently on clusters. We present here the result of an experimental study into load balancing based scheduling of a mixture of parallel and sequential applications on a non-dedicated cluster.

Evidence of high-skilled VET practitioners and high-performing VET organisations : findings from an evaluation of the long-term impacts of Framing the Future projects conducted in 1999-2000

Framing the Future is a major staff development initiative of the Australian National Training Authority (ANTA), designed to support the implementation of the National Training Framework (NTF). Since 1997 over 20,000 vocational education and training (VET) practitioners have participated in the program. The program was renamed Reframing the Future in 2001.

This study reports on research conducted on the long-term impacts of projects funded by Framing the Future in 1999 and 2000. John Mitchell and Sarah Wood from John Mitchell & Associates conducted the research from May 2000–May 2001.

Using twenty four case studies and the results of interviews and an extensive survey, the report provides evidence of high-skilled VET practitioners and high-performing VET organisations who ensure that their involvement in Framing the Future projects leads to long-term gains, particularly in support of the implementation of the NTF.

What (a) difference a degree makes : the evaluation of the new social work degree in England

After many years of debate in the UK about the need for a degree-level qualification in social work, the arguments for a minimum degree-level qualification were accepted. The requirements for the degree in England were developed drawing on work from a number of sources, including a benchmark statement for undergraduate degrees in social work and focus groups with stakeholders. The new degree in England, launched in 2003, involves one extra year’s study; improvements in the qualifying standard for social work; and specific curriculum and entrance requirements. At the time of launching the degree, the government department responsible for funding (Department of Health) commissioned a three-year evaluation of the implementation of the new degree to establish whether the new qualifying level leads to improvements in the qualified workforce. The aim of the evaluation is to describe the experiences of those undertaking the degree, collect the views of the various stakeholders about the effectiveness of the degree and measure the impact of a degree-level qualification on those entering the workforce. This article, written by the team undertaking the evaluation of the England degree, explores the reasons for the methodological approach adopted and the issues that have arisen in setting up the research.

Evaluation of the effectiveness of marine protected areas in temperate waters of Australasia

An evaluation of the effectiveness of Marine Protected Areas (MPAs) in temperate waters of Australasia has been conducted for this thesis. The aim was to identify key elements needed in a strategy for establishment and management of MPA’s in temperate waters of Australasia. This aim was achieved by assessing how effective a sample of MPA’s has been in meeting the conservation objectives for their establishment and by identifying factors that have contributed to success or failure of the MPA’s in meeting these objectives. Particular attention was paid to the objectives of ecological sustainability and biodiversity preservation. A MPA for the purposes of this research was defined as an area of coastal or marine environment, with a substantial subtidal component, set aside by law primarily for conservation purposes. The study region encompassed the coastal zones of Victoria, Tasmania and South Australia (Australia) and New Zealand. The questions posed in order to address the aim of this thesis were; a) Have existing MPA’s been effective in achieving conservation objectives? b) What have been the important influences on effectiveness of existing MPA’s? c) What are the key elements required for implementation of effective MPA’s? The thesis is divided into three parts. Part I is a review of the literature on implementation and effectiveness of MPA’s. Part II presents a detailed evaluation of one MPA: Point Lonsdale Marine Reserve (PLMR), Victoria, Australia. Part in is an evaluation of a number of Australasian temperate MPA’s based on information provided in a survey of people involved in management of MPA’s, and from a variety of published and unpublished documents. The MPA’s are described, evidence about ecological effectiveness is presented and factors that have enhanced and limited the ability of these MPA’s to achieve conservation objectives are derived. A substantial amount of scientific evidence was found for increases in abundance, mean size and size range of fish and invertebrate populations within the boundaries of ‘no-take’ MPA’s, Some evidence was found for ‘spillover’ of adults and juveniles into adjacent fishing grounds. Ecological effects detected within ‘no-take’ MPA’s in Australasia matched those described in the literature. The abundance and mean size of a number of previously exploited species have increased, migration into adjacent fishing grounds has been documented, and species richness has increased in at least one MPA. The PLMR was established primarily to protect the scientifically significant intertidal rock platforms. The results of the case study suggest that this objective has been achieved. Opinions about effectiveness were obtained for 28 MPA’s. Of these 19 were considered to be achieving some objectives and 10 were considered to be performing well in terms of overall ecological effectiveness. Positive effects on biodiversity were generally assumed as a result of reduction of damaging anthropogenic effects on habitat. Many questionnaire respondents noted an increase in community awareness about and support for marine conservation as a result of proclamation of MPA’s, Overall, the results support the value of MPA’s for sustainability of fish stocks and preservation of biodiversity, but there is substantial doubt over whether some of the MPA’s are too small to maintain benefits in the long-term. ‘No-take’ MPA’s, particularly those more remote from the impacts of human activities, have been the most effective in achieving objectives. A number of interacting factors important to eventual success of MPA’s were identified. The most important enhancing factors identified for the PLMR were physical attributes that limit the extent of human use and a strong conservation ethic amongst many of the visitors to this marine reserve. Limiting factors were far more numerous. Of most concern is the inadequacy of at-site management. Almost half of visitors to the area were not aware of its marine reserve status, despite the fact many were frequent visitors. The need for better educational and interpretative material on-site is highlighted by the results of the PLMR visitor survey. A total of 56 factors that have enhanced effectiveness and 46 factors that have limited effectiveness of Australasian temperate MPA’s were identified. A number of factors were important in more than one MPA and this was used to derive a set of critical, or key, factors. For example, a conclusion of all three approaches used in this study is that failure to implement day-to-day management through lack of resources was a major constraint on effectiveness. The importance of MPA’s to marine conservation depends, in part, on how well they are managed. The key factors that influence MPA effectiveness were used as the basis for derivation of the main requirements for implementation of MPA’s that will be capable of meeting the objectives for their establishment. The most important needs are: • that ‘no-take’ areas surrounded by buffer zones form the basis for a system of MPA’s; • that a high level of protection is bestowed by legislation and regulations; • that a minimum size be set for the ‘no-take’ core areas; • that the selection of sites for MPA’s takes into account land-based impacts; • that institutional arrangements are developed specifically for MPA’s; • that funding for MPA’s is increased to enable effective management; • that day-to-day management is implemented in all MPA’s, with enforcement and education programs as priority areas; • that a monitoring program for one or more MPA in each 'State' is established to provide evidence of ecological effects of reservation; • that public and stakeholder involvement in development and implementation of MPA’s is encouraged as this will influence the degree of public support and compliance; • that community-based programs to educate the general public, stakeholders, the media and decision-makers about the value of MPA’s are essential; and • that measures to reduce financial impact on affected stakeholders be implemented.

A preliminary evaluation of the world's largest skills enhancement program for entrepreneurs

Start and Improve Your Business (SIYB) is an entrepreneurial training program created, sponsored and disseminated by the International Labour Organization. SIYB is, arguably, the world’s largest skills enhancement program for entrepreneurs. SIYB has been in operation since the early 1970s and currently operates in almost 80 countries. During the last decade, more than 100,000 entrepreneurs, thousands of trainers and hundreds of small enterprise development organizations around the world have participated in it (Samuelsen 2003). Surprisingly for an education program of this magnitude and potential global importance, there has been relatively little program evaluation performed. What evaluation has been conducted has been unsystematic, qualitative and unsatisfactory (Harper 1985).

Meanwhile, in the nation of Botswana, since the mid seventies, there has been a huge growth in programs devoted to the training of small and medium entrepreneurs. The SIYB program has formed a significant component of this entrepreneurial training effort in Botswana (ILO 1996). SIYB training was initially supported by the United Nations and later by the Botswana government. Since its introduction into Botswana in1983, the SIYB program has been evaluated only once, in 1993 (Samuelsen 2003). The methods used (subjective questionnaire administered to an unsystematic sample of past participants) fails to provide a satisfactory evaluation of the program. So, in Botswana and worldwide, the world’s largest entrepreneurial training program continues to run in the absence of any knowledge concerning its efficacy. This paper describes the various elements of the SIYB program and places it in the context of the data-rich Botswanan environment. The descriptive work is a necessary predicate to creation of a research design capable of providing the detailed, critical program evaluation that has been so conspicuously lacking throughout the history of the SIYB initiative.