Assessment frameworks : a critical reflection

Increasing widespread requirements that assessment practice conforms to generic guidelines contained in assessment frameworks has been contentious and critiques offered on individual frameworks have been assumed to apply to the concept of assessment frameworks more generally. After comparing four assessment frameworks currently being used in the UK, this paper argues that although some generalizations can be made, for the most part, they are highly individual documents in terms of range and depth of content, the extent to which they are evidenced and the quality of that evidence and implicit expectations as to the skill bases of assessors. Furthermore, the introduction of assessment frameworks is not in itself a panacea to ensure good practice. Even with the most comprehensive frameworks, social workers will still need comprehensive training in assessment and supervision of their practice.

No effect of eccentric training on jumper's knee in volleyball plays. During the competitive season : a randomized clinical trial

Background: The effect of surgery on patellar tendinopathy (jumper's knee) is questionable, and conservative treatment protocols have not been properly documented.

Purpose: The aim of this study was to investigate the effect of a newly developed eccentric training program for patellar tendinopathy in volleyball players during the competitive season.

Study Design: Randomized clinical trial.

Methods: Patients were recruited from male and female elite volleyball teams in Norway, and the diagnosis was based on clinical examination alone. Of 51 players diagnosed with patellar tendinopathy, 29 could be included in the study. The training group (n = 13) performed squats on a 25° decline board as a home exercise program (3 × 15 repetitions twice daily) for a 12-week intervention period during the final half of the competitive season. The eccentric (downward) component was done on the affected leg. The control group (n = 16) trained as usual. The primary outcome was a symptom-based questionnaire developed specifically for patellar tendinopathy (Victorian Institute of Sport Assessment score), and patients were followed up before and after the intervention period, as well as after 6 and 30 weeks. All subjects self-recorded training to document their activity level (eccentric training, volleyball training, matches, other training).

Results: There was no change in Victorian Institute of Sport Assessment score during the intervention period in the training (pre, 71.1 ± 11.3; post, 70.2 ± 15.4) or control group (pre, 76.4 ± 12.1; post, 75.4 ± 16.7), nor was there any change during the follow-up period at 6 weeks or 6 months. The training group completed 8.2 ± 4.6 weekly sessions of eccentric training during the intervention period (59% of the recommended volume), and there was no difference between groups in training or competition load.

Conclusion: There was no effect on knee function from a 12-week program with eccentric training among a group of volleyball players with patellar tendinopathy who continued to train and compete during the treatment period. Whether the training would be effective if the patients did not participate in sports activity is not known.

Equity-focused health impact assessment framework

Background to the Development of the Equity-Focused HIA Framework
The equity focused health impact assessment (EFHIA) framework arises out of a two year research project funded for the most part by the Australian Government’s Public Health Education Research Program (PHERP) Innovations Grants (Round 2) scheme. This project had as its primary objective the development of a framework for health inequalities impact assessment, subsequently renamed equity focused health impact assessment. A partnership between the University of Newcastle, Deakin University and the University of New South Wales (the Project Management Steering Committee) received the funding and the Australasian Collaboration for Health Equity Impact Assessment (ACHEIA) was formed to undertake appropriate background research and to develop, pilot test, modify and disseminate the framework. The work commenced in September 2002 and concluded in October 2004. Part of the funding included a capacity building workshop in August 2004. ACT Health and the Division of Medicine at the John Hunter Hospital, Newcastle, also provided financial support for the project. The August 2004 Workshop was supported by NSW Health. All participants and organisations involved in the project gave extensive in-kind support.
The aims of the workshop were to bring together an international collaboration of multidisciplinary investigators, public health experts, and key senior health managers working in national, state and local settings, to inform the further development of the framework and to provide training in its application. The initial goals of the project were to work collaboratively to develop a strategic framework to assess the health inequalities of public health-related policies, plans, strategies, decisions, programs and services. The EFHIA framework as presented at the August workshop was developed through:
1. an extensive review of the relevant literature
2. formal and informal consultation with members of ACHEIA (the international
reference group), members of the Project Management Steering Committee and
other relevant experts; and
3. testing of the draft EFHIA framework with the 5 case study partners – who applied the draft framework in a range of health settings (see
Acknowledgements).
The result of this work has been the development of an equity focused health impact assessment framework that can be used to determine the unanticipated and systemic health inequities that may exist within the decision making processes or activities of a range of organisations and sectors. The EFHIA framework provides one approach that can be used to assist decision makers to put equity and health on their agenda in a more obvious and systematic way. The framework represents a ‘moment in time’ rather than a definitive statement or ‘toolkit’ on the best way to proceed. Further practice, refinement and adjustment will be needed over many years to consolidate both HIA and EFHIA. As well as this guide to the framework, additional outputs from the project team include:
- A literature review
- A position paper
- A report on the five case studies
- An evaluation report.
With the consent of the Australian Government, a monograph will be made available to workshop participants at the end of October which contains the framework and the appropriate background papers.

A review of play and play assessment used in occupational therapy

In occupational therapy play is regarded as important in itself. This view has been influenced by occupational science and the assumption that play is a child's primary occupation. To reflect this change in the view of play, assessments of play are now being developed which focus on aspects of behaviour which are unique to play. As a result of this work on play, play training programs have been developed which focus on teaching children how to play.

Flexible delivery and student attrition in the vocational education and training sector: case studies of students who dropped out

Government policy in Australia is increasingly encouraging training organisations in the Vocational Education and Training (VET) sector to adopt flexible delivery approaches. This policy shift is supported by key VET stakeholders including Industry Training Advisory Boards. A recurring theme in VET policy documents is an apparent confidence that flexible delivery can meet the diverse needs of individual learners while at the same time providing cost savings. Yet evidence is emerging that Australian VET learners are not typically ready for flexible delivery, and this lack of readiness is reflected in high attrition rates and low pass rates in many flexibly delivered courses. One research project found that over 70% of learners in the Australian VET sector do not have the learning capabilities required to be ready for flexible delivery. A recent review of the module outcomes achieved by VET students nationally found that students studying by external/correspondence and self-paced unscheduled modes had lower module completion rates than students studying by other delivery strategies.

Research on student progress in flexible delivery within the Australian VET sector has largely been quantitative. That research provides useful statistical data on completion and attrition rates for various modes of delivery, but does not explore the reasons underlying the high attrition rates found in flexible delivery. The qualitative research that is available tends to focus on students who successfully complete their courses, not on those who withdraw. As a result, the Australian literature on flexible delivery in the VET sector is lacking in-depth qualitative information about students who enrol in courses but do not complete. In comparison, the broader literature on distance education and flexible delivery in other educational sectors offers some useful insights into student attrition, and can be can be used to inform research into attrition within the Australian VET sector.

This paper reports on aspects of a research project that followed up six adult learners who enrolled in VET courses but who either failed assessment or withdrew. The research project presented the students’ stories in the form of narrative case studies, focussing on the detailed examination of the barriers that each student experienced, and analysing these barriers in relation to issues raised in the literature. This paper reports on two particular themes that emerged from that research project. The literature on distance education and flexible delivery argues that:


· student dropout is often not determined by a single factor, but by the interaction of a number of factors that build up over time;

· students who experience difficulties when studying by flexible delivery can often be reluctant to access the support that is available to them.

This paper uses these themes as a point of reference in presenting the stories of some of the students who participated in the research project.

Putting woman-centered care into practice : a new (ANEW) approach to psychosocial risk assessment during pregnancy

Background: When antenatal care is provided, identification and management of challenging problems, such as depression, domestic violence, child abuse, and substance abuse, are absent from traditional midwifery and medical training. The main objective of this project was to provide an alternative to psychosocial risk screening in pregnancy by offering a training program (ANEW) in advanced communication skills and common psychosocial issues to midwives and doctors, with the aim of improving identification and support of women with psychosocial issues in pregnancy.

Methods: ANEW used a before‐and‐after survey design to evaluate the effects of a 6‐month educational intervention for health professionals. The setting for the project was the Mercy Hospital for Women in Melbourne, Australia. Surveys covered issues, such as perceived competency and comfort in dealing with specific psychosocial issues, self‐rated communication skills, and open‐ended questions about participants' experience of the educational program.

Results: Educational program participants (n = 22/27) completed both surveys. After the educational intervention, participants were more likely to ask directly about domestic violence (p = 0.05), past sexual abuse (p = 0.05), and concerns about caring for the baby (p = 0.03). They were less likely to report that psychosocial issues made them feel overwhelmed (p = 0.01), and they reported significant gains in knowledge of psychosocial issues, and competence in dealing with them. Participants were highly positive about the experience of participating in the program.

Conclusions:The program increased the self‐reported comfort and competency of health professionals to identify and care for women with psychosocial issues.

Language, power and ruling relations in vocational education and training

This thesis uses institutional ethnography to explore the text-based regulatory framework of the Australian Vocational Education and Training (VET) sector. Training Packages are national competency standards used to assess local workplace practice. The Australian Quality Training Framework (AQTF) is a national compliance framework used to audit local learning and assessment practice. These texts operate in a ‘symbiotic relationship’ to achieve a policy goal of national consistency. The researcher explicates the social relations of VET starting from her disquiet as a practitioner. The thesis argues that Training Packages and the AQTF socially organise the content and delivery of local learning and assessment activities. VET practitioners struggle to use these texts to support good practice, and their hidden work maintains an unstable VET system. Yet the extralocal mode of ruling offers no room to challenge VET policy. The thesis explicates three themes. Interview data is used to explore the contrast between the institutional language of Training Packages and the vernacular of workplaces in which these texts are activated. Many practitioners and participants simply do not understand Training Package competency standards. Using these texts to judge employee performance shifts the policing of workplace practice from local sites to external VET authorities. A second theme emerges as the analysis explores why VET practitioners use this excluding language in their work with participants. Interview data reveals that local training organisations achieve different readings as they engage with ruling VET texts. Some organisations use the national texts as broad frameworks, allowing practitioners to create spaces for meaningful learning. Other organisations adopt a narrow and rule-bound reading of national texts, displacing practitioners’ authority over their own practice. A third theme is explored through examination of a sequence of VET texts. The review and redevelopment of the mandatory qualifications for VET practitioners identified the language of the competency standards as a significant accessibility issue. These concerns were reshaped and subsumed in an official response that established the use of this language as a compulsory assessable requirement and a language and literacy benchmark. The thesis presents a new understanding of VET as a regulatory framework established through multiple levels of ruling texts that connect local sites to national government agendas. While some individual practitioners are able to navigate through this system, there is an urgent need for practitioners as a profession to challenge national hegemony.

Pharmacist assessment of adherence, risk and treatment in cardiovascular disease (PAART CVD)

Cardiovascular disease (CVD) accounts for 18% of disease burden in Australia, and 35% of deaths. Evidence- based management of CVD risk requires systematic consideration of individual risk factors and overall CVD risk, and a balanced approach to lifestyle modification, the optimal use of medicines, and medicines adherence.

This project examines a pHot model for primary prevention of CVD in community pharmacy aimed at improving quality of care. Pharmacists from ten pharmacies received training in CVD risk factor management and facilitating patient lifestyle modification.

They recruited 70 participants aged 50-74 years, taking medicines for blood pressure (BP) or cholesterol, and without diabetes or CVD, At baseline, research assistants conducted a clinical assessment of anthropometric and biomedical risk factors, and conducted interviews to examine health behaviours, medicines use and related issues. Data was analysed by a consultant pharmacist and summary reports produced, with recommendations and targets for risk reduction. These were addressed by patients and their community pharmacists over five monthly sessions. At follow up, the relative risk reduction for CVD onset over the next five years was 24%, contributed to by reductions in mean systolic BP (-7mmHg), diastolic PP (-5 mmHg), total:HDL cholesterol ratio (—0.2), waist circumference (—2cm in males, —0.7cm in females) and other risk factors.

Several key health behaviours improved, including diet quality and physical activity levels. Prevalence of non-adherence to cardiovascular medicines dropped by 1 6% to 22%.

The potential health benefits from this intervention need to be confirmed via larger, controlled clinical trials. Overall, this appears to be a feasible and potentially effective public health measure.

Perspectives on assessment practices in Australian journalism education

Claims from both educational and industry sides about what journalism students should be learning are not new, and not confined to Australia. European debates on the nexus between practical training and theoretical capacity extend to those by American journalism educators, who share concerns about how journalism schools can accommodate both theory and practice (Adam 2001; Bjork 1996; Bromley & Servaes 2006; Dickenson & Brandon 2000; O’Donnell 2001-02; Rosenbaum 2002; Ricketson 2005). These discussions merge coherently with initiatives undertaken by Australian universities to ensure graduates from any discipline are equipped with a set of measurable skills (or attributes)appropriate to the international context of higher education. The paper explores this tension through the lens of assessment in journalism education, and does so by drawing mostly upon education theory. It suggests some possible ways to cater for media industry pressure on universities to cut theory and concentrate on practice, while accounting for the educator’s responsibility to promote learning in line with graduate attributes such as the capacity to function as a global citizen, a capacity for critical evaluation, and a deep knowledge of the field of study.

Utility of parent training for child behaviour difficulties

Focuses on parent training for child behaviour difficulties and includes four case studies providing a detailed assessment, formulation and evaluation of the treatment. The reports illustrate the utility of parent training alone and in combination with other psychological therapies and pharmacotherapy in the treatment of different childhood disorders.

Comparison of two modes of delivery of first aid training including basic life support

Aims: Flexible-learning first aid courses are increasingly common due to reduced classroom contact time. This study compared retention of first aid knowledge and basic life support (BLS) skills three months after a two-day, classroom-based first aid course (STD) to one utilizing on-line theory learning at home followed by one day of classroom training (FLEX).
Methods: In this prospective randomized controlled trial, 256 participants with internet access and no first aid related training for at least five years were randomly allocated to a STD or FLEX course. Assessment was conducted immediately after training and again three months later. Each participant was allocated a theory and a BLS score, which were summed and averaged to create an equally-weighted ‘combined score’
of first aid knowledge and skills.
Results: There was no significant difference in theory scores between the STD and FLEX groups immediately after training and after three months. STD participants had significantly higher BLS scores immediately after training (p = 0.001) and three months later (p = 0.046). Males had significantly higher BLS scores after training (p < 0.001), but not three months later (p = 0.02). Participants older than 46 years had significantly lower BLS scores than younger participants (p < 0.001). There was no significant difference in combined scores between the STD and FLEX groups or between genders, education or age groups either immediately after training or three months later.
Conclusion: After replacing one day of classroom-based training with on-line theory training, there was no significant difference in the first aid competencies of the study population, as measured by an equallyweighted
combined score of basic life support and first aid theory.

Reliability and variability of day-to-day vault training measures in artistic gymnastics

Inter-day training reliability and variability in artistic gymnastics vaulting was determined using a customised infra-red timing gate and contact mat timing system. Thirteen Australian high performance gymnasts (eight males and five females) aged 11-23 years were assessed during two consecutive days of normal training. Each gymnast completed a number of vault repetitions per daily session. Inter-day variability of vault run-up velocities (at -18 to -12 m, -12 to -6 m, -6 to -2 m, and -2 to 0 m from the nearest edge of the beat board), and board contact, pre-flight, and table contact times were determined using mixed modelling statistics to account for random (within-subject variability) and fixed effects (gender, number of subjects, number of trials). The difference in the mean (Mdiff) and Cohen's effect sizes for reliability assessment and intra-class correlation coefficients, and the coefficient of variation percentage (CV%) were calculated for variability assessment. Approach velocity (-18 to -2 m, CV = 2.4-7.8%) and board contact time (CV = 3.5%) were less variable measures when accounting for day-to-day performance differences, than pre-flight time (CV = 17.7%) and table contact time (CV = 20.5%). While pre-flight and table contact times are relevant training measures, approach velocity and board contact time are more reliable when quantifying vaulting performance.

Potential utilisation of assessment centre methodology to enhance student placement outcomes, experiences and employability

Background: Placements are of particular importance due to the richness of learning associated with placement experiences and the wider links they represent to industry and the community. Students often refer to placements as the most significant, productive and memorable component of their training. Importantly, placements also provide the opportunity for students to become work ready, i.e., integrate their knowledge into a new set of employable skills and personal qualities. There is now increased emphasis on employability by employers and universities alike; in fact, it now represents a critical performance measure for Australian universities. Despite these key points, there appears to be inconsistencies in approaches to maximising work placements across and within Universities. Assessment centre methodology may represent a useful approach to standardise and optimise work placements for all stakeholders. Assessment centre methodology has been used successfully for selection purposes in industry for the past 50 years. However, their use as a developmental tool is less prominent. Furthermore, their application in the higher education setting, particularly in the context of placements and student development appears under researched.
Overview of issue: Only one published study was found that reported the use of a developmental assessment centre with a post-graduate sample. That study took place over 10 years ago when the concept of employability was still gaining recognition and work placements were less common. The current paper reviews this unique concept in the context of the existing literature and the current needs of Universities, employers and students.
Discussion: It is argued that the reconsideration of assessment centre methodology for development represents an innovative approach to consistently maximising work placement outcomes, experiences and employability.
Conclusions: Given the importance and increased use of placements, the application of assessment centre methodology within the placement curriculum warrants further research. This methodology represents a standardised approach for implementation within a range of placement programs to enhance student development, placement outcomes and employability.