Learning and teaching assessment: reviewing the evidence

The authors have recently completed a research review on learning and teaching of assessment in social work which was commissioned by the Social Care Institute for Excellence (SCIE) and the Social Policy and Social Work Learning and Teaching Support Network (SWAPltsn) to support the development of the new social work award in England. This involved reviewing relevant literature from social work and cognate disciplines back to 1990 with the aim of identifying best practice in learning and teaching of assessment skills.

Although assessment has been recognised as a core skill in social work and should underpin social work interventions, there is no singular theory or understanding as to what the purpose of assessment is and what the process should entail. Social work involvement in the assessment process may include establishing need or eligibility for services, to seek evidence of past events or to determine likelihood of future danger, may underpin recommendations to other agencies, or may determine the suitability of other service providers. In some settings assessment is considered to begin from the first point of contact and may be a relatively short process, whereas elsewhere it may be a process involving several client contacts over an extended period of time. The assessment process may range from the collection of data on standardised proforma to a flexible approach depending on circumstances. These variations permeate the literature on the learning and teaching of assessment in social work and cognate disciplines.

Several different approaches to classroom based learning were proposed in the literature including case-based teaching, interviews with actors who have been trained to play 'standardised clients', and observation of children and families, as well as didactic lecturing and various uses of video equipment and computers. Furthermore learning by doing has long been one of the hallmarks of social work education, and there are a number of models proposed in which students learn about the assessment process through conducting assessments. The evidence to support these different approaches to learning and teaching is variable. Based on the evidence reviewed, recommendations as to what is good practice in learning and teaching about assessment will be presented.

Evidence-based practice and the borders of data in the global information era

This article explores the range of boundaries to negotiate the demands of evidence-based practice. Increasing demands that social work be a profession committed to evidence-based practice have coincided with innovations in information technology, which potentially give social workers unprecedented access to a plethora of sources and types of evidence. Because these innovations can enable access to evidence beyond traditional boundaries, the question of how the author establish the borders of acceptability warrants consideration. Recommendations for a critical approach to selective evidence based for social work interventions are also provided.

Interventions to reduce harm associated with adolescent substance use

A major proportion of the disease burden and deaths for young people in developed nations is attributable to misuse of alcohol and illicit drugs. Patterns of substance use established in adolescence are quite stable and predict chronic patterns of use, mortality, and morbidity later in life. We integrated fi ndings of systematic reviews to summarise evidence for interventions aimed at prevention and reduction of harms related to adolescent substance use. Evidence of efficacy was available for developmental prevention interventions that aim to prevent onset of harmful patterns in settings such as vulnerable families, schools, and communities, and universal strategies to reduce attractiveness of substance use. Regulatory interventions aim to increase perceived costs and reduce availability and accessibility of substances. Increasing price, restricting settings of use, and raising legal purchase age are eff ective in reducing use of alcohol and tobacco and related harms. Screening and brief intervention are efficacious, but efficacy of a range of treatment approaches has not been reliably established. Harm-reduction interventions are effective in young people involved in risky and injecting substance use.

A role for workforce competencies in evidence-based health promotion education

Education programs should be based on research about the knowledge and skills required for practice, rather than on intuition or tradition, but there is limited published curriculum research on health promotion education. This paper describes a case study of how workforce competencies have been used to assist evidence-based health promotion education in the areas of curriculum design, selection of assessment tasks and continuous quality assurance processes in an undergraduate program at an Australian university. A curriculum-competency mapping process successfully identified gaps and areas of overlap in an existing program. Previously published health promotion workforce competencies were effectively used in the process of selecting assessment items, providing clear guidelines for curriculum revision and a useful method to objectively assess competency content in an evidence informed framework. These health promotion workforce competencies constituted an additional tool to assess course quality. We recommend other tertiary institutions consider curriculum-competency mapping and curriculum based assessment selection as quality and evidence based curriculum review strategies.

Preparing construction project managers to document professional growth

Deakin University’s School of Architecture and Building is renowned for producing graduates who possess relevant attributes that make them job ready for the building and construction industry. Graduate destination surveys indicate that in the last eight (8) years, 100% of all Infrastructure Logistics (Construction and Facility Management) course graduates found relevant employment. This success is a direct result of a curriculum that is responsive to industry needs alongside educational methodology that focuses on excellent teaching and research while seeking new ways of developing and delivering courses.

The Infrastructure Logistics course prepares graduates to successfully compete in today’s global job market, and allows them to showcase relevant knowledge and skills that are critical in seeking and sustaining employment. Traditionally, tailored resumes served this purpose; however, in many professional fields, professional portfolios are now becoming a more desirable way of providing a summary of relevant attributes alongside evidence of professional abilities.

Sustaining employment, appraisals, and applying for a promotion are often subject to adequate evidence of professional standards and growth. Professional bodies require records of contribution to Continuing Professional Development (CPD) schemes; and accrediting organisations require professionals applying for professional registration to provide documented evidence of their relevant experience and abilities. The Australian Institute of Project Management (AIPM 2007) requires candidates wanting to become Registered Project Managers (RegPM) to demonstrate their current work-based experience and competencies.

This paper reports on a teaching strategy adopted in the Project Management (PM) stream, offered as part of Infrastructure Logistic courses. The teaching strategy is based on a combination of constructivism theory of learning, problem and project based learning, and active learning. The strategy requires systematic reflection and conscious creation of documented evidence of PM attributes and competences in the form of a portfolio.

Preliminary results of action research monitoring the effectiveness of systematic reflection indicate that students respond very positively to the idea of professional journals and professional portfolios. Preliminary results also indicate that students accept reflection and conscious documentation of their achievements as an integral part of their study and future practice.

Understanding and influencing physical activity to improve health outcomes

Participation in physical activity is associated with significant benefits to health. We provide an overview of research relevant to understanding and influencing health-enhancing physical activity in adults. We describe a behavioural epidemiology framework that is designed to integrate the range of studies in the field; give brief examples of studies on the relationships between physical activity and health outcomes; and, we consider descriptive studies of adult populations on levels of participation. We describe research findings on the correlates of physical activity participation; describe ecological models of health behaviour that may be used in understanding and influencing physical activity; and, we review research findings on how environmental attributes can influence adults’ physical activity, particularly walking. There is considerable potential to use evidence-based approaches to increase the physical activity levels of whole populations, particularly through a focus on developing the attributes of community environments that can promote walking.

A controlled trial of internet-based cognitive-behavioural therapy for panic disorder with face-to-face support from a general practitioner or email support from a psychologist

Background: Panic disorder (PD) is one of the most common anxiety disorders seen in general practice, but provision of evidence-based cognitive-behavioural treatment (CBT) is rare. Many Australian GPs are now trained to deliver focused psychological strategies, but in practice this is time consuming and costly.

Objective: To evaluate the efficacy of an internet-based CBT intervention (Panic Online) for the treatment of PD supported by general practitioner (GP)-delivered therapeutic assistance.

Design: Panic Online supported by GP-delivered face-to-face therapy was compared to Panic Online supported by psychologist-delivered email therapy.

Methods: Sixty-five people with a primary diagnosis of PD (78% of whom also had agoraphobia) completed 12 weeks of therapy using Panic Online and therapeutic assistance with his/her GP (n = 34) or a clinical psychologist (n = 31). The mean duration of PD for participants allocated to these groups was 59 months and 58 months, respectively. Participants completed a clinical diagnostic interview delivered by a psychologist via telephone and questionnaires to assess panic-related symptoms, before and after treatment.

Results: The total attrition rate was 20%, with no group differences in attrition frequency. Both treatments led to significant improvements in panic attack frequency, depression, anxiety, stress, anxiety sensitivity and quality of life. There were no statistically significant differences in the two treatments on any of these measures, or in the frequency of participants with clinically significant PD at post assessment.

Conclusions: When provided with accessible online treatment protocols, GPs trained to deliver focused psychological strategies can achieve patient outcomes comparable to efficacious treatments delivered by clinical psychologists. The findings of this research provide a model for how GPs may be assisted to provide evidence-based mental healthcare successfully.

Testing the immunocompetence handicap hypothesis : a review of the evidence

The immunocompetence handicap hypothesis was formulated 12 years ago in an attempt to offer a proximate mechanism by which female choice of males could be explained by endocrine control of honest signalling. The hypothesis suggested that testosterone has a dual effect in males of controlling the development of sexual signals while causing immunosuppression. Our purpose in this review is to examine the empirical evidence to date that has attempted to test the hypothesis, and to conduct a meta-analysis on two of the assumptions of the hypothesis, that testosterone reduces immunocompetence and increases parasitism, to ascertain any statistical trend in the data. There is some evidence to suggest that testosterone is responsible for the magnitude of trait expression or development of sexual traits, but this is by no means conclusive. The results of many studies attempting to find evidence for the supposed immunosuppressive qualities of testosterone are difficult to interpret since they are observational rather than experimental. Of the experimental studies, the data obtained are ambiguous, and this is reflected in the result of the meta-analysis. Overall, the meta-analysis found a significant suppressive effect of testosterone on immunity, in support of the hypothesis, but this effect disappeared when we controlled for multiple studies on the same species. There was no effect of testosterone on direct measures of immunity, but it did increase ectoparasite abundance in several studies, in particular in reptiles. A funnel analysis indicated that the results were robust to a publication bias. Alternative substances that interact with testosterone, such as glucocorticoids, may be important. Ultimately, a greater understanding is required of the complex relationships that exist both within and between the endocrine and immune systems and their consequences for mate choice decision making.

Government revenue and government expenditure nexus : evidence from developing countries

The relationship between government revenue and government expenditure has attracted a lot of interest given its policy relevance, particularly with respect to budget deficits. The goal of this paper is to investigate evidence for causality between government revenue and government expenditure within a multivariate framework by modelling them together with gross domestic product for 12 developing countries. Our application of the Toda and Yamamoto (1995) test for Granger causality reveals support for the tax-and-spend hypothesis for Mauritius, El Salvador, Haiti, Chile and Venezuela. For Haiti, there is evidence for the spend-and-tax hypothesis, while for Peru, South Africa, Guatemala, Uruguay and Ecuador there is evidence of neutrality.

Are nominal exchange rates and price levels co-integrated? new evidence from threshold autoregressive and momentum-threshold autoregressive models

The goal of this paper is to examine evidence for co-integration between nominal exchange rates for Canada, the UK, Japan, Germany, Italy and France (G6) vis-à-vis the US dollar, and the relative price ratios using monthly data over the period 1973:01 to 1997:04. Motivated by the fact that exchange rate adjustment may be asymmetric, we allowed for asymmetric adjustment in exchange rates by using the threshold autoregressive model and the momentum threshold autoregressive model. We do not find any evidence of a co-integrating relationship; hence, we fail to establish long-run purchasing power parity.

Effects of strategies to promote children's physical activity on potential mediators

The aim of this paper is to review evidence of the effectiveness of interventions that present physical activity outcomes and potential mediators of behavioural change among 4–12-year-old children. A systematic search of electronic databases for original research articles published in peer-review journals between January 1985 and the end of June 2006 was carried out. A total of 19 studies that reported intervention effects on physical activity and mediators of behavioural change were identified. The most common mediators reported included physical activity knowledge or beliefs (11 studies); self-efficacy (8 studies); and enjoyment or preference for physical activity (6 studies). Less frequently reported mediators included attitudes, behavioural capability, intentions, outcome expectancies, social norms, social support and self-concept. Seven of the 11 interventions that reported intervention effects on knowledge/beliefs stated positive changes in this mediator. Four of the eight studies that reported intervention effects on self-efficacy had significant improvements; however, only two out of six interventions reported significant improvements in physical activity enjoyment or preference. None of the studies reviewed reported whether changes in these constructs mediated changes in children's physical activity behaviours. Although more than half of the studies reviewed reported a positive intervention effect on children's physical activity, no study carried out a mediating analysis to attempt to identify the mechanisms of change. Future research should more clearly identify the mediators of behavioural change that are being targeted and whether this explains intervention effects.

Implementing a journal club in a palliative care setting : a link in the chain of evidence-based practice

This paper describes the implementation and evaluation of a journal club in a privately funded palliative care unit. Journal club meetings were initiated as part of a quality improvement process to foster the uptake of evidence-based practice. Nurses were presented with research articles each month and discussions were conducted focussing on methodological considerations of the research and implications of the research for patient care. The maximum number of attendees at any one meeting was nine and the minimum number was four. Overall, evaluations were positive about all aspects of the meetings. Attendees found that the selected articles were relevant, providing new information, stimulated discussion and reflection on clinical practice and encouraged further reading. One of the positive aspects of the meetings identified by participants was the facilitation style that enabled discussion in a safe and supportive environment. An important outcome of the meetings is the potential to explore evidence-based practices relevant to palliative care and to implement new practices or revise existing ones. As part of this process practice changes and clinical guidelines have been implemented. A dedicated facilitator with university links and a supportive organisational culture promoted club meetings as a practical way to provide clinical nurses with the opportunity to explore evidence-based research in the area of palliative care.

Doing justice' : stories of everyday life in disadvantaged schools and neighbourhoods

I worked as a school administrator in 'disadvantaged schools' for many years. In this study I asked colleagues from sixteen schools in the northern and western suburbs of Adelaide to co - theorise about changes in their neighbourhood, school populations and programs, now that their schools are no longer recognised by policy as 'disadvantaged1. I explore the use of narrative method and arts based approaches by constructing a 'literary' research text that uses conventional sociological forms together with images, poetry and personal stories. I use anthropological and geographical theoretical constructs to look at the changing material, economic, cultural and social landscapes and the mosaic of inequalities in the city of Adelaide. I suggest that this is not a simple binary polarisation, although large numbers of people are similarly positioned by de-industrialisation and the diminishing social wage. After examining the literature on poverty in Australia, I am eventually prepared to call this space class, understanding that this is a sociological metaphor. Through a theorisation of each school as a 'place' within a specific neighbourhood, I look at the similarities and differences across sites. I suggest that 'disadvantaged schools' are similarly positioned as sites for the mediation of social inequalities, and that this can be readily seen in the time consuming 'housework' of discipline and welfare. I indicate how each school is differently able to 'do more with less', because of their unique neighbourhood and its narratives, knowledges, histories, teleologies and people. I show that the common coercive regimes of market devolution, new public management and the 'distributive curriculum' frame the work of teachers, students and administrators in ways that are not conducive to 'doing justice', despite the policy rhetoric of equity and community. I provide evidence that the neoliberal imaginary of context free schooling enshrined in effective schools literatures is Utopian and irrational. I argue that the capacity of the school to 'generate context' is always paradoxically dependent on 'context derived'. I discuss the notion of 'doing justice' and the benefits of 'disadvantaged schools' having a local set of principles that guide their decisions and actions and provide evidence that the school administrator's understandings of 'doing justice' are important. I also suggest that, despite being increasingly isolated and hindered by policy directions, the majority of the sixteen schools continue to work for and with principles of justice and equity, drawing on a range of emotional and intellectual resources and deep, longstanding commitments. I conclude by speculating on the kinds of policy and research agendas that might take account of both the commonalities and differences amongst 'disadvantaged schools', and what might be included in a comprehensive and systematic approach to 'doing justice'.

Evidence on PPP for selected Asian countries from a panel cointegration test with structural breaks

The goal of this article is to examine evidence for purchasing power parity (PPP) for a panel of Asian countries, namely Malaysia, Thailand, India, Pakistan, Sri Lanka and the Philippines. Our main contribution is that for the first time in this literature we use a panel cointegration test, developed by Westerlund (2006), which allows us to incorporate multiple structural breaks. We find that using Gregory and Hansen's (1996) residual-based test for cointegration and Pedroni's (1999) panel cointegration test without structural breaks provide weak evidence of cointegration between nominal exchange rates vis-à-vis the US dollar and relative prices. However, when we use the Lagrange multiplier panel structural break cointegration test we find strong evidence of panel cointegration, providing evidence for PPP.

Student researchers in the middle : using visual images to make sense of inclusive education

Using ‘visual narrative’ theoretically and practically, this paper explores issues of inclusive education, during a period of curriculum reform and renewal in Australia. In Australia, the middle years of schooling, Years 5 to 9, are well researched and known as a period when students disengage with learning and participation in schooling. Research in the middle years affirms the importance of engaging with ‘student voice’. In this special edition, we are aiming to highlight how the use of visual imagery can be a rich source of understanding, illustrating students’ self-knowledge of schooling. Methodologically we refer to our research approach as ‘visual narrative’. Other writers in this edition use the term ‘photo voice’. For researchers it is important to highlight the differing orientations that ‘visual narrative’ and ‘photo voice’ signify. The terms are not mutually exclusive but highlight differing research possibilities and emphasis. Our argument, through the use of visual narrative produced by middle years’ students, is that visual texts open out some innovative possibilities for understanding inclusive education and supporting new relationships with our research community. Such approaches are not new; however, in a field such as special education that purports to support marginalised groups, liberatory research methods are under-represented. This paper aims to open out these discussions and provide a way forwards for teachers and researchers interested in breaking apart why it is that inclusive education remains a never-ending struggle.