Australian higher education evaluation through assurance of learning

A collaborative research project conducted by five Australian universities inquired into the philosophy and motivation for Assurance of Learning (AoL) as a process of education evaluation. Associate Deans Teaching and Learning representing Business schools from twenty-five universities across Australia participated in telephone interviews. Data was analysed using NVIVO9. Results indicated that articulated rationale for AoL was both ensuring that students had acquired the attributes and skills the universities claimed they had, and the philosophy of continuous improvement. AoL was motivated both by ritualistic objectives to satisfy accreditation requirements and virtuous agendas for quality improvement. Closing-the-loop was emphasised, but was mostly wishful thinking for next steps beyond data collection and reporting. AoL was conceptualised as one element within the larger context of quality review, but there was no evidence of comprehensive frameworks or strategic plans.

Assurance of learning – are academics and senior management singing from the same hymn sheet?

Assurance of learning (AoL) is an important process in quality education, designed to measure the accomplishment of educational aims at the core of an institution’s programs, whilst encouraging faculty to continuously develop and improve the programs and courses. This paper reports on a study of Australian business schools to investigate current AoL practices through semi structured interviews with senior faculty leaders followed by focus group interviews with groups of senior program leaders and groups of academic teaching staff. Initial findings indicate there are significant challenges in encouraging academic staff to commit to the process and recognise the benefits of assuring learning. The differences in understanding between the various leaders and the academics were highlighted through the different focus groups. Leaders’ stressed strategic issues such as staff engagement and change, while academics focussed on process issues such as teaching graduate attributes and external accreditation. Understanding the differences in the perspectives of leaders and faculty is important, as without a shared understanding between the two groups, there is likely to be limited engagement, which creates difficulties in developing effective assurance of learning processes. Findings indicate that successful strategies developed to foster shared values on assurance of learning include: strong senior leaders’ commitment; developing champions among program and unit level staff; providing professional development opportunities; promoting and celebrating success and effectiveness; and ensuring an inclusive process with academics of all levels collaborating in the development and implementation of the process.

Strategies to engage academics in assuring graduate attributes

Assurance of learning (AoL) is a predominant feature in both quality assurance and quality enhancement in higher education. The process may be used for program development, and to inform external accreditation and evaluation bodies. However, there is an obvious challenge in trying to get academic staff to buy into the benefits of the AoL process. This project conducted an audit across 25 Australian Business Schools. The majority of those interviewed stated that academic staff considered AoL to be extra work and viewed the process as a box ticking exercise for external bodies rather than sound educational practice. A change management process is required to promote the necessary cultural change to embed AoL into practice. This paper showcases some of the educational leadership strategies that have been successfully implemented across Australia to foster staff engagement in the AoL process. These include: strong senior management commitment and leadership demonstrating a constant and high level drive for staff engagement until AoL becomes an institutional norm; developing leadership and champions among unit and program level staff, to share practices and promote the benefits that come from engaging in the process; providing professional development opportunities to discuss and resolve difficulties and tensions around AoL; demonstrating success and effectiveness by selling staff on the evidence that AoL makes a difference; and making the process inclusive with academics collaborating in the development and implementation of the process.

A qualitative approach to assessing the validity of the posttraumatic growth inventory

The Posttraumatic Growth Inventory (PTGI; Tedeschi & Calhoun, 1996) is the most commonly used measure of positive psychological change that can result from negotiating a traumatic experience. Whilst the PTGI has strong internal reliability, validity studies are still sparse. The presented research details trauma survivors’ understanding of items comprising the PTGI in order to qualitatively assess content validity. Participants were 14 trauma survivors who completed the PTGI and participated in a semi-structured interview. Thematic Analysis was conducted on participant’s transcribed interviews. One latent theme was identified reflecting that questions were consistently understood. A relationship was found between the constituent themes identified and the five factors of the PTGI. Participants answered the PTGI statements in a way that is consistent with the purpose of the instrument with only a small discrepancy found when some participants used the PTGI scale to indicate when a decrease in an element of the inventory had been experienced. Overall results supported the content validity of the PTGI.

Building sustainable and effective assurance of learning process in a changing higher education environment

In a study of assuring learning in Australian Business Schools, 25 Teaching and Learning Associate Deans were interviewed to identify current issues in developing and measuring the quality of teaching and learning outcomes. Results indicate that for most institutions developing a perspective on graduate attributes and mapping assessments to measure outcomes across an entire program required knowledge creation and the building of new inclusive processes. Common elements of effective practice, namely those which offered consistently superior outcomes, included: inclusive processes; embedded graduate attributes throughout a program; alongside consistent and appropriate assessment. Results indicate that assurance of learning processes are proliferating nationally while quality of teaching and learning outcomes and in the processes for assuring it is increasing as a result.

Positive experiences for participants in suicide bereavement groups : a grounded theory model of elements that contribute to the process of adjusting to the loss

Grounded Theory was used to examine the experiences of 13 participants who had attended psycho-educational support groups for those bereaved by suicide. Results demonstrated core and central categories which fit well with group therapeutic factors developed by Yalom (1995) and emphasised the importance of universality, imparting information and instilling hope, catharsis and self-disclosure, and broader meaning making processes surrounding acceptance or adjustment. Participants were commonly engaged in a lengthy process of oscillating between loss oriented and restoration focused reappraisals. The functional experience of the group comprised feeling normal within the group, providing a sense of permission to feel and to express emotions and thoughts and to bestow meaning. Structural variables of information and guidance and different perspectives on the suicide and bereavement were gained from other participants, the facilitators, group content and process. Personal changes, including in relationships and in their sense of self, assisted participants to develop an altered and more positive personal narrative.

What if you're really different? Case studies of children with high functioning autism participating in the Get REAL programme who had atypical learning trajectories.

Evaluation of the Get REAL programme in an inclusive primary school setting has indicated its effectiveness in promoting pro-social behaviour for children with high functioning Autism. However, two children with co-morbid diagnoses and complex personal circumstances showed less consistent improvements. In order to explain their unique trajectories, not readily derived from quantitative studies, an exploratory case study approach was used to examine contextual influences on patterns of progress. Multiple data sources included coded video footage from the Get REAL programme, school reports on conduct, and parents and classroom teacher reports using the Strengths and Difficulties Questionnaire. While results provide support for the efficacy of the Get REAL programme for the two children, they also highlight the value of co-ordinated strategies and collaborative individualised approaches in more complex cases. This paper outlines the Get REAL intervention and a range of other school and support agency strategies impacting progress.

Posttraumatic growth and posttraumatic depreciation as predictors of psychological adjustment

Informed by current trauma literature, this study explored the relationships between Posttraumatic Growth (PTG; Tedeschi & Calhoun, 1995), Posttraumatic Depreciation (PTD; Cann et al., 2010) and other post-trauma outcomes including well-being, psychological flourishing, and psychological distress. The predictive utility of PTG and PTD was also examined. The sample comprised 104 trauma survivors who completed the Posttraumatic Growth Inventory – 42 (Baker et al., 2008) and several outcome measures. As expected, PTD showed strong linear correlations with well-being, flourishing and distress, and emerged as a significant predictor of scores on such measures. However, PTG showed negligible correlations with well-being, flourishing and distress. This reaffirms that PTG and PTD measure conceptually distinct and independent dimensions of experience, which has implications for therapeutic practice.

Working with refugee survivors of torture and trauma : an opportunity for vicarious posttraumatic growth

Clinical work with people who have survived trauma carries a risk of vicarious traumatisation for the service provider, but also the potential for vicarious posttraumatic growth. Despite growing interest in this area, the effects of working with survivors of refugee-related trauma have remained relatively unexplored. The aim of the current study was to examine the lived experiences of people working on a daily basis with survivors of torture and trauma who had sought refuge in Australia. Seventeen clinical, administrative, and managerial staff from a not-for-profit organisation participated in a semi-structured interview that was later analysed using interpretive phenomenological analysis. Analysis of the data demonstrated that the entire sample reported symptoms of vicarious trauma (e.g., strong emotional reactions, intrusive images, shattering of existing beliefs) as well as vicarious posttraumatic growth (e.g., forming new relationships, increased self-understanding, greater appreciation of life). Moreover, effortful meaning making processes appeared to facilitate such positive changes. Reduction in the risks associated with this work, enhancement of clinician well-being, and improvement of therapeutic outcomes is a shared responsibility of the organisation and clinician. Without negating the distress of trauma work, clinicians are encouraged to more deeply consider the unique positive outcomes that supporting survivors can provide.

Exploring the process of meaning making in healing after childhood sexual assault : a case study approach

Childhood sexual assault (CSA) is one of the most devastating of all traumatic experiences with population studies documenting survivors experiencing higher levels of pathology than general trends in survivors of other traumatic experiences. Yet recent research has demonstrated that far from being permanently crippled by their experiences, many adult survivors of CSA manage to heal and move forward in their lives to experience a rich and fulfilling existence. In this paper two case studies are presented to provide a detailed account of how a person who has experienced CSA may find a pathway to healing. Moreover, data demonstrates that meaning making, spiritual or otherwise, is a pivotal part of acceptance of CSA and ensuing growth. The case studies highlight the unique journeys of two women and the underlying similarities in their pathway to healing. Clinical implications of the research are discussed and specific strategies for encouraging healing and growth are outlined.

Postdiagnosis personal growth in an Australian population of parents raising children with developmental disability

Background Parenting a child with a developmental disability presents a variety of long-term physical and emotional challenges. When exploring parent wellbeing, the disability field is dominated by a deficit model despite parents reportedly demonstrating coping and resilience. The current study is embedded in a salutogenic theory (Antonovsky, 1979) and explores the potential for parents of children diagnosed with a developmental disability to undergo positive changes. Method Participants were 6 fathers and 27 mothers who completed measures of distress and posttraumatic growth. Results Compared with a number of other Australian samples, participants reported significantly higher levels of posttraumatic growth. Reports of growth did not negate reports of distress. Results also indicated that constructs of distress and growth were independent. Conclusions The research has important implications for disability support services, reminding providers to be cognisant of the potential for growth, as well as distress, thereby permitting an atmosphere conducive to exploring such outcomes.

The practice of quality assuring learning in higher education

There remains a lack of published empirical data on the substantive outcomes of higher learning and the establishment of quality processes for determining them. Studies that do exist are nationally focused with available rankings of institutions reflecting neither the quality of teaching and learning nor the diversity of institutions. This paper describes two studies in which Associate Deans from Australian higher education institutions and focus groups of management and academics identify current issues and practices in the design, development and implementation of processes for assuring the quality of learning and teaching. Results indicate that developing a perspective on graduate attributes and mapping assessments to measure outcomes across an entire program necessitates knowledge creation and new inclusive processes. Common elements supporting consistently superior outcomes included: inclusivity; embedded graduate attributes; consistent and appropriate assessment; digital collection mechanisms; and systematic analysis of outcomes used in program review. Quality measures for assuring learning are proliferating nationally and changing the processes, systems and culture of higher education as a result.

A qualitative exploration of young women's drinking experiences and associated protective behaviours

While initial research supports the effectiveness of protective strategies in mitigating young people’s alcohol-related harm, few studies have investigated these behaviours from a uniquely female perspective. Yet, young women consume alcohol within a social context that is distinctly different from that of young men and face risks that are specific to their gender. To explore a group of young Australian women’s experiences, perceptions of risks and use of protective strategies in relation to drinking in public places, we conducted either focus groups or one-on-one telephone interviews with a total of 40 women aged 18–24 years. While young women reported substantial risks associated with drinking, they also reported using a range of protective behaviours that moderated the adverse effects of alcohol, with most of these strategies being derived from the friendship group to which the women belonged. Our findings add to the limited body of knowledge on women’s insights into, and their use of protective strategies to minimise the negative consequences of alcohol.

Jane McCredie - Making Girls and Boys : Inside the Science of Sex [Book Review]

Activists, Feminists, queer theorists, and those who live outside traditional gender narratives have long challenged the fixity of the sex and gender binaries. While the dominant Western paradigm posits sex and gender as natural and inherent, queer theory argues that sex and gender are socially constructed. This means that our ideas about sex and gender, and the concepts themselves, are shaped by particular social contexts. Questioning the nature of sex can be puzzling. After all, isn’t sex biology? Binary sex – male and female – was labelled as such by scientists based on existing binary categories and observations of hormones, genes, chromosomes, reproductive organs, genitals and other bodily elements. Binary sex is allocated at birth by genital appearance. Not everyone fits into these categories and this leads queer theorists, and others, to question the categories. Now, “some scientists are also starting to move away from the idea of biology as the fixed basis on which the social artefact of gender is built” (5). Making Girls and Boys: Inside the Science of Sex, by Jane McCredie, examines theories about gender roles and behaviours also considering those who don’t fit the arbitrary sex and gender binaries.