Evaluation of the quality of diverse teaching practice in higher education research methods

The purpose of this paper is to report on a methods research project investigating the evaluation of diverse teaching practice in Higher Education. The research method is a single site case study of an Australian university with data collected through published documents, surveys, interviews and focus groups. This project provides evidence of the wide variety of evaluation practice and diverse teaching practice across the university. This breadth identifies the need for greater flexibility of evaluation processes, tools and support to assist teaching staff to evaluate their diverse teaching practice. The employment opportunities for academics benchmark the university nationally and position the case study in the field. Finally this reaffirms the institutional responsibility for services to support teaching staff in an ongoing manner.

Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

A framework for mathematics graphical tasks : The influence of the graphic element on student sense making

Graphical tasks have become a prominent aspect of mathematics assessment. From a conceptual stance, the purpose of this study was to better understand the composition of graphical tasks commonly used to assess students’ mathematics understandings. Through an iterative design, the investigation described the sense making of 11–12-year-olds as they decoded mathematics tasks which contained a graphic. An ongoing analysis of two phases of data collection was undertaken as we analysed the extent to which various elements of text, graphics, and symbols influenced student sense making. Specifically, the study outlined the changed behaviour (and performance) of the participants as they solved graphical tasks that had been modified with respect to these elements. We propose a theoretical framework for understanding the composition of a graphical task and identify three specific elements which are dependently and independently related to each other, namely: the graphic; the text; and the symbols. Results indicated that although changes to the graphical tasks were minimal, a change in student success and understanding was most evident when the graphic element was modified. Implications include the need for test designers to carefully consider the graphics embedded within mathematics tasks since the elements within graphical tasks greatly influence student understanding.

In the bank or on the ground : an examination of financial reserves in Australian international aid organisations

This study contributes to the understanding of the contribution of financial reserves to sustaining nonprofit organisations. Recognising the limited recent Australian research in the area of nonprofit financial vulnerability, it specifically examines financial reserves held by signatories to the Code of Conduct of the Australian Council for International Development (ACFID) for the years 2006 to 2010. As this period includes the Global Financial Crisis, it presents a unique opportunity to observe the role of savings in a period of heightened financial threats to sustainability. The need for nonprofit entities to maintain reserves, while appearing intuitively evident, is neither unanimously accepted nor supported by established theoretic constructs. Some early frameworks attempt to explain the savings behaviour of nonprofit organisations and its role in organisational sustainability. Where researchers have considered the issue, its treatment has usually been either purely descriptive or alternatively, peripheral to a broader attempt to predict financial vulnerability. Given the importance of nonprofit entities to civil society, the sustainability of these organisations during times of economic contraction, such as the recent Global Financial Crisis, is a significant issue. Widespread failure of nonprofits, or even the perception of failure, will directly affect, not only those individuals who access their public goods and services, but would also have impacts on public confidence in both government and the sectors’ ability to manage and achieve their purpose. This study attempts to ‘shine a light’ on the paradox inherent in considering nonprofit savings. On the one hand, a public prevailing view is that nonprofit organisations should not hoard and indeed, should spend all of their funds on the direct achievement of their purposes. Against this, is the commonsense need for a financial buffer if only to allow for the day to day contingencies of pay rises and cost increases. At the entity level, the extent of reserves accumulated (or not) is an important consideration for Management Boards. The general public are also interested in knowing the level of funds held by nonprofits as a measure of both their commitment to purpose and as an indicator of their effectiveness. There is a need to communicate the level and prevalence of reserve holdings, balancing the prudent hedging of uncertainty against a sense of resource hoarding in the mind of donors. Finally, funders (especially governments) are interested in knowing the appropriate level of reserves to facilitate the ongoing sustainability of the sector. This is particularly so where organisations are involved in the provision of essential public goods and services. At a scholarly level, the study seeks to provide a rationale for this behaviour within the context of appropriate theory. At a practical level, the study seeks to give an indication of the drivers for savings, the actual levels of reserves held within the sector studied, as well as an indication as to whether the presence of reserves did mitigate the effects of financial turmoil during the Global Financial Crisis. The argument is not whether there is a need to ensure sustainability of nonprofits, but rather how it is to be done and whether the holding of reserves (net assets) is an essential element is achieving this. While the study offers no simple answers, it does appear that the organisations studied present as two groups, the ‘savers’ who build reserves and keep ‘money in the bank’ and ‘spender-delivers’ who put their resources ‘on the ground’. To progress an understanding of this dichotomy, the study suggests a need to move from its current approach to one which needs to more closely explore accounts based empirical donor attitude and nonprofit Management Board strategy.

Hybridized writing for scientific literacy : pedagogy and evidence

Disengagement of students in science and the scientific literacy of young adults are interrelated international concerns. One way to address these concerns is to engage students imaginatively in activities designed to improve their scientific literacy. Our ongoing program of research has focused on the effects of a sequence of activities that require students to transform scientific information on important issues for their communities from government websites into narrative text suitable for a lay reader. These hybridized stories we call BioStories. Students upload their stories for peer review to a dedicated website. Peer reviews are intended to help students refine their stories. Reviewing BioStories also gives students access to a wider range of scientific topics and writing styles. We have conducted separate studies with students from Grade 6, Grade 9 and Grade 12, involving case study and quasi-experimental designs. The results from the 6th grade study support the argument that writing the sequence of stories helped the students become more familiar with the scientific issue, develop a deeper understanding of related biological concepts, and improve their interest in science. Unlike the Grade 6 study, it was not possible to include a control group for the study conducted across eight 9th grade classes. Nevertheless, these results suggest that hybridized writing developed more positive attitudes toward science and science learning, particularly in terms of the students’ interest and enjoyment. In the most recent case study with Grade 12 students, we found that pride, strength, determination, interest and alertness were among the positive emotions most strongly elicited by the writing project. Furthermore, the students expressed enhanced feelings of self-efficacy in successfully writing hybridized scientific narratives in science. In this chapter, we describe the pedagogy of hybridized writing in science, overview the evidence to support this approach, and identify future developments.

A prospective study of pregnancy weight gain in Australian women

Background: While weight gain during pregnancy is regarded as important, there has not been a prospective study of measured weight gain in pregnancy in Australia. This study aimed to prospectively evaluate pregnancy-related weight gain against the Institute of Medicine (IOM) recommendations in women receiving antenatal care in a setting where ongoing weight monitoring is not part of routine clinical practice, to describe women's knowledge of weight gain recommendations and to describe the health professional advice received relating to gestational weight gain (GWG). Methods: Pregnant women were recruited ≤20 weeks of gestation (n = 664) from a tertiary obstetric hospital between August 2010 to July 2011 for this prospective observational study. Outcome measures were weight gain from pre-pregnancy to 36 weeks of gestation, weight gain knowledge and health professional advice received. Results: Thirty-six percent of women gained weight according to guidelines. Twenty-six percent gained inadequate weight, and 38% gained excess weight. Fifty-six percent of overweight women gained weight in excess of the IOM guidelines compared with 30% of those who started with a healthy weight (P < 0.001). At 16 weeks, 47% of participants were unsure of the weight gain recommendations for them. Sixty-two percent of women reported that the health professionals caring for them during this pregnancy ‘never’ or ‘rarely’ offered advice about how much weight to gain. Conclusions: The prevalence of inappropriate gestational weight gain in this study was high. The majority of women do not know their recommended weight gain. The advice women received from health professionals relating to healthy weight gain in pregnancy could be improved.

Randomised controlled trial of an automated, interactive telephone intervention (TLC Diabetes) to improve type 2 diabetes management : Baseline findings and six-month outcomes

Background: Effective self-management of diabetes is essential for the reduction of diabetes-related complications, as global rates of diabetes escalate. Methods: Randomised controlled trial. Adults with type 2 diabetes (n = 120), with HbA1c greater than or equal to 7.5 %, were randomly allocated (4 × 4 block randomised block design) to receive an automated, interactive telephone-delivered management intervention or usual routine care. Baseline sociodemographic, behavioural and medical history data were collected by self-administered questionnaires and biological data were obtained during hospital appointments. Health-related quality of life (HRQL) was measured using the SF-36. Results: The mean age of participants was 57.4 (SD 8.3), 63 % of whom were male. There were no differences in demographic, socioeconomic and behavioural variables between the study arms at baseline. Over the six-month period from baseline, participants receiving the Australian TLC (Telephone-Linked Care) Diabetes program showed a 0.8 % decrease in geometric mean HbA1c from 8.7 % to 7.9 %, compared with a 0.2 % HbA1c reduction (8.9 % to 8.7 %) in the usual care arm (p = 0.002). There was also a significant improvement in mental HRQL, with a mean increase of 1.9 in the intervention arm, while the usual care arm decreased by 0.8 (p = 0.007). No significant improvements in physical HRQL were observed. Conclusions: These analyses indicate the efficacy of the Australian TLC Diabetes program with clinically significant post-intervention improvements in both glycaemic control and mental HRQL. These observed improvements, if supported and maintained by an ongoing program such as this, could significantly reduce diabetes-related complications in the longer term. Given the accessibility and feasibility of this kind of program, it has strong potential for providing effective, ongoing support to many individuals with diabetes in the future.

Impaired driving countermeasures : an Australian perspective

The prevalence of impaired driving in Australia  Regulatory approaches used to manage: – Alcohol impaired driving – Other drug impaired driving  Key countermeasures – Lower blood alcohol limits – Random breath testing (RBT) – Random drug testing (RDT)  Ongoing challenges and future directions

Seeking inclusion : views from ‘vulnerable’ communities about reporting by the Australian news media

This conference paper reports on the findings of the 'Vulnerability and the News Media’ project about news reporting on communities that are commonly regarded as ‘vulnerable’ by virtue of their issues or circumstances. The project focuses on news reporting of Indigenous and ethnically diverse communities, as well as people affected by mental health issues, people with disabilities, and survivors of crime and traumatic events. Numerous educational initiatives have tried to improve the quality of media reports about these communities and their issues. Despite this, the project’s research with stakeholders from those communities has found that they continue to raise the same concerns that have been expressed about the news media since the 1970s. In focus group research, stakeholders from these communities expressed concern about their continuing under-representation or omission from the news media. They felt that voices, experiences, perspectives and issues from their communities rarely appeared, or if they did appear, it was in limited contexts – often in circumstances that portrayed them as vulnerable or disruptive. They also pointed to ongoing media misrepresentation, such as stereotyping, inappropriate framing, and over-reliance on ‘usual suspects’ to talk about their communities. A common theme that they voiced was their need for greater inclusiveness in the media. Participants wished that journalists would better represent the diversity of life experiences and perspectives within their communities. Stakeholders also wanted an increased in representation of their political frameworks, such as stories about the difficulties they encountered in dealing with social and bureaucratic systems, and their understandings of causes and potential solutions for issues affecting their communities.

Negotiating : experiences of community nurses when contracting with clients

A community nurse is required to have excellent interpersonal, teaching, collaborative and clinical skills in order to develop effective individualised client care contracts. Using a descriptive qualitative design data was collected from two focus groups of fourteen community nurses to explore the issues surrounding negotiating and contracting client care contracts from the perspective of community nurses. Thematic analysis revealed three themes: ‘assessment of needs’, ‘education towards enablement’, and ‘negotiation’. ‘Assessment of needs’ identified that community nurses assess both the client’s requirements for health care as well as the ability of the nurse to provide that care. ‘Education towards enablement’ described that education of the client is a common strategy used by community nurses to establish realistic goals of health care as part of developing an ongoing care plan. The final theme, ‘negotiation’, involved an informed agreement between the client and the community nurse which forms the origin of the care contract that will direct the partnership between the client and the nurse. Of importance for community nurses is that development of successful person-centred care contracts requires skillful negotiation of care that strikes the balance between the needs of the client and the ability of the nurse to meet those needs.

Variation in risk seeking behavior in a natural experiment following a large negative wealth shock induced by a natural disaster

An ongoing challenge in behavioral economics is to understand the variations observed in risk attitudes as a function of their environmental context. Of particular interest is the effect of wealth on risk attitudes. The research in this area has however faced two constraints: the difficulty to study the causal effects of large changes in wealth, and the causal effects of losses on risk behavior. The present paper address this double limitation by providing evidence of the variation of risk attitude after large losses using a natural disaster (Brisbane floods) as the setting for a natural experiment.

Digital dietetics : practices and attitudes to technology use among Australian dietitians

Recent advancements in the capabilities of information and communication technologies (ICT) offer unique avenues to support the delivery of nutrition care. Despite ICTs being widely available, evidence on the practices and attitudes with regard to ICT use among dietitians is limited. A cross-sectional survey of Dietitians Association of Australia members was administered online in August 2011. All dietitians who responded (n=87) had access to a computer at work. Half reported providing non face-to-face consultations, with the telephone and email the most common modes of delivery. The use of smart phones was prevalent for 49% of practitioners, with 30% recommending nutrition-related applications and/or programs to clients. Benefits to technology use in practice most commonly reported included improvements in access to information/resources, time management, and workflow efficiency. Barriers identified related to cost and access to technology, and lack of suitable programs/applications. Technology was viewed as an important tool in practice among 93% of dietitians surveyed, however only 38% were satisfied with their current level of use. The majority (81%) believed more technology should be integrated within dietetics, while 85% indicated that the development of suitable and practical applications andprograms is necessary for future practice. Technology is regarded as an important tool by Australian dietitians, with an expressed need for theirinclusion to further facilitate nutrition care. Regular and ongoing evaluation of technology use among dietitians is vital to ensure thatapplications and use are evidence based and relevant to consumers in the digital world.

Managing older workers during a period of tight labour supply

This article reports on a recent survey of employer attitudes and policies towards older workers in Australia at a time of sustained economic growth and ongoing concerns about labour shortages. Findings from a survey of 590 employers with more than 50 employees in the State of Queensland point to an unusually strong orientation towards the recruitment of older workers among respondents, although the retraining of older workers is not prioritised by the majority. The issue of workforce ageing is viewed as being of medium-term importance by the majority of respondents, although for a substantial number the issue is of immediate concern. Both sector and organisation size are predictive of the application of a broad range of policies targeting older workers, with public-sector and larger organisations more likely to be active. Concerns about workforce ageing and labour supply are predictive of employer behaviours regarding older workers, suggesting that sustained policy making may be emerging in response to population ageing over and above more immediate concerns about labour shortages and that this broad thrust of organisational policy making may be immune to the point in the economic cycle. This study found no evidence that the flexible firm will not countenance an ageing workforce.

Auger spectroscopy of stratospheric particles : the influence of aerosols on interplanetary dust

Particle collections from the stratosphere via either the JSC Curatorial Program or the U2 Program (NASA Ames) occur between 16km and 19km altitude and are usually part of ongoing experiments to measure parameters related to the aerosol layer. Fine-grained aerosols (<0.1µm) occur in the stratosphere up to 35km altitude and are concentrated between 15km and 25km altitude[1]. All interplanetary dust particles (IDP's) from these stratospheric collections must pass through this aerosol layer before reaching the collection altitude. The major compounds in this aerosol layer are sulfur rich particulates (<0.1µm) and gases and include H2S04, OCS, S02 and CS2 [2].In order to assess possible surface reactions of interplanetary dust particles (IDP's) with ambient aerosols in the stratosphere, we have initiated a Surface Auger Microprobe (SAM) and electron microscope study of selected particles from the JSC Cosmic Dust Collection.

Development and testing of an iPad application for teaching self-management to heart failure patients. (Nursing/Allied Health Professional Investigator Award)- Abstract

Purpose: Heart failure (HF) is the leading cause of hospitalization and significant burden to the health care system in Australia. To reduce hospitalizations, multidisciplinary approaches and enhance self-management programs have been strongly advocated for HF patients globally. HF patients who can effectively manage their symptoms and adhere to complex medicine regimes will experience fewer hospitalizations. Research indicates that information technologies (IT) have a significant role in providing support to promote patients' self-management skills. The iPad utilizes user-friendly interfaces and to date an application for HF patient education has not been developed. This project aimed to develop the HF iPad teaching application in the way that would be engaging, interactive and simple to follow and usable for patients' carers and health care workers within both the hospital and community setting. Methods: The design for the development and evaluation of the application consisted of two action research cycles. Each cycle included 3 phases of testing and feedback from three groups comprising IT team, HF experts and patients. All patient education materials of the application were derived from national and international evidence based practice guidelines and patient self-care recommendations. Results: The iPad application has animated anatomy and physiology that simply and clearly teaches the concepts of the normal heart and the heart in failure. Patient Avatars throughout the application can be changed to reflect the sex and culture of the patient. There is voice-over presenting a script developed by the heart failure expert panel. Additional engagement processes included points of interaction throughout the application with touch screen responses and the ability of the patient to enter their weight and this data is secured and transferred to the clinic nurse and/or research data set. The application has been used independently, for instance, at home or using headphones in a clinic waiting room or most commonly to aid a nurse-led HF consultation. Conclusion: This project utilized iPad as an educational tool to standardize HF education from nurses who are not always heart failure specialists. Furthermore, study is currently ongoing to evaluate of the effectiveness of this tool on patient outcomes and to develop several specifically designed cultural adaptations [Hispanic (USA), Aboriginal (Australia), and Maori (New Zealand)].