REFRAME : a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

Comprehensive assessment of the fitness of older people for chemotherapy

Purpose: To present the results of a mixed-method study comparing the level of agreement of a two-phased, nurse-administered Comprehensive Geriatric Assessment (CGA) with current methods that assess the fitness for chemotherapy of older cancer patients. A nurse-led model of multidisciplinary cancer care based on the results is also described. Methods: The two phases comprised initial screening by a nurse with the Vulnerable Elders Survey-13 [VES-13], followed by nurse administration of a detailed CGA. Both phases were linked to a computerised algorithm categorising the patient as ‘fit’, ‘vulnerable’ or ‘frail’. The study determined the level of agreement between VES-13- and CGA-determined categories; and between the CGA and the physicians’ assessments. It also compared the CGA’s predictive abilities in terms of subsequent treatment toxicity; while interviews determined the acceptability of the nurse-led procedure from key stakeholders' perspectives. Results: Data collection was completed in December 2011. The results will be presented at the conference. A consecutive-series n=170 will be enrolled, 33% of whom are ‘fit’; 33% ‘vulnerable’; and 33% ‘too frail’ for treatment. This sample can detect, with 90% power, kappa coefficients of agreement of ≥ 0.70 or higher (“substantial agreement”). Fitness sub-group comparisons of agreement between the medical oncologist and the nurse assessments can detect kappa estimates of Κ ≥ 0.80 with the same power. Conclusion: The results have informed a nurse-led model of cancer care. It meets a clear need to develop, implement and test a nurse-led, robust, evidence-based, clinically-justifiable and economically-feasible CGA process that has relevance in national and international contexts.

Primary classroom teachers' use of social and emotional wellbeing programs and the factors influencing program use

There has been a rapid escalation in the development and evaluation of social and emotional well-being (SEW) programs in primary schools over the last few decades. Despite the plethora of programs available, primary teachers’ use of SEW programs is not well documented in Australian schools, with even less consideration of the factors influencing program use. A cross-sectional survey was undertaken with primary classroom teachers across twelve schools in the Brisbane and Sunshine Coast Education Districts in Queensland, Australia, during 2005. A checklist of SEW programs and an audit of SEW practices in schools were employed to investigate the number, range and types of SEW programs used by primary classroom teachers and the contextual factors influencing program use. Whilst the majority of implementation studies have been conducted under intervention conditions, this study was designed to capture primary classroom teachers’ day-to-day use of SEW programs and the factors influencing program use under real-world conditions. The findings of this research indicate that almost three quarters of the primary classroom teachers involved in the study reported using at least one SEW program during 2005. Wide variation in the number and range of programs used was evident, suggesting that teachers are autonomous in their use of SEW programs. Evidence-based SEW programs were used by a similar proportion of teachers to non-evidence-based programs. However, irrespective of the type of program used, primary teachers overwhelmingly reported using part of a SEW program rather than the whole program. This raises some issues about the quality of teachers’ program implementation in real-world practice, especially with respect to programs that are evidence-based. A content analysis revealed that a wide range of factors have been examined as potential influences on teachers’ implementation of health promotion programs in schools, including SEW programs, despite the limited number of studies undertaken to date. However, variation in the factors examined and study designs employed both within and across health promotion fields limited the extent to which studies could be compared. A methodological and statistical review also revealed substantial variation in the quality of reporting of studies. A variety of factors were examined as potential influences on primary classroom teachers’ use of SEW programs across multiple social-ecological levels of influence (ranging from community to school and individual levels). In this study, parent or caregiver involvement in class activities and the availability of wellbeing-related policies in primary schools were found to be influential in primary classroom teachers’ use of SEW programs. Teachers who often or always involve parents or caregivers in class activities were at a higher odds of program use relative to teachers who never or rarely involved parents or caregivers in class activities. However, teachers employed in schools with the highest number of wellbeing-related policies available were at a lower odds of program use relative to teachers employed in schools with fewer wellbeing-related policies available. Future research should investigate primary classroom teachers’ autonomy and motivations for using SEW programs and the reasons behind the selection and use of particular types of programs. A larger emphasis should also be placed upon teachers not using SEW programs to identify valid reasons for non-use. This would provide another step towards bridging the gap between the expectations of program developers and the needs of teachers who implement programs in practice. Additionally, the availability of wellbeing-related school policies and the types of activities that parents and caregivers are involved with in the classroom warrant more in-depth investigation. This will help to ascertain how and why these factors influence primary classroom teachers’ use of SEW programs on a day-to-day basis in schools.

Distributing leadership and cultivating dialogue with collaborative EBIP

The purpose of this paper is to demonstrate the efficacy of collaborative evidence based information practice (EBIP) as an organizational effectiveness model. Shared leadership, appreciative inquiry and knowledge creation theoretical frameworks provide the foundation for change toward the implementation of a collaborative EBIP workplace model. Collaborative EBIP reiterates the importance of gathering the best available evidence, but it differs by shifting decision-making authority from "library or employer centric" to "user or employee centric". University of Colorado Denver Auraria Library Technical Services department created a collaborative EBIP environment by flattening workplace hierarchies, distributing problem solving and encouraging reflective dialogue. By doing so, participants are empowered to identify problems, create solutions, and become valued and respected leaders and followers. In an environment where library budgets are in jeopardy, recruitment opportunities are limited and the workplace is in constant flux, the Auraria Library case study offers an approach that maximizes the capability of the current workforce and promotes agile responsiveness to industry and organizational challenges. Collaborative EBIP is an organizational model demonstrating a process focusing first on the individual and moving to the collective to develop a responsive and high performing business unit, and in turn, organization.

Planning for success : repurposing, retooling and reprioritising with results

This paper presents an organisational learning system implemented across a three year period within a multi campus tertiary library. It proposes a three stage system, framed within a reflective evidence based practice process to foster professional engagement and lifelong learning of staff.

Workplace information literacy : cultivation strategies for 'working smarter' in 21st century libraries

This paper presents a hybrid framework of Swedish cultural practices and Australian grounded theory for organizational development and suggests practical strategies for 'working smarter' in 21st Century libraries. Toward that end, reflective evidence-based practices are offered to incrementally build organizational capacity for asking good questions, selecting authoritative sources, evaluating multiple perspectives, organizing emerging insights, and communicating them to inform, educate, and influence. In addition, to ensure the robust information exchange necessary to collective workplace learning, leadership traits are proposed for ensuring inclusive communication, decision making, and planning processes. These findings emerge from action research projects conducted from 2003 to 2008 in two North American libraries.

Nurse-administered procedural sedation and analgesia in the cardiac catheter laboratory : an integrative review

Objectives: To identify and appraise the literature concerning nurse-administered procedural sedation and analgesia in the cardiac catheter laboratory. Design and data sources: An integrative review method was chosen for this study. MEDLINE and CINAHL databases as well as The Cochrane Database of Systematic Reviews and the Joanna Briggs Institute were searched. Nineteen research articles and three clinical guidelines were identified. Results: The authors of each study reported nurse-administered sedation in the CCL is safe due to the low incidence of complications. However, a higher percentage of deeply sedated patients were reported to experience complications than moderately sedated patients. To confound this issue, one clinical guideline permits deep sedation without an anaesthetist present, while others recommend against it. All clinical guidelines recommend nurses are educated about sedation concepts. Other findings focus on pain and discomfort and the cost-savings of nurse-administered sedation, which are associated with forgoing anaesthetic services. Conclusions: Practice is varied due to limitations in the evidence and inconsistent clinical practice guidelines. Therefore, recommendations for research and practice have been made. Research topics include determining how and in which circumstances capnography can be used in the CCL, discerning the economic impact of sedation-related complications and developing a set of objectives for nursing education about sedation. For practice, if deep sedation is administered without an anaesthetist present, it is essential nurses are adequately trained and have access to vital equipment such as capnography to monitor ventilation because deeply sedated patients are more likely to experience complications related to sedation. These initiatives will go some way to ensuring patients receiving nurse-administered procedural sedation and analgesia for a procedure in the cardiac catheter laboratory are cared for using consistent, safe and evidence-based practices.

Australian and New Zealand nurses’ perceptions of procedural sedation and analgesia in the cardiac catheterisation laboratory : a qualitative study

Background: Australian and New Zealand College of Anaesthetists’ guidelines for procedural sedation and analgesia (PSA) are intended to apply across all clinical settings. As nurses are frequently responsible for patient care during PSA in the cardiac catheterisation laboratory (CCL), their perspectives can provide insight into the effectiveness of these guidelines within this particular setting. Methods: A cross-sectional sampling design was used to recruit nurses from urban, regional, public and private CCLs across Australia and New Zealand. Semi-structured interviews were conducted, digitally recorded and transcribed. Data were analysed using thematic analysis. Findings: Twenty-three nurses from 16 CCLs across four states in Australia and New Zealand participated. Most held senior positions (managers=14; educators=5) and CCL experience ranged from 4 to 26 years (mean 11). Participants were concerned about the legitimacy of their practice as they administered PSA outside of guideline recommendations and deemed present education and training as deficient. Participants noted also that guideline recommendations were sometimes not adhered to as it was difficult to balance the increasingly complex PSA requirements of their case-mix with limited access to anaesthetists while trying not to delay procedures. Conclusion: Findings suggest that application of current PSA guidelines may be impractical for CCL nurses and, as a consequence, they are often not followed. Participants were concerned about risks to patient safety as they felt education and training was not commensurable with practice requirements. The findings suggest existing guidelines should be reviewed or new guidelines developed which address nursing practice, education and competency standards for PSA in the CCL

Prolegomenon to the study of the concepts of maturity and maturity model : from Black Horse to White Knight?

This paper takes its root in a trivial observation: management approaches are unable to provide relevant guidelines to cope with uncertainty, and trust of our modern worlds. Thus, managers are looking for reducing uncertainty through information’s supported decision-making, sustained by ex-ante rationalization. They strive to achieve best possible solution, stability, predictability, and control of “future”. Hence, they turn to a plethora of “prescriptive panaceas”, and “management fads” to bring simple solutions through best practices. However, these solutions are ineffective. They address only one part of a system (e.g. an organization) instead of the whole. They miss the interactions and interdependencies with other parts leading to “suboptimization”. Further classical cause-effects investigations and researches are not very helpful to this regard. Where do we go from there? In this conversation, we want to challenge the assumptions supporting the traditional management approaches and shed some lights on the problem of management discourse fad using the concept of maturity and maturity models in the context of temporary organizations as support for reflexion. Global economy is characterized by use and development of standards and compliance to standards as a practice is said to enable better decision-making by managers in uncertainty, control complexity, and higher performance. Amongst the plethora of standards, organizational maturity and maturity models hold a specific place due to general belief in organizational performance as dependent variable of (business) processes continuous improvement, grounded on a kind of evolutionary metaphor. Our intention is neither to offer a new “evidence based management fad” for practitioners, nor to suggest research gap to scholars. Rather, we want to open an assumption-challenging conversation with regards to main stream approaches (neo-classical economics and organization theory), turning “our eyes away from the blinding light of eternal certitude towards the refracted world of turbid finitude” (Long, 2002, p. 44) generating what Bernstein has named “Cartesian Anxiety” (Bernstein, 1983, p. 18), and revisit the conceptualization of maturity and maturity models. We rely on conventions theory and a systemic-discursive perspective. These two lenses have both information & communication and self-producing systems as common threads. Furthermore the narrative approach is well suited to explore complex way of thinking about organizational phenomena as complex systems. This approach is relevant with our object of curiosity, i.e. the concept of maturity and maturity models, as maturity models (as standards) are discourses and systems of regulations. The main contribution of this conversation is that we suggest moving from a neo-classical “theory of the game” aiming at making the complex world simpler in playing the game, to a “theory of the rules of the game”, aiming at influencing and challenging the rules of the game constitutive of maturity models – conventions, governing systems – making compatible individual calculation and social context, and possible the coordination of relationships and cooperation between agents with or potentially divergent interests and values. A second contribution is the reconceptualization of maturity as structural coupling between conventions, rather than as an independent variable leading to organizational performance.

Sustainable and affordable housing : a myth or reality

The Australian government has released a draft National Building Framework that will likely tighten the building standard for new houses to meet higher sustainability requirements. There are uncertainties about the impact this could have on the cost of housing and the supply of affordable housing. This paper aims to provide evidence-based conclusions on the possibility of delivering sustainable and affordable housing for low income people. The case studies are gathered from Brisbane and Gold Coast. Case studies are analysed by unpacking the features that were included to meet sustainability and affordability goals for housing. This paper outlines the key factors for their success and also challenges for replication of the projects. The study shows that the key success drivers for delivering sustainable and affordable housing are providing planning incentives, subsidies for increased energy efficiency, supportive regulatory frameworks and appropriate allocation of infrastructure charges. It shows that government can prioritise their resources to support affordable and sustainable housing for low income people.

Reducing the Risk of Alcohol and Other Drugs in Construction : An Australian Assessment

There is increasing concern about the impact of employees’ alcohol and other drug (AOD) consumption on workplace safety, particularly within the construction industry. No known study has scientifically evaluated the relationship between the use of drugs and alcohol and safety impacts in construction, and there has been only limited adoption of nationally coordinated strategies, supported by employers and employees to render it socially unacceptable to arrive at a construction workplace with impaired judgment from AODs. This research aims to scientifically evaluate the use of AODs within the Australian construction industry in order to reduce the potential resulting safety and performance impacts and engender a cultural change in the workforce. Using the Alcohol Use Disorders Identification Test (AUDIT), the study will adopt both quantitative and qualitative methods to evaluate the extent of general AOD use in the industry. Results indicate that a proportion of the construction sector may be at risk of hazardous alcohol consumption. A total of 286 respondents (58%) scored above the cut-off score for risky alcohol use with 43 respondents (15%) scoring in the significantly ‘at risk’ category. Other drug use was also identified as a major issue that must be addressed. Results support the need for evidence-based, preventative educational initiatives that are tailored specifically to the construction industry.

Designing a continuum of quality external cause of injury information in Queensland : from ambulance to hospital

This study is the first to employ an epidemiological framework to evaluate the ‘fit-for-purpose’ of ICD-10-AM external cause of injury codes, ambulance and hospital clinical documentation for injury surveillance. Importantly, this thesis develops an evidence-based platform to guide future improvements in routine data collections used to inform the design of effective injury prevention strategies. Quantification of the impact of ambulance clinical records on the overall information quality of Queensland hospital morbidity data collections for injury causal information is a unique and notable contribution of this study.

Review : "Spatial planning and climate change" by Elizabeth Wilson and Jake Piper

This timely and thorough book seeks to provide evidence-based assessments of ways in which spatial planning may develop and deliver new strategies for addressing both the causes and impacts of climate change. The authors state that much of the analysis is informed by experiences and learning from their own involvements with climate change projects. The book aims to be relevant to a wide audience and nominates its intended readership to include planning practitioners, scholars, post-graduate students of built environment courses, politicians and the ‘interested’ public. In this regard, the authors skilfully deliver with a comprehensive and accessible dissemination of the nexus between spatial planning and climate change...

Nursing research : the Australian College of Nursing position statement

Background Nursing perspectives play an important role in addressing the health priorities of today’s society. The Australian College of Nursing (ACN) acknowledges the significant contribution that nursing research has made since the first nurse researcher, Florence Nightingale, documented the factors that affected the morbidity and mortality of soldiers wounded in the Crimean war in the 1800s. The nursing profession continues to celebrate the significant contribution nursing research made to improving nursing practice and health outcomes. These significant contributions over recent years include, but are not limited to: 1. Health services research that has demonstrated the importance of nursing services and how such services are designed/organised to ensure safety and quality of care (Duffield, et al., 2011; Fernandez, et al., 2012; Middleton, et al., 2011); 2. Clinical research that has demonstrated the value of specific nursing interventions to improved health outcomes, including enhanced survival, reduced morbidity, and improved quality of life and consumer engagement (Cancer Australia and Cancer Voices Australia, 2011; Kitson, et al., 2013; Middleton, et al., 2012; Rickard, et al., 2012; Zeitz, et al., 2011); 3. Basic science research that has advanced discoveries in terms of understanding the biological mechanisms underpinning nursing interventions (Illi, et al., 2012; Kim, et al., 2012; Miaskowski, et al., 2010; Simonova, et al., 2012); 4. Epidemiological research that has advanced understanding about how individuals and populations respond to health problems (Carrington, et al., 2012); 5. Qualitative research that has advanced understanding about experiences of and responses to health and illness and the processes of care that are important to optimal outcomes (Schulman-Green, et al., 2012; Scott, et al., 2011).

Randomised, double blind, placebo-controlled trial of Echinacea supplementation in air travellers

Objective. To identify whether a standardised Echinacea formulation is effective in the prevention of respiratory and other symptoms associated with long-haul flights. Methods. 175 adults participated in a randomised, double-blind placebo-controlled trial travelling back from Australia to America, Europe, or Africa for a period of 1–5 weeks on commercial flights via economy class. Participants took Echinacea (root extract, standardised to 4.4 mg alkylamides) or placebo tablets. Participants were surveyed before, immediately after travel, and at 4 weeks after travel regarding upper respiratory symptoms and travel-related quality of life. Results. Respiratory symptoms for both groups increased significantly during travel (