Sampling perceptions; testing reality : an evidence-based approach to measurably improve information literacy and student research skills

Do commencing students possess the level of information literacy (IL) knowledge and skills they need to succeed at university? What impact does embedding IL within the engineering and design curriculum have? This paper reports on the self-perception versus the reality of IL knowledge and skills, across a large cohort of first year built environment and engineering students. Acting on the findings of this evaluation, the authors (a team of academic librarians) developed an intensive IL skills program which was integrated into a faculty wide unit. Perceptions, knowledge and skills were re-evaluated at the end of the semester to determine if embedded IL education made a difference. Findings reveal that both the perception and reality of IL skills were significantly and measurably improved.

Testing the effectiveness of a Practice Development intervention on changing the culture of evidence based practice in an acute care environment

In this age of evidence-based practice, nurses are increasingly expected to use research evidence in a systematic and judicious way when making decisions about patient care practices. Clinicians recognise the role of research when it provides valid, realistic answers in practical situations. Nonetheless, research is still perceived by some nurses as external to practice and implementing research findings into practice is often difficult. Since its conceptual platform in the 1960s, the emergence and growth of Nursing Development Units, and later, Practice Development Units has been described in the literature as strategic, organisational vehicles for changing the way nurses think about nursing by promoting and supporting a culture of inquiry and research-based practice. Thus, some scholars argue that practice development is situated in the gap between research and practice. Since the 1990s, the discourse has shifted from the structure and outcomes of developing practice to the process of developing practice, using a Practice Development methodology; underpinned by critical social science theory, as a vehicle for changing the culture and context of care. The nursing and practice development literature is dominated by descriptive reports of local practice development activity, typically focusing on reflection on processes or outcomes of processes, and describing perceived benefits. However, despite the volume of published literature, there is little published empirical research in the Australian or international context on the effectiveness of Practice Development as a methodology for changing the culture and context of care - leaving a gap in the literature. The aim of this study was to develop, implement and evaluate the effectiveness of a Practice Development model for clinical practice review and change on changing the culture and context of care for nurses working in an acute care setting. A longitudinal, pre-test/post-test, non-equivalent control group design was used to answer the following research questions: 1. Is there a relationship between nurses' perceptions of the culture and context of care and nurses' perceptions of research and evidence-based practice? 2. Is there a relationship between engagement in a facilitated process of Practice Development and change in nurses' perceptions of the culture and context of care? 3. Is there a relationship between engagement in a facilitated process of Practice Development and change in nurses' perceptions of research and evidence-based practice? Through a critical analysis of the literature and synthesis of the findings of past evaluations of Nursing and Practice Development structures and processes, this research has identified key attributes consistent throughout the chronological and theoretical development of Nursing and Practice Development that exemplify a culture and context of care that is conducive to creating a culture of inquiry and evidence-based practice. The study findings were then used in the development, validation and testing of an instrument to measure change in the culture and context of care. Furthermore, this research has also provided empirical evidence of the relationship of the key attributes to each other and to barriers to research and evidence-based practice. The research also provides empirical evidence regarding the effectiveness of a Practice Development methodology in changing the culture and context of care. This research is noteworthy in its contribution to advancing the discipline of nursing by providing evidence of the degree to which attributes of the culture and context of care, namely autonomy and control, workplace empowerment and constructive team dynamics, can be connected to engagement with research and evidence-based practice.

The evidence-based development of an intervention to address the information needs of adults newly diagnosed with primary brain tumours and their carers

Adults diagnosed with primary brain tumours often experience physical, cognitive and neuropsychiatric impairments and decline in quality of life. Although disease and treatment-related information is commonly provided to cancer patients and carers, newly diagnosed brain tumour patients and their carers report unmet information needs. Few interventions have been designed or proven to address these information needs. Accordingly, a three-study research program, that incorporated both qualitative and quantitative research methods, was designed to: 1) identify and select an intervention to improve the provision of information, and meet the needs of patients with a brain tumour; 2) use an evidence-based approach to establish the content, language and format for the intervention; and 3) assess the acceptability of the intervention, and the feasibility of evaluation, with newly diagnosed brain tumour patients. Study 1: Structured concept mapping techniques were undertaken with 30 health professionals, who identified strategies or items for improving care, and rated each of 42 items for importance, feasibility, and the extent to which such care was provided. Participants also provided data to interpret the relationship between items, which were translated into ‘maps’ of relationships between information and other aspects of health care using multidimensional scaling and hierarchical cluster analysis. Results were discussed by participants in small groups and individual interviews to understand the ratings, and facilitators and barriers to implementation. A care coordinator was rated as the most important strategy by health professionals. Two items directly related to information provision were also seen as highly important: "information to enable the patient or carer to ask questions" and "for doctors to encourage patients to ask questions". Qualitative analyses revealed that information provision was individualised, depending on patients’ information needs and preferences, demographic variables and distress, the characteristics of health professionals who provide information, the relationship between the individual patient and health professional, and influenced by the fragmented nature of the health care system. Based on quantitative and qualitative findings, a brain tumour specific question prompt list (QPL) was chosen for development and feasibility testing. A QPL consists of a list of questions that patients and carers may want to ask their doctors. It is designed to encourage the asking of questions in the medical consultation, allowing patients to control the content, and amount of information provided by health professionals. Study 2: The initial structure and content of the brain tumour specific QPL developed was based upon thematic analyses of 1) patient materials for brain tumour patients, 2) QPLs designed for other patient populations, and 3) clinical practice guidelines for the psychosocial care of glioma patients. An iterative process of review and refinement of content was undertaken via telephone interviews with a convenience sample of 18 patients and/or carers. Successive drafts of QPLs were sent to patients and carers and changes made until no new topics or suggestions arose in four successive interviews (saturation). Once QPL content was established, readability analyses and redrafting were conducted to achieve a sixth-grade reading level. The draft QPL was also reviewed by eight health professionals, and shortened and modified based on their feedback. Professional design of the QPL was conducted and sent to patients and carers for further review. The final QPL contained questions in seven colour-coded sections: 1) diagnosis; 2) prognosis; 3) symptoms and problems; 4) treatment; 5) support; 6) after treatment finishes; and 7) the health professional team. Study 3: A feasibility study was conducted to determine the acceptability of the QPL and the appropriateness of methods, to inform a potential future randomised trial to evaluate its effectiveness. A pre-test post-test design was used with a nonrandomised control group. The control group was provided with ‘standard information’, the intervention group with ‘standard information’ plus the QPL. The primary outcome measure was acceptability of the QPL to participants. Twenty patients from four hospitals were recruited a median of 1 month (range 0-46 months) after diagnosis, and 17 completed baseline and follow-up interviews. Six participants would have preferred to receive the information booklet (standard information or QPL) at a different time, most commonly at diagnosis. Seven participants reported on the acceptability of the QPL: all said that the QPL was helpful, and that it contained questions that were useful to them; six said it made it easier to ask questions. Compared with control group participants’ ratings of ‘standard information’, QPL group participants’ views of the QPL were more positive; the QPL had been read more times, was less likely to be reported as ‘overwhelming’ to read, and was more likely to prompt participants to ask questions of their health professionals. The results from the three studies of this research program add to the body of literature on information provision for brain tumour patients. Together, these studies suggest that a QPL may be appropriate for the neuro-oncology setting and acceptable to patients. The QPL aims to assist patients to express their information needs, enabling health professionals to better provide the type and amount of information that patients need to prepare for treatment and the future. This may help health professionals meet the challenge of giving patients sufficient information, without providing ‘too much’ or ‘unnecessary’ information, or taking away hope. Future studies with rigorous designs are now needed to determine the effectiveness of the QPL.

Validation of scales measuring self-efficacy and outcome expectancy in evidence-based practice

Background: Evidence-based practice (EBP) is embraced internationally as an ideal approach to improve patient outcomes and provide cost-effective care. However, despite the support for and apparent benefits of evidence-based practice, it has been shown to be complex and difficult to incorporate into the clinical setting. Research exploring implementation of evidence-based practice has highlighted many internal and external barriers including clinicians’ lack of knowledge and confidence to integrate EBP into their day-to-day work. Nurses in particular often feel ill-equipped with little confidence to find, appraise and implement evidence. Aims: The following study aimed to undertake preliminary testing of the psychometric properties of tools that measure nurses’ self-efficacy and outcome expectancy in regard to evidence-based practice. Methods: A survey design was utilised in which nurses who had either completed an EBP unit or were randomly selected from a major tertiary referral hospital in Brisbane, Australia were sent two newly developed tools: 1) Self-efficacy in Evidence-Based Practice (SE-EBP) scale and 2) Outcome Expectancy for Evidence-Based Practice (OE-EBP) scale. Results: Principal Axis Factoring found three factors with eigenvalues above one for the SE-EBP explaining 73% of the variance and one factor for the OE-EBP scale explaining 82% of the variance. Cronbach’s alpha for SE-EBP, three SE-EBP factors and OE-EBP were all >.91 suggesting some item redundancy. The SE-EBP was able to distinguish between those with no prior exposure to EBP and those who completed an introductory EBP unit. Conclusions: While further investigation of the validity of these tools is needed, preliminary testing indicates that the SE-EBP and OE-EBP scales are valid and reliable instruments for measuring health professionals’ confidence in the process and the outcomes of basing their practice on evidence.

Development of an innovative technology-based youth passenger safety program : an evidence-based approach

Young drivers are overrepresented in motor vehicle crash rates, and their risk increases when carrying similar aged passengers. Graduated Driver Licensing strategies have demonstrated effectiveness in reducing fatalities among young drivers, however complementary approaches may further reduce crash rates. Previous studies conducted by the researchers have shown that there is considerable potential for a passenger focus in youth road safety interventions, particularly involving the encouragement of young passengers to intervene in their peers’ risky driving (Buckley, Chapman, Sheehan & Davidson, 2012). Additionally, this research has shown that technology-based applications may be a promising means of delivering passenger safety messages, particularly as young people are increasingly accessing web-based and mobile technologies. This research describes the participatory design process undertaken to develop a web-based road safety program, and involves feasibility testing of storyboards for a youth passenger safety application. Storyboards and framework web-based materials were initially developed for a passenger safety program, using the results of previous studies involving online and school-based surveys with young people. Focus groups were then conducted with 8 school staff and 30 senior school students at one public high school in the Australian Capital Territory. Young people were asked about the situations in which passengers may feel unsafe and potential strategies for intervening in their peers’ risky driving. Students were also shown the storyboards and framework web-based material and were asked to comment on design and content issues. Teachers were also shown the material and asked about their perceptions of program design and feasibility. The focus group data will be used as part of the participatory design process, in further developing the passenger safety program. This research describes an evidence-based approach to the development of a web-based application for youth passenger safety. The findings of this research and resulting technology will have important implications for the road safety education of senior high school students.

Safe perioperative fasting : implementation of evidence based guidelines and an ‘at risk’ checklist

Introduction Guidelines existed at the Royal Children’s Hospital (RCH) to direct preoperative/pre-procedural fasting in day patients undergoing general anaesthetic. However audit, risk analyses and a recent research project at the RCH identified prolonged pre-procedural fasting times in children undergoing day surgical and gastroenterology procedures. Aims 1. Reduce median fasting time to <8 hrs for children admitted for a day procedure under general anaesthetic; 2. Identify children at risk of perioperative hypoglycaemia. Methods The study was conducted in 4 phases: 1) revision and implementation of evidence-based perioperative fasting guidelines with staff education relating to these guidelines; 2) cross-sectional descriptive study with day surgical patients (n = 377) requiring preoperative fasting. ‘Normal risk’ and ‘High risk’ groups were identified for fasting hypoglycaemia using an ‘at risk’ checklist. Venous blood glucose (BGL) testing was performed at a) anaesthetic induction; b) prior to first caloric food/fluid postoperatively; 3) chart audit to evaluate efficacy of guidelines and parent information; 4) development of recommendations for clinical practice. Results The median fasting time for children having morning surgery (14 hrs, IQ range 5–22 hrs) was twice as long compared to afternoon lists (7 hrs, IQ range 6–22 hrs) (p < 0.001). Median fasting times were not significantly different between ‘at risk’ and control groups (p = 0.496). However the proportion of children who experienced hypoglycaemia (BGL <3 mmol/L) was greater in the ‘at risk’ group (5, 8%) compared to the control group (18, 4.3%). Although not statistically significant (x2 = 2.254, p = 0.133), ‘at risk’ children appear more likely to experience hypoglycaemia as children in the control group, constituting a clinically significant finding. Conclusion Appropriate identification and management of ‘high risk’ children, will reduce the risk of deleterious sequelae in children undergoing surgical or investigative procedures requiring general anaesthesia.

Development of an evidence-based symptom checklist for symptoms of recurrence in women with endometrial cancer

Objective Women treated for endometrial cancer currently commonly attend clinic-based follow-up examinations for up to five years. This is based on little evidence and alternative models need to be investigated. This study aimed to identify currently available symptom checklists, determine the comprehensiveness of identified checklists, and generate an updated list of symptoms potentially associated with a recurrence of endometrial cancer for future testing within a prospective study. Methods/materials We conducted a systematic review of the literature extracting; routine follow-up schedules; proportion of patients with symptomatic or asymptomatic recurrence; symptoms of recurrence; prevalence of these symptoms at recurrence. Results Overall, three previous checklists, and 12 retrospective studies were identified meeting the selection criteria. The average rate of recurrence across the studies was 13% (range 3%-19%). The proportion of patients identified with a symptomatic recurrence varied widely (overall average 67%;range 41% to 91%). The most commonly reported symptoms were vaginal bleeding (25%), pain [not further described] (16%) and abdominal pain and/or discomfort and swelling (15%) which combined, represented 56% of the total reported symptoms. The three previous checklists listed 14 and this review identified an additional 24 symptoms (e.g. vaginal discharge, leg pain, constipation, headache and self-detected mass) not previously identified. Conclusion The newly developed symptom checklist expands previous ones, by an additional 24 symptoms. It will be used in a prospective cohort study to assess whether it is sensitive and specific enough to identify recurrence compared to current standard follow-up examinations.

Amblyopia treatment : an evidence-based approach to maximising treatment outcome

The basis of treatment for amblyopia (poor vision due to abnormal visual experience early in life) for 250 years has been patching of the unaffected eye for extended times to ensure a period of use of the affected eye. Over the last decade randomised controlled treatment trials have provided some evidence on how to tailor amblyopia therapy more precisely to achieve the best visual outcome with the least negative impact on the patient and the family. This review highlights the expansion of knowledge regarding treatment for amblyopia and aims to provide optometrists with a summary of research evidence to enable them to better treat amblyopia. Treatment for amblyopia is effective, as it reduces overall prevalence and severity of visual loss in this population. Correction of refractive error alone significantly improves visual acuity, sometimes to the point where further amblyopia treatment is not required. Atropine penalisation and patch occlusion are effective in treating amblyopia. Lesser amounts of occlusion or penalisation have been found to be just as effective as greater amounts. Recent evidence has highlighted that occlusion or penalisation in amblyopia treatment can create negative changes in behaviour in children and impact on family life. These complications should be considere when prescribing treatment because they can negatively affect compliance. Studies investigating the maximum age at which treatment of amblyopia can still be effective and the importance of near activities during occlusion are ongoing.

Evidence-based practice and information literacy

Evidence-based Practice (EBP) has recently emerged as a topic of discussion amongst professionals within the library and information services (LIS) industry. Simply stated, EBP is the process of using formal research skills and methods to assist in decision making and establishing best practice. The emerging interest in EBP within the library context serves to remind the library profession that research skills and methods can help ensure that the library industry remains current and relevant in changing times. The LIS sector faces ongoing challenges in terms of the expectation that financial and human resources will be managed efficiently, particularly if library budgets are reduced and accountability to the principal stakeholders is increased. Library managers are charged with the responsibility to deliver relevant and cost effective services, in an environment characterised by rapidly changing models of information provision, information access and user behaviours. Consequently they are called upon not only to justify the services they provide, or plan to introduce, but also to measure the effectiveness of these services and to evaluate the impact on the communities they serve. The imperative for innovation in and enhancements to library practice is accompanied by the need for a strong understanding of the processes of review, measurement, assessment and evaluation. In 2001 the Centre for Information Research was commissioned by the Chartered Institute of Library and Information Professionals (CILIP) in the UK to conduct an examination into the research landscape for library and information science. The examination concluded that research is “important for the LIS [library and information science] domain in a number of ways” (McNicol & Nankivell, 2001, p.77). At the professional level, research can inform practice, assist in the future planning of the profession, raise the profile of the discipline, and indeed the reputation and standing of the library and information service itself. At the personal level, research can “broaden horizons and offer individuals development opportunities” (McNicol & Nankivell, 2001, p.77). The study recommended that “research should be promoted as a valuable professional activity for practitioners to engage in” (McNicol & Nankivell, 2001, p.82). This chapter will consider the role of EBP within the library profession. A brief review of key literature in the area is provided. The review considers issues of definition and terminology, highlights the importance of research in professional practice and outlines the research approaches that underpin EBP. The chapter concludes with a consideration of the specific application of EBP within the dynamic and evolving field of information literacy (IL).

Are library and information professionals ready for evidence based practice?

Evidence based practice (EBP) is recognised as a way of improving the quality of professional practice in many disciplines however its adoption within library and information sciences (LIS) has been gradual. The term was first introduced into the library and information profession‟s vocabulary a decade ago but an impediment to its uptake is the lack of clear understanding regarding how LIS practitioners understand the concept. Partridge, Thorpe, Edwards and Hallam (2007) identified the need to understand how LIS professionals experience or understand evidence based practice and proposed a model of four categories of experience to describe how LIS professionals experience EBP. This paper extends that framework by refining the different conceptions of evidence based practice and identifying relationships which exist between the categories of experience to provide a rich description of the EBP phenomenon. The paper also argues that the phrase “evidence based librarianship” and its variations be abandoned as practitioners do not see a distinction between EBP as applied to librarianship and information practice and industry specific jargon like “evidence based library and information practice”. This research will help current and future LIS practitioners, leaders and educators engage more actively in the establishment of an evidence based culture to improve library and information practice in Australia and internationally.

Challenges in implementing evidence-based practice into mental health services

This paper highlights challenges in implementing mental health policy at a service delivery level. It describes an attempt to foster greater application of recovery-orientated principles and practices within mental health services. Notwithstanding a highly supportive policy environment, strong support from service administrators, and an enthusiastic staff response to training, application of the training and support tools was weaker than anticipated. This paper evaluates the dissemination trial against key elements to promote sustained adoption of innovations. Organisational and procedural changes are required before mental health policies are systematically implemented in practice.

Evidence-based decision making to strengthen local governance : nutritional health interventions in Bantul and Gunungkidul

Since 2001, district governments have had the main responsibility for providing public health care in Indonesia. One of the main public health challenges facing many district governments is improving nutritional standards, particularly among poorer segments of the population. Developing effective policies and strategies for improving nutrition requires a multi-sectoral approach encompassing agricultural development policy, access to markets, food security (storage) programs, provision of public health facilities, and promotion of public awareness of nutritional health. This implies a strong need for a coordinated approach involving multiple government agencies at the district level. Due to diverse economic, agricultural, and infrastructure conditions across the country, district governments’ ought to be better placed than central government both to identify areas of greatest need for public nutrition interventions, and devise policies that reflect local characteristics. However, in the two districts observed in this study—Bantul and Gunungkidul—it was clear that local government capacity to generate, obtain and integrate evidence about local conditions into the policy-making process was still limited. In both districts, decision-makers tended to rely more on intuition,anecdote, and precedent in formulating policy. The potential for evidence-based decision making was also severely constrained by a lack of coordination and communication between agencies, and current arrangements related to central government fiscal transfers, which compel local governments to allocate funding to centrally determined programs and priorities.