Evaluation of public hospital performance in Khanh Hoa Province : Vietnam in connection with patient and staff satisfaction surveys

This research aimed to develop a framework for performance evaluation of public hospitals in Vietnam that is culturally, socially, and politically appropriate. The research included both qualitative and quantitative methods and identified and validated novel instruments to measure patient satisfaction and job satisfaction of hospital staff and to determine a set of hospital indicators that reflect the quality of hospital performance. New models for understanding the determinants of patient and staff satisfaction were developed along with a new performance indicator framework for hospital performance. These instruments will now be applied to the evaluation of hospital services in Khanh Hoa Province, permitting longer term evaluation of their effectiveness in changing system wide performance and satisfaction.

Relationship between expectation management and client retention in online Cognitive Behavioural Therapy

Background Engaging clients from the outset of psychotherapy is important for therapeutic success. However, there is little research evaluating therapists’ initial attempts to engage clients. This article reports retrospective analysis of data from a trial of online Cognitive Behavioural Therapy (CBT) for depression. Qualitative and quantitative methods were used to evaluate how therapists manage clients’ expectations at the outset of therapy and its relationship with client retention in the therapeutic intervention. Aims To develop a system to codify expectation management in initial sessions of online CBT and evaluate its relationship with retention. Method Initial qualitative research using conversation analysis identified three different communication practices used by therapists at the start of first sessions: no expectation management, some expectation management, and comprehensive expectation management. These findings were developed into a coding scheme that enabled substantial inter-rater agreement (weighted Kappa = 0.78; 95% CI: 0.52 to 0.94) and was applied to all trial data. Results Adjusting for a range of client variables, primary analysis of data from 147 clients found comprehensive expectation management was associated with clients remaining in therapy for 1.4 sessions longer than those who received no expectation management (95% CI: -0.2 to 3.0). This finding was supported by a sensitivity analysis including an additional 21 clients (1.6 sessions, 95% CI: 0.2 to 3.1). Conclusions Using a combination of qualitative and quantitative methods, this study suggests a relationship between expectation management and client retention in online CBT for depression, which has implications for professional practice. A larger prospective study would enable a more precise estimate of retention.

Evolving a synergistic approach to road safety : an appraisal of the project management, stakeholder engagement and change facilitation (PSC) approach by means of two case studies

Existing research and best practice were utilized to develop the Project Management, Stakeholder Engagement and Change Facilitation (PSC) approach to road safety infrastructure projects. Two case studies involving Queensland Transport and Main Roads demonstrated that use of the PSC has potential to create synergies for projects undertaken by multi-disciplinary road safety groups, and to complement Safe System projects and philosophy. The case studies were the North West Road Safety Alliance project, and the implementation of Road Safety Audit policy, and utilised a mix of qualitative and quantitative methods including interviews and surveys.

Using a free online questionnaire to determine the skills, competencies and knowledge required to work in a digital library environment in Australia

This paper discusses the data collection technique used to determine the skills and knowledge required of academic librarians working in a digital library environment in Australia. The research was undertaken as part of the researcher’s master’s thesis conducted at Tallinn University. The data collection instrument used was a freely available online survey tool, and its advantages and disadvantages are discussed in terms of the desired outcomes and circumstances surrounding the thesis project. Decisions regarding the design of the questionnaire are also discussed.

Medicines information sources and services for consumers : A special focus on the Internet and people with depression

The range of consumer health and medicines information sources has diversified along with the increased use of the Internet. This has led to a drive to develop medicines information services and to better incorporate the Internet and e-mail into routine practice in health care and in community pharmacies. To support the development of such services more information is needed about the use of online information by consumers, particularly of those who may be the most likely to use and to benefit from the new sources and modes of medicines communication. This study explored the role and utilization of the Internet-based medicines information and information services in the context of a wider network of information sources accessible to the public in Finland. The overall aim was to gather information to develop better and more accessible sources of information for consumers and services to better meet the needs of consumers. Special focus was on the needs and information behavior among people with depression and using antidepressant medicines. This study applied both qualitative and quantitative methods. Consumer medicines information needs and sources were identified by analyzing the utilization of the University Pharmacy operated national drug information call center (Study I) and surveying Finnish adults (n=2348) use of the different medicines information sources (Study II). The utilization of the Internet as a source of antidepressant information among people with depression was explored by focus group discussions among people with depression and with current or past use of the antidepressant(s) (n=29, Studies III & IV). Pharmacy response to the needs of consumers in term of providing e-mail counseling was assessed by conducting a virtual pseudo customer study among the Finnish community pharmacies (n=161, Study V). Physicians and pharmacists were the primary sources of medicines information. People with mental disorders were more frequent users of telephone- and Internet-based medicines information sources and patient information leaflets than people without mental disorders. These sources were used to complement rather than replace information provided face-to-face by health professionals. People with depression used the Internet to seek facts about antidepressants, to share experiences with peers, and for the curiosity. They described that the access to online drug information was empowering. Some people reported lacking the skills necessary to assess the quality of online information. E-mail medication counseling services provided by community pharmacies were rare and varied in quality. Study results suggest that rather than discouraging the use of the Internet, health professionals should direct patients to use accurate and reliable sources of online medicines information. Health care providers, including community pharmacies should also seek to develop new ways of communicating information about medicines with consumers. This study determined that people with depression and using antidepressants need services enabling interactive communication not only with health care professionals, but also with peers. Further research should be focused on developing medicines information service facilitating communication among different patient and consumer groups.

Teacher Education, School Effectiveness and Improvement : A Study of Academic and Professional Qualification on Teachers' Job Effectiveness in Nigerian Secondary Schools

This academic work begins with a compact presentation of the general background to the study, which also includes an autobiography for the interest in this research. The presentation provides readers who know little of the topic of this research and of the structure of the educational system as well as of the value given to education in Nigeria. It further concentrates on the dynamic interplay of the effect of academic and professional qualification and teachers' job effectiveness in secondary schools in Nigeria in particular, and in Africa in general. The aim of this study is to produce a systematic analysis and rich theoretical and empirical description of teachers' teaching competencies. The theoretical part comprises a comprehensive literature review that focuses on research conducted in the areas of academic and professional qualification and teachers' job effectiveness, teaching competencies, and the role of teacher education with particular emphasis on school effectiveness and improvement. This research benefits greatly from the functionalist conception of education, which is built upon two emphases: the application of the scientific method to the objective social world, and the use of an analogy between the individual 'organism' and 'society'. To this end, it offers us an opportunity to define terms systematically and to view problems as always being interrelated with other components of society. The empirical part involves describing and interpreting what educational objectives can be achieved with the help of teachers' teaching competencies in close connection to educational planning, teacher training and development, and achieving them without waste. The data used in this study were collected between 2002 and 2003 from teachers, principals, supervisors of education from the Ministry of Education and Post Primary Schools Board in the Rivers State of Nigeria (N=300). The data were collected from interviews, documents, observation, and questionnaires and were analyzed using both qualitative and quantitative methods to strengthen the validity of the findings. The data collected were analyzed to answer the specific research questions and hypotheses posited in this study. The data analysis involved the use of multiple statistical procedures: Percentages Mean Point Value, T-test of Significance, One-Way Analysis of Variance (ANOVA), and Cross Tabulation. The results obtained from the data analysis show that teachers require professional knowledge and professional teaching skills, as well as a broad base of general knowledge (e.g., morality, service, cultural capital, institutional survey). Above all, in order to carry out instructional processes effectively, teachers should be both academically and professionally trained. This study revealed that teachers are not however expected to have an extraordinary memory, but rather looked upon as persons capable of thinking in the right direction. This study may provide a solution to the problem of teacher education and school effectiveness in Nigeria. For this reason, I offer this treatise to anyone seriously committed in improving schools in developing countries in general and in Nigeria in particular to improve the lives of all its citizens. In particular, I write this to encourage educational planners, education policy makers, curriculum developers, principals, teachers, and students of education interested in empirical information and methods to conceptualize the issue this study has raised and to provide them with useful suggestions to help them improve secondary schooling in Nigeria. Though, multiple audiences exist for any text. For this reason, I trust that the academic community will find this piece of work a useful addition to the existing literature on school effectiveness and school improvement. Through integrating concepts from a number of disciplines, I aim to describe as holistic a representation as space could allow of the components of school effectiveness and quality improvement. A new perspective on teachers' professional competencies, which not only take into consideration the unique characteristics of the variables used in this study, but also recommend their environmental and cultural derivation. In addition, researchers should focus their attention on the ways in which both professional and non-professional teachers construct and apply their methodological competencies, such as their grouping procedures and behaviors to the schooling of students. Keywords: Professional Training, Academic Training, Professionally Qualified, Academically Qualified, Professional Qualification, Academic Qualification, Job Effectiveness, Job Efficiency, Educational Planning, Teacher Training and Development, Nigeria.

Evaluation of a workplace alcohol and other drug policy

BACKGROUND The current impetus for developing alcohol and/or other drugs (AODs) workplace policies in Australia is to reduce workplace AOD impairment, improve safety, and prevent AOD-related injury in the workplace. For these policies to be effective, they need to be informed by scientific evidence. Evidence to inform the development and implementation of effective workplace AOD policies is currently lacking. There does not currently appear to be conclusive evidence for the effectiveness of workplace AOD policies in reducing impairment and preventing AOD-related injury. There is also no apparent evidence regarding which factors facilitate or impede the success of an AOD policy, or whether, for example, unsuccessful policy outcomes were due to poor policy or merely poor implementation of the policy. It was the aim of this research to undertake a process, impact, and outcome evaluation of a workplace AOD policy, and to contribute to the body of knowledge on the development and implementation of effective workplace AOD policies. METHODS The research setting was a state-based power-generating industry in Australia between May 2008 and May 2010. Participants for the process evaluation study were individuals who were integral to either the development or the implementation of the workplace AOD policy, or both of these processes (key informants), and comprised the majority of individuals who were involved in the process of developing and/or implementing the workplace AOD policy. The sample represented the two main groups of interest—management and union delegates/employee representatives—from all three of the participating organisations. For the impact and outcome evaluation studies, the population included all employees from the three participating organisations, and participants were all employees who consented to participate in the study and who completed both the pre-and post-policy implementation questionnaires. Qualitative methods in the form of interviews with key stakeholders were used to evaluate the process of developing and implementing the workplace AOD policy. In order to evaluate the impact of the policy with regard to the risk factors for workplace AOD impairment, and the outcome of the policy in terms of reducing workplace AOD impairment, quantitative methods in the form of a non-randomised single group pre- and post-test design were used. Changes from Time 1 (pre) to Time 2 (post) in the risk factors for workplace AOD impairment, and changes in the behaviour of interest—(self-reported) workplace AOD impairment—were measured. An integration of the findings from the process, impact, and outcome evaluation studies was undertaken using a combination of qualitative and quantitative methods. RESULTS For the process evaluation study Study respondents indicated that their policy was developed in the context of comparable industries across Australia developing workplace AOD policies, and that this was mainly out of concern for the deleterious health and safety impacts of workplace AOD impairment. Results from the process evaluation study also indicated that in developing and implementing the workplace AOD policy, there were mainly ‗winners', in terms of health and safety in the workplace. While there were some components of the development and implementation of the policy that were better done than others, and the process was expensive and took a long time, there were, overall, few unanticipated consequences to implementing the policy and it was reported to be thorough and of a high standard. Findings also indicated that overall the policy was developed and implemented according to best-practice in that: consultation during the policy development phase (with all the main stakeholders) was extensive; the policy was comprehensive; there was universal application of the policy to all employees; changes in the workplace (with regard to the policy) were gradual; and, the policy was publicised appropriately. Furthermore, study participants' responses indicated that the role of an independent external expert, who was trusted by all stakeholders, was integral to the success of the policy. For the impact and outcome evaluation studies Notwithstanding the limitations of pre- and post-test study designs with regard to attributing cause to the intervention, the findings from the impact evaluation study indicated that following policy implementation, statistically significant positive changes with regard to workplace AOD impairment were recorded for the following variables (risk factors for workplace AOD impairment): Knowledge; Attitudes; Perceived Behavioural Control; Perceptions of the Certainty of being punished for coming to work impaired by AODs; Perceptions of the Swiftness of punishment for coming to work impaired by AODs; and Direct and Indirect Experience with Punishment Avoidance for workplace AOD impairment. There were, however, no statistically significant positive changes following policy implementation for Behavioural Intentions, Subjective Norms, and Perceptions of the Severity of punishment for workplace AOD impairment. With regard to the outcome evaluation, there was a statistically significant reduction in self-reported workplace AOD impairment following the implementation of the policy. As with the impact evaluation, these findings need to be interpreted in light of the limitations of the study design in being able to attribute cause to the intervention alone. The findings from the outcome evaluation study also showed that while a positive change in self-reported workplace AOD impairment following implementation of the policy did not appear to be related to gender, age group, or employment type, it did appear to be related to levels of employee general alcohol use, cannabis use, site type, and employment role. Integration of the process, impact, and outcome evaluation studies There appeared to be qualitative support for the relationship between the process of developing and implementing the policy, and the impact of the policy in changing the risk factors for workplace AOD impairment. That is, overall the workplace AOD policy was developed and implemented well and, following its implementation, there were positive changes in the majority of measured risk factors for workplace AOD impairment. Quantitative findings lend further support for a relationship between the process and impact of the policy, in that there was a statistically significant association between employee perceived fidelity of the policy (related to the process of the policy) and positive changes in some risk factors for workplace AOD impairment (representing the impact of the policy). Findings also indicated support for the relationship between the impact of the policy in changing the risk factors for workplace AOD impairment and the outcome of the policy in reducing workplace AOD impairment: positive changes in the risk factors for workplace AOD impairment (impact) were related to positive changes in self reported workplace AOD impairment (representing the main goal and outcome of the policy). CONCLUSIONS The findings from the research indicate support for the conclusion that the policy was appropriately implemented and that it achieved its objectives and main goal. The Doctoral research findings also addressed a number of gaps in the literature on workplace AOD impairment, namely: the likely effectiveness of AOD policies for reducing AOD impairment in the workplace, which factors in the development and implementation of a workplace AOD policy are likely to facilitate or impede the effectiveness of the policy to reduce workplace AOD impairment, and which employee groups are less likely to respond well to policies of this type. The findings from this research not only represent an example of translational, applied research—through the evaluation of the study industry's policy—but also add to the body of knowledge on workplace AOD policies and provide policy-makers with evidence which may be useful in the development and implementation of effective workplace AOD policies. Importantly, the findings espouse the importance of scientific evidence in the development, implementation, and evaluation of workplace AOD policies.

Hospital-related fears and coping strategies in 4-6-year-old children

There is only little information available on the 4-6-year-old child s hospital-related fears, and on the coping with such fears, as expressed by the children themselves. However, previous data collected from parents and hospital personnel indicate that hospitalization is an anxiety-producing experience for young children. The purpose of this study was to describe the experience of hospital-related fears and the experience of coping with hospital-related fears of 4-6-year-old children. The aim of this study was to form a descriptive model of the subjective experience of hospital-related fears and coping strategies of 4-6-year old children. The data were collected by interviewing 4-6-year-old children from a hospital and kindergarten settings in Finland from 2004 to 2006. Ninety children were interviewed in order to describe the hospital-related fear and the experience of fear, and 89 to describe their coping with the fear and the experience of coping. The children were chosen through purposive sampling. The data were gathered by semi-structured interview, supported by pictures. The data about hospital-related fears and on strategies for coping with hospital-related fears were reviewed by qualitative and quantitative methods. The experience of hospital-related fears and coping with these fears were analyzed using Colaizzi s Method of Phenomenological Analysis. The results revealed that more than 90 % of the children said they were afraid of at least one thing in hospital. Most of the fears could be categorized as nursing interventions, fears of being a patient, and fears caused by the developmental stage of the child. Children interviewed in the hospital expressed substantially more fears than children interviewed in kindergarten. Children s meanings of hospital-related fears were placed into four main clusters: 1) insecurity, 2) injury, 3) helplessness, 4) and rejection. The results also showed that children have plenty of coping strategies, to deal with their fears, especially such strategies in which the children themselves play an active role. Most often mentioned coping strategies were 1) the presence of parents and other family members, 2) the help of the personnel, 3) positive images and humour, 4) play, and 5) the child s own safety toy. The children interviewed in the hospital mentioned statistically significantly more often play, positive imagination and humour as their coping strategy than children interviewed in kindergarten. The meaning of coping with hospital fears consisted of six clusters: pleasure, security, care, understanding the meaning of the situation participating, and protecting oneself. Being admitted to a hospital is an event which may increase the fears of a 4-6-year-old child. Children who have personal experience of being admitted to a hospital describe more fears than healthy children in kindergarten. For young children, hospital-related fear can be such a distressing experience that it reflects on their feelings of security and their behaviour. Children can sometimes find it difficult to admit their fear. Children need the help of adults to express their hospital-related fears, the objects of the fears, and to cope with the fears. Personnel should be aware of children s fears and support them in the use of coping strategies. In addition to the experiences of security and care, pre-school-aged children need active coping strategies that they can use themselves, regardless of the presence of the parents or nurses. Most of all, children need the possibility to play and experience pleasure. Children can also be taught coping strategies which give them an active, positive role.

Methodological implications of critical realism for mixed-methods research

Building on recent developments in mixed methods, we discuss the methodological implications of critical realism and explore how these can guide dynamic mixed-methods research design in information systems. Specifically, we examine the core ontological assumptions of CR in order to gain some perspective on key epistemological issues such as causation and validity, and illustrate how these shape our logic of inference in the research process through what is known as retroduction. We demonstrate the value of a CR-led mixed-methods research approach by drawing on a study that examines the impact of ICT adoption in the financial services sector. In doing so, we provide insight into the interplay between qualitative and quantitative methods and the particular value of applying mixed methods guided by CR methodological principles. Our positioning of demi-regularities within the process of retroduction contributes a distinctive development in this regard. We argue that such a research design enables us to better address issues of validity and the development of more robust meta-inferences.

A Risky Business: An Examination of Irish Probation Officers Attitudes and Work Practices Regarding Risk Assessment

This article examines recent research on risk assessment and probation practice in Ireland and relates the findings to the ongoing debate regarding risk management practices in probation. The piece discusses current theoretical arguments on the influence of risk in criminal justice and outlines the impact of risk discourse on probation practice in Ireland and England and Wales. Using a mix of qualitative and quantitative methods, Irish probation officers’ attitudes are examined in order to highlight key issues facing probation officers when making risk decisions. These findings are compared and contrasted to other research results from England and Wales. All the conclusions identify both positive and negative consequences of adopting risk tools and point to the continued salience of clinical judgment over actuarial methods of risk assessment. It is argued that the research highlights the role of ‘resistance’ by criminal justice professionals in mediating the effects of the ‘new penology’ at the level of implementation. The idea of resistance holds particular relevance for probation practice in Ireland where professional discretion is maintained within the National Standards framework. Despite this, to date there has been an uncritical approach taken to risk assessment which may ignore the dangers of risk inflation/deflation and the need to take into account local factors in assessing risk of reoffending

Assessing and measuring impact of a digital collection in the humanities: An analysis of the SPHERE (Stormont Parliamentary Hansards: Embedded in Research and Education) Project

Although a substantial corpus of digital materials is now available to scholarship across the disciplines, objective evidence of their use, impact, and value, based on a robust assessment, is sparse. Traditional methods of assessment of impact in the humanities, notably citation in scholarly publications, are not an effective way of assessing impact of digital content. These issues are problematic in the field of Digital Humanities where there is a need to effectively assess impact to justify its continued funding and existence. A number of qualitative and quantitative methods exist that can be used to monitor the use of digital resources in various contexts although they have yet to be applied widely. These have been made available to the creators, managers, and funders of digital content in an accessible form through the TIDSR (Toolkit for the Impact of Digital Scholarly Resources) developed by the Oxford Internet Institute. In 2011, the authors of this article developed the SPHERE project (Stormont Parliamentary Hansards: Embedded in Research and Education) specifically to use TIDSR to evaluate the use and impact of The Stormont Papers, a digital collection of the Hansards of the Stormont Northern Irish Parliament from 1921 to 1972. This article presents the methodology, findings, and analysis of the project. The authors argue that TIDSR is a useful and, critically, transferrable method to understand and increase the impact of digital resources. The findings of the project are modified into a series of wider recommendations on protecting the investment in digital resources by increasing their use, value, and impact. It is reasonable to suggest that effectively showing the impact of Digital Humanities is critical to its survival.

New technology and new workplaces: call centre careers – a growing reality?

Research to date suggests that career advancement in call centres (CCs) is relatively uncommon with employees often viewing such employment as a stopgap measure before moving on to something better. This study set out to determine whether such scenarios have changed over time since CCs have become more established in their work organisation, information and communication technology (ICT) and management processes. This study particularly focused on training and development initiatives, how employees access training and development, and whether CCs support career development. Using both qualitative and quantitative methods, these issues are examined within 10 Australian CCs of varying size from various sectors. Two-thirds of respondents stated that they intended to develop a career in the industry and 7 in 10 reported that they believed there were promotional opportunities emerging in their current organisation. Despite these findings, the evidence also suggests that more needs to be done both to create coherent career paths and to establish structured, accredited training programmes for CC employees.

Developing the clinical components of a complex intervention for a glaucoma screening trial:a mixed methods study

BACKGROUND: Glaucoma is a leading cause of avoidable blindness worldwide. Open angle glaucoma is the most common type of glaucoma. No randomised controlled trials have been conducted evaluating the effectiveness of glaucoma screening for reducing sight loss. It is unclear what the most appropriate intervention to be evaluated in any glaucoma screening trial would be. The purpose of this study was to develop the clinical components of an intervention for evaluation in a glaucoma (open angle) screening trial that would be feasible and acceptable in a UK eye-care service.

METHODS: A mixed-methods study, based on the Medical Research Council (MRC) framework for complex interventions, integrating qualitative (semi-structured interviews with 46 UK eye-care providers, policy makers and health service commissioners), and quantitative (economic modelling) methods. Interview data were synthesised and used to revise the screening interventions compared within an existing economic model.

RESULTS: The qualitative data indicated broad based support for a glaucoma screening trial to take place in primary care, using ophthalmic trained technical assistants supported by optometry input. The precise location should be tailored to local circumstances. There was variability in opinion around the choice of screening test and target population. Integrating the interview findings with cost-effectiveness criteria reduced 189 potential components to a two test intervention including either optic nerve photography or screening mode perimetry (a measure of visual field sensitivity) with or without tonometry (a measure of intraocular pressure). It would be more cost-effective, and thus acceptable in a policy context, to target screening for open angle glaucoma to those at highest risk but for both practicality and equity arguments the optimal strategy was screening a general population cohort beginning at age forty.

CONCLUSIONS: Interventions for screening for open angle glaucoma that would be feasible from a service delivery perspective were identified. Integration within an economic modelling framework explicitly highlighted the trade-off between cost-effectiveness, feasibility and equity. This study exemplifies the MRC recommendation to integrate qualitative and quantitative methods in developing complex interventions. The next step in the development pathway should encompass the views of service users.

Development of Social Relationships, Interactions and Behaviours in Early Education Settings

Recent research and policy regarding the advantages of early years provision has focused largely on the enhancement and development of cognitive skills for preschoolers. This study, based in the United Kingdom, focuses on a range of cognitive and social skills and identifies beneficial characteristics of a government pilot scheme for 2-year-olds in areas of social disadvantage. Data were collected from nursery managers and parents across six early years settings using a combination of qualitative and quantitative methods centred around in-depth observational techniques focused on children. Results indicate that in addition to the development of cognitive skills, children showed increased confidence and modes of communication and interaction and that these were associated with the varied activities and routines established within the early years settings. Some variations in terms of frequency and quality of interactions, activities and practice were identified in settings; however, interpersonal support for learning and development was consistent across settings.

Pauvreté, criminalité et problèmes de santé mentale : une évaluation qualitative et quantitative des interventions communautaires et policières dans un taudis mal famé

L'analyse quantitative a été réalisée en cotutelle avec Rémi Boivin et Pierre Tremblay et publiée dans la Revue de Criminologie: Boivin, R., Lamige, C,. Tremblay, P. (2009) La police devrait-elle cibler les taudis malfamés? Criminologie, (42)1, 225-266.