The impact of health information technology on the quality of medical and health care : a systematic review

Objective: To systematically review the published evidence of the impact of health information technology (HIT) on the quality of medical and health care specifically clinicians’ adherence to evidence-based guidelines and the corresponding impact this had on patient clinical outcomes. In order to be as inclusive as possible the research examined literature discussing the use of health information technologies and systems in both medical care such as clinical and surgical, and other health care such as allied health and preventive services.----- Design: Systematic review----- Data Sources: Relevant literature was systematically searched on English language studies indexed in MEDLINE and CINAHL(1998 to 2008), Cochrane Library, PubMed, Database of Abstracts of Review of Effectiveness (DARE), Google scholar and other relevant electronic databases. A search for eligible studies (matching the inclusion criteria) was also performed by searching relevant conference proceedings available through internet and electronic databases, as well as using reference lists identified from cited papers.----- Selection criteria: Studies were included in the review if they examined the impact of Electronic Health Record (EHR), Computerised Provider Order-Entry (CPOE), or Decision Support System (DS); and if the primary outcomes of the studies were focused on the level of compliance with evidence-based guidelines among clinicians. Measures could be either changes in clinical processes resulting from a change of the providers’ behaviour or specific patient outcomes that demonstrated the effectiveness of a particular treatment given by providers. ----- Methods: Studies were reviewed and summarised in tabular and text form. Due to heterogeneity between studies, meta-analysis was not performed.----- Results: Out of 17 studies that assessed the impact of health information technology on health care practitioners’ performance, 14 studies revealed a positive improvement in relation to their compliance with evidence-based guidelines. The primary domain of improvement was evident from preventive care and drug ordering studies. Results from the studies that included an assessment for patient outcomes however, were insufficient to detect either clinically or statistically important improvements as only a small proportion of these studies found benefits. For instance, only 3 studies had shown positive improvement, while 5 studies revealed either no change or adverse outcomes.----- Conclusion: Although the number of included studies was relatively small for reaching a conclusive statement about the effectiveness of health information technologies and systems on clinical care, the results demonstrated consistency with other systematic reviews previously undertaken. Widescale use of HIT has been shown to increase clinician’s adherence to guidelines in this review. Therefore, it presents ongoing opportunities to maximise the uptake of research evidence into practice for health care organisations, policy makers and stakeholders.

Utility of routine data sources for feedback on the quality of cancer care: an assessment based on clinical practice guidelines

Background Not all cancer patients receive state-of-the-art care and providing regular feedback to clinicians might reduce this problem. The purpose of this study was to assess the utility of various data sources in providing feedback on the quality of cancer care. Methods Published clinical practice guidelines were used to obtain a list of processes-of-care of interest to clinicians. These were assigned to one of four data categories according to their availability and the marginal cost of using them for feedback. Results Only 8 (3%) of 243 processes-of-care could be measured using population-based registry or administrative inpatient data (lowest cost). A further 119 (49%) could be measured using a core clinical registry, which contains information on important prognostic factors (e.g., clinical stage, physiological reserve, hormone-receptor status). Another 88 (36%) required an expanded clinical registry or medical record review; mainly because they concerned long-term management of disease progression (recurrences and metastases) and 28 (11.5%) required patient interview or audio-taping of consultations because they involved information sharing between clinician and patient. Conclusion The advantages of population-based cancer registries and administrative inpatient data are wide coverage and low cost. The disadvantage is that they currently contain information on only a few processes-of-care. In most jurisdictions, clinical cancer registries, which can be used to report on many more processes-of-care, do not cover smaller hospitals. If we are to provide feedback about all patients, not just those in larger academic hospitals with the most developed data systems, then we need to develop sustainable population-based data systems that capture information on prognostic factors at the time of initial diagnosis and information on management of disease progression.

The Mobile Application Rating Scale (MARS): A new tool to measure the quality of health mobile applications

Smartphone technology provides free or inexpensive access to mental health and wellbeing resources. As a result the use of mobile applications for these purposes has increased significantly in recent years. Yet, there is currently no app quality assessment alternative to the popular ‘star’-ratings, which are often unreliable. This presentation describes the development of the Mobile Application Rating Scale (MARS) a new measure for classifying and rating the quality of mobile applications. A review of existing literature on app and web quality identified 25 published papers, conference proceedings, and online resources (published since 1999), which identified 372 explicit quality criteria. Qualitative analysis identified five broad categories of app quality rating criteria: engagement, functionality, aesthetics, information quality, and overall satisfaction, which were refined into the 23-item MARS. Independent ratings of 50 randomly selected mental health and wellbeing mobile apps indicated the MARS had excellent levels of internal consistency (α = 0.92) and inter-rater reliability (ICC = 0.85). The MARS provides practitioners and researchers with an easy-to-use, simple, objective and reliable tool for assessing mobile app quality. It also provides mHealth professionals with a checklist for the design and development of high quality apps.

The role of affect in consumer evaluation of health care services

Health care services are typically consumed out of necessity, typically to recover from illness. While the consumption of health care services can be emotional given that consumers experience fear, hope, relief, and joy, surprisingly, there is little research on the role of consumer affect in health care consumption. We propose that consumer affect is a heuristic cue that drives evaluation of health care services. Drawing from cognitive appraisal theory and affect-as-information theory, this article tests a research model (N = 492) that investigates consumer affect resulting from service performance on subsequent service outcomes.

Mobile app rating scale: A new tool for assessing the quality of health mobile apps

Background The use of mobile apps for health and well being promotion has grown exponentially in recent years. Yet, there is currently no app-quality assessment tool beyond “star”-ratings. Objective The objective of this study was to develop a reliable, multidimensional measure for trialling, classifying, and rating the quality of mobile health apps. Methods A literature search was conducted to identify articles containing explicit Web or app quality rating criteria published between January 2000 and January 2013. Existing criteria for the assessment of app quality were categorized by an expert panel to develop the new Mobile App Rating Scale (MARS) subscales, items, descriptors, and anchors. There were sixty well being apps that were randomly selected using an iTunes search for MARS rating. There were ten that were used to pilot the rating procedure, and the remaining 50 provided data on interrater reliability. Results There were 372 explicit criteria for assessing Web or app quality that were extracted from 25 published papers, conference proceedings, and Internet resources. There were five broad categories of criteria that were identified including four objective quality scales: engagement, functionality, aesthetics, and information quality; and one subjective quality scale; which were refined into the 23-item MARS. The MARS demonstrated excellent internal consistency (alpha = .90) and interrater reliability intraclass correlation coefficient (ICC = .79). Conclusions The MARS is a simple, objective, and reliable tool for classifying and assessing the quality of mobile health apps. It can also be used to provide a checklist for the design and development of new high quality health apps.

The Australian Palliative Care Outcomes Collaboration (PCOC) : measuring the quality and outcomes of palliative care on a routine basis

Australia is leading the way in establishing a national system (the Palliative Care Outcomes Collaboration – PCOC) to measure the outcomes and quality of specialist palliative care services and to benchmark services across the country. This article reports on analysis of data collected routinely at point-of-care on 5939 patients treated by the first fifty one services that voluntarily joined PCOC. By March 2009, 111 services have agreed to join PCOC, representing more than 70% of services and more than 80% of specialist palliative care patients nationally. All states and territories are involved in this unique process that has involved extensive consultation and infrastructure and close collaboration between health services and researchers. The challenges of dealing with wide variation in outcomes and practice and the progress achieved to date are described. PCOC is aiming to improve understanding of the reasons for variations in clinical outcomes between specialist palliative care patients and differences in service outcomes as a critical step in an ongoing process to improve both service quality and patient outcomes. What is known about the topic? Governments internationally are grappling with how best to provide care for people with life limiting illnesses and how best to measure the outcomes and quality of that care. There is little international evidence on how to measure the quality and outcomes of palliative care on a routine basis. What does this paper add? The Palliative Care Outcomes Collaboration (PCOC) is the first effort internationally to measure the outcomes and quality of specialist palliative care services and to benchmark services on a national basis through an independent third party. What are the implications for practitioners? If outcomes and quality are to be measured on a consistent national basis, standard clinical assessment tools that are used as part of everyday clinical practice are necessary.

A Survey-based Study of Knowledge of Alzheimer's Disease among Health Care Staff

Background Continued aging of the population is expected to be accompanied by substantial increases in the number of people with dementia and in the number of health care staff required to care for them. Adequate knowledge about dementia among health care staff is important to the quality of care delivered to this vulnerable population. The purpose of this study was to assess knowledge about dementia across a range of health care staff in a regional health service district. Methods Knowledge levels were investigated via the validated 30-item Alzheimer's Disease Knowledge Scale (ADKS). All health service district staff with e-mail access were invited to participate in an online survey. Knowledge levels were compared across demographic categories, professional groups, and by whether the respondent had any professional or personal experience caring for someone with dementia. The effect of dementia-specific training or education on knowledge level was also evaluated. Results A diverse staff group (N = 360), in terms of age, professional group (nursing, medicine, allied health, support staff) and work setting from a regional health service in Queensland, Australia responded. Overall knowledge about Alzheimer's disease was of a generally moderate level with significant differences being observed by professional group and whether the respondent had any professional or personal experience caring for someone with dementia. Knowledge was lower for some of the specific content domains of the ADKS, especially those that were more medically-oriented, such as 'risk factors' and 'course of the disease.' Knowledge was higher for those who had experienced dementia-specific training, such as attendance at a series of relevant workshops. Conclusions Specific deficits in dementia knowledge were identified among Australian health care staff, and the results suggest dementia-specific training might improve knowledge. As one piece of an overall plan to improve health care delivery to people with dementia, this research supports the role of introducing systematic dementia-specific education or training.

Nursing practice environment, quality of care and morale of hospital nurses in Japan

The purpose of this study was to describe Japanese hospital nurses’ perceptions of the nursing practice environment and examine its association with nurse-reported ability to provide quality nursing care, quality of patient care and ward morale. A cross-sectional survey design was used including 223 nurses working in 12 acute inpatient wards in a large Japanese teaching hospital. Nurses rated their work environment favorably overall using the Japanese version of the Practice Environment Scale of the Nursing Work Index. Subscale scores indicated high perceptions of physician relations and quality of nursing management, but lower scores for staffing and resources. Ward nurse managers generally rated the practice environment more positively than staff nurses except for staffing and resources. Regression analyses found the practice environment was a significant predictor of quality of patient care and ward morale, whereas perceived ability to provide quality nursing care was most strongly associated with years of clinical experience. These findings support interventions to improve the nursing practice environment, particularly staffing and resource adequacy, to enhance quality of care and ward morale in Japan.

The impact of nurse practitioner services on cost, quality of care, satisfaction and wait times in the emergency department: A systematic review

Aims To provide the best available evidence to determine the impact of nurse practitioner services on cost, quality of care, satisfaction and waiting times in the emergency department for adult patients. Background The delivery of quality care in the emergency department is one of the most important service indicators in health delivery. Increasing service pressures in the emergency department have resulted in the adoption of service innovation models: the most common and rapidly expanding of these is emergency nurse practitioner services. The rapid uptake of emergency nurse practitioner service in Australia has outpaced the capacity to evaluate this service model in terms of outcomes related to safety and quality of patient care. Previous research is now outdated and not commensurate with the changing domain of delivering emergency care with nurse practitioner services. Data A comprehensive search of four electronic databases from 2006-­‐2013 was conducted to identify research evaluating nurse practitioner service impact in the emergency department. English language articles were sought using MEDLINE, CINAHL, Embase and Cochrane and included two previous systematic reviews completed five and seven years ago. Methods A three step approach was used. Following a comprehensive search, two reviewers assessed identified studies against the inclusion criteria. From the original 1013 studies, 14 papers were retained for critical appraisal on methodological quality by two independent reviewers and data extracted using standardised tools. Results Narrative synthesis was conducted to summarise and report the findings as insufficient data was available for meta-­‐analysis of results. This systematic review has shown that emergency nurse practitioner service has a positive impact on quality of care, patient satisfaction and waiting times. There was insufficient evidence to draw conclusions regarding impact on costs. Conclusion Synthesis of the available research attempts to provide an evidence base for emergency nurse practitioner service to guide healthcare leaders, policy makers and clinicians in reforming emergency department service provision. The findings suggest that further quality research is required for comparative measures of clinical and service effectiveness of emergency nurse practitioner service. In the context of increased health service demand and the need to provide timely and effective care to patients, such measures will assist in delivering quality patient care.

Use of online health information to manage children’s health care: A prospective study investigating parental decisions

Background The use of the internet to access information is rapidly increasing; however, the quality of health information provided on various online sites is questionable. We aimed to examine the underlying factors that guide parents' decisions to use online information to manage their child's health care, a behaviour which has not yet been explored systematically. Methods Parents (N=391) completed a questionnaire assessing the standard theory of planned behaviour (TPB) measures of attitude, subjective norm, perceived behavioural control (PBC), and intention as well as the underlying TPB belief-based items (i.e., behavioural, normative, and control beliefs) in addition to a measure of perceived risk and demographic variables. Two months later, consenting parents completed a follow-up telephone questionnaire which assessed the decisions they had made regarding their use of online information to manage their child's health care during the previous 2 months. Results We found support for the TPB constructs of attitude, subjective norm, and PBC as well as the additional construct of perceived risk in predicting parents' intentions to use online information to manage their child's health care, with further support found for intentions, but not PBC, in predicting parents' behaviour. The results of the TPB belief-based analyses also revealed important information about the critical beliefs that guide parents' decisions to engage in this child health management behaviour. Conclusions This theory-based investigation to understand parents' motivations and online information-seeking behaviour is key to developing recommendations and policies to guide more appropriate help-seeking actions among parents.