The Mobile Application Rating Scale (MARS): A new tool to measure the quality of health mobile applications

Smartphone technology provides free or inexpensive access to mental health and wellbeing resources. As a result the use of mobile applications for these purposes has increased significantly in recent years. Yet, there is currently no app quality assessment alternative to the popular ‘star’-ratings, which are often unreliable. This presentation describes the development of the Mobile Application Rating Scale (MARS) a new measure for classifying and rating the quality of mobile applications. A review of existing literature on app and web quality identified 25 published papers, conference proceedings, and online resources (published since 1999), which identified 372 explicit quality criteria. Qualitative analysis identified five broad categories of app quality rating criteria: engagement, functionality, aesthetics, information quality, and overall satisfaction, which were refined into the 23-item MARS. Independent ratings of 50 randomly selected mental health and wellbeing mobile apps indicated the MARS had excellent levels of internal consistency (α = 0.92) and inter-rater reliability (ICC = 0.85). The MARS provides practitioners and researchers with an easy-to-use, simple, objective and reliable tool for assessing mobile app quality. It also provides mHealth professionals with a checklist for the design and development of high quality apps.

Mobile app rating scale: A new tool for assessing the quality of health mobile apps

Background The use of mobile apps for health and well being promotion has grown exponentially in recent years. Yet, there is currently no app-quality assessment tool beyond “star”-ratings. Objective The objective of this study was to develop a reliable, multidimensional measure for trialling, classifying, and rating the quality of mobile health apps. Methods A literature search was conducted to identify articles containing explicit Web or app quality rating criteria published between January 2000 and January 2013. Existing criteria for the assessment of app quality were categorized by an expert panel to develop the new Mobile App Rating Scale (MARS) subscales, items, descriptors, and anchors. There were sixty well being apps that were randomly selected using an iTunes search for MARS rating. There were ten that were used to pilot the rating procedure, and the remaining 50 provided data on interrater reliability. Results There were 372 explicit criteria for assessing Web or app quality that were extracted from 25 published papers, conference proceedings, and Internet resources. There were five broad categories of criteria that were identified including four objective quality scales: engagement, functionality, aesthetics, and information quality; and one subjective quality scale; which were refined into the 23-item MARS. The MARS demonstrated excellent internal consistency (alpha = .90) and interrater reliability intraclass correlation coefficient (ICC = .79). Conclusions The MARS is a simple, objective, and reliable tool for classifying and assessing the quality of mobile health apps. It can also be used to provide a checklist for the design and development of new high quality health apps.

Perceived quality of health care in macular disease:A survey of members of the Macular Disease Society

Aim: To investigate the experiences of people with macular disease within the British healthcare system. Method: The Macular Disease Society Questionnaire, a self completion questionnaire designed to survey the experiences of people with macular disease, was sent to 2000 randomly selected members of the Macular Disease Society. The questionnaire incorporated items about people's experiences with health professionals and the information and support provided by them at the time of diagnosis and thereafter. Results: Over 50% thought their consultant eye specialist was not interested in them as a person and 40% were dissatisfied with their diagnostic consultation. 185 people thought their general practitioner (GP) was well informed about macular disease but twice as many people thought their GP was not well informed. About an equal number of people thought their GP was supportive as those who thought their GP was not supportive. A total of 1247 people were told "nothing can be done to help with your macular disease." A number of negative emotional reactions were experienced by those people as a result, with 61% of them reporting feeling anxious or depressed. Of 282 people experiencing visual hallucinations after diagnosis with macular disease, only 20.9% were offered explanations for them. Concluslons: Many people with macular disease have unsatisfactory experiences of the healthcare system. Many of the reasons for dissatisfaction could be resolved by healthcare professionals if they were better informed about macular disease and had a better understanding of and empathy with patients' experiences.

Does self-efficacy mediate the cross-sectional relationship between perceived quality of health care and self-management of diabetes? Results from Diabetes MILES - Australia

OBJECTIVE: Quality of health care (QoC) and self-efficacy may affect self-management of diabetes, but such effects are not well understood. We examined the indirect role of diabetes-specific self-efficacy (DSE) and generalised self-efficacy (GSE) in mediating the cross-sectional relationship between self-reported QoC and diabetes self-management.

DESIGN: Diabetes MILES-Australia was a national survey of 3,338 adults with diabetes. We analysed data from 1,624 respondents (Age: M=52.1, SD=13.9) with type 1 (T1D; n=680) or type 2 diabetes (T2D; n=944), who responded to a version of the survey containing key measures.

MAIN OUTCOME MEASURES: Self-reported healthy eating, physical activity, self-monitoring of blood glucose frequency, HbA1c, medication/insulin adherence. RESULTS: We used Preacher and Hayes' bootstrapping method, controlling for age, gender and diabetes duration, to test mediation of DSE and GSE on the relationship of QoC with each self-management variable. We found statistically significant but trivial mediation effects of DSE and of GSE on most, but not all, variables (all effect sizes <0.06).

CONCLUSION: Support for mediation was weak, suggesting that relationships amongst these variables are small and that future research might explore other aspects of self-management in diabetes.

The impact of health information technology on the quality of medical and health care : a systematic review

Objective: To systematically review the published evidence of the impact of health information technology (HIT) on the quality of medical and health care specifically clinicians’ adherence to evidence-based guidelines and the corresponding impact this had on patient clinical outcomes. In order to be as inclusive as possible the research examined literature discussing the use of health information technologies and systems in both medical care such as clinical and surgical, and other health care such as allied health and preventive services.----- Design: Systematic review----- Data Sources: Relevant literature was systematically searched on English language studies indexed in MEDLINE and CINAHL(1998 to 2008), Cochrane Library, PubMed, Database of Abstracts of Review of Effectiveness (DARE), Google scholar and other relevant electronic databases. A search for eligible studies (matching the inclusion criteria) was also performed by searching relevant conference proceedings available through internet and electronic databases, as well as using reference lists identified from cited papers.----- Selection criteria: Studies were included in the review if they examined the impact of Electronic Health Record (EHR), Computerised Provider Order-Entry (CPOE), or Decision Support System (DS); and if the primary outcomes of the studies were focused on the level of compliance with evidence-based guidelines among clinicians. Measures could be either changes in clinical processes resulting from a change of the providers’ behaviour or specific patient outcomes that demonstrated the effectiveness of a particular treatment given by providers. ----- Methods: Studies were reviewed and summarised in tabular and text form. Due to heterogeneity between studies, meta-analysis was not performed.----- Results: Out of 17 studies that assessed the impact of health information technology on health care practitioners’ performance, 14 studies revealed a positive improvement in relation to their compliance with evidence-based guidelines. The primary domain of improvement was evident from preventive care and drug ordering studies. Results from the studies that included an assessment for patient outcomes however, were insufficient to detect either clinically or statistically important improvements as only a small proportion of these studies found benefits. For instance, only 3 studies had shown positive improvement, while 5 studies revealed either no change or adverse outcomes.----- Conclusion: Although the number of included studies was relatively small for reaching a conclusive statement about the effectiveness of health information technologies and systems on clinical care, the results demonstrated consistency with other systematic reviews previously undertaken. Widescale use of HIT has been shown to increase clinician’s adherence to guidelines in this review. Therefore, it presents ongoing opportunities to maximise the uptake of research evidence into practice for health care organisations, policy makers and stakeholders.

Is quality of life measurement likely to be a proxy for health needs assessment in patients with coronary artery disease?

BACKGROUND: The identification of patients' health needs is pivotal in optimising the quality of health care, increasing patient satisfaction and directing resource allocation. Health needs are complex and not so easily evaluated as health-related quality of life (HRQL), which is becoming increasingly accepted as a means of providing a more global, patient-orientated assessment of the outcome of health care interventions than the simple medical model. The potential of HRQL as a surrogate measure of healthcare needs has not been evaluated. OBJECTIVES AND METHOD: A generic (Short Form-12; SF-12) and a disease-specific questionnaire (Seattle Angina Questionnaire; SAQ) were tested for their potential to predict health needs in patients with acute coronary disease. A wide range of healthcare needs were determined using a questionnaire specifically developed for this purpose. RESULTS: With the exception of information needs, healthcare needs were highly correlated with health-related quality of life. Patients with limited enjoyment of personal interests, weak financial situation, greater dependency on others to access health services, and dissatisfaction with accommodation reported poorer HRQL (SF-12: p < 0.001; SAQ: p < 0.01). Difficulties with mobility, aids to daily living and activities requiring assistance from someone else were strongly associated with both generic and disease-specific questionnaires (SF-12: r = 0.46-0.55, p < 0.01; SAQ: r = 0.53-0.65, p < 0.001). Variables relating to quality of care and health services were more highly correlated with SAQ components (r = 0.33-0.59) than with SF-12 (r = 0.07-0.33). Overall, the disease-specific Seattle Angina Questionnaire was superior to the generic Short Form-12 in detecting healthcare needs in patients with coronary disease. Receiver-operator curves supported the sensitivity of HRQL tools in detecting health needs. CONCLUSION: Healthcare needs are complex and developing suitable questionnaires to measure these is difficult and time-consuming. Without a satisfactory means of measuring these needs, the extent to which disease impacts on health will continue to be underestimated. Further investigation on larger populations is warranted but HRQL tools appear to be a reasonable proxy for healthcare needs, as they identify the majority of needs in patients with coronary disease, an observation not previously reported in this patient group

Do health care providers use online patient ratings to improve the quality of care?

Background: Physician-rating websites have become a popular tool to create more transparency about the quality of health care providers. So far, it remains unknown whether online-based rating websites have the potential to contribute to a better standard of care. Objective: Our goal was to examine which health care providers use online rating websites and for what purposes, and whether health care providers use online patient ratings to improve patient care. Methods: We conducted an online-based cross-sectional study by surveying 2360 physicians and other health care providers (September 2015). In addition to descriptive statistics, we performed multilevel logistic regression models to ascertain the effects of providers' demographics as well as report card-related variables on the likelihood that providers implement measures to improve patient care. Results: Overall, more than half of the responding providers surveyed (54.66%, 1290/2360) used online ratings to derive measures to improve patient care (implemented measures: mean 3.06, SD 2.29). Ophthalmologists (68%, 40/59) and gynecologists (65.4%, 123/188) were most likely to implement any measures. The most widely implemented quality measures were related to communication with patients (28.77%, 679/2360), the appointment scheduling process (23.60%, 557/2360), and office workflow (21.23%, 501/2360). Scaled-survey results had a greater impact on deriving measures than narrative comments. Multilevel logistic regression models revealed medical specialty, the frequency of report card use, and the appraisal of the trustworthiness of scaled-survey ratings to be significantly associated predictors for implementing measures to improve patient care because of online ratings. Conclusions: Our results suggest that online ratings displayed on physician-rating websites have an impact on patient care. Despite the limitations of our study and unintended consequences of physician-rating websites, they still may have the potential to improve patient care.

Families of the traumatically brian-injured : a case study approach to perceptions of quality of service, degree of satisfaction, and family needs /

The purpose of this qualitative research study was to foster an understanding of the rehabilitation counselling practice offamilies of the brain-injured. Specifically, the study explores the perceptions of stakeholders in regards to the degree of satisfaction with the quality of service received. Questionnaires were administered, and semi-structured, openended interviews were conducted, with six participating families (n=8). Preliminary data were collected via two instruments: (i) the Family Participant Questionnaire, consisting of participants' sample characteristics, information pertaining to the history of the family, details of the injury, and information relating to the type, use, and need offamily services utilized; and (ii) the Community Integration Questionnaire, a measurement of the degree of social displacementllevel of community integration of the injured family member. Utilizing the procedural steps outlined by Colaizzi's (1978) method of protocol analysis, recommendations for a future program based on related and current family needs are discussed in detail. Substantiating and supporting information are offered to rehabilitation practitioners, educational planners, and policymakers alike, concerning the degree of satisfaction with rehabilitative service, and the means of improving upon the overall quality of health care to families of the brain-injured. Implications for clinical practice and research are also raised for discussion.

The influence of primary care clinic characteristics on the quality of care for depression in patients with different comorbidity profiles

Dans les services de première ligne, la majorité des personnes atteintes de dépression souffrent également d’autres maladies chroniques comorbides. Offrir des soins de haute qualité à ces patients représente un défi important pour les intervenants en première ligne ainsi que pour le système de santé. Il y a des raisons de croire que les contextes organisationnels dans lesquels les intervenants pratiquent ont une influence importante sur les soins. Cependant, peu d’études ont examiné directement la façon dont les caractéristiques des cliniques facilitent ou entravent les soins offerts aux patients atteints de dépression et de différents types de maladies chroniques comorbides. L’objectif général de ce projet de recherche était donc de mieux comprendre comment différentes caractéristiques des cliniques de première ligne influencent la qualité des soins pour la dépression chez des patients ayant différents profils de comorbidité. La thèse comporte deux études. Tout d'abord, nous avons effectué une revue systématique examinant les relations entre la comorbidité physique chronique et la qualité des soins pour la dépression dans les services de première ligne afin de clarifier la nature de ces relations et d’identifier les facteurs qui pourraient influer sur ces relations. Ensuite, nous avons effectué une étude aux méthodes mixtes ayant deux volets : (a) un volet quantitatif examinant les relations entre la qualité des soins pour la dépression, les profils de comorbidité des patients, et les caractéristiques des cliniques de première ligne par le biais d’analyses de régression multiniveaux de données issues de deux enquêtes, et (b) un volet qualitatif basé sur une étude de cas explorant les perceptions des professionnels des services de première ligne sur les facteurs organisationnels pouvant influencer la qualité des soins offerts aux patients souffrant de dépression et d’autres maladies chroniques comorbides. Les résultats de ces études ont montré que, bien que la qualité des soins de la dépression en soins primaires soit sous-optimale, certains sous-groupes de patients dépressifs sont plus à risque que d’autres de recevoir des soins pour la dépression inadéquats, notamment des patients ayant uniquement des comorbidités chroniques physiques. Cependant, plusieurs caractéristiques des cliniques de première ligne semblent faciliter l’offre de soins de qualité aux patients atteints de dépression et de maladies chroniques comorbides : les normes et les valeurs liées au travail d'équipe et le soutien mutuel, l'accès au soutien des professionnels ayant une expertise en santé mentale, l’utilisation des algorithmes de traitement et d’autres outils d’aide à la décision pour la dépression, et l’absence d’obstacles liés aux modèles de rémunération inadéquats. Une des façons dont ces caractéristiques favorisent la qualité est en facilitant la circulation des connaissances dans les cliniques de première ligne. Nos résultats suggèrent que des interventions organisationnelles ciblées sont nécessaires pour améliorer la qualité des soins pour la dépression que reçoivent les patients ayant des maladies chroniques comorbides. Ces interventions peuvent viser différents domaines organisationnels (ex : caractéristiques structurelles/stratégiques, sociales, technologies et épistémiques) mais doivent aussi prendre en compte comment les éléments de chaque domaine interagissent et comment ils pourraient influencer les soins pour des patients ayant des profils de comorbidité différents.

The effectiveness of health interventions in cardiovascular risk reduction among emergency service personnel

Purpose
The physical demands and hazards associated with emergency service work place particular stress on responders’ cardiovascular systems. Indeed, cardiovascular disease (CVD) is a significant problem for emergency service personnel. Although it may be difficult to alter the cardiovascular health hazards associated with the work environment, it is possible for personnel to control their modifiable CVD risk factors, cardiovascular fitness levels and subsequently, reduce their CVD risk. This review aimed to determine the effectiveness and methodological quality of health interventions designed to mitigate CVD risk in emergency service personnel.

Methods
A literature search of electronic journal databases was performed. Sixteen relevant studies were assessed for methodological quality using a standardised assessment tool. Data regarding the effectiveness of each intervention were extracted and synthesised in a narrative format.

Results
Fifteen studies were rated ‘Weak’ and one study was rated ‘Strong’. Interventions which combined behavioural counselling, exercise and nutrition were more effective in improving cardiovascular health than nutrition, exercise or CVD risk factor assessment-based interventions alone. Further, CVD risk factor assessment in isolation proved to be an ineffective intervention type to reduce CVD risk.

Conclusion
Combined interventions appear most effective in improving the cardiovascular health of emergency service personnel. Accordingly, fire and emergency service agencies should consider trialling multifaceted interventions to improve the cardiovascular health of personnel and avoid interventions focused only on one of nutrition, exercise or CVD risk factor assessment. However, as most studies were methodologically weak, further studies of a higher methodological quality are needed.

Quality of weight loss advice on internet forums.

BACKGROUND: Adults use the Internet for weight loss information, sometimes by participating in discussion forums. Our purpose was to analyze the quality of advice exchanged on these forums. METHODS: This was a retrospective analysis of messages posted to 18 Internet weight loss forums during 1 month in 2006. Advice was evaluated for congruence with clinical guidelines; potential for causing harm; and subsequent correction when it was contradictory to guidelines (erroneous) or potentially harmful. Message- and forum-specific characteristics were evaluated as predictors of advice quality and self-correction. RESULTS: Of 3368 initial messages, 266 (7.9%) were requests for advice. Of 654 provisions of advice, 56 (8.6%) were erroneous and 19 of these 56 (34%) were subsequently corrected. Forty-three (6.6%) provisions of advice were harmful, and 12 of these 43 (28%) were subsequently corrected. Messages from low-activity forums (fewer messages) were more likely than those from high-activity forums to be erroneous (10.6% vs 2.4%, P < .001) or harmful (8.4% vs 1.2%, P < .001). In high-activity forums, 2 of 4 (50%) erroneous provisions of advice and 2 of 2 (100%) potentially harmful provisions of advice were corrected by subsequent postings. Compared with general weight loss advice, medication-related advice was more likely to be erroneous (P = .02) or harmful (P = .01). CONCLUSIONS: Most advice posted on highly active Internet weight loss forums is not erroneous or harmful. However, clinical and research strategies are needed to address the quality of medication-related advice.

Quality of weight loss advice on internet forums.

BACKGROUND: Adults use the Internet for weight loss information, sometimes by participating in discussion forums. Our purpose was to analyze the quality of advice exchanged on these forums. METHODS: This was a retrospective analysis of messages posted to 18 Internet weight loss forums during 1 month in 2006. Advice was evaluated for congruence with clinical guidelines; potential for causing harm; and subsequent correction when it was contradictory to guidelines (erroneous) or potentially harmful. Message- and forum-specific characteristics were evaluated as predictors of advice quality and self-correction. RESULTS: Of 3368 initial messages, 266 (7.9%) were requests for advice. Of 654 provisions of advice, 56 (8.6%) were erroneous and 19 of these 56 (34%) were subsequently corrected. Forty-three (6.6%) provisions of advice were harmful, and 12 of these 43 (28%) were subsequently corrected. Messages from low-activity forums (fewer messages) were more likely than those from high-activity forums to be erroneous (10.6% vs 2.4%, P < .001) or harmful (8.4% vs 1.2%, P < .001). In high-activity forums, 2 of 4 (50%) erroneous provisions of advice and 2 of 2 (100%) potentially harmful provisions of advice were corrected by subsequent postings. Compared with general weight loss advice, medication-related advice was more likely to be erroneous (P = .02) or harmful (P = .01). CONCLUSIONS: Most advice posted on highly active Internet weight loss forums is not erroneous or harmful. However, clinical and research strategies are needed to address the quality of medication-related advice.