Mobile app rating scale: A new tool for assessing the quality of health mobile apps

Background The use of mobile apps for health and well being promotion has grown exponentially in recent years. Yet, there is currently no app-quality assessment tool beyond “star”-ratings. Objective The objective of this study was to develop a reliable, multidimensional measure for trialling, classifying, and rating the quality of mobile health apps. Methods A literature search was conducted to identify articles containing explicit Web or app quality rating criteria published between January 2000 and January 2013. Existing criteria for the assessment of app quality were categorized by an expert panel to develop the new Mobile App Rating Scale (MARS) subscales, items, descriptors, and anchors. There were sixty well being apps that were randomly selected using an iTunes search for MARS rating. There were ten that were used to pilot the rating procedure, and the remaining 50 provided data on interrater reliability. Results There were 372 explicit criteria for assessing Web or app quality that were extracted from 25 published papers, conference proceedings, and Internet resources. There were five broad categories of criteria that were identified including four objective quality scales: engagement, functionality, aesthetics, and information quality; and one subjective quality scale; which were refined into the 23-item MARS. The MARS demonstrated excellent internal consistency (alpha = .90) and interrater reliability intraclass correlation coefficient (ICC = .79). Conclusions The MARS is a simple, objective, and reliable tool for classifying and assessing the quality of mobile health apps. It can also be used to provide a checklist for the design and development of new high quality health apps.

Adaptação transcultural para o português de instrumentos de avaliação do estado nutricional em pacientes idosos em tratamento crônico de hemodiálise

O contingente de idosos iniciando tratamento de diálise vem aumentado de maneira importante desde o ano de 2000, conforme mostrado pelo United States Renal Data System. Dados nacionais demonstram que cerca de 31,5% dos pacientes em diálise tem idade acima de 65 anos, segundo o Censo Brasileiro de Diálise de 2011. Estes dados alertam para a importância no cuidado da saúde do idoso em diálise. O cuidado nutricional desse grupo merece especial atenção, uma vez que já foi demonstrado que a prevalência de desnutrição energético-proteica nos pacientes idosos em diálise é significantemente maior do que a de adultos jovens em diálise. Nesse sentido, faz-se importante desenvolver estudos com instrumentos que avaliem o estado nutricional desse grupo. Os questionários de avaliação subjetiva global de 7 pontos (ASG-7p) e o malnutrition inflammation score (MIS) têm sido bastante empregados em estudos incluindo pacientes em diálise. Contudo, estes instrumentos estão originalmente na língua Inglesa, e para o seu uso em nosso meio, é necessário a tradução por meio da adaptação transcultural. Porém, até o momento, não há estudos que tenham realizado a tradução transcultural desses questionários para a língua Portuguesa. Deste modo, o objetivo deste estudo foi realizar a adaptação transcultural para o português de dois instrumentos de avaliação do estado nutricional em pacientes idosos em tratamento crônico de hemodiálise (HD). O estudo é do tipo observacional e seccional. A adaptação transcultural consistiu na tradução para a língua Portuguesa da ASG-7p e MIS pelo método da retrotradução, avaliação da equivalência semântica, confiabilidade e validade de construto. Para tanto, 101 pacientes idosos em HD foram avaliados. Ambos questionários apresentaram alto grau de similaridade semântica. A consistência interna apresentou um valor de α de Cronbach para a ASG-7p de 0,72 (satisfatório) e para o MIS de 0,53 (não satisfatório). A ASG-7p apresentou discreta reprodutibilidade intra-avaliador e moderada reprodutibilidade interavaliador; e para o MIS tanto a reprodutibilidade inter quanto intra-avaliador foi indicativo de forte reprodutibilidade. Referente à validade de construto, ao avaliar o estado nutricional pela ASG-7p notou-se que os pacientes classificados como bem nutridos apresentaram medidas de peso corporal, adequação da dobra cutânea tricipital, percentual de gordura corporal, circunferência da panturrilha e creatinina sérica significantemente maiores do que de pacientes desnutridos. Para o MIS, ao comparar os grupo de bem nutridos com o de desnutridos, a albumina sérica, ângulo de fase, percentual de gordura corporal, a adequação da força de preensão manual e da dobra cutânea tricipital e a circunferência da panturrilha apresentaram diferença significante entre os grupos. Em conclusão, os questionários ASG-7p e MIS traduzidos para o português podem ser utilizados na população de idosos em HD.

应用多质—多评价者程序对评定误差的分析

Two kinds of rating bias ——halo effect and ego-centric effect were analyzed in multitrait-multirater matrix by this research. To get the multitrait-multirater matrix, ten college students watched the video-tapes of football matches and rated the performance of the players on several traits. After the interviewing of 41 football fans, the performance traits of four different positions in a football team were obtained using critical incident technique. The results indicate: comparing the heterotrait-monorater triangless, some rater's rating showed halo effect obviously; comparing the monotrait-heterorater diagonals, ego-centric effect can be shown in some extent on different traits. There were less interrater reliability on the rating of some ambiguous traits. The conclusion can be used on rater training. We can give the raters feedback about their rating bias by analyzing the multitrait-multirater matrix. The results are also helpful for rater training.

Judging pain in newborns:facial and cry determinants

Explored the facial and cry characteristics that adults use when judging an infant's pain. Sixteen women viewed videotaped reactions of 36 newborns subjected to noninvasive thigh rubs and vitamin K injections in the course of routine care and rated discomfort. The group mean interrater reliability was high. Detailed descriptions of the infants' facial reactions and cry sounds permitted specification of the determinants of distress judgments. Several facial variables (a brow bulge, eyes squeezed shut, and deepened nasolabial fold constellation, and taut tongue) accounted for 49% of the variance in ratings of affective discomfort after controlling for ratings of discomfort during a noninvasive event. In a separate analysis not including facial activity, several cry variables (formant frequency, latency to cry) also accounted for variance (38%) in ratings. When the facial and cry variables were considered together, cry variables added little to the prediction of ratings in comparison to facial variables. Cry would seem to command attention, but facial activity, rather than cry, can account for the major variations in adults' judgments of neonatal pain.

Problem solving and computer-assisted instruction in science education : analysis of research findings and the research process /

The quantitative component of this study examined the effect of computerassisted instruction (CAI) on science problem-solving performance, as well as the significance of logical reasoning ability to this relationship. I had the dual role of researcher and teacher, as I conducted the study with 84 grade seven students to whom I simultaneously taught science on a rotary-basis. A two-treatment research design using this sample of convenience allowed for a comparison between the problem-solving performance of a CAI treatment group (n = 46) versus a laboratory-based control group (n = 38). Science problem-solving performance was measured by a pretest and posttest that I developed for this study. The validity of these tests was addressed through critical discussions with faculty members, colleagues, as well as through feedback gained in a pilot study. High reliability was revealed between the pretest and the posttest; in this way, students who tended to score high on the pretest also tended to score high on the posttest. Interrater reliability was found to be high for 30 randomly-selected test responses which were scored independently by two raters (i.e., myself and my faculty advisor). Results indicated that the form of computer-assisted instruction (CAI) used in this study did not significantly improve students' problem-solving performance. Logical reasoning ability was measured by an abbreviated version of the Group Assessment of Lx)gical Thinking (GALT). Logical reasoning ability was found to be correlated to problem-solving performance in that, students with high logical reasoning ability tended to do better on the problem-solving tests and vice versa. However, no significant difference was observed in problem-solving improvement, in the laboratory-based instruction group versus the CAI group, for students varying in level of logical reasoning ability.Insignificant trends were noted in results obtained from students of high logical reasoning ability, but require further study. It was acknowledged that conclusions drawn from the quantitative component of this study were limited, as further modifications of the tests were recommended, as well as the use of a larger sample size. The purpose of the qualitative component of the study was to provide a detailed description ofmy thesis research process as a Brock University Master of Education student. My research journal notes served as the data base for open coding analysis. This analysis revealed six main themes which best described my research experience: research interests, practical considerations, research design, research analysis, development of the problem-solving tests, and scoring scheme development. These important areas ofmy thesis research experience were recounted in the form of a personal narrative. It was noted that the research process was a form of problem solving in itself, as I made use of several problem-solving strategies to achieve desired thesis outcomes.

Confiabilidade interobservador da escala do equilíbrio de Berg entre fisioterapeutas com extensa e escassa prática clínica

This study aimed at assessing the interobserver reliability of the Brazilian-Portuguese version of the Berg Balance Scale (BBS). The assessment was made by physiotherapists with extensive or little clinical experience in non-institutionalized elderly individuals. Participants comprised 12 elderly subjects (10 women and 2 men) with mean ages of 75.8 ± 8.4 years (range = 63-87) and 18 physiotherapists with varying clinical experience. Inter-examiner reliability obtained for each scale item yielded weighted kappa value > 0.75 in 11 of the 14 items (varying from 0.37 to 1.0). The intra-class correlation coefficient (ICC) for the total sum of BBS scores between the two groups of physiotherapists was 0.996 (95% confidence interval, 0.987 0.999) with a Cronbach alpha coefficient of 0.996. We found no difference between the rater groups when we compared the sum score means obtained with the student s T-test (p = 0.86). Although some items had low reliability values, in general our results suggest that the Brazilian Version of the BBS showed good levels of interrater reliability and agreement when used by physiotherapists with different clinical practice levels and without previous training on non-institutionalized elderly patients. We concluded that the BBS can be useful as an important evaluation instrument on a protocol for Rehabilitation clinics. It may be used by various health professionals, as: Physicians, Physical therapists, Physical educators, Occupational therapists, Nurses and Phonoaudiologists, so confirming the interdisciplinary character of this study

Comorbidity of obsessive-compulsive disorder and personality disorders. A Brazilian controlled study

The aim of this study was to evaluate the presence of personality disorders (PDs) in 40 patients with obsessive-compulsive disorder (DSM-III-R criteria) from the Medical School of Botucatu (UNESP), Sao Paulo, Brazil. It is a case-control study. Patients were 24 women and 16 men, 16-68 years old, referred to our outpatient psychiatric service for treatment. Controls were 40 nonpsychiatric outpatients matched to the cases by sex, age and marital status. The instrument used was the Portuguese version of the Structured Interview for DSM-III-R Personality Disorders (SIDP-R). All interviews (n = 80) were made simultaneously by 2 raters, with independent scoring, so that the interrater reliability of the instrument could also be assessed (kappa statistics). The consensual axis II diagnoses in the OCD group were: avoidant (52.5%, κ = 0.80), dependent (40%, κ = 0.84), histrionic (20%, κ = 0.83), paranoid (20%, κ = 0.74), obsessive-compulsive (17.5%, κ = 0.86), narcissistic (7.5%, κ = 1.00), schizotypal (5%, κ = 0.65), passive-aggressive (5%, κ = 0.79) and self-defeating (5%, κ 0.55). At least one PD diagnosis was made in 70% of the patients, while only 6 controls had a PD diagnosis (p < 0.01). A great deal of diagnostic overlap was found in the OCD group (57.5% had two or more PDs), especially between avoidant and dependent PDs. The features of these two PDs may be secondary to the OCD. The study also suggests that there is not a close relationship between OCD and obsessive-compulsive personality disorder (OCPD). Patients with OCPD or even 3 or 4 O-C traits had significantly less insight into their obsessions and compulsions (p < 0.01).

Validation of the brazilian version of the apathy inventory

Background Apathy is a frequent neuropsychiatric condition in neurodegenerative disorders, depression, and often in mild cognitive impairment. The Apathy Inventory (AI) is a reliable instrument for improving the accuracy of the apathy diagnosis. The aim was to establish the validity of the Apathy Inventory for the Brazilian community. Methods We established the concurrent validity, internal consistency, inter-rater reliability, and the sensitivity and specificity of AI for the Brazilian community in a cohort of 175 individuals with Alzheimer's disease, Parkinson's disease, depression, mild cognitive impairment, and healthy controls. The three dimensions of the AI (emotional blunting, lack of initiative, and lack of interest) were compared with the Apathy domain of the Neuropsychiatric Inventory-Clinician rating scale (NPI-C) in an independent scheme. Results The analyses demonstrated high correlation coefficients in AI's individual dimensions and in AI-total score (F = 0.965). Concerning the NPI-C/Apathy domain, intra-class correlation coefficients were also high (F = 0.977). Concurrent validity was high according to both raters on AI dimensions × NPI-C/Apathy domain and regarding total score (rater 1: rho = 0.956 vs. rater 2: rho = 0.970). The internal consistency of the AI was also high concerning the AI's individual dimensions and total score (rater 1: 0.945 vs. rater 2: 0.958). Conclusion We observed high internal consistency, high concurrent validity, and inter-rater reliability of the Apathy Inventory. In addition, we found that its sensitivity and specificity were high. We suggest that the Brazilian version of the Apathy Inventory would be an appropriate instrument to identify the apathy syndrome in Brazilian patients. © 2012 John Wiley & Sons, Ltd.

Avaliação da concordância na aplicação da Escala de Braden interobservadores

OBJETIVOS: Verificar a prevalência de úlcera por pressão nas unidades de internação de pacientes adultos do Hospital Universitário da Universidade de São Paulo (HU-USP) e verificar a concordância entre observadores na avaliação de risco, por meio da Escala de Braden. MÉTODOS: Estudo exploratório, quantitativo. Os dados foram coletados por seis colaboradoras treinadas que realizaram exame físico e avaliação de risco em 87 pacientes, avaliação esta considerada "padrão ouro". Os dados das avaliações feitas pelas enfermeiras, nos mesmos pacientes, foram coletados dos prontuários. RESULTADOS: verificou-se prevalência de 19,5% no hospital e 63,6% na Unidade de Terapia Intensiva, 15,6% na Clínica Cirúrgica, 13,9% na Clínica Médica e 0% na Semi-Intensiva. Quanto à concordância entre os observadores na avaliação clínica dos pacientes, a percepção sensorial, atividade, mobilidade e fricção/cisalhamento apresentaram fortíssima concordância. Umidade e nutrição, baixa concordância, sugerindo que esses subescores deverão ser discutidos para verificar as causas da controvérsia. CONCLUSÃO: Estudos de prevalência de úlcera por pressão possibilitam verificar a extensão do problema e fornecem subsídios para construção de estratégias e programas de prevenção.

The Bern psychopathology scale for the assessment of system-specific psychotic symptoms

The translation from psychiatric core symptoms to brain functions and vice versa is a largely unresolved issue. In particular, the search for disorders of single brain regions explaining classical symptoms has not yielded the expected results. Based on the assumption that the psychopathology of psychosis is related to a functional imbalance of higher-order brain systems, the authors focused on three specific candidate brain circuitries, namely the language, and limbic and motor systems. These domains are of particular interest for understanding the disastrous communication breakdown during psychotic disorders. Core symptoms of psychosis were mapped on these domains by shaping their definitions in order to match the related brain functions. The resulting psychopathological assessment scale was tested for interrater reliability and internal consistency in a group of 168 psychotic patients. The items of the scale were reliable and a principal component analysis (PCA) was best explained by a solution resembling the three candidate systems. Based on the results, the scale was optimized as an instrument to identify patient subgroups characterized by a prevailing dysfunction of one or more of these systems. In conclusion, the scale is apt to distinguish symptom domains related to the activity of defined brain systems. PCA showed a certain degree of independence of the system-specific symptom clusters within the patient group, indicating relative subgroups of psychosis. The scale is understood as a research instrument to investigate psychoses based on a system-oriented approach. Possible immediate advantages in the clinical application of the understanding of psychoses related to system-specific symptom domains are also discussed.

Comparison of inversion recovery and contrast-enhanced T1-weighted fat-suppressed sequences for the staging of cervical lymphoma

In a retrospective analysis with two readers blinded to the clinical information, coronal short tau inversion recovery (STIR) images were compared to contrast-enhanced fat-saturated T1-weighted imaging (T1 CEfs) in 51 cases of cervical lymphoma. Interrater reliability was good to excellent. Although sensitivity and subjective quality of the STIR sequence were higher than those of the T1 CEfs sequence (sensitivity 85%/72%, respectively), specificity (82%/95%) as well as positive likelihood ratio (4.65/15.93) was much lower. Therefore, contrast-enhanced sequences should be included in the primary staging of lymphoma.

The Validation of a New Visual Anaemia Evaluation Tool HemoHue HH1 in Patients with End-Stage Renal Disease

In chronic haemodialysis patients, anaemia is a frequent finding associated with high therapeutic costs and further expenses resulting from serial laboratory measurements. HemoHue HH1, HemoHue Ltd, is a novel tool consisting of a visual scale for the noninvasive assessment of anaemia by matching the coloration of the conjunctiva with a calibrated hue scale. The aim of the study was to investigate the usefulness of HemoHue in estimating individual haemoglobin concentrations and binary treatment outcomes in haemodialysis patients. A prospective blinded study with 80 hemodialysis patients comparing the visual haemoglobin assessment with the standard laboratory measurement was performed. Each patient's haemoglobin concentration was estimated by seven different medical and nonmedical observers with variable degrees of clinical experience on two different occasions. The estimated population mean was close to the measured one (11.06 ± 1.67 versus 11.32 ± 1.23 g/dL, P < 0.0005). A learning effect could be detected. Relative errors in individual estimates reached, however, up to 50%. Insufficient performance in predicting binary outcomes (ROC AUC: 0.72 to 0.78) and poor interrater reliability (Kappa < 0.6) further characterised this method.

Impacted maxillary canines and root resorptions of neighbouring teeth: a radiographic analysis using cone-beam computed tomography

The study analyses the location of impacted maxillary canines and factors influencing root resorptions of adjacent teeth using cone-beam computed tomography (CBCT). In addition, the interrater reliability between observers of two different dental specialties for radiographic parameters will be evaluated. CBCT images of patients who were referred for radiographic localization of impacted maxillary canines and/or suspicion of root resorptions of adjacent teeth were included. The study analysed the exact three-dimensional location of the impacted canines in the anterior maxilla, frequency and extent of root resorptions, and potential influencing factors. To assess interrater agreement, Cohen's correlation parameters were calculated. This study comprises 113 patients with CBCT scans, and 134 impacted canines were analysed retrospectively. In the patients evaluated, 69 impacted canines were located palatally (51.49 per cent), 41 labially (30.60 per cent), and 24 (17.91 per cent) in the middle of the alveolar process. Root resorptions were found in 34 lateral incisors (25.37 per cent), 7 central incisors (5.22 per cent), 6 first premolars (4.48 per cent), and 1 second premolar (0.75 per cent). There was a significant correlation between root resorptions on adjacent teeth and localization of the impacted canine in relation to the bone, as well as vertical localization of the canine. Interrater agreement showed values of 0.546-0.877. CBCT provides accurate information about location of the impacted canine and prevalence and degree of root resorption of neighbouring teeth with high interrater correlation. This information is of great importance for surgeons and orthodontists for accurate diagnostics and interdisciplinary treatment planning.

Patient classification system: An integrated method for measuring nursing intensity and optimizing resource allocation

A patient classification system was developed integrating a patient acuity instrument with a computerized nursing distribution method based on a linear programming model. The system was designed for real-time measurement of patient acuity (workload) and allocation of nursing personnel to optimize the utilization of resources.^ The acuity instrument was a prototype tool with eight categories of patients defined by patient severity and nursing intensity parameters. From this tool, the demand for nursing care was defined in patient points with one point equal to one hour of RN time. Validity and reliability of the instrument was determined as follows: (1) Content validity by a panel of expert nurses; (2) predictive validity through a paired t-test analysis of preshift and postshift categorization of patients; (3) initial reliability by a one month pilot of the instrument in a practice setting; and (4) interrater reliability by the Kappa statistic.^ The nursing distribution system was a linear programming model using a branch and bound technique for obtaining integer solutions. The objective function was to minimize the total number of nursing personnel used by optimally assigning the staff to meet the acuity needs of the units. A penalty weight was used as a coefficient of the objective function variables to define priorities for allocation of staff.^ The demand constraints were requirements to meet the total acuity points needed for each unit and to have a minimum number of RNs on each unit. Supply constraints were: (1) total availability of each type of staff and the value of that staff member (value was determined relative to that type of staff's ability to perform the job function of an RN (i.e., value for eight hours RN = 8 points, LVN = 6 points); (2) number of personnel available for floating between units.^ The capability of the model to assign staff quantitatively and qualitatively equal to the manual method was established by a thirty day comparison. Sensitivity testing demonstrated appropriate adjustment of the optimal solution to changes in penalty coefficients in the objective function and to acuity totals in the demand constraints.^ Further investigation of the model documented: correct adjustment of assignments in response to staff value changes; and cost minimization by an addition of a dollar coefficient to the objective function. ^

Self -management behavior in patients with cystic fibrosis

Self-management is being promoted in cystic fibrosis (CF). However, it has not been well studied. Principal aims of this research were (1) to evaluate psychometric properties of a CF disease status measure, the NIH Clinical Score; (2) to develop and validate a measure of self-management behavior, the SMQ-CF scale, and (3) to examine the relation between self-management and disease status in CF patients over two years.^ In study 1, NIH Clinical Scores for 200 patients were used. The scale was examined for internal consistency, interrater reliability, and content validity using factor analysis. The Cronbach's alpha (.81) and interrater reliability (.90) for the total scale were high. General scale items were less reliable. Factor analysis indicated that most of the variance in disease status is accounted for by Factor 1 which consists of pulmonary disease items.^ The SMQ-CF measures the performance of CF self-management. Pilot testing was done with 98 CF primary caregivers. Internal consistency reliability, social desirability bias, and content validity using factor analysis were examined. Internal consistency was good (alpha =.95). Social desirability correlation was low (r =.095). Twelve factors identified were consistent with conceptual groupings of behaviors. Around two hundred caregivers from two CF centers were surveyed and multivariate analysis of variance was used to assess construct validity. Results confirmed expected relations between self-management, patient age, and disease status. Patient age accounted for 50% and disease status 18% of the variance in the SMQ-CF scale.^ It was hypothesized that self-management would positively affect future disease status. Data from 199 CF patients (control and education intervention groups) were examined. Models of hypothesized relations were tested using LISREL structural equation modeling. Results indicated that the relations between baseline self-management and Time 1 disease status were not significant. Significant relations were observed in self-management behaviors from time 1 to time 2 and patterns of significant relations differed between the two groups.^ This research has contributed to refinements in the ability to measure self-management behavior and disease status outcomes in cystic fibrosis. In addition, it provides the first steps in exploratory behavioral analysis with regard to self-management in this disease. ^