The Spanish translation, cultural adaptation and validation of the Powe Fatalism Inventory

Background/significance. The scarcity of reliable and valid Spanish language instruments for health related research has hindered research with the Hispanic population. Research suggests that fatalistic attitudes are related to poor cancer screening behaviors and may be one reason for low participation of Mexican-Americans in cancer screening. This problem is of major concern because Mexican-Americans constitute the largest Hispanic subgroup in the U.S.^ Purpose. The purposes of this study were: (1) To translate the Powe Fatalism Inventory, (PFI) into Spanish, and culturally adapt the instrument to the Mexican-American culture as found along the U.S.-Mexico border and (2) To test the equivalence between the Spanish translated, culturally adapted version of the PFI and the English version of the PFI to include clarity, content validity, reading level and reliability.^ Design. Descriptive, cross-sectional.^ Methods. The Spanish language translation used a translation model which incorporates a cultural adaptation process. The SPFI was administered to 175 bilingual participants residing in a midsize, U.S-Mexico border city. Data analysis included estimation of Cronbach's alpha, factor analysis, paired samples t-test comparison and multiple regression analysis using SPSS software, as well as measurement of content validity and reading level of the SPFI. ^ Findings. A reliability estimate using Cronbach's alpha coefficient was 0.81 for the SPFI compared to 0.80 for the PFI in this study. Factor Analysis extracted four factors which explained 59% of the variance. Paired t-test comparison revealed no statistically significant differences between the SPFI and PFI total or individual item scores. Content Validity Index was determined to be 1.0. Reading Level was assessed to be less than a 6th grade reading level. The correlation coefficient between the SPFI and PFI was 0.95.^ Conclusions. This study provided strong psychometric evidence that the Spanish translated, culturally adapted SPFI is an equivalent tool to the English version of the PFI in measuring cancer fatalism. This indicates that the two forms of the instrument can be used interchangeably in a single study to accommodate reading and speaking abilities of respondents. ^

Measuring the quality of life of patients with diabetes: Validating the tool and determining the effects on quality of life

There are several tools for measuring quality of life (QoL) and specifically, health-related quality of life (HRQoL) for persons with diabetes. A commonly-used measure, the Diabetes Quality of Life (DQOL) Survey, developed for the Diabetes Control and Complications Trial (DCCT), has been used in several experimental settings, and its reliability and validity are well-established. However, it is considered too long to be of practical use in clinical settings. Because of this, a shortened version of the tool was used recently in the Community Diabetes Education (CoDE) Project in Dallas, Texas, a clinic-based patient education program that uses a specially-trained community healthcare worker to provide patient education. However, the modified scale has never been tested for reliability and validity. Thus, one goal of this thesis was to measure these psychometric properties of the scale. After establishing the reliability and validity, the results of the scale were analyzed to determine the effects of the intervention on the subjects’ quality of life. The changes in QoL scales were compared with changes in physiologic measures which are most closely allied with diabetes, including blood glucose levels, weight/BMI, co-morbidities and health beliefs in order to determine if there is a relationship between such measures and quality of life. The results of the reliability and validity testing were not conclusive. Measures of reliability and criterion validity were established, but these contrasted with poor measures of repeatability and content validity. The effect of the intervention on quality of life, however, was more significant, particularly regarding the impact of diabetes. Those who received the counseling had significantly higher scores on the Impact scale than those who did not, and the former group had much greater improvement in scores over the twelve month period than the latter group. ^

Use of cognitive interviewing in the development of a Spanish language genetic knowledge instrument

Study purpose. Genetic advances are significantly impacting healthcare, yet recent studies of ethnic group participation in genetic services demonstrate low utilization rates by Latinos. Limited genetic knowledge is a major barrier. The purpose of this study was to field test items in a Spanish-language instrument that will be used to measure genetic knowledge relevant to type 2 diabetes among members of the ethnically heterogeneous U.S. Latino community. Accurate genetic knowledge measurement can provide the foundation for interventions to enhance genetic service utilization. ^ Design. Three waves of cognitive interviews were conducted in Spanish to field test 44 instrument items Thirty-six Latinos, with 12 persons representative of Mexican, Central and South American, and Cuban heritage participated, including 7 males and 29 females between 22 and 60 years of age; 17 participants had 12 years or less of education. ^ Methods. Text narratives from transcriptions of audiotaped interviews were qualitatively analyzed using a coding strategy to indicate potential sources of response error. Through an iterative process of instrument refinement, codes that emerged from the data were used to guide item revisions at the conclusion of each phase; revised items were examined in subsequent interview waves. ^ Results. Inter-cultural and cross-cultural themes associated with difficulties in interpretation and grammatical structuring of items were identified; difficulties associated with comprehension reflected variations in educational level. Of the original 44 items, 32 were retained, 89% of which were revised. Six additional items reflective of cultural knowledge were constructed, resulting in a 38-item instrument. ^ Conclusions. Use of cognitive interviewing provided a valuable tool for detecting both potential sources of response error and cultural variations in these sources. Analysis of interview data guided successive instrument revisions leading to improved item interpretability and comprehension. Although testing in a larger sample will be essential to test validity and reliability, the outcome of field testing suggests initial content validity of a Spanish-language instrument to measure genetic knowledge relative to type 2 diabetes. ^ Keywords. Latinos, genetic knowledge, instrument development, cognitive interviewing ^

Translation and cultural adaptation of the Stigma-Devaluation scale for use among family caregivers of mentally ill relatives in Jordan

Background/significance. Mental illness stigma is a matter of great concern to family caregivers. Few research studies have been conducted in the Arab World on family caregivers' perception of stigma associated with caring for a mentally ill relative. Review of the literature on measurement of the concept of stigma related to caring for a mentally ill relative yielded no instrument appropriate for use in a Jordanian sample. Reliable and valid instruments to measure stigma perception among family caregivers are needed for research and practice, particularly in Arabic speaking populations. ^ Purpose. The purposes of this study were: (1) translate the Stigma-Devaluation scale (SDS) into Arabic, modifying it to accurately reflect the cultural parameters specific to Jordan, and (2) test the reliability, the content and construct validity of the Arabic version of the SDS for use among a sample of family members of mentally ill relatives in Jordan. ^ Design. Methodologic, cross-sectional. ^ Methods. The SDS was translated into Arabic language, modified and culturally adapted to the Jordanian culture by a translation model which incorporates a cultural adaptation process. The Arabic SDS was evaluated in a sample of 164 family caregivers in the outpatient mental health clinic in Irbid-Jordan. Cronbach's alpha estimation of internal consistency was used to assess the reliability of the SDS. Construct validity was determined by confirmatory factor analysis (CFA). Measurements of content validity and reading level of the Arabic SDS were included. ^ Findings. Content Validity Index was determined to be 1.0. Reading level of the Arabic SDS was considered at a 6th grade or lower Cronbach's alpha coefficient of the modified Arabic SDS total scale was .87. Initial results of CFA did not fully support the proposed factor structures of the SDS or its subscales. After modifications, the indices indicated that the modified model of each subscale had satisfactory fit. ^ Conclusion. This study provided psychometric evidence that the modified Arabic SDS translated and culturally adapted instrument, is valid and conceptually consistent with the content of the original English SDS in measuring stigma perception among families of mentally ill relatives in Jordan. ^

Data Accuracy in Medical Record Abstraction

Clinical Research Data Quality Literature Review and Pooled Analysis We present a literature review and secondary analysis of data accuracy in clinical research and related secondary data uses. A total of 93 papers meeting our inclusion criteria were categorized according to the data processing methods. Quantitative data accuracy information was abstracted from the articles and pooled. Our analysis demonstrates that the accuracy associated with data processing methods varies widely, with error rates ranging from 2 errors per 10,000 files to 5019 errors per 10,000 fields. Medical record abstraction was associated with the highest error rates (70–5019 errors per 10,000 fields). Data entered and processed at healthcare facilities had comparable error rates to data processed at central data processing centers. Error rates for data processed with single entry in the presence of on-screen checks were comparable to double entered data. While data processing and cleaning methods may explain a significant amount of the variability in data accuracy, additional factors not resolvable here likely exist. Defining Data Quality for Clinical Research: A Concept Analysis Despite notable previous attempts by experts to define data quality, the concept remains ambiguous and subject to the vagaries of natural language. This current lack of clarity continues to hamper research related to data quality issues. We present a formal concept analysis of data quality, which builds on and synthesizes previously published work. We further posit that discipline-level specificity may be required to achieve the desired definitional clarity. To this end, we combine work from the clinical research domain with findings from the general data quality literature to produce a discipline-specific definition and operationalization for data quality in clinical research. While the results are helpful to clinical research, the methodology of concept analysis may be useful in other fields to clarify data quality attributes and to achieve operational definitions. Medical Record Abstractor’s Perceptions of Factors Impacting the Accuracy of Abstracted Data Medical record abstraction (MRA) is known to be a significant source of data errors in secondary data uses. Factors impacting the accuracy of abstracted data are not reported consistently in the literature. Two Delphi processes were conducted with experienced medical record abstractors to assess abstractor’s perceptions about the factors. The Delphi process identified 9 factors that were not found in the literature, and differed with the literature by 5 factors in the top 25%. The Delphi results refuted seven factors reported in the literature as impacting the quality of abstracted data. The results provide insight into and indicate content validity of a significant number of the factors reported in the literature. Further, the results indicate general consistency between the perceptions of clinical research medical record abstractors and registry and quality improvement abstractors. Distributed Cognition Artifacts on Clinical Research Data Collection Forms Medical record abstraction, a primary mode of data collection in secondary data use, is associated with high error rates. Distributed cognition in medical record abstraction has not been studied as a possible explanation for abstraction errors. We employed the theory of distributed representation and representational analysis to systematically evaluate cognitive demands in medical record abstraction and the extent of external cognitive support employed in a sample of clinical research data collection forms. We show that the cognitive load required for abstraction in 61% of the sampled data elements was high, exceedingly so in 9%. Further, the data collection forms did not support external cognition for the most complex data elements. High working memory demands are a possible explanation for the association of data errors with data elements requiring abstractor interpretation, comparison, mapping or calculation. The representational analysis used here can be used to identify data elements with high cognitive demands.

Self -management behavior in patients with cystic fibrosis

Self-management is being promoted in cystic fibrosis (CF). However, it has not been well studied. Principal aims of this research were (1) to evaluate psychometric properties of a CF disease status measure, the NIH Clinical Score; (2) to develop and validate a measure of self-management behavior, the SMQ-CF scale, and (3) to examine the relation between self-management and disease status in CF patients over two years.^ In study 1, NIH Clinical Scores for 200 patients were used. The scale was examined for internal consistency, interrater reliability, and content validity using factor analysis. The Cronbach's alpha (.81) and interrater reliability (.90) for the total scale were high. General scale items were less reliable. Factor analysis indicated that most of the variance in disease status is accounted for by Factor 1 which consists of pulmonary disease items.^ The SMQ-CF measures the performance of CF self-management. Pilot testing was done with 98 CF primary caregivers. Internal consistency reliability, social desirability bias, and content validity using factor analysis were examined. Internal consistency was good (alpha =.95). Social desirability correlation was low (r =.095). Twelve factors identified were consistent with conceptual groupings of behaviors. Around two hundred caregivers from two CF centers were surveyed and multivariate analysis of variance was used to assess construct validity. Results confirmed expected relations between self-management, patient age, and disease status. Patient age accounted for 50% and disease status 18% of the variance in the SMQ-CF scale.^ It was hypothesized that self-management would positively affect future disease status. Data from 199 CF patients (control and education intervention groups) were examined. Models of hypothesized relations were tested using LISREL structural equation modeling. Results indicated that the relations between baseline self-management and Time 1 disease status were not significant. Significant relations were observed in self-management behaviors from time 1 to time 2 and patterns of significant relations differed between the two groups.^ This research has contributed to refinements in the ability to measure self-management behavior and disease status outcomes in cystic fibrosis. In addition, it provides the first steps in exploratory behavioral analysis with regard to self-management in this disease. ^

Validação do protocolo de avaliação do frênulo da língua em bebês

Este estudo teve por objetivo validar o Protocolo de avaliação do frênulo da língua em bebês. Para isso, a partir do cálculo amostral, foi aplicado o protocolo em 100 bebês saudáveis, nascidos a termo, com 30 dias de vida, em amamentação exclusiva. O processo de validação consistiu da análise da validade de conteúdo, de critério e de construto, bem como da confiabilidade, sensibilidade, especificidade, valor preditivo positivo e negativo. A validade de conteúdo foi realizada por três examinadores, por meio da classificação de cada item quanto à clareza e posterior aplicação do Índice de Validação do Conteúdo. As avaliadoras sugeriram modificações no protocolo, por consenso, possibilitando obter a versão final. Para a validade de critério, comparou-se o Protocolo de avaliação do frênulo da língua em bebês com o instrumento Bristol Tongue Assessment Tool (BTAT). A validade de construto foi analisada a partir da comparação dos escores do protocolo aplicado nos bebês com 30 e 75 dias. As avaliações foram realizadas por duas fonoaudiólogas especialistas em Motricidade Orofacial (denominadas A1 e A2), devidamente treinadas e calibradas, por meio da análise das filmagens realizadas durante a aplicação do protocolo, para verificação da concordância entre examinadores, bem como definição dos valores de sensibilidade, especificidade e valores preditivos. Para a análise da concordância intra-avaliador foi realizado o teste/reteste de 20% da amostra pela A2. Quanto ao tratamento estatístico, para a análise de concordância intra e entre avaliadores, foram utilizados o Coeficiente de Correlação Intraclasse e o cálculo do erro do método. Para análise da validade de construto foram aplicados os testes de Wilcoxon e Mann-Whitney. O nível de significância adotado em todos os testes foi de 5%. Houve 100% de concordância na validação do conteúdo. A validade de critério apresentou correlações fortes dos itens correspondentes do Protocolo de avaliação do frênulo da língua em bebês e do instrumento BTAT, sendo o valor do coeficiente de correlação de Spearman igual a -0,997. Os resultados obtidos evidenciaram uma concordância muito boa intra e entre avaliadores, com valores baixos de erro casual e valores de p>0,05 (evidenciando que não há diferença entre a análise dos avaliadores) e Coeficiente de Correlação Intraclasse maior que 0,75; mostrando ainda, uma capacidade significativa do protocolo em mensurar as mudanças resultantes da frenotomia lingual, pela história clínica, avaliação anatomofuncional e avaliação da sucção não nutritiva e nutritiva (p<0,05). Quando comparados os resultados dos bebês com alteração do frênulo lingual (grupo experimental) e sem alteração (grupo controle), com 30 e 75 dias, houve diferença nos escores parciais e no escore total do exame clínico e do protocolo completo. Os índices de sensibilidade, especificidade e valores preditivos positivo e negativo foram 100%. A ocorrência das alterações do frênulo lingual nesse estudo foi de 21%. Concluiu-se, com este estudo, que o Protocolo de avaliação do frênulo da língua em bebês mostrou ser um instrumento válido e confiável de avaliação, assegurando acurácia em diagnosticar as alterações do frênulo lingual dentro dos parâmetros investigados, podendo ser aplicado por diferentes avaliadores, desde que os mesmos sejam capacitados e treinados para sua aplicação.

Development of the DORI-TBI: An Investigation to Develop a New Screening Measure to Determine Consultation with a School-Based Brain Injury Resource Team

Brain injury is the leading cause of disability and death in children in the United States. Student re-entry into the school setting following a traumatic brain injury is crucial to student success. Multidisciplinary teams within the school district comprised of individuals with expertise in brain injury are ideal in implementing student specific treatment plans given their specialized training and wide range of expertise addressing student needs. Therefore, the purpose of this study is to develop and initially validate a quantitative instrument that school personnel can use to determine if a student, identified as having a traumatic brain injury, will benefit from district-level consultation from a brain injury team. Three studies were designed to investigate the research questions. In study one, the planning and construction of the DORI-TBI was completed. Study two addressed the content validity of the DORI-TBI through a comparison analysis with other referral forms, content review with experts in the field of TBI, and cognitive interviews with professionals to test the usability of the new screening tool. In study three, a field administration was conducted using vignettes to measure construct validity. Results produced a valid and reliable new screening instrument that can aid school-based teams to more efficiently utilize district level consultation with a brain injury support team.

Psychometric Investigation of the Check-In, Check-Out Fidelity of Implementation Measure

Suspension and expulsion are utilized frequently and disproportionality in schools in the United States. Many schools utilize Positive Behavioral Interventions and Supports (PBIS), a tiered framework to prevent problem behavior and reduce the use of discipline practices (Sugai et al., 2000). Check-In, Check-Out (CICO) is a targeted group behavioral intervention that is utilized within this framework in schools to prevent severe problem behavior in students that are beginning to exhibit externalizing and/or internalizing behavioral needs; thus, preventing the use of exclusionary discipline practices (Crone et al., 2010; Hawken & Horner, 2003). As the use of CICO in schools continues to grow, so too does the need for an instrument measuring its fidelity of implementation. The purpose of this study was to investigate the reliability and validity of the Check-In, Check-Out Fidelity of Implementation Measure (Crone et al., 2010), an instrument created to measure the fidelity of implementation of CICO intervention. This study assessed the psychometric properties of the instrument utilizing an archival data set collected by the statewide PBIS initiative in a western state in the U.S. The results demonstrated promising content validity, construct validity, internal consistency, and interrater reliability. A unidimensional structure was determined to be the best structure for the instrument based on parsimony and the strong results obtained from the item loadings, internal consistency, and interrater reliability. Implications for use and future research are discussed.

Validación de la versión española del cuestionario Physician Readiness To Manage Intimate Partner Violence Survey (PREMIS)

Fundamentos: El Physician Readiness to Manage Intimate Partner Violence Survey (PREMIS) es uno de los cuestionarios más completos en el contexto internacional para la valoración de la capacidad de respuesta frente a la violencia del compañero íntimo por los profesionales de Atención Primaria de Salud. El objetivo de este estudio fue determinar la fiabilidad, consistencia interna y validez de constructo de la versión española de este cuestionario. Métodos: Tras la traducción, retrotraducción y valoración de la validez de contenido del cuestionario, se distribuyeron en una muestra de 200 profesionales de medicina y enfermería de 15 centros de atención primaria de 4 Comunidades Autónomas en 2013 (Comunidad Valenciana, Castilla León, Murcia y Cantabria). Se calcularon los coeficientes alfa de Cronbach, los de correlación intraclase y rho de Spearman (test-retest). Resultados: la versión española del PREMIS incluyó 64 ítems. El coeficiente α de Cronbach fue superior a 0,7 o muy cercano a ese valor en la mayoría de los índices. Se obtuvo un coeficiente de correlación intraclase de 0,87 y un coeficiente de Spearman de 0,67 que muestran una fiabilidad alta. Todas las correlaciones observadas para la escala de opiniones, la única tratada como estructura factorial en el cuestionario PREMIS, fueron superiores a 0,30. Conclusiones: el PREMIS en español obtuvo una buena validez interna, alta fiabilidad y capacidad predictiva de las prácticas auto-referidas por médicos(as) y enfermeros(as) frente a casos de violencia del compañero íntimo en centros de atención primaria.

A reliable and valid questionnaire was developed to measure computer vision syndrome at the workplace

Objectives: To design and validate a questionnaire to measure visual symptoms related to exposure to computers in the workplace. Study Design and Setting: Our computer vision syndrome questionnaire (CVS-Q) was based on a literature review and validated through discussion with experts and performance of a pretest, pilot test, and retest. Content validity was evaluated by occupational health, optometry, and ophthalmology experts. Rasch analysis was used in the psychometric evaluation of the questionnaire. Criterion validity was determined by calculating the sensitivity and specificity, receiver operator characteristic curve, and cutoff point. Testeretest repeatability was tested using the intraclass correlation coefficient (ICC) and concordance by Cohen’s kappa (k). Results: The CVS-Q was developed with wide consensus among experts and was well accepted by the target group. It assesses the frequency and intensity of 16 symptoms using a single rating scale (symptom severity) that fits the Rasch rating scale model well. The questionnaire has sensitivity and specificity over 70% and achieved good testeretest repeatability both for the scores obtained [ICC 5 0.802; 95% confidence interval (CI): 0.673, 0.884] and CVS classification (k 5 0.612; 95% CI: 0.384, 0.839). Conclusion: The CVS-Q has acceptable psychometric properties, making it a valid and reliable tool to control the visual health of computer workers, and can potentially be used in clinical trials and outcome research.

Diseño y validación de un instrumento para evaluar la competencia digital de los docentes en la Educación Superior española

El objetivo del presente estudio ha sido desarrollar un instrumento válido y fiable para evaluar la competencia digital del profesorado. El Cuestionario sobre la Competencia Digital del profesorado de la Educación Superior Española fue construido a partir de la revisión bibliográfica de estudios e investigaciones referentes a la temática. Dicho instrumento está compuesto de 112 ítems, distribuidos en cuatro dimensiones. Se ofrecen los diferentes resultados obtenidos de los valores de alfa de Cronbach, así como una serie de estadísticos descriptivos. La población ha estado formada por 8.013 docentes, obteniendo 1.145, la validez de contenido fue evaluada mediante juicio de expertos.

Construcción de un instrumento para medir la utilidad percibida de las TIC usadas en la docencia por estudiantes de Arquitectura Técnica

Se ha realizado una investigación acerca del uso del ordenador y de los objetos de aprendizaje que utilizan los estudiantes en una asignatura de Arquitectura Técnica de la Universidad de Alicante. Para ello, se ha creado un instrumento que analiza la utilidad percibida de los objetos de aprendizaje en la adquisición de las competencias y las actitudes de los estudiantes hacia el uso del ordenador. Los análisis realizados indican que el instrumento de medición elaborado es fiable y válido. La validez de contenido del instrumento se analizó a través del juicio de expertos (validez general del cuestionario = .912, p-valor = .000). La validez de constructo se estudió a través del análisis de su estructura interna, sometiendo a un análisis factorial los ítems de la versión definitiva del cuestionario (se identificaron cuatro factores que juntos explicaron el 45.65% de la varianza). La fiabilidad del instrumento se analizó calculando su consistencia interna por medio del coeficiente alpha de Cronbach (? para el total de la escala = .90).

A national e-Delphi towards the measurement of safe medication practices in Portuguese hospitals

Objectives To determine the face and content validity of items for measuring safe medication practices in Portuguese hospitals. Methods 128 items were drafted from content analysis of existing questionnaires and the literature, employing preferred terms of the WHO International Classification for Patient Safety (Portuguese version). A two-round e-Delphi was convened, using a purposive multidisciplinary panel. Hospital-based experts were asked to rate the relevance of items on a 7-point Likert scale and to comment on their clarity and completeness. Results The response rate was similar in both rounds (70.3% and 73.4%, respectively). In the first round 91/128 (71.1%) items reached the predefined level of positive consensus. In the second round 23 additional items reached positive consensus, as well as seven items newly derived by the panel. Conclusions Most items have face and content validity, indicating relevance and clarity, and can be included in a future questionnaire for measuring safe medication practices in Portuguese hospitals.

Functional capacity evaluation as a performance measure - Evidence for a new approach for clients with chronic back pain

Objectives: To report the research and development of a new approach to Functional Capacity Evaluation, the Gibson Approach to Functional Capacity Evaluation (GAPP FCE) for chronic back pain clients. Methods: Four Studies, including pilot and feasibility testing, expert review, and preliminary interrater reliability examination, are described here. Participants included 7 healthy young adults and 19 rehabilitation clients with back pain who underwent assessment using the GAPP FCE. Thirteen therapists were trained in the approach and were silently observed administering the Functional Capacity Evalutions by at least 1 other trained therapists or the first investigator Or both. An expert review using 5 expert occupational therapists was also conducted. Results: Study 1, the pilot with healthy individuals, indicated that the GAPP FCE was a feasible approach with good utility. Study 2, a pilot using 2 trained therapists assessing 5 back pain clients, supported the clinical feasibility of the approach. The expert review in Study 3 found support for GAPP FCE. Study 4, a trial of the approach with 14 rehabilitation clients, found support for the interrater reliability of recommendations for return to work based on performance in the GAPP FCE. Discussion: The evidence thus far available supports the GAPP FCE as ail approach that provides a Sound method for evaluating the performance of the physical demands of work with clients with chronic back pain. The tool has been shown to have good face and content validity, to meet acceptable test standards, and to have reasonable interrater reliability. Further research is occurring to look at a larger interrater reliability study, to further examine content validity, and to examine predictive validity.