The Responsiveness, Content Validity, and Convergent Validity of the Measure Yourself Concerns and Wellbeing (MYCaW) Patient-Reported Outcome Measure

Objective Measure Yourself Concerns and Wellbeing (MYCaW) is a patient-centred questionnaire that allows cancer patients to identify and quantify the severity of their ‘Concerns’ and Wellbeing, as opposed to using a pre-determined list. MYCaW administration is brief and aids in prioritising treatment approaches. Our goal was to assess the convergent validity and responsiveness of MYCaW scores over time, the generalisability of the existing qualitative coding framework in different complementary and integrative healthcare settings and content validity. Methods Baseline and 6-week follow-up data (n=82) from MYCaW and FACIT-SpEx questionnaires were collected for a service evaluation of the ‘Living Well With The Impact of Cancer’ course at Penny Brohn Cancer Care. MYCaW construct validity was determined using Spearman's Rank Correlation test, and responsiveness indices assessed score changes over time. The existing qualitative coding framework was reviewed using a new dataset (n=158) and coverage of concern categories compared to items of existing outcome measures. Results Good correlation between MYCaW and FACIT-SpEx score changes were achieved (r= -0.57, p≥0.01). MYCaW Profile and Concern scores were highly responsive to change: SRM=1.02 and 1.08; effect size=1.26 and 1.22. MYCaW change scores showed the anticipated gradient of change according to clinically relevant degrees of change. Categories including ‘Spirituality’, ‘weight change’ and ‘practical concerns’ were added to the coding framework to improve generalisability. Conclusions MYCaW scores were highly responsive to change, allowing personalized patient outcomes to be quantified; the qualitative coding framework is generalisable across different oncology settings and has broader coverage of patient-identified concerns compared with existing cancer-related patient-reported outcome measures.

Preliminary reliability and validity testing of a self-efficacy questionnaire for Chinese family caregivers

Objectives: To develop and test preliminary reliability and validity of a Self-Efficacy Questionnaire for Chinese Family Caregivers (SEQCFC). Methods: A cross-sectional survey of 196 family caregivers (CGs) of people with dementia (CGs) was conducted to determine the factor structure of a SEQCFC of people with dementia. Following factor analyses, preliminary testing was performed, including internal consistency, 4-week test retest reliability, and construct and convergent validity. Results: Factor analyses with direct oblimin rotation were performed. Eight items were removed and five subscales(selfefficacy for gathering information about treatment, symptoms and health care; obtaining support; responding to behaviour disturbances; managing household, personal and medical care; and managing distress associated with caregiving) were identified. The Cronbach’s alpha coefficients for the whole scale and for each subscale were all over 0.80. The 4-week testretest reliabilities for the whole scale and for each subscale ranged from 0.64 to 0.85. The convergent validity was acceptable. Conclusions: Evidence for the preliminary testing of the SEQCFC was encouraging. A future follow-up study using confirmatory factor analysis with a new sample from different recruitment centres in Shanghai will be conducted. Future psychometric property testings of the questionnaire will be required for CGs from other regions of mainland China.

Assessing the construct validity and reliability of the parental perception on antibiotics (PAPA) scales

Background: The overuse of antibiotics is becoming an increasing concern. Antibiotic resistance, which increases both the burden of disease, and the cost of health services, is perhaps the most profound impact of antibiotics overuse. Attempts have been made to develop instruments to measure the psychosocial constructs underlying antibiotics use, however, none of these instruments have undergone thorough psychometric validation. This study evaluates the psychometric properties of the Parental Perceptions on Antibiotics (PAPA) scales. The PAPA scales attempt to measure the factors influencing parental use of antibiotics in children. Methods: 1111 parents of children younger than 12 years old were recruited from primary schools’ parental meetings in the Eastern Province of Saudi Arabia from September 2012 to January 2013. The structure of the PAPA instrument was validated using Confirmatory Factor Analysis (CFA) with measurement model fit evaluated using the raw and scaled χ2, Goodness of Fit Index, and Root Mean Square Error of Approximation. Results: A five-factor model was confirmed with the model showing good fit. Constructs in the model include: Knowledge and Beliefs, Behaviors, Sources of information, Adherence, and Awareness about antibiotics resistance. The instrument was shown to have good internal consistency, and good discriminant and convergent validity. Conclusion: The availability of an instrument able to measure the psychosocial factors underlying antibiotics usage allows the risk factors underlying antibiotic use and overuse to now be investigated.

Validity of a self-report recall tool for estimating sedentary behaviour in adults

BACKGROUND Sedentary behavior is continuing to emerge as an important target for health promotion. The purpose of this study was to determine the validity of a self-report use of time recall tool, the Multimedia Activity Recall for Children and Adults (MARCA) in estimating time spent sitting/lying, compared with a device-based measure. METHODS Fifty-eight participants (48% female, [mean±standard deviation] 28±7.4 years of age, 23.9±3.05 kg/m2) wore an activPAL device for 24-h and the following day completed the MARCA. Pearson correlation coefficients (r) were used to analyse convergent validity of the adult MARCA compared with activPAL estimates of total sitting/lying time. Agreement was examined using Bland-Altman plots. RESULTS According to activPAL estimates, participants spent 10.4 hr/day [standard deviation (SD)=2.06] sitting or lying down while awake. The correlation between MARCA and activPAL estimates of total sit/lie time was r=0.77 (95% confidence interval = 0.64-0.86; p<0.001). Bland-Altman analyses revealed a mean bias of +0.59 hr/day with moderately wide limits of agreement (-2.35 hours to +3.53 hr/day). CONCLUSIONS This study found a moderate to strong agreement between the adult MARCA and the activPAL, suggesting that the MARCA is an appropriate tool for the measurement of time spent sitting or lying down in an adult population.

The validity of the GENEActiv wrist-worn accelerometer for measuring adult sedentary time in free living

OBJECTIVES Based on self-reported measures, sedentary time has been associated with chronic disease and mortality. This study examined the validity of the wrist-worn GENEactiv accelerometer for measuring sedentary time (i.e. sitting and lying) by posture classification, during waking hours in free living adults. DESIGN Fifty-seven participants (age=18-55 years 52% male) were recruited using convenience sampling from a large metropolitan Australian university. METHODS Participants wore a GENEActiv accelerometer on their non-dominant wrist and an activPAL device attached to their right thigh for 24-h (00:00 to 23:59:59). Pearson's Correlation Coefficient was used to examine the convergent validity of the GENEActiv and the activPAL for estimating total sedentary time during waking hours. Agreement was illustrated using Bland and Altman plots, and intra-individual agreement for posture was assessed with the Kappa statistic. RESULTS Estimates of average total sedentary time over 24-h were 623 (SD 103) min/day from the GENEActiv, and 626 (SD 123) min/day from the activPAL, with an Intraclass Correlation Coefficient of 0.80 (95% confidence intervals 0.68-0.88). Bland and Altman plots showed slight underestimation of mean total sedentary time for GENEActiv relative to activPAL (mean difference: -3.44min/day), with moderate limits of agreement (-144 to 137min/day). Mean Kappa for posture was 0.53 (SD 0.12), indicating moderate agreement for this sample at the individual level. CONCLUSIONS The estimation of sedentary time by posture classification of the wrist-worn GENEActiv accelerometer was comparable to the activPAL. The GENEActiv may provide an alternative, easy to wear device based measure for descriptive estimates of sedentary time in population samples

DEVELOPMENT AND VALIDITY OF THE DISORDERED EATING ATTITUDE SCALE (DEAS)

The aim of this study was to develop and validate the Disordered Eating Attitude Scale to measure disordered eating attitudes, defined as abnormal beliefs, thoughts, feelings, behaviors, and relationship regarding food. Exploratory factor analysis was performed and internal consistency assessed in a sample of female university students (N=196). Convergent validity was acceptable based on statistically significant correlations with the Eating Attitude Test-26 and Restraint Scale. Known-groups validity was determined by comparing the student sample`s mean scores against scores of an eating disorder group (N=51). The Disordered Eating Attitude Scale comprises 25 questions and five subscales explaining 54.3% of total variance. The total scores differentiated student, bulimia, and anorexia groups. The scale should prove useful for evaluating eating attitudes in various population groups and eating disordered patients.

Validity and reliability of the Portuguese version of Mandibular Function Impairment Questionnaire

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

The Neuropsychiatric Inventory-Clinician rating scale (NPI-C): Reliability and validity of a revised assessment of neuropsychiatric symptoms in dementia

Background: Neuropsychiatric symptoms (NPS) affect almost all patients with dementia and are a major focus of study and treatment. Accurate assessment of NPS through valid, sensitive and reliable measures is crucial. Although current NPS measures have many strengths, they also have some limitations (e.g. acquisition of data is limited to informants or caregivers as respondents, limited depth of items specific to moderate dementia). Therefore, we developed a revised version of the NPI, known as the NPI-C. The NPI-C includes expanded domains and items, and a clinician-rating methodology. This study evaluated the reliability and convergent validity of the NPI-C at ten international sites (seven languages). Methods: Face validity for 78 new items was obtained through a Delphi panel. A total of 128 dyads (caregivers/patients) from three severity categories of dementia (mild = 58, moderate = 49, severe = 21) were interviewed separately by two trained raters using two rating methods: the original NPI interview and a clinician-rated method. Rater 1 also administered four additional, established measures: the Apathy Evaluation Scale, the Brief Psychiatric Rating Scale, the Cohen-Mansfield Agitation Index, and the Cornell Scale for Depression in Dementia. Intraclass correlations were used to determine inter-rater reliability. Pearson correlations between the four relevant NPI-C domains and their corresponding outside measures were used for convergent validity. Results: Inter-rater reliability was strong for most items. Convergent validity was moderate (apathy and agitation) to strong (hallucinations and delusions; agitation and aberrant vocalization; and depression) for clinician ratings in NPI-C domains. Conclusion: Overall, the NPI-C shows promise as a versatile tool which can accurately measure NPS and which uses a uniform scale system to facilitate data comparisons across studies. Copyright © 2010 International Psychogeriatric Association.

The Brazilian version of the Neuropsychiatric Inventory-Clinician rating scale (NPI-C): Reliability and validity in dementia

ABSTRACT Background: Patients with dementia may be unable to describe their symptoms, and caregivers frequently suffer emotional burden that can interfere with judgment of the patient's behavior. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C) was therefore developed as a comprehensive and versatile instrument to assess and accurately measure neuropsychiatric symptoms (NPS) in dementia, thereby using information from caregiver and patient interviews, and any other relevant available data. The present study is a follow-up to the original, cross-national NPI-C validation, evaluating the reliability and concurrent validity of the NPI-C in quantifying psychopathological symptoms in dementia in a large Brazilian cohort. Methods: Two blinded raters evaluated 312 participants (156 patient-knowledgeable informant dyads) using the NPI-C for a total of 624 observations in five Brazilian centers. Inter-rater reliability was determined through intraclass correlation coefficients for the NPI-C domains and the traditional NPI. Convergent validity included correlations of specific domains of the NPI-C with the Brief Psychiatric Rating Scale (BPRS), the Cohen-Mansfield Agitation Index (CMAI), the Cornell Scale for Depression in Dementia (CSDD), and the Apathy Inventory (AI). Results: Inter-rater reliability was strong for all NPI-C domains. There were high correlations between NPI-C/delusions and BPRS, NPI-C/apathy-indifference with the AI, NPI-C/depression-dysphoria with the CSDD, NPI-C/agitation with the CMAI, and NPI-C/aggression with the CMAI. There was moderate correlation between the NPI-C/aberrant vocalizations and CMAI and the NPI-C/hallucinations with the BPRS. Conclusion: The NPI-C is a comprehensive tool that provides accurate measurement of NPS in dementia with high concurrent validity and inter-rater reliability in the Brazilian setting. In addition to universal assessment, the NPI-C can be completed by individual domains. © International Psychogeriatric Association 2013.

Severity of temporomandibular disorders in women: validity and reliability of the Fonseca Anamnestic Index

The aim of this study was to assess the validity and reliability of the Fonseca Anamnestic Index (IAF), used to assess the severity of temporomandibular disorders, applied to Brazilian women. We used a probabilistic sampling design. The participants were 700 women over 18 years of age, living in the city of Araraquara (SP). The IAF questionnaire was applied by telephone interviews. We conducted Confirmatory Factor Analysis (CFA) using Chi-Square Over Degrees of Freedom (χ2/df), Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), and Root Mean Square Error of Approximation (RMSEA) as goodness of fit indices. We calculated the convergent validity, the average variance extracted (AVE) and the composite reliability (CR). Internal consistency was assessed by Cronbach's alpha coefficient (α).The factorial weights of questions 8 and 10 were below the adequate values. Thus, we refined the original model and these questions were excluded. The resulting factorial model showed appropriate goodness of fit to the sample (χ2/df = 3.319, CFI = 0.978, TLI = 0.967, RMSEA = 0.058). The convergent validity (AVE = 0.513, CR = 0.878) and internal consistency (α = 0.745) were adequate. The reduced IAF version showed adequate validity and reliability in a sample of Brazilian women.

Cross-cultural adaptation and assessment of the reliability and validity of the Core Outcome Measures Index (COMI) for the Brazilian-Portuguese language

The use of patient-orientated questionnaires is of utmost importance in assessing the outcome of spine surgery. Standardisation, using a common set of outcome measures, is essential to aid comparisons across studies/in registries. The Core Outcome Measures Index (COMI) is a short, multidimensional outcome instrument validated for patients with spinal disorders. This study aimed to produce a Brazilian-Portuguese version of the COMI. A cross-cultural adaptation of the COMI into Brazilian-Portuguese was carried out using established guidelines. 104 outpatients with chronic LBP (> 3 months) were recruited from a Public Health Spine Medical Care Centre. They completed a questionnaire booklet containing the newly translated COMI, and other validated symptom-specific questionnaires: Oswestry Disability Index (ODI) and Roland Morris disability scale (RM), and a pain visual analogue scale. All patients completed a second questionnaire within 7-10 days to assess reproducibility. The COMI summary score displayed minimal floor and ceiling effects. On re-test, the responses for each individual domain of the COMI were within 1 category in 98% patients for the domain 'function', 96% for 'symptom-specific well-being', 97% for 'general quality of life', 99% for 'social disability' and 100% for 'work disability'. The intraclass correlation coefficients (ICC2,1) for COMI pain and COMI summary scores were 0.91-0.96, which compared favourably with the corresponding values for the RM (ICC, 0.99) and ODI (ICC, 0.98). The standard error of measurement for the COMI was 0.6, giving a "minimum detectable change" (MDC95%) of approximately 1.7 points i.e., the minimum change to be considered "real change" beyond measurement error. The COMI scores correlated as hypothesised (Rho, 0.4-0.8) with the other symptom-specific questionnaires. The reproducibility of the Brazilian-Portuguese version of the COMI was comparable to that of other language versions. The COMI scores correlated in the expected manner with existing but longer symptom-specific questionnaires suggesting good convergent validity for the COMI. The Brazilian-Portuguese COMI represents a valuable tool for Brazilian study-centres in future multicentre clinical studies and surgical registries.

Is VHB-JOURQUAL2 a Good Measure of Scientific Quality? Assessing the Validity of the Major Business Journal Ranking in German-Speaking Countries

This study examines the question of whether the journal ranking VHB-JOURQUAL 2 can be considered as a good measure for the construct “scientific quality”. Various rankings in business research provide the database for the analysis. The correlations between theses rankings are used to assess the validity of VHB-JOURQUAL 2 along various validity criteria. The correlations with rankings that measure the same construct based on different methods show that VHB-JOURQUAL 2 has acceptable, but moderate convergent validity. The validity varies considerably across disciplines, showing that the heterogeneity of business administration is not sufficiently represented by this overall ranking. The variability is related to the variation in members per discipline represented by the German Association for Business Research. Furthermore, the measure shows a weak correlation with acceptance rates as an indicator of nomological validity in some disciplines.

Validity and reliability of using MVP 4 Function Walk4Life digital pedometers to assess physical activity levels among preschool-aged Head Start children

The Surgeon General recommends preschoolers 3-5 years old accumulate 60 minutes of moderate-to-vigorous physical activity (MVPA) per day. However, there is limited data measuring physical activity (PA) and MVPA amongst this population. The purpose of this cross-sectional study is to determine the validity, reliability, and feasibility of using MVP 4 Function Walk4Life digital pedometers (MVP-4) in measuring MVPA among preschoolers using the newly modified direct observational technique, System for Observing Fitness Instruction Time-Preschool Version (SOFIT-P) as the gold standard. An ethnically diverse population of 3-5 year old underserved children were recruited from two Harris County Department of Education (HCDE) Head Start centers. For 2 days at baseline and 2 days at post-test, 75 children enrolled wore MVP-4 pedometers for approximately 6-hours per observation day and were observed using SOFIT-P during predominantly active times. Statistical analyses used Pearson "r" correlation coefficients to determine mean minutes of PA and MVPA, convergent and criterion validity, and reliability. Significance was set at p = <0.05. Feasibility was determined through process evaluation information collected during this study via observations from data collectors and teacher input. Results show mean minutes of PA and MVPA ranged between 30-42 and 11-14 minutes, respectively. Convergent validity comparing BMI percentiles with MVP-4 PA outcomes show no significance at pre-test; however, each measurement at post-test showed significance for MVPA (p = 0.0247, p = 0.0056), respectively. Criterion validity comparing percent MVPA time between SOFIT-P and MVP-4 pedometers was determined; however, results deemed insufficient due to inconsistency in observation times while using the newly developed SOFIT-P. Reliability measures show no significance at pre-test, yet show significant results for all PA outcomes at post-test (p = 0.001, p = 0.001, p = 0.0010, p = 0.003), respectively. Finally, MVP-4 pedometers lacked feasibility due to logistical barriers in design. Researchers feel the significant results at post-test are secondary to increased familiarity and more accurate placement of pedometers across time. Researchers suggest manufacturers of MVP-4 pedometers further modify the instrument for ease of use with this population, following which future studies ought to determine validity using objective measures or all-day direct observation techniques.^

An examination of the cross-cultural reliability and construct validity of a measure of loneliness

Loneliness is a pervasive, rather common experience in American culture, particularly notable among adolescents. However, the phenomenon is not well documented in the cross-cultural psychiatric literature. For psychiatric epidemiology to encompass a wide array of psychopathologic phenomena, it is important to develop useful measures to characterize and classify both non-clinical and clinical dysfunction in diverse subgroups and cultures.^ The goal of this research was to examine the cross-cultural reliability and construct validity of a scale designed to measure loneliness. The Roberts Loneliness Scale (RLS-8) was administered to 4,060 adolescents ages 10-19 years enrolled in high schools along either side of the Texas-Tamaulipas border region between the U.S. and Mexico. Data collected in 1988 from a study focusing on substance use and psychological distress among adolescents in these regions were used to examine the operating characteristics of the RLS-8. A sample stratified by nationality and language, age, gender, and grade was used for analysis.^ Results indicated that in general the RLS-8 has moderate reliability in the U.S. sample, but not in the Mexican sample. Validity analyses demonstrated that there was evidence for convergent validity of the RLS-8 in the U.S. sample, but none in the Mexican sample. Discriminant validity of the measures in neither sample could be established. Based on the factor structure of the RLS-8, two subscales were created and analyzed for construct validity. Evidence for convergent validity was established for both subscales in both national samples. However, the discriminant validity of the measure remains unsubstantiated in both national samples. Also, the dimensionality of the scale is unresolved.^ One primary goal for future cross-cultural research would be to develop and test better defined culture-specific models of loneliness within the two cultures. From such scientific endeavor, measures of loneliness can be developed or reconstructed to classify the phenomenon in the same manner across cultures. Since estimates of prevalence and incidence are contingent upon reliable and valid screening or diagnostic measures, this objective would serve as an important foundation for future psychiatric epidemiologic inquiry into loneliness. ^