Toward an acoustic vowel metric: listener validation

This paper examines objective measures of speech production, specifically vowels. The relationship between the listener's perception of sections of the vowels with their perception of the entire vocalic utterance was examined.

Assessment of thought–shape fusion: initial validation of a short version of the trait thought–shape fusion scale

Objective: Thought–shape fusion (TSF) is a cognitive distortion that has been linked to eating pathology. Two studies were conducted to further explore this phenomenon and to establish the psychometric properties of a French short version of the TSF scale. Method: In Study 1, students (n 5 284) completed questionnaires assessing TSF and related psychopathology. In Study 2, the responses of women with eating disorders (n 5 22) and women with no history of an eating disorder (n 5 23) were compared. Results: The French short version of the TSF scale has a unifactorial structure, with convergent validity with measures of eating pathology, and good internal consistency. Depression, eating pathology, body dissatisfaction, and thought-action fusion emerged as predictors of TSF. Individuals with eating disorders have higher TSF, and more clinically relevant food-related thoughts than do women with no history of an eating disorder. Discussion: This research suggests that the shortened TSF scale can suitably measure this construct, and provides support for the notion that TSF is associated with eating pathology.

Content validation for level of use of feature rich systems: a Delphi study of electronic medical records systems

Introduction. Feature usage is a pre-requisite to realising the benefits of investments in feature rich systems. We propose that conceptualising the dependent variable 'system use' as 'level of use' and specifying it as a formative construct has greater value for measuring the post-adoption use of feature rich systems. We then validate the content of the construct as a first step in developing a research instrument to measure it. The context of our study is the post-adoption use of electronic medical records (EMR) by primary care physicians. Method. Initially, a literature review of the empirical context defines the scope based on prior studies. Having identified core features from the literature, they are further refined with the help of experts in a consensus seeking process that follows the Delphi technique. Results.The methodology was successfully applied to EMRs, which were selected as an example of feature rich systems. A review of EMR usage and regulatory standards provided the feature input for the first round of the Delphi process. A panel of experts then reached consensus after four rounds, identifying ten task-based features that would be indicators of level of use. Conclusions. To study why some users deploy more advanced features than others, theories of post-adoption require a rich formative dependent variable that measures level of use. We have demonstrated that a context sensitive literature review followed by refinement through a consensus seeking process is a suitable methodology to validate the content of this dependent variable. This is the first step of instrument development prior to statistical confirmation with a larger sample.

Criteria for validation and selection of cognitive tests for investigating the effects of foods and nutrients.

This review is an output of the International Life Sciences Institute (ILSI) Europe Marker Initiative, which aims to identify evidence-based criteria for selecting adequate measures of nutrient effects on health through comprehensive literature review. Experts in cognitive and nutrition sciences examined the applicability of these proposed criteria to the field of cognition with respect to the various cognitive domains usually assessed to reflect brain or neurological function. This review covers cognitive domains important in the assessment of neuronal integrity and function, commonly used tests and their state of validation, and the application of the measures to studies of nutrition and nutritional intervention trials. The aim is to identify domain-specific cognitive tests that are sensitive to nutrient interventions and from which guidance can be provided to aid the application of selection criteria for choosing the most suitable tests for proposed nutritional intervention studies using cognitive outcomes. The material in this review serves as a background and guidance document for nutritionists, neuropsychologists, psychiatrists, and neurologists interested in assessing mental health in terms of cognitive test performance and for scientists intending to test the effects of food or food components on cognitive function.

Validation of the NANA (Novel Assessment of Nutrition and Ageing) touch screen system for use at home by older adults

Prospective measurement of nutrition, cognition, and physical activity in later life would facilitate early detection of detrimental change and early intervention but is hard to achieve in community settings. Technology can simplify the task and facilitate daily data collection. The Novel Assessment of Nutrition and Ageing (NANA) toolkit was developed to provide a holistic picture of an individual's function including diet, cognition and activity levels. This study aimed to validate the NANA toolkit for data collection in the community. Forty participants aged 65 years and over trialled the NANA toolkit in their homes for three 7-day periods at four-week intervals. Data collected using the NANA toolkit were compared with standard measures of diet (four-day food diary), cognitive ability (processing speed) and physical activity (self-report). Bland–Altman analysis of dietary intake (energy, carbohydrates, protein fat) found a good relationship with the food diary and cognitive processing speed and physical activity (hours) were significantly correlated with their standard counterparts. The NANA toolkit enables daily reporting of data that would otherwise be collected sporadically while reducing demands on participants; older adults can complete the daily reporting at home without a researcher being present; and it enables prospective investigation of several domains at once

How reliable is internet-based self-reported identity, socio-demographic and obesity measures in European adults?

In e-health intervention studies, there are concerns about the reliability of internet-based, self-reported (SR) data and about the potential for identity fraud. This study introduced and tested a novel procedure for assessing the validity of internet-based, SR identity and validated anthropometric and demographic data via measurements performed face-to-face in a validation study (VS). Participants (n = 140) from seven European countries, participating in the Food4Me intervention study which aimed to test the efficacy of personalised nutrition approaches delivered via the internet, were invited to take part in the VS. Participants visited a research centre in each country within 2 weeks of providing SR data via the internet. Participants received detailed instructions on how to perform each measurement. Individual’s identity was checked visually and by repeated collection and analysis of buccal cell DNA for 33 genetic variants. Validation of identity using genomic information showed perfect concordance between SR and VS. Similar results were found for demographic data (age and sex verification). We observed strong intra-class correlation coefficients between SR and VS for anthropometric data (height 0.990, weight 0.994 and BMI 0.983). However, internet-based SR weight was under-reported (Δ −0.70 kg [−3.6 to 2.1], p < 0.0001) and, therefore, BMI was lower for SR data (Δ −0.29 kg m−2 [−1.5 to 1.0], p < 0.0001). BMI classification was correct in 93 % of cases. We demonstrate the utility of genotype information for detection of possible identity fraud in e-health studies and confirm the reliability of internet-based, SR anthropometric and demographic data collected in the Food4Me study.

Simple measures of climate, soil properties and plant traits predict national scale grassland soil carbon stocks

1. Soil carbon (C) storage is a key ecosystem service. Soil C stocks play a vital role in soil fertility and climate regulation, but the factors that control these stocks at regional and national scales are unknown, particularly when their composition and stability are considered. As a result, their mapping relies on either unreliable proxy measures or laborious direct measurements. 2. Using data from an extensive national survey of English grasslands we show that surface soil (0-7cm) C stocks in size fractions of varying stability can be predicted at both regional and national scales from plant traits and simple measures of soil and climatic conditions. 3. Soil C stocks in the largest pool, of intermediate particle size (50-250 µm), were best explained by mean annual temperature (MAT), soil pH and soil moisture content. The second largest C pool, highly stable physically and biochemically protected particles (0.45-50 µm), was explained by soil pH and the community abundance weighted mean (CWM) leaf nitrogen (N) content, with the highest soil C stocks under N rich vegetation. The C stock in the small active fraction (250-4000 µm) was explained by a wide range of variables: MAT, mean annual precipitation, mean growing season length, soil pH and CWM specific leaf area; stocks were higher under vegetation with thick and/or dense leaves. 4. Testing the models describing these fractions against data from an independent English region indicated moderately strong correlation between predicted and actual values and no systematic bias, with the exception of the active fraction, for which predictions were inaccurate. 5. Synthesis and Applications: Validation indicates that readily available climate, soils and plant survey data can be effective in making local- to landscape-scale (1-100,000 km2) soil C stock predictions. Such predictions are a crucial component of effective management strategies to protect C stocks and enhance soil C sequestration.

Development and validation of the Morphing Fear Questionnaire (MFQ)

Morphing fears (also called transformation obsessions) involve concerns that a person may become contaminated by and acquire undesirable characteristics of others. These symptoms are found in patients with OCD and are thought to be related to mental contamination. Given the high levels of distress and interference morphing fears can cause, a reliable and valid assessment measure is needed. This article describes the development and evaluation of the Morphing Fear Questionnaire (MFQ), a 13-item measure designed to assess for the presence and severity of morphing fears. A sample of 900 participants took part in the research. Of these, 140 reported having a current diagnosis of OCD (SR-OCD) and 760 reported never having had OCD (N-OCD; of whom 24 reported a diagnosis of an anxiety disorder and 23 reported a diagnosis of depression). Factor structure, reliability, and construct and criterion related validity were investigated. Exploratory and confirmatory factor analyses supported a one-factor structure replicable across the N-OCD and SR-OCD group. The MFQ was found to have high internal consistency and good temporal stability, and showed significantly greater associations with convergent measures (assessing obsessive-compulsive symptoms, mental contamination, thought-action fusion and magical thinking) than with divergent measures (assessing depression and anxiety). Moreover, the MFQ successfully discriminated between the SR-OCD sample and the N-OCD group, anxiety disorder sample, and depression sample. These findings suggest that the MFQ has sound psychometric properties and that it can be used to assess morphing fear. Clinical implications are discussed.

A new short and simple health-related quality of life measurement for paediatric rheumatic diseases: initial validation in juvenile idiopathic arthritis

Objective. To develop and validate a new short and simple measure of health-related quality of life (HRQL) in children with juvenile idiopathic arthritis (JIA).Methods. The Paediatric Rheumatology Quality of Life Scale (PRQL) is a 10-item questionnaire that explores HRQL in two domains: physical health (PhH) and psychosocial health (PsH). Validation of the parent proxy report and child self-report versions of the instrument was accomplished by evaluating 472 JIA patients and similar to 800 healthy children. Validation analyses included assessment of feasibility, face and content validity; construct and discriminative ability; internal structure and consistency; test-retest reliability; responsiveness to clinical change; and minimal clinically important difference.Results. The PRQL was found to be feasible and to possess both face and content validity. The PRQL score correlated in the predicted range with most of the other JIA outcome measures, thereby demonstrating good construct validity, and discriminated well between different levels of disease severity. Assessment of internal structure (factor analysis) revealed that the PhH and PsH subscales identify two unambiguously separated domains. The internal consistency (Cronbach's alpha) was 0.86. The intraclass correlation coefficient for test-retest reliability was 0.91. The PRQL revealed fair responsiveness, with a standardized response mean of 0.67 in improved patients. Overall, the PRQL appeared to be more able to capture physical HRQL than psychosocial HRQL.Conclusion. The PRQL was found to possess good measurement properties and is, therefore, a valid instrument for the assessment of HRQL in children with JIA. This tool is primarily proposed for use in standard clinical care.

The Pediatric Rheumatology International Trials Organization American-College-of-Rheumatology provisional criteria for the evaluation of response to therapy in juvenile systemic lupus erythematosus: Prospective validation of the definition of improvement

Objective. To use the Pediatric Rheumatology International Trials Organization (PRINTO) core set of outcome measures to develop a validated definition of improvement for the evaluation of response to therapy in juvenile systemic lupus erythematosus (SLE).Methods. Thirty-seven experienced pediatric rheumatologists from 27 countries, each of whom had specific experience in the assessment of juvenile SLE patients, achieved consensus on 128 patient profiles as being clinically improved or not improved. Using the physicians' consensus ratings as the gold standard measure, the chi-square, sensitivity, specificity, false-positive and false-negative rates, area under the receiver operating characteristic curve, and kappa level of agreement for 597 candidate definitions of improvement were calculated. Only definitions with a kappa value greater than 0.7 were retained. The top definitions were selected based on the product of the content validity score multiplied by its kappa statistic.Results. The definition of improvement with the highest final score was at least 50% improvement from baseline in any 2 of the 5 core set measures, with no more than 1 of the remaining worsening by more than 30%.Conclusion. PRINTO proposes a valid and reproducible definition of improvement that reflects well the consensus rating of experienced clinicians and that incorporates clinically meaningful change in core set measures in a composite end point for the evaluation of global response to therapy in patients with juvenile SLE. The definition is now proposed for use in juvenile SLE clinical trials and may help physicians to decide whether a child with SLE responded adequately to therapy.

Preliminary core sets of measures for disease activity and damage assessment in juvenile systemic lupus erythematosus and juvenile dermatomyositis

Objective. To identify preliminary core sets of outcome variables for disease activity and damage assessment in juvenile systemic lupus erythematosus (JSLE) and juvenile dermatomyositis (JDM). Methods. Two questionnaire surveys were mailed to 267 physicians from 46 different countries asking each member to select and rank the response variables used when assessing clinical response in patients with JSLE or JDM. Next, 40 paediatric rheumatologists from 34 countries met and, using the nominal group technique, selected the domains to be included in the disease activity and damage core sets for JSLE and JDM. Results. A total of 41 response variables for JSLE and 37 response variables for JDM were selected and ranked through the questionnaire surveys. In the consensus conference, domains selected for both JSLE and JDM activity or damage core sets included the physician and parent/patient subjective assessments and a global score tool. Domains specific for JSLE activity were the immunological tests and the kidney function parameters. Concerning JDM, functional ability and muscle strength assessments were indicated for both activity and damage core sets, whereas serum muscle enzymes were included only in the activity core set. A specific paediatric domain called 'growth and development' was introduced in the disease damage core set for both diseases and the evaluation of health-related quality of life was advised in order to capture the influence of the disease on the patient lifestyle. Conclusions. We developed preliminary core sets of measures for disease activity and damage assessment in JSLE and JDM. The prospective validation of the core sets is in progress.

Using phenological cameras to track the green up in a cerrado savanna and its on-the-ground validation

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Cross-cultural adaptation and assessment of the reliability and validity of the Core Outcome Measures Index (COMI) for the Brazilian-Portuguese language

The use of patient-orientated questionnaires is of utmost importance in assessing the outcome of spine surgery. Standardisation, using a common set of outcome measures, is essential to aid comparisons across studies/in registries. The Core Outcome Measures Index (COMI) is a short, multidimensional outcome instrument validated for patients with spinal disorders. This study aimed to produce a Brazilian-Portuguese version of the COMI. A cross-cultural adaptation of the COMI into Brazilian-Portuguese was carried out using established guidelines. 104 outpatients with chronic LBP (> 3 months) were recruited from a Public Health Spine Medical Care Centre. They completed a questionnaire booklet containing the newly translated COMI, and other validated symptom-specific questionnaires: Oswestry Disability Index (ODI) and Roland Morris disability scale (RM), and a pain visual analogue scale. All patients completed a second questionnaire within 7-10 days to assess reproducibility. The COMI summary score displayed minimal floor and ceiling effects. On re-test, the responses for each individual domain of the COMI were within 1 category in 98% patients for the domain 'function', 96% for 'symptom-specific well-being', 97% for 'general quality of life', 99% for 'social disability' and 100% for 'work disability'. The intraclass correlation coefficients (ICC2,1) for COMI pain and COMI summary scores were 0.91-0.96, which compared favourably with the corresponding values for the RM (ICC, 0.99) and ODI (ICC, 0.98). The standard error of measurement for the COMI was 0.6, giving a "minimum detectable change" (MDC95%) of approximately 1.7 points i.e., the minimum change to be considered "real change" beyond measurement error. The COMI scores correlated as hypothesised (Rho, 0.4-0.8) with the other symptom-specific questionnaires. The reproducibility of the Brazilian-Portuguese version of the COMI was comparable to that of other language versions. The COMI scores correlated in the expected manner with existing but longer symptom-specific questionnaires suggesting good convergent validity for the COMI. The Brazilian-Portuguese COMI represents a valuable tool for Brazilian study-centres in future multicentre clinical studies and surgical registries.

Translation and Cross-cultural Adaptation of the Lower Extremity Functional Scale Into a Brazilian Portuguese Version and Validation on Patients With Knee Injuries

STUDY DESIGN: Clinical measurement. OBJECTIVE: To translate and culturally adapt the Lower Extremity Functional Scale (LEFS) into a Brazilian Portuguese version, and to test the construct and content validity and reliability of this version in patients with knee injuries. BACKGROUND: There is no Brazilian Portuguese version of an instrument to assess the function of the lower extremity after orthopaedic injury. METHODS: The translation of the original English version of the LEFS into a Brazilian Portuguese version was accomplished using standard guidelines and tested in 31 patients with knee injuries. Subsequently, 87 patients with a variety of knee disorders completed the Brazilian Portuguese LEES, the Medical Outcomes Study 36-Item Short-Form Health Survey, the Western Ontario and McMaster Universities Osteoarthritis Index, and the International Knee Documentation Committee Subjective Knee Evaluation Form and a visual analog scale for pain. All patients were retested within 2 days to determine reliability of these measures. Validation was assessed by determining the level of association between the Brazilian Portuguese LEFS and the other outcome measures. Reliability was documented by calculating internal consistency, test-retest reliability, and standard error of measurement. RESULTS: The Brazilian Portuguese LEES had a high level of association with the physical component of the Medical Outcomes Study 36-Item Short-Form Health Survey (r = 0.82), the Western Ontario and McMaster Universities Osteoarthritis Index (r = 0.87), the International Knee Documentation Committee Subjective Knee Evaluation Form (r = 0.82), and the pain visual analog scale (r = -0.60) (all, P<.05). The Brazilian Portuguese LEES had a low level of association with the mental component of the Medical Outcomes Study 36-Item Short-Form Health Survey (r = 0.38, P<.05). The internal consistency (Cronbach alpha = .952) and test-retest reliability (intraclass correlation coefficient = 0.957) of the Brazilian Portuguese version of the LEES were high. The standard error of measurement was low (3.6) and the agreement was considered high, demonstrated by the small differences between test and retest and the narrow limit of agreement, as observed in Bland-Altman and survival-agreement plots. CONCLUSION: The translation of the LEFS into a Brazilian Portuguese version was successful in preserving the semantic and measurement properties of the original version and was shown to be valid and reliable in a Brazilian population with knee injuries. J Ort hop Sports Phys Ther 2012;42(11):932-939, Epub 9 October 2012. doi:10.2519/jospt.2012.4101