Validity and reliability of the Portuguese version of Mandibular Function Impairment Questionnaire

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Normative reference values for the 20-meter shuttlerun test in a population-based sample of schoolchildren in Bogota, Colombia: The FUPRECOL Study

Our aim was to determine the normative reference values of cardiorespiratory fitness (CRF) and to establish the proportion of subjects with low CRF suggestive of future cardio-metabolic risk.

Translation and psychometric properties of the Chinese version of the Leeds Attitudes to Concordance II scale

Background Concordance is characterised as a negotiation-like health communication approach based on an equal and collaborative partnership between patients and health professionals. The Leeds Attitudes to Concordance II (LATCon II) scale was developed to measure the attitudes towards concordance. The purpose of this study was to translate the LATCon II into Chinese and psychometrically test the Chinese version of LATCon II (C-LATCon II). Methods The study involved three phases: i) translation and cross-cultural adaptation; ii) pilot study, and; iii) a cross-sectional survey (n = 366). Systematic random sampling was used to recruit hypertensive patients from nine communities covering around 78,000 residents in China. Tests of psychometric properties included content validity, construct validity, criteria-related validity (correlation between the C-LATCon II and the Therapeutic Adherence Scale for Hypertensive Patients (TASHP)), internal reliability, and test-retest reliability (n = 30). Results The study found that the C-LATCon II had a satisfactory content validity (item-level Content Validity Index (CVI) = 0.83-1, scale-level CVI/universal agreement = 0.89, and scale-level CVI/averaging calculation = 0.98), construct validity (four components extracted explained 56.66% of the total variance), internal reliability (Cronbach’s alpha of overall scale and four components was 0.78 and 0.66-0.84, respectively), and test-retest reliability (Pearson’s correlation coefficient = 0.82, p < 0.001; interclass correlation coefficient = 0.82, p < 0.001; linear weighted kappa3 statistic for each item = 0.40-0.65, p < 0.05). Criteria-related validity showed a weak association (Pearson’s correlation coefficient = 0.11, p < 0.05) between patients’ attitudes towards concordance during health communication and their health behaviours for hypertension management. Conclusions The C-LATCon II is a validated and reliable instrument which can be used to evaluate the attitudes to concordance in Chinese populations. Four components (health professionals’ attitudes, partnership between two parties, therapeutic decision making, and patients’ involvement) describe the attitudes towards concordance during health communication.

Validation of a Spanish version of the Spine Functional Index

Background The Spine Functional Index (SFI) is a recently published, robust and clinimetrically valid patient reported outcome measure. Objectives The purpose of this study was the adaptation and validation of a Spanish-version (SFI-Sp) with cultural and linguistic equivalence. Methods A two stage observational study was conducted. The SFI was cross-culturally adapted to Spanish through double forward and backward translation then validated for its psychometric characteristics. Participants (n = 226) with various spine conditions of >12 weeks duration completed the SFI-Sp and a region specific measure: for the back, the Roland Morris Questionnaire (RMQ) and Backache Index (BADIX); for the neck, the Neck Disability Index (NDI); for general health the EQ-5D and SF-12. The full sample was employed to determine internal consistency, concurrent criterion validity by region and health, construct validity and factor structure. A subgroup (n = 51) was used to determine reliability at seven days. Results The SFI-Sp demonstrated high internal consistency (α = 0.85) and reliability (r = 0.96). The factor structure was one-dimensional and supported construct validity. Criterion specific validity for function was high with the RMQ (r = 0.79), moderate with the BADIX (r = 0.59) and low with the NDI (r = 0.46). For general health it was low with the EQ-5D and inversely correlated (r = −0.42) and fair with the Physical and Mental Components of the SF-12 and inversely correlated (r = −0.56 and r = −0.48), respectively. The study limitations included the lack of longitudinal data regarding other psychometric properties, specifically responsiveness. Conclusions The SFI-Sp was demonstrated as a valid and reliable spine-regional outcome measure. The psychometric properties were comparable to and supported those of the English-version, however further longitudinal investigations are required.

Patient reported adherence to hypertension treatment: A revalidation study

Background Adherence to hypertension management in patients with hypertension is known to influence their blood pressure control. It is important to measure patients’ adherence behaviours to assist with designing appropriate interventions to improve blood pressure control. Aims The purposes of this study were to use confirmatory factor analysis to revalidate the Therapeutic Adherence Scale for Hypertensive Patients (TASHP), and to calculate the cut-off score for classifying adherence behaviours into two groups: satisfactory and low adherence behaviours. Methods Systematic random sampling was used to recruit patients with hypertension in China. Demographic characteristics, the TASHP and blood pressure were collected. The psychometric tests of the TASHP included: construct validity, criteria-related validity, internal reliability, and split-half reliability. The area under the receiver operating characteristics curve and Youden index were used to identify the cut-off score of the TASHP for blood pressure control. Results This study involved 366 patients. Confirmatory factor analysis supported the four-component structure of the TASHP proposed in the original scale development study. The TASHP has a satisfactory internal reliability (Cronbach’s α > 0.7) and a satisfactory split-half reliability (Spearman–Brown coefficients > 0.7). The patients with overall scores of the TASHP ⩾ 109 points were considered to have satisfactory adherence behaviours. Conclusion The TASHP is a validated and reliable instrument to measure the adherence to hypertension management in Chinese patients with hypertension. The cut-off score of 109 points can be considered as an effective measure to classify the level of adherence into satisfactory and low adherence behaviours.

Symptom burden in individuals with inflammatory bowel disease: a mixed methods study

To investigate the symptom burden experiences of individuals with inflammatory bowel disease (IBD). An explanatory sequential mixed methods study was conducted. A cross-sectional, correlational survey was first undertaken. Symptom burden was measured using a modified disease specific version of the Memorial Symptom Assessment Scale, which was administered to a consecutive sample of individuals with IBD (n = 247) at an IBD Outpatients department in one urban teaching hospital in Ireland. Disease activity was determined using clinical disease activity indices, which were completed by the consulting physician. A sequential qualitative, descriptive study was then conducted aimed at explaining noteworthy quantitative findings. A criterion-related purposeful sample of seven participants from the quantitative study was recruited. Semi-structured face to face interviews were conducted using an interview guide and data were analysed using content analysis. Findings revealed that participants experienced a median of 10 symptoms during the last week, however as many as 16 symptoms were experienced during active disease. The most burdensome symptoms were lack of energy, bowel urgency, diarrhoea, feeling bloated, flatulence and worry. Total symptom burden was found to be low with a mean score of 0.56 identified out of a possible range from 0 to 4. Participants with active disease (M = 0.81, SD = 0.48; n = 68) had almost double mean total symptom burden scores than participants with inactive disease (M = 0.46, SD = 0.43; n = 166) (p < 0.001). Mean total psychological symptom burden was found to be significantly greater than mean total physical symptom burden (rho = 0.73, n = 247, p < 0.001). Self-reported disease control, gender, number of flare ups in the last two years, and smoking status was found to be significant predictors of total symptom burden, with self-reported disease control identified as the strongest predictor. Qualitative data revealed tiredness, pain, bowel symptoms, worry and fear as being burdensome. Furthermore, symptom burden experiences were described in terms of its impact on restricting aspects of daily activities, which accumulated into restrictions on general life events. Psychological symptom burden was revealed as more problematic than physical symptom burden due to its constant nature, with physical and psychological symptoms described to occur in a cyclical manner. Participants revealed that disease control was evaluated not only in terms of symptoms, but also in terms of their abilities to control the impact of symptoms on their lives. This study highlights the considerable number of symptoms and the most burdensome symptoms experienced by individuals with IBD, both during active and inactive disease. This study has important implications on symptom assessment in terms of the need to encompass both physical and psychological symptoms. In addition, greater attention needs to be placed on psychological aspects of IBD care.

A brief index of affective job satisfaction

This article responds to criticisms that affective job satisfaction research suffers serious measurement problems: Noncomparable measures; studies conceptualizing job satisfaction affectively but measuring it cognitively; and ad hoc measures lacking systematic development and validation, especially across populations by nationality, job level, and job type. We address these problems through a series of qualitative (total N = 28) and quantitative (total N = 901) studies to systematically develop and validate a short affective job satisfaction measure ultimately deriving from Brayfield and Rothe’s (1951) job satisfaction index. Unlike any previous job satisfaction measure, the resulting four-item Brief Index of Affective Job Satisfaction is overtly affective, minimally cognitive, and optimally brief. The new measure also differs from any previous job satisfaction measure in being comprehensively validated not just for internal consistency reliability, temporal stability, convergent and criterion-related validities, but also for cross-population invariance by nationality, job level, and job type.

Cluster identification and characterization in the riser of a circulating fluidized bed from numerical simulation results

A methodology of identification and characterization of coherent structures mostly known as clusters is applied to hydrodynamic results of numerical simulation generated for the riser of a circulating fluidized bed. The numerical simulation is performed using the MICEFLOW code, which includes the two-fluids IIT's hydrodynamic model B. The methodology for cluster characterization that is used is based in the determination of four characteristics, related to average life time, average volumetric fraction of solid, existing time fraction and frequency of occurrence. The identification of clusters is performed by applying a criterion related to the time average value of the volumetric solid fraction. A qualitative rather than quantitative analysis is performed mainly owing to the unavailability of operational data used in the considered experiments. Concerning qualitative analysis, the simulation results are in good agreement with literature. Some quantitative comparisons between predictions and experiment were also presented to emphasize the capability of the modeling procedure regarding the analysis of macroscopic scale coherent structures. (c) 2007 Elsevier B.V. All rights reserved.

Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording

This study evaluated the effect of item inversion on the construct validity and reliability of psychometric scales and proposed a theoretical framework for the evaluation of the psychometric properties of data gathered with psychometric instruments. To this propose, we used the Maslach Burnout Inventory, which is the most used psychometric inventory to measure burnout in different professional context (Students, Teachers, Police, Doctors, Nurses, etc…). The version of the MBI used was the MBI-Student Survey (MBI-SS). This inventory is composed of three key dimensions: Exhaustion, Cynicism and Professional Efficacy. The two first dimensions—which have positive formulated items—are moderate to strong positive correlated, and show moderate to strong negative correlations with the 3rd dimension—which has negative formulated items. We tested the hypothesis that, in college students, formulating the 3rd dimension of burnout as Inefficacy (reverting the negatively worded items in the Efficacy dimension) improves the correlation of the 3rd dimension with the other two dimensions, improves its internal consistency, and the overall MBI-SS’ construct validity and reliability. Confirmatory factor analysis results, estimated by Maximum Likelihood, revealed adequate factorial fit for both forms of the MBI-SS (with Efficacy) vs. the MBI-SSi (with Inefficacy). Also both forms showed adequate convergent and discriminant related validity. However, reliability and convergent validity were higher for the MBI-SSi. There were also stronger (positive) correlations between the 3 factors in MBI-SSi than the ones observed in MBI-SS. Results show that positively rewording of the 3rd dimension of the MBI-SS improves its validity and reliability. We therefore propose that the 3rd dimension of the MBI-SS should be named Professional Inefficacy and its items should be positively worded.

Validation of a measuring instrument for the perception of oral health in women

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Using complex networks concepts to assess approaches for citations in scientific papers

The number of citations received by authors in scientific journals has become a major parameter to assess individual researchers and the journals themselves through the impact factor. A fair assessment therefore requires that the criteria for selecting references in a given manuscript should be unbiased with regard to the authors or journals cited. In this paper, we assess approaches for citations considering two recommendations for authors to follow while preparing a manuscript: (i) consider similarity of contents with the topics investigated, lest related work should be reproduced or ignored; (ii) perform a systematic search over the network of citations including seminal or very related papers. We use formalisms of complex networks for two datasets of papers from the arXiv and the Web of Science repositories to show that neither of these two criteria is fulfilled in practice. By representing the texts as complex networks we estimated a similarity index between pieces of texts and found that the list of references did not contain the most similar papers in the dataset. This was quantified by calculating a consistency index, whose maximum value is one if the references in a given paper are the most similar in the dataset. For the areas of "complex networks" and "graphenes", the consistency index was only 0.11-0.23 and 0.10-0.25, respectively. To simulate a systematic search in the citation network, we employed a traditional random walk search (i.e. diffusion) and a random walk whose probabilities of transition are proportional to the number of the ingoing edges of the neighbours. The frequency of visits to the nodes (papers) in the network had a very small correlation with either the actual list of references in the papers or with the number of downloads from the arXiv repository. Therefore, apparently the authors and users of the repository did not follow the criterion related to a systematic search over the network of citations. Based on these results, we propose an approach that we believe is fairer for evaluating and complementing citations of a given author, effectively leading to a virtual scientometry.

Psychometric properties of the Beck Depression Inventory-II: a comprehensive review

OBJECTIVE: To review the psychometric properties of the Beck Depression Inventory-II (BDI-II) as a self-report measure of depression in a variety of settings and populations. METHODS: Relevant studies of the BDI-II were retrieved through a search of electronic databases, a hand search, and contact with authors. Retained studies (k = 118) were allocated into three groups: non-clinical, psychiatric/institutionalized, and medical samples. RESULTS: The internal consistency was described as around 0.9 and the retest reliability ranged from 0.73 to 0.96. The correlation between BDI-II and the Beck Depression Inventory (BDI-I) was high and substantial overlap with measures of depression and anxiety was reported. The criterion-based validity showed good sensitivity and specificity for detecting depression in comparison to the adopted gold standard. However, the cutoff score to screen for depression varied according to the type of sample. Factor analysis showed a robust dimension of general depression composed by two constructs: cognitive-affective and somatic-vegetative. CONCLUSIONS: The BDI-II is a relevant psychometric instrument, showing high reliability, capacity to discriminate between depressed and non-depressed subjects, and improved concurrent, content, and structural validity. Based on available psychometric evidence, the BDI-II can be viewed as a cost-effective questionnaire for measuring the severity of depression, with broad applicability for research and clinical practice worldwide.

Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents' well-being and health-related quality of life

Background To assess the criterion and construct validity of the KIDSCREEN-10 well-being and health-related quality of life (HRQoL) score, a short version of the KIDSCREEN-52 and KIDSCREEN-27 instruments. Methods The child self-report and parent report versions of the KIDSCREEN-10 were tested in a sample of 22,830 European children and adolescents aged 8–18 and their parents (n = 16,237). Correlation with the KIDSCREEN-52 and associations with other generic HRQoL measures, physical and mental health, and socioeconomic status were examined. Score differences by age, gender, and country were investigated. Results Correlations between the 10-item KIDSCREEN score and KIDSCREEN-52 scales ranged from r = 0.24 to 0.72 (r = 0.27–0.72) for the self-report version (proxy-report version). Coefficients below r = 0.5 were observed for the KIDSCREEN-52 dimensions Financial Resources and Being Bullied only. Cronbach alpha was 0.82 (0.78), test–retest reliability was ICC = 0.70 (0.67) for the self- (proxy-)report version. Correlations between other children self-completed HRQoL questionnaires and KIDSCREEN-10 ranged from r = 0.43 to r = 0.63 for the KIDSCREEN children self-report and r = 0.22–0.40 for the KIDSCREEN parent proxy report. Known group differences in HRQoL between physically/mentally healthy and ill children were observed in the KIDSCREEN-10 self and proxy scores. Associations with self-reported psychosomatic complaints were r = −0.52 (−0.36) for the KIDSCREEN-10 self-report (proxy-report). Statistically significant differences in KIDSCREEN-10 self and proxy scores were found by socioeconomic status, age, and gender. Conclusions Our results indicate that the KIDSCREEN-10 provides a valid measure of a general HRQoL factor in children and adolescents, but the instrument does not represent well most of the single dimensions of the original KIDSCREEN-52. Test–retest reliability was slightly below a priori defined thresholds.

Towards criterion validity in classroom language analysis: methodological constraints of metadiscourse and inter-rater agreement

This paper reports on a process to validate a revised version of a system for coding classroom discourse in foreign language lessons, a context in which the dual role of language (as content and means of communication) and the speakers' specific pedagogical aims lead to a certain degree of ambiguity in language analysis. The language used by teachers and students has been extensively studied, and a framework of concepts concerning classroom discourse well-established. Models for coding classroom language need, however, to be revised when they are applied to specific research contexts. The application and revision of an initial framework can lead to the development of earlier models, and to the re-definition of previously established categories of analysis that have to be validated. The procedures followed to validate a coding system are related here as guidelines for conducting research under similar circumstances. The advantages of using instruments that incorporate two types of data, that is, quantitative measures and qualitative information from raters' metadiscourse, are discussed, and it is suggested that such procedure can contribute to the process of validation itself, towards attaining reliability of research results, as well as indicate some constraints of the adopted research methodology.

Metaheuristic approaches to the hybrid flow shop scheduling problem with a cost-related criterion

In the paper, the flow-shop scheduling problem with parallel machines at each stage (machine center) is studied. For each job its release and due date as well as a processing time for its each operation are given. The scheduling criterion consists of three parts: the total weighted earliness, the total weighted tardiness and the total weighted waiting time. The criterion takes into account the costs of storing semi-manufactured products in the course of production and ready-made products as well as penalties for not meeting the deadlines stated in the conditions of the contract with customer. To solve the problem, three constructive algorithms and three metaheuristics (based one Tabu Search and Simulated Annealing techniques) are developed and experimentally analyzed. All the proposed algorithms operate on the notion of so-called operation processing order, i.e. the order of operations on each machine. We show that the problem of schedule construction on the base of a given operation processing order can be reduced to the linear programming task. We also propose some approximation algorithm for schedule construction and show the conditions of its optimality.