Reliability of retinal vessel calibre measurements using a retinal oximeter

Background: Summarised retinal vessel diameters are linked to systemic vascular pathology. Monochromatic images provide best contrast to measure vessel calibres. However, when obtaining images with a dual wavelength oximeter the red-free image can be extracted as the green channel information only which in turn will reduce the number of photographs taken at a given time. This will reduce patient exposure to the camera flash and could provide sufficient quality images to reliably measure vessel calibres. Methods: We obtained retinal images of one eye of 45 healthy participants. Central retinal arteriolar and central retinal venular equivalents (CRAE and CRVE, respectively) were measured using semi-automated software from two monochromatic images: one taken with a red-free filter and one extracted from the green channel of a dual wavelength oximetry image. Results: Participants were aged between 21 and 62 years, all were normotensive (SBP: 115 (12) mmHg; DBP: 72 (10) mmHg) and had normal intra-ocular pressures (12 (3) mmHg). Bland-Altman analysis revealed good agreement of CRAE and CRVE as obtained from both images (mean bias CRAE = 0.88; CRVE = 2.82). Conclusions: Summarised retinal vessel calibre measurements obtained from oximetry images are in good agreement to those obtained using red-free photographs.

Development of an instrument to measure high school students' global awareness and attitudes: Looking through the lens of social sciences

The purpose of this study was to develop an instrument to measure high school students’ perspectives on global awareness and attitudes toward social issues. The research questions that guided this study were: (a) Can acceptable validity and reliability estimates be established for an instrument developed to measure high schools students' global awareness? (b) Can acceptable validity and reliability estimates be established for an instrument developed to measure high schools students' attitudes towards global social issues? (c) What is the relationship between high school students’ GPA, race/ethnicity, gender, socio-economic status, parents’ education, getting the news, reading and listening habits, the number of classes taken in the social sciences, whether they speak a second language, and have experienced living in or visiting other countries, and their perception of global awareness and attitudes toward global social issues. ^ An ex post facto research design was used and the data were collected using a 4-part Likert-type survey. It was administered to 14 schools in the Miami-Dade County, Florida area to 704 students. A factor analysis with an orthogonal varimax rotation was vii used to select the factors that best represented the three constructs – global education, global citizenship, and global workforce. This was done to establish construct validity. Cronbach’s alpha was used to determine the reliability of the instrument. Descriptive statistics and a hierarchical multiple regression were used for the demographics to establish their relationship, if any, to the findings. ^ Key findings of the study were that reliable and valid estimates can be developed for the instrument. The multiple regression analysis for model 1 and 2 accounted for a variance of 3% and 5% for self-perceptions of global awareness (factor 1). The regression model also accounted for a 5% and 13% variance in the two models for attitudes toward global social issues (factor 2). The demographics that were statistically significant were: ethnicity, gender, SES, parents’ education, listening to music, getting the news, speaking a second language, GPA, classes taken in the social sciences, and visiting other countries. An important finding for the study was those attending public schools (as opposed to private schools) had more positive attitudes towards global social issues (factor 2) The statistics indicated that these students had taken history, economics, and social studies – a curriculum infused with global perspectives.^

The development of rubrics to measure undergraduate students' global awareness and global perspective: A validity study

Higher education institutions across the United States have developed global learning initiatives to support student achievement of global awareness and global perspective, but assessment options for these outcomes are extremely limited. A review of research for a global learning initiative at a large, Hispanic-serving, urban, public, research university in South Florida found a lack of instruments designed to measure global awareness and global perspective in the context of an authentic performance assessment. This quasi-experimental study explored the development of two rubrics for the global learning initiative and the extent to which evidence supported the rubrics' validity and reliability. One holistic rubric was developed to measure students' global awareness and the second to measure their global perspective. The study utilized a pretest/posttest nonequivalent group design. Multiple linear regression was used to ascertain the rubrics' ability to discern and compare average learning gains of undergraduate students enrolled in two global learning courses and students enrolled in two non-global learning courses. Parallel pretest/posttest forms of the performance task required students to respond to two open-ended questions, aligned with the learning outcomes, concerning a complex case narrative. Trained faculty raters read responses and used the rubrics to measure students' global awareness and perspective. Reliability was tested by calculating the rates of agreement among raters. Evidence supported the finding that the global awareness and global perspective rubrics yielded scores that were highly reliable measures of students' development of these learning outcomes. Chi-square tests of frequency found significant rates of inter-rater agreement exceeding the study's .80 minimum requirement. Evidence also supported the finding that the rubrics yielded scores that were valid measures of students' global awareness and global perspective. Regression analyses found little evidence of main effects; however, post hoc analyses revealed a significant interaction between global awareness pretest scores and the treatment, the global learning course. Significant interaction was also found between global perspective pretest scores and the treatment. These crossover interactions supported the finding that the global awareness and global perspective rubrics could be used to detect learning differences between the treatment and control groups as well as differences within the treatment group.

Reliability of the Clinical Application of a Mechanical Inclinometer in Measuring Glenohumeral Motion

Objective: Establish intra- and inter-examiner reliability of glenohumeral range of motion (ROM) measures taken by a single-clinician using a mechanical inclinometer. Design: A single-session, repeated-measure, randomized, counterbalanced design. Setting: Athletic Training laboratory. Participants: Ten college-aged volunteers (9 right-hand dominant; 4 males, 6 females; age=23.2±2.4y, mass=73±16kg, height=170±8cm) without shoulder or neck injuries within one year. Interventions: Two Certified Athletic Trainers separately assessed passive glenohumeral (GH) internal (IR) and external (ER) rotation bilaterally. Each clinician secured the inclinometer to each subject’s distal forearm using elastic straps. Clinicians followed standard procedures for assessing ROM, with the participants supine on a standard treatment table with 90° of elbow flexion. A second investigator recorded the angle. Clinicians measured all shoulders once to assess inter-clinician reliability and eight shoulders twice to assess intra-clinician reliability. We used SPSS 14.0 (SPSS Inc., Chicago, IL) to calculate standard error of measure (SEM) and Intraclass Correlation Coefficients (ICC) to evaluate intra- and inter-clinician reliability. Main Outcome Measures: Dependent variables were degrees of IR, ER, glenohumeral internal rotation deficit (GIRD) and total arc of rotation. We calculated GIRD as the bilateral difference in IR (nondominant–dominant) and total arc for each shoulder (IR+ER). Results: Intra-clinician reliability for each examiner was excellent (ICC[1,1] range=0.90-0.96; SEM=2.2°-2.5°) for all measures. Examiners displayed excellent inter-clinician reliability (ICC[2,1] range=0.79-0.97; SEM=1.7°-3.0°) for all measures except nondominant IR which had good reliability(0.72). Conclusions: Results suggest that clinicians can achieve reliable measures of GH rotation and GIRD using a single-clinician technique and an inexpensive, readily available mechanical inclinometer.

The development and preliminary testing of an instrument to measure the perceived economic burden of a subtype of arrhythmogenic right ventricular cardiomyopathy (ARVC) on patients and families in Newfoundland

The goal of this thesis was to develop, construct, and validate the Perceived Economic Burden scale to quantitatively measure the burden associated with a subtype Arrhythmogenic Right Ventricular Cardiomyopathy (ARVC) in families from the island of Newfoundland. An original 76 item self-administered survey was designed using content from existing literature as well as themes from qualitative research conducted by our team and distributed to individuals of families known to be at risk for the disease. A response rate of 37.2% (n = 64) was achieved between December 2013 and May 2014. Tests for data quality, Likert scale assumptions and scale reliability were conducted and provided preliminary evidence of the psychometric properties of the final constructed perceived economic burden of ARVC scale comprising 62 items in five sections. Findings indicated that being an affected male was a significant predictor of increased perceived economic burden in the majority of economic burden measures. Affected males also reported an increased likelihood of going on disability and difficulty obtaining insurance. Affected females also had an increased perceived financial burden. Preliminary results suggest that a perceived economic burden exists within the ARVC population in Newfoundland.

The Reliability and Validity of a Child and Adolescent Participation in Decision Making Questionnaire

Background
There is a growing impetus across the research, policy and practice communities for children and young people to participate in decisions that affect their lives. Furthermore, there is a dearth of general instruments that measure children and young people’s views on their participation in decision making. This paper presents the reliability and validity of the Child and Adolescent Participation in Decision Making Questionnaire (CAP-DMQ) and specifically looks at a population of looked-after children where a lack of participation in decision making is an acute issue.
Methods
The participants were 151 looked after children and adolescents between 10-23 years of age who completed the 10 item CAP-DMQ. Of the participants 113 were in receipt of an advocacy service that had an aim of increasing participation in decision-making with the remaining participants not having received this service.
Results
The results showed that the CAP-DMQ had good reliability (Cronbach’s alpha = .94) and showed promising uni-dimensional construct validity through an exploratory factor analysis. The items in the CAP-DMQ also demonstrated good content validity by overlapping with prominent models of child and adolescent participation (Lundy 2007) and decision making (Halpern 2014). A regression analysis showed that age and gender were not significant predictors of CAP-DMQ scores but receipt of advocacy was a significant predictor of scores (effect size d=.88), thus showing appropriate discriminant criterion validity.
Conclusion
Overall, the CAP-DMQ showed good reliability and validity. Therefore, the measure has excellent promise for theoretical investigation in the area of child and adolescent participation in decision making and equally shows empirical promise for use as a measure in evaluating services which have increasing the participation of children and adolescents in decision making as an intended outcome.

Response process and test-retest reliability of the Context Assessment for Community Health tool in Vietnam

BACKGROUND: The recently developed Context Assessment for Community Health (COACH) tool aims to measure aspects of the local healthcare context perceived to influence knowledge translation in low- and middle-income countries. The tool measures eight dimensions (organizational resources, community engagement, monitoring services for action, sources of knowledge, commitment to work, work culture, leadership, and informal payment) through 49 items. OBJECTIVE: The study aimed to explore the understanding and stability of the COACH tool among health providers in Vietnam. DESIGNS: To investigate the response process, think-aloud interviews were undertaken with five community health workers, six nurses and midwives, and five physicians. Identified problems were classified according to Conrad and Blair's taxonomy and grouped according to an estimation of the magnitude of the problem's effect on the response data. Further, the stability of the tool was examined using a test-retest survey among 77 respondents. The reliability was analyzed for items (intraclass correlation coefficient (ICC) and percent agreement) and dimensions (ICC and Bland-Altman plots). RESULTS: In general, the think-aloud interviews revealed that the COACH tool was perceived as clear, well organized, and easy to answer. Most items were understood as intended. However, seven prominent problems in the items were identified and the content of three dimensions was perceived to be of a sensitive nature. In the test-retest survey, two-thirds of the items and seven of eight dimensions were found to have an ICC agreement ranging from moderate to substantial (0.5-0.7), demonstrating that the instrument has an acceptable level of stability. CONCLUSIONS: This study provides evidence that the Vietnamese translation of the COACH tool is generally perceived to be clear and easy to understand and has acceptable stability. There is, however, a need to rephrase and add generic examples to clarify some items and to further review items with low ICC.

Preliminary Development and Psychometric Evaluation of the ACL Scale: Factor Structure, Measurement Invariance, Reliability, and Validity

Thesis (Master's)--University of Washington, 2016-08

Validity and reliability of a pictorial instrument for assessing perceived motor competence in Portuguese children

It is important to assess young children's perceived Fundamental Movement Skill (FMS) competence in order to examine the role of perceived FMS competence in motivation toward physical activity. Children's perceptions of motor competence may vary according to the culture/country of origin; therefore, it is also important to measure perceptions in different cultural contexts. The purpose was to assess the face validity, internal consistency, test–retest reliability and construct validity of the 12 FMS items in the Pictorial Scale for Perceived Movement Skill Competence for Young Children (PMSC) in a Portuguese sample. Methods Two hundred one Portuguese children (girls, n = 112), 5 to 10 years of age (7.6 ± 1.4), participated. All children completed the PMSC once. Ordinal alpha assessed internal consistency. A random subsamples (n = 47) were reassessed one week later to determine test–retest reliability with Bland–Altman method. Children were asked questions after the second administration to determine face validity. Construct validity was assessed on the whole sample with a Bayesian Structural Equation Modelling (BSEM) approach. The hypothesized theoretical model used the 12 items and two hypothesized factors: object control and locomotor skills. Results The majority of children correctly identified the skills and could understand most of the pictures. Test–retest reliability analysis was good, with an agreement ration between 0.99 and 1.02. Ordinal alpha values ranged from acceptable (object control 0.73, locomotor 0.68) to good (all FMS 0.81). The hypothesized BSEM model had an adequate fit. Conclusions The PMSC can be used to investigate perceptions of children's FMS competence. This instrument can also be satisfactorily used among Portuguese children.

Validity and reliability of the Cyber-aggression Questionnaire for Adolescents (CYBA)

Cybercrime is a growing and worrisome problem, particularly when it involves minors. Cyber-aggression among adolescents in particular can result in negative legal and psychological consequences for people involved. Therefore, it is important to have instruments to detect these incidents early and understand the problem to propose effective measures for prevention and treatment. This paper aims to design a new self-report, the Cyber-Aggression Questionnaire for Adolescents (CYBA), to evaluate the extent to which the respondent conducts aggressions through a mobile phone or the internet and analyse the factorial and criterion validity and reliability of their scores in a sample of adolescents from Asturias, Spain. The CYBA was administered to 3,148 youth aged between 12 and 18 years old along with three self-reports to measure aggression at school, impulsivity, and empathy. Regarding factorial validity, the model that best represents the structure of the CYBA consists of three factors (Impersonation, Visual-sexual Cyber-aggression, and Verbal Cyber-aggression and Exclusion) and four additional indicators of Visual Cyber-aggression-Teasing/Happy Slapping. Regarding criterion validity, the score on the CYBA correlates positively with aggression at school and impulsivity and negatively with empathy. That is the way cyber-aggression correlates with these three variables, according to previous empirical evidence. The reliability of the scores on each item and factor of the CYBA are adequate. Therefore, the CYBA offers a valid and reliable measure of cyber-aggression in adolescents.

An inter-laboratory validation of a real time PCR assay to measure host excretion of bacterial pathogens, particularly of Mycobacterium bovis

Advances in the diagnosis of Mycobacterium bovis infection in wildlife hosts may benefit the development of sustainable approaches to the management of bovine tuberculosis in cattle. In the present study, three laboratories from two different countries participated in a validation trial to evaluate the reliability and reproducibility of a real time PCR assay in the detection and quantification of M. bovis from environmental samples. The sample panels consisted of negative badger faeces spiked with a dilution series of M. bovis BCG Pasteur and of field samples of faeces from badgers of unknown infection status taken from badger latrines in areas with high and low incidence of bovine TB (bTB) in cattle. Samples were tested with a previously optimised methodology. The experimental design involved rigorous testing which highlighted a number of potential pitfalls in the analysis of environmental samples using real time PCR. Despite minor variation between operators and laboratories, the validation study demonstrated good concordance between the three laboratories: on the spiked panels, the test showed high levels of agreement in terms of positive/negative detection, with high specificity (100%) and high sensitivity (97%) at levels of 10(5) cells g(-1) and above. Quantitative analysis of the data revealed low variability in recovery of BCG cells between laboratories and operators. On the field samples, the test showed high reproducibility both in terms of positive/negative detection and in the number of cells detected, despite low numbers of samples identified as positive by any laboratory. Use of a parallel PCR inhibition control assay revealed negligible PCR-interfering chemicals co-extracted with the DNA. This is the first example of a multi-laboratory validation of a real time PCR assay for the detection of mycobacteria in environmental samples. Field studies are now required to determine how best to apply the assay for population-level bTB surveillance in wildlife.

Validation and reliability of the Japanese version of the Food Allergy Quality of Life Questionnaire - Parent Form

Background: Food allergy (FA) is a heavy burden for patients and their families and can significantly reduce the quality of life (QoL) of both. To provide adequate support, qualitative and quantitative evaluation of the parents' QoL may be helpful. The objective of this study is to develop and validate a Japanese version of the Food Allergy QoL QuestionnaireeParent Form (FAQLQ-PF-J), an internationally validated disease-specific QoL measurement of the parental burden of having a child with FA. Methods: The FAQLQ-PF and the Food Allergy Independent Measure (FAIM), an instrument to test the construct validity of the FAQLQ-PF-J, were translated into Japanese. After language validation, the questionnaires were administered to parents of FA children aged 0e12 years and those of age-matched healthy (without FA) children. Internal consistency (by Cronbach's a) and test-retest reliability were evaluated. Construct validity and discriminant validity were also examined. Results: One hundred twenty-seven parents of children with FA and 48 parents of healthy children filled out the questionnaire. The FAQLQ-PF-J showed excellent internal consistency (Cronbach's a > 0.77) and test-retest reliability. Good construct validity was demonstrated by significant correlations between the FAQLQ-PF-J and FAIM-J scores. It discriminated parents of children with FA from those without. The scores were significantly higher (lower QoL) for parents of FA children with a history of anaphylaxis than those without, for those with >6 FA-related symptoms experienced than those with less FA-related symptoms. Conclusions: The FAQLQ-PF-J is a reliable and valid measure of the parental burden of FA in children.

Validity and reliability of the international fItness scale (IFIS) in a population-based sample of schoolchildren in Bogota, Colombia: The FUPRECOL study

The International FItness Scale (IFIS) is a self-reported measure of physical fitness that could easily. This scale has been validated in children, adolescents, and young adults; however, it is unknown whether the IFIS represents a valid and reliable estimate of physical fitness in Latino-American youth population. In the present study we aimed to examine the validity and reliability of the IFIS on a population-based sample of schoolchildren in Bogota, Colombia. Participants were 1,875 Colombian youth (56.2% girls) aged 9 to 17.9 years old. We measured adiposity markers (body fat, waist-to-height ratio, skinfold thicknesses and BMI), blood pressure, lipids profile, fasting glucose, and physical fitness level (self reported and measured). Also, a validated cardiometabolic risk index was used. An age- and sex-matched sample of 229 Schoolchildren originally not included in the study sample fulfilled IFIS twice for reliability purposes. Our data suggest that both measured and self-reported overall fitness were associated inversely with adiposity indicators and a cardiometabolic risk score. Overall, schoolchildren who self-reported “good” and “very good” fitness had better measured fitness than those who reported “very poor” and “poor” fitness (all p<0.001). Test–retest reliability of IFIS items was also good, with an average weighted Kappa of 0.811. Therefore, our findings suggest that self-reported fitness, as assessed by IFIS, is a valid, reliable, and health-related measure, and it can be a good alternative for future use in large studies with Latin-schoolchildren from Colombia.

How should we measure online learning activity?

The proliferation of Web-based learning objects makes finding and evaluating resources a considerable hurdle for learners to overcome. While established learning analytics methods provide feedback that can aid learner evaluation of learning resources, the adequacy and reliability of these methods is questioned. Because engagement with online learning is different from other Web activity, it is important to establish pedagogically relevant measures that can aid the development of distinct, automated analysis systems. Content analysis is often used to examine online discussion in educational settings, but these instruments are rarely compared with each other which leads to uncertainty regarding their validity and reliability. In this study, participation in Massive Open Online Course (MOOC) comment forums was evaluated using four different analytical approaches: the Digital Artefacts for Learning Engagement (DiAL-e) framework, Bloom's Taxonomy, Structure of Observed Learning Outcomes (SOLO) and Community of Inquiry (CoI). Results from this study indicate that different approaches to measuring cognitive activity are closely correlated and are distinct from typical interaction measures. This suggests that computational approaches to pedagogical analysis may provide useful insights into learning processes.