The accuracy of self-reported medical history: A preliminary analysis of the promise of internet-based research in Inflammatory Bowel Diseases

BACKGROUND AND AIMS: Internet-based surveys provide a potentially important tool for Inflammatory Bowel Disease (IBD) research. The advantages include low cost, large numbers of participants, rapid study completion and less extensive infrastructure than traditional methods. The aim was to determine the accuracy of patient self-reporting in internet-based IBD research and identify predictors of greater reliability. METHODS: 197 patients from a tertiary care center answered an online survey concerning personal medical history and an evaluation of disease specific knowledge. Self-reported medical details were compared with data abstracted from medical records. Agreement was assessed by kappa (κ) statistics. RESULTS: Participants responded correctly with excellent agreement (κ=0.96-0.97) on subtype of IBD and history of surgery. The agreement was also excellent for colectomy (κ=0.88) and small bowel resection (κ=0.91), moderate for abscesses and fistulas (κ=0.60 and 0.63), but poor regarding partial colectomy (κ=0.39). Time since last colonoscopy was self-reported with better agreement (κ=0.84) than disease activity. For disease location/extent, moderate agreements at κ=69% and 64% were observed for patients with Crohn's disease and ulcerative colitis, respectively. Subjects who scored higher than the average in the IBD knowledge assessment were significantly more accurate about disease location than their complementary group (74% vs. 59%, p=0.02). CONCLUSION: This study demonstrates that IBD patients accurately report their medical history regarding type of disease and surgical procedures. More detailed medical information is less reliably reported. Disease knowledge assessment may help in identifying the most accurate individuals and could therefore serve as validity criteria. Internet-based surveys are feasible with high reliability about basic disease features only. However, the participants in this study were engaged at a tertiary center, which potentially leads to a bias and compromises generalization to an unfiltered patient group.

Quantitative analysis of fluorescence lifetime measurements of the macula using the fluorescence lifetime imaging ophthalmoscope in healthy subjects.

PURPOSE Fundus autofluorescence (FAF) cannot only be characterized by the intensity or the emission spectrum, but also by its lifetime. As the lifetime of a fluorescent molecule is sensitive to its local microenvironment, this technique may provide more information than fundus autofluorescence imaging. We report here the characteristics and repeatability of FAF lifetime measurements of the human macula using a new fluorescence lifetime imaging ophthalmoscope (FLIO). METHODS A total of 31 healthy phakic subjects were included in this study with an age range from 22 to 61 years. For image acquisition, a fluorescence lifetime ophthalmoscope based on a Heidelberg Engineering Spectralis system was used. Fluorescence lifetime maps of the retina were recorded in a short- (498-560 nm) and a long- (560-720 nm) spectral channel. For quantification of fluorescence lifetimes a standard ETDRS grid was used. RESULTS Mean fluorescence lifetimes were shortest in the fovea, with 208 picoseconds for the short-spectral channel and 239 picoseconds for the long-spectral channel, respectively. Fluorescence lifetimes increased from the central area to the outer ring of the ETDRS grid. The test-retest reliability of FLIO was very high for all ETDRS areas (Spearman's ρ = 0.80 for the short- and 0.97 for the long-spectral channel, P < 0.0001). Fluorescence lifetimes increased with age. CONCLUSIONS The FLIO allows reproducible measurements of fluorescence lifetimes of the macula in healthy subjects. By using a custom-built software, we were able to quantify fluorescence lifetimes within the ETDRS grid. Establishing a clinically accessible standard against which to measure FAF lifetimes within the retina is a prerequisite for future studies in retinal disease.

Poor Reliability between Cochrane Reviewers and Blinded External Reviewers When Applying the Cochrane Risk of Bias Tool in Physical Therapy Trials

OBJECTIVES To test the inter-rater reliability of the RoB tool applied to Physical Therapy (PT) trials by comparing ratings from Cochrane review authors with those of blinded external reviewers. METHODS Randomized controlled trials (RCTs) in PT were identified by searching the Cochrane Database of Systematic Reviews for meta-analysis of PT interventions. RoB assessments were conducted independently by 2 reviewers blinded to the RoB ratings reported in the Cochrane reviews. Data on RoB assessments from Cochrane reviews and other characteristics of reviews and trials were extracted. Consensus assessments between the two reviewers were then compared with the RoB ratings from the Cochrane reviews. Agreement between Cochrane and blinded external reviewers was assessed using weighted kappa (κ). RESULTS In total, 109 trials included in 17 Cochrane reviews were assessed. Inter-rater reliability on the overall RoB assessment between Cochrane review authors and blinded external reviewers was poor (κ  =  0.02, 95%CI: -0.06, 0.06]). Inter-rater reliability on individual domains of the RoB tool was poor (median κ  = 0.19), ranging from κ  =  -0.04 ("Other bias") to κ  =  0.62 ("Sequence generation"). There was also no agreement (κ  =  -0.29, 95%CI: -0.81, 0.35]) in the overall RoB assessment at the meta-analysis level. CONCLUSIONS Risk of bias assessments of RCTs using the RoB tool are not consistent across different research groups. Poor agreement was not only demonstrated at the trial level but also at the meta-analysis level. Results have implications for decision making since different recommendations can be reached depending on the group analyzing the evidence. Improved guidelines to consistently apply the RoB tool and revisions to the tool for different health areas are needed.

A Comparative Analysis of Beaconless Opportunistic Routing Protocols for Video Dissemination over Flying Ad-Hoc Networks

A reliable and robust routing service for Flying Ad-Hoc Networks (FANETs) must be able to adapt to topology changes, and also to recover the quality level of the delivered multiple video flows under dynamic network topologies. The user experience on watching live videos must also be satisfactory even in scenarios with network congestion, buffer overflow, and packet loss ratio, as experienced in many FANET multimedia applications. In this paper, we perform a comparative simulation study to assess the robustness, reliability, and quality level of videos transmitted via well-known beaconless opportunistic routing protocols. Simulation results shows that our developed protocol XLinGO achieves multimedia dissemination with Quality of Experience (QoE) support and robustness in a multi-hop, multi-flow, and mobile networks, as required in many multimedia FANET scenarios.

Coloured Letters and Numbers (CLaN): A reliable factor-analysis based synaesthesia questionnaire

Synaesthesia is a heterogeneous phenomenon, even when considering one particular sub-type. The purpose of this study was to design a reliable and valid questionnaire for grapheme-colour synaesthesia that captures this heterogeneity. By the means of a large sample of 628 synaesthetes and a factor analysis, we created the Coloured Letters and Numbers (CLaN) questionnaire with 16 items loading on 4 different factors (i.e., localisation, automaticity/attention, deliberate use, and longitudinal changes). These factors were externally validated with tests which are widely used in the field of synaesthesia research. The questionnaire showed good test–retest reliability and construct validity (i.e., internally and externally). Our findings are discussed in the light of current theories and new ideas in synaesthesia research. More generally, the questionnaire is a useful tool which can be widely used in synaesthesia research to reveal the influence of individual differences on various performance measures and will be useful in generating new hypotheses.

Reliability of operational data from pig herds and performance ratings by veterinarians and pig farmers collected during telephone interviews for the evaluation of a PCV2 piglet vaccination

BackgroundThe aim of the present study was to evaluate the feasibility of using a telephone survey in gaining an understanding of the possible herd and management factors influencing the performance (i.e. safety and efficacy) of a vaccine against porcine circovirus type 2 (PCV2) in a large number of herds and to estimate customers¿ satisfaction.ResultsDatasets from 227 pig herds that currently applied or have applied a PCV2 vaccine were analysed. Since 1-, 2- and 3-site production systems were surveyed, the herds were allocated in one of two subsets, where only applicable variables out of 180 were analysed. Group 1 was comprised of herds with sows, suckling pigs and nursery pigs, whereas herds in Group 2 in all cases kept fattening pigs. Overall 14 variables evaluating the subjective satisfaction with one particular PCV2 vaccine were comingled to an abstract dependent variable for further models, which was characterized by a binary outcome from a cluster analysis: good/excellent satisfaction (green cluster) and moderate satisfaction (red cluster). The other 166 variables comprised information about diagnostics, vaccination, housing, management, were considered as independent variables. In Group 1, herds using the vaccine due to recognised PCV2 related health problems (wasting, mortality or porcine dermatitis and nephropathy syndrome) had a 2.4-fold increased chance (1/OR) of belonging to the green cluster. In the final model for Group 1, the diagnosis of diseases other than PCV2, the reason for vaccine administration being other than PCV2-associated diseases and using a single injection of iron had significant influence on allocating into the green cluster (P¿<¿0.05). In Group 2, only unchanged time or delay of time of vaccination influenced the satisfaction (P¿<¿0.05).ConclusionThe methodology and statistical approach used in this study were feasible to scientifically assess ¿satisfaction¿, and to determine factors influencing farmers¿ and vets¿ opinion about the safety and efficacy of a new vaccine.

Intra- and interlaboratory reliability of a cryopreserved trout hepatocyte assay for the prediction of chemical bioaccumulation potential

Measured rates of intrinsic clearance determined using cryopreserved trout hepatocytes can be extrapolated to the whole animal as a means of improving modeled bioaccumulation predictions for fish. To date, however, the intra- and interlaboratory reliability of this procedure has not been determined. In the present study, three laboratories determined in vitro intrinsic clearance of six reference compounds (benzo[a]pyrene, 4-nonylphenol, di-tert-butyl phenol, fenthion, methoxychlor and o-terphenyl) by conducting substrate depletion experiments with cryopreserved trout hepatocytes from a single source. O-terphenyl was excluded from the final analysis due to nonfirst-order depletion kinetics and significant loss from denatured controls. For the other five compounds, intralaboratory variability (% CV) in measured in vitro intrinsic clearance values ranged from 4.1 to 30%, while interlaboratory variability ranged from 27 to 61%. Predicted bioconcentration factors based on in vitro clearance values exhibited a reduced level of interlaboratory variability (5.3-38% CV). The results of this study demonstrate that cryopreserved trout hepatocytes can be used to reliably obtain in vitro intrinsic clearance of xenobiotics, which provides support for the application of this in vitro method in a weight-of-evidence approach to chemical bioaccumulation assessment.

Exploring the validity and reliability of a questionnaire for evaluating virtual patient design with a special emphasis on fostering clinical reasoning

Background: Virtual patients (VPs) are increasingly used to train clinical reasoning. So far, no validated evaluation instruments for VP design are available. Aims: We examined the validity of an instrument for assessing the perception of VP design by learners. Methods: Three sources of validity evidence were examined: (i) Content was examined based on theory of clinical reasoning and an international VP expert team. (ii) The response process was explored in think-aloud pilot studies with medical students and in content analyses of free text questions accompanying each item of the instrument. (iii) Internal structure was assessed by exploratory factor analysis (EFA) and inter-rater reliability by generalizability analysis. Results: Content analysis was reasonably supported by the theoretical foundation and the VP expert team. The think-aloud studies and analysis of free text comments supported the validity of the instrument. In the EFA, using 2547 student evaluations of a total of 78 VPs, a three-factor model showed a reasonable fit with the data. At least 200 student responses are needed to obtain a reliable evaluation of a VP on all three factors. Conclusion: The instrument has the potential to provide valid information about VP design, provided that many responses per VP are available.

Reliability of Quantitative Sensory Tests in a Low Back Pain Population.

BACKGROUND AND OBJECTIVES Reliability is an essential condition for using quantitative sensory tests (QSTs) in research and clinical practice, but information on reliability in patients with chronic pain is sparse. The aim of this study was to evaluate the reliability of different QST in patients with chronic low back pain. METHODS Eighty-nine patients with chronic low back pain participated in 2 identical experimental sessions, separated by at least 7 days. The following parameters were recorded: pressure pain detection and tolerance thresholds at the toe, electrical pain thresholds to single and repeated stimulation, heat pain detection and tolerance thresholds at the arm and leg, cold pain detection threshold at the arm and leg, and conditioned pain modulation using the cold pressor test.Reliability was analyzed using the coefficient of variation, the coefficient of repeatability, and the intraclass correlation coefficient. It was judged as acceptable or not based primarily on the analysis of the coefficient of repeatability. RESULTS The reliability of most tests was acceptable. Exceptions were cold pain detection thresholds at the leg and arm. CONCLUSIONS Most QST measurements have acceptable reliability in patients with chronic low back pain.

Submaximal cardiopulmonary thresholds on a robotics-assisted tilt table, a cycle and a treadmill: a comparative analysis

BACKGROUND: The robotics-assisted tilt table (RATT), including actuators for tilting and cyclical leg movement, is used for rehabilitation of severely disabled neurological patients. Following further engineering development of the system, i.e. the addition of force sensors and visual bio-feedback, patients can actively participate in exercise testing and training on the device. Peak cardiopulmonary performance parameters were previously investigated, but it also important to compare submaximal parameters with standard devices. The aim of this study was to evaluate the feasibility of the RATT for estimation of submaximal exercise thresholds by comparison with a cycle ergometer and a treadmill. METHODS: 17 healthy subjects randomly performed six maximal individualized incremental exercise tests, with two tests on each of the three exercise modalities. The ventilatory anaerobic threshold (VAT) and respiratory compensation point (RCP) were determined from breath-by-breath data. RESULTS: VAT and RCP on the RATT were lower than the cycle ergometer and the treadmill: oxygen uptake (V'O2) at VAT was [mean (SD)] 1.2 (0.3), 1.5 (0.4) and 1.6 (0.5) L/min, respectively (p < 0.001); V'O2 at RCP was 1.7 (0.4), 2.3 (0.8) and 2.6 (0.9) L/min, respectively (p = 0.001). High correlations for VAT and RCP were found between the RATT vs the cycle ergometer and RATT vs the treadmill (R on the range 0.69-0.80). VAT and RCP demonstrated excellent test-retest reliability for all three devices (ICC from 0.81 to 0.98). Mean differences between the test and retest values on each device were close to zero. The ventilatory equivalent for O2 at VAT for the RATT and cycle ergometer were similar and both were higher than the treadmill. The ventilatory equivalent for CO2 at RCP was similar for all devices. Ventilatory equivalent parameters demonstrated fair-to-excellent reliability and repeatability. CONCLUSIONS: It is feasible to use the RATT for estimation of submaximal exercise thresholds: VAT and RCP on the RATT were lower than the cycle ergometer and the treadmill, but there were high correlations between the RATT vs the cycle ergometer and vs the treadmill. Repeatability and test-retest reliability of all submaximal threshold parameters from the RATT were comparable to those of standard devices.

Coherence and Historical understanding in children's Biography and Historical Nonfiction Literature: A Content Analysis of Selected Orbis Pictus Books

The purpose of this study was to investigate a selection of children's historical nonfiction literature for evidence of coherence. Although research has been conducted on coherence of textbook material and its influences on comprehension there has been limited study on coherence in children's nonfiction literature. Generally, textual coherence has been seen as critical in the comprehensibility of content area textbooks because it concerns the unity of connections among ideas and information. Disciplinary coherence concerns the extent to which authors of historical text show readers how historians think and write. Since young readers are apprentices in learning historical content and conventions of historical thinking, evidence of disciplinary coherence is significant in nonfiction literature for young readers. The sample of the study contained 32 books published between 1989 and 2000 ranging in length from less than 90 pages to more than 150 pages. Content analysis was the quantitative research technique used to measure 84 variables of textual and disciplinary coherence in three passages of each book, as proportions of the total number of words for each book. Reliability analyses and an examination of 750 correlations showed the extent to which variables were related in the books. Three important findings emerged from the study that should be considered in the selection and use of children's historical nonfiction literature in classrooms. First, characteristics of coherence are significantly related together in high quality nonfiction literature. Second, shorter books have a higher proportion of textual coherence than longer books as measured in three passages. Third, presence of the author is related to characteristics of coherence throughout the books. The findings show that nonfiction literature offers students content that researchers have found textbooks lack. Both younger and older students have the opportunity to learn the conventions of historical thinking as they learn content through nonfiction literature. Further, the children's literature, represented in the Orbis Pictus list, shows students that authors select, interpret, and question information, and give other interpretations. The implications of the study for teaching history, teacher preparation in content and literacy, school practices, children's librarians, and publishers of children's nonfiction are discussed.

Reliability studies of the skew normal distribution

It has been observed in various practical applications that data do not conform to the normal distribution, which is symmetric with no skewness. The skew normal distribution proposed by Azzalini(1985) is appropriate for the analysis of data which is unimodal but exhibits some skewness. The skew normal distribution includes the normal distribution as a special case where the skewness parameter is zero. In this thesis, we study the structural properties of the skew normal distribution, with an emphasis on the reliability properties of the model. More specifically, we obtain the failure rate, the mean residual life function, and the reliability function of a skew normal random variable. We also compare it with the normal distribution with respect to certain stochastic orderings. Appropriate machinery is developed to obtain the reliability of a component when the strength and stress follow the skew normal distribution. Finally, IQ score data from Roberts (1988) is analyzed to illustrate the procedure.

Evaluation of therapist and client language in Motivational Interviewing (MI) sessions: A secondary analysis of data from the Southern Methodist Alcohol Research Trial (SMART) study

In the United States, “binge” drinking among college students is an emerging public health concern due to the significant physical and psychological effects on young adults. The focus is on identifying interventions that can help decrease high-risk drinking behavior among this group of drinkers. One such intervention is Motivational interviewing (MI), a client-centered therapy that aims at resolving client ambivalence by developing discrepancy and engaging the client in change talk. Of late, there is a growing interest in determining the active ingredients that influence the alliance between the therapist and the client. This study is a secondary analysis of the data obtained from the Southern Methodist Alcohol Research Trial (SMART) project, a dismantling trial of MI and feedback among heavy drinking college students. The present project examines the relationship between therapist and client language in MI sessions on a sample of “binge” drinking college students. Of the 126 SMART tapes, 30 tapes (‘MI with feedback’ group = 15, ‘MI only’ group = 15) were randomly selected for this study. MISC 2.1, a mutually exclusive and exhaustive coding system, was used to code the audio/videotaped MI sessions. Therapist and client language were analyzed for communication characteristics. Overall, therapists adopted a MI consistent style and clients were found to engage in change talk. Counselor acceptance, empathy, spirit, and complex reflections were all significantly related to client change talk (p-values ranged from 0.001 to 0.047). Additionally, therapist ‘advice without permission’ and MI Inconsistent therapist behaviors were strongly correlated with client sustain talk (p-values ranged from 0.006 to 0.048). Simple linear regression models showed a significant correlation between MI consistent (MICO) therapist language (independent variable) and change talk (dependent variable) and MI inconsistent (MIIN) therapist language (independent variable) and sustain talk (dependent variable). The study has several limitations such as small sample size, self-selection bias, poor inter-rater reliability for the global scales and the lack of a temporal measure of therapist and client language. Future studies might consider a larger sample size to obtain more statistical power. In addition the correlation between therapist language, client language and drinking outcome needs to be explored.^

Evidence of reliability and validity of IPAQ for Mexican-American adults

Physical activity is a key component of life-style modification process which helps to reduce the risk of developing chronic diseases. It is important to have accurate estimates of physical activity to identify sedentary populations where interventions might be helpful. The International Physical Activity Questionnaire (IPAQ) short version has been used to estimate physical activity in diverse populations. However, there is little literature depicting the use of the IPAQ short version in Mexican America population. This study addressed the predictive validity and test-retest reliability of the IPAQ short version in Mexican American adults. The analysis was performed on 97 participants enrolled in the Cameron County Hispanic Cohort. Individuals selected in this study were 18 years of age or older. The predictive validity was evaluated by studying the relationship between physical activity and biomarkers known to be correlated with physical activity, namely, TNF-α, Adiponectin, and HDL. Multiple linear regression analysis was performed to delineate predictive validity. To assess test-retest reliability, two IPAQ-short last seven days questionnaires were interviewer administered to the participants on the same day, approximately two hours apart. Test-Retest reliability of IPAQ was estimated by performing intraclass correlations between the readings at two different time periods. The study showed that the IPAQ – short version used in the above study had acceptable test-retest reliability in the Mexican American population. This study showed that the IPAQ – short version did not have acceptable predictive validity when looking at physical activity and TNF-α, Adiponectin, and HDL in this sample.^

Social support, health status and health services utilization among the noninstitutionalized elderly: An analysis of the Supplement on Aging to the 1984 national health interview survey

The association between Social Support, Health Status, and Health Services Utilization of the elderly, was explored based on the analysis of data from the Supplement on Aging to the National Health Interview Survey, 1984 (N = 11,497) using a modified framework of Aday and Andersen's Expanded Behavioral Model. The results suggested that Social Support as operationalized in this study was an independent determinant of the use of health services. The quantity of social activities and the use of community services were the two most consistent determinants across different types of health services use.^ The effects of social support on the use of health services were broken down into three components to facilitate explanations of the mechanisms through which social support operated. The Predisposing and Enabling component of Social Support had independent, although not uniform, effects on the use of health services. Only slight substitute effects of social support were detected. These included the substitution of the use of senior centers for longer stay in the hospital and the substitution of help with IADL problems for the use of formal home care services.^ The effect of financial support on the use of health services was found to be different for middle and low income populations. This differential effect was also found for the presence of intimate networks, the frequencies of interaction with children and the perceived availability of support among urban/rural, male/female and white/non-white subgroups.^ The study also suggested that the selection of appropriate Health Status measures should be based on the type of Health Services Utilization in which a researcher is interested. The level of physical function limitation and role activity limitation were the two most consistent predictors of the volume of physician visits, number of hospital days, and average length of stay in the hospital during the past year.^ Some alternative hypotheses were also raised and evaluated, when possible. The impacts of the complex sample design, the reliability and validity of the measures and other limitations of this analysis were also discussed. Finally, a revised framework was proposed and discussed based on the analysis. Some policy implications and suggestions for future study were also presented. ^