Assessment of inter-examiner agreement and variability in the manual classification of auditory brainstem response

Abstract Background: The analysis of the Auditory Brainstem Response (ABR) is of fundamental importance to the investigation of the auditory system behaviour, though its interpretation has a subjective nature because of the manual process employed in its study and the clinical experience required for its analysis. When analysing the ABR, clinicians are often interested in the identification of ABR signal components referred to as Jewett waves. In particular, the detection and study of the time when these waves occur (i.e., the wave latency) is a practical tool for the diagnosis of disorders affecting the auditory system. Significant differences in inter-examiner results may lead to completely distinct clinical interpretations of the state of the auditory system. In this context, the aim of this research was to evaluate the inter-examiner agreement and variability in the manual classification of ABR. Methods: A total of 160 ABR data samples were collected, for four different stimulus intensity (80dBHL, 60dBHL, 40dBHL and 20dBHL), from 10 normal-hearing subjects (5 men and 5 women, from 20 to 52 years). Four examiners with expertise in the manual classification of ABR components participated in the study. The Bland-Altman statistical method was employed for the assessment of inter-examiner agreement and variability. The mean, standard deviation and error for the bias, which is the difference between examiners’ annotations, were estimated for each pair of examiners. Scatter plots and histograms were employed for data visualization and analysis. Results: In most comparisons the differences between examiner’s annotations were below 0.1 ms, which is clinically acceptable. In four cases, it was found a large error and standard deviation (>0.1 ms) that indicate the presence of outliers and thus, discrepancies between examiners. Conclusions: Our results quantify the inter-examiner agreement and variability of the manual analysis of ABR data, and they also allows for the determination of different patterns of manual ABR analysis.

Adding a treatment arm to an ongoing clinical trial: a review of methodology and practice

Incorporating an emerging therapy as a new randomisation arm in a clinical trial that is open to recruitment would be desirable to researchers, regulators and patients to ensure that the trial remains current, new treatments are evaluated as quickly as possible, and the time and cost for determining optimal therapies is minimised. It may take many years to run a clinical trial from concept to reporting within a rapidly changing drug development environment; hence, in order for trials to be most useful to inform policy and practice, it is advantageous for them to be able to adapt to emerging therapeutic developments. This paper reports a comprehensive literature review on methodologies for, and practical examples of, amending an ongoing clinical trial by adding a new treatment arm. Relevant methodological literature describing statistical considerations required when making this specific type of amendment is identified, and the key statistical concepts when planning the addition of a new treatment arm are extracted, assessed and summarised. For completeness, this includes an assessment of statistical recommendations within general adaptive design guidance documents. Examples of confirmatory ongoing trials designed within the frequentist framework that have added an arm in practice are reported; and the details of the amendment are reviewed. An assessment is made as to how well the relevant statistical considerations were addressed in practice, and the related implications. The literature review confirmed that there is currently no clear methodological guidance on this topic, but that guidance would be advantageous to help this efficient design amendment to be used more frequently and appropriately in practice. Eight confirmatory trials were identified to have added a treatment arm, suggesting that trials can benefit from this amendment and that it can be practically feasible; however, the trials were not always able to address the key statistical considerations, often leading to uninterpretable or invalid outcomes. If the statistical concepts identified within this review are considered and addressed during the design of a trial amendment, it is possible to effectively assess a new treatment arm within an ongoing trial without compromising the original trial outcomes.

In vitro and clinical evaluation of specific dentifrices for complete denture hygiene

To study the physical properties of two experimental dentifrices for complete denture hygiene, their effect on denture biofilm removal and antimicrobial properties by means of a clinical trial. The experimental dentifrices comprised two compositions. One was based on the addition of 1% chloramine T (D1) and the other on the presence of 0.01% fluorosurfactant (D2). Measurements of density, pH, consistency, rheological features and abrasiveness were conducted. Sixty complete denture wearers were randomly assigned to three groups and were instructed to brush their dentures with a specific toothbrush: (1) Water (control); (2) D1; or (3) D2. Each method was used for 21 days. Denture biofilm was disclosed by a 1% neutral red solution and quantified by means of digital photos taken from the internal surface. Microbiological assessment was conducted to quantify Candida sp. and mutans streptococci. Data were evaluated by one-way anova and Tukey HSD, or Kruskal-Wallis (alpha = 0.05). Both dentifrices decreased biofilm coverage when compared with the control group. D1 was the most efficacious treatment to reduce mutans streptococci, whereas D2 showed an intermediate outcome (anova, p < 0.040). No treatment influenced Candida albicans or non-albicans species (Kruskal-Wallis, p = 0.163 and 0.746, respectively). It can be concluded that brushing complete dentures with the experimental dentifrices tested could be effective for the removal of denture biofilm.

Impact of socioeconomic and clinical factors on child oral health-related quality of life (COHRQoL)

Child oral health-related quality of life (COHRQoL) has been increasingly assessed; however, few studies appraised the influence of socioeconomic status on COHRQoL in developing countries. This study assessed the relationship of COHRQoL with socioeconomic backgrounds and clinical factors. This study followed a cross-sectional design, with a multistage random sample of 792 schoolchildren aged 12 years, representative of Santa Maria, a southern city in Brazil. Participants completed the Brazilian version of the Child Perceptions Questionnaire (CPQ(11-14)), their parents or guardians answered questions on socioeconomic status, and a dental examination provided information on the prevalence of caries, dental trauma and occlusion. The assessment of association used hierarchically adjusted Poisson regression models. Higher impacts on COHRQoL were observed for children presenting with untreated dental caries (RR 1.20; 95% CI 1.07-1.35) and maxillary overjet (RR 1.19; 95% CI 1.02-1.40). Socioeconomic factors also associated with COHRQoL; poorer scores were reported by children whose mothers have not completed primary education (RR 1.30; 95% CI 1.17-1.44) and those with lower household income (RR 1.13; 95% CI 1.02-1.26). Poor socioeconomic standings and poor dental status have a negative impact on COHRQoL; reducing health inequalities may demand dental programmes and policies targeting deprived population.

Clinical risk factors for osteoporotic fractures in Brazilian women and men: the Brazilian Osteoporosis Study (BRAZOS)

The Brazilian Osteoporosis Study (BRAZOS) is the first epidemiological study carried out in a representative sample of Brazilian men and women aged 40 years or older. The prevalence of fragility fractures is about 15.1% in the women and 12.8% in the men. Moreover, advanced age, sedentarism, family history of hip fracture, current smoking, recurrent falls, diabetes mellitus and poor quality of life are the main clinical risk factors associated with fragility fractures. The Brazilian Osteoporosis Study (BRAZOS) is the first epidemiological study carried out in a representative sample of Brazilian men and women aged 40 years or older with the purpose of identifying the prevalence and the main clinical risk factors (CRF) associated with osteoporotic fracture in our population. A total of 2,420 individuals (women, 70%) from 150 different cities in the five geographic regions in Brazil, and all different socio-economical classes were selected to participate in the present survey. Anthropometrical data as well as life habits, fracture history, food intake, physical activity, falls and quality of life were determined by individual quantitative interviews. The representative sampling was based on Brazilian National data provided by the 2000 and 2003 census. Low trauma fracture was defined as that resulting of a fall from standing height or less in individuals 50 years or older at specific skeletal sites: forearm, femur, ribs, vertebra and humerus. Sampling error was 2.2% with 95% confidence intervals. Logistic regression analysis models were designed having the fragility fracture as the dependent variable and all other parameters as the independent variable. Significance level was set as p < 0.05. The average of age, height and weight for men and women were 58.4 +/- 12.8 and 60.1 +/- 13.7 years, 1.67 +/- 0.08 and 1.56 +/- 0.07 m and 73.3 +/- 14.7 and 64.7 +/- 13.7 kg, respectively. About 15.1% of the women and 12.8% of the men reported fragility fractures. In the women, the main CRF associated with fractures were advanced age (OR = 1.6; 95% CI 1.06-2.4), family history of hip fracture (OR = 1.7; 95% CI 1.1-2.8), early menopause (OR = 1.7; 95% CI 1.02-2.9), sedentary lifestyle (OR = 1.6; 95% CI 1.02-2.7), poor quality of life (OR = 1.9; 95% CI 1.2-2.9), higher intake of phosphorus (OR = 1.9; 95% CI 1.2-2.9), diabetes mellitus (OR = 2.8; 95% CI 1.01-8.2), use of benzodiazepine drugs (OR = 2.0; 95% CI 1.1-3.6) and recurrent falls (OR = 2.4; 95% CI 1.2-5.0). In the men, the main CRF were poor quality of life (OR = 3.2; 95% CI 1.7-6.1), current smoking (OR = 3.5; 95% CI 1.28-9.77), diabetes mellitus (OR = 4.2; 95% CI 1.27-13.7) and sedentary lifestyle (OR = 6.3; 95% CI 1.1-36.1). Our findings suggest that CRF may contribute as an important tool to identify men and women with higher risk of osteoporotic fractures and that interventions aiming at specific risk factors (quit smoking, regular physical activity, prevention of falls) may help to manage patients to reduce their risk of fracture.

Inference and local influence assessment in skew-normal null intercept measurement error model

In this article, we discuss inferential aspects of the measurement error regression models with null intercepts when the unknown quantity x (latent variable) follows a skew normal distribution. We examine first the maximum-likelihood approach to estimation via the EM algorithm by exploring statistical properties of the model considered. Then, the marginal likelihood, the score function and the observed information matrix of the observed quantities are presented allowing direct inference implementation. In order to discuss some diagnostics techniques in this type of models, we derive the appropriate matrices to assessing the local influence on the parameter estimates under different perturbation schemes. The results and methods developed in this paper are illustrated considering part of a real data set used by Hadgu and Koch [1999, Application of generalized estimating equations to a dental randomized clinical trial. Journal of Biopharmaceutical Statistics, 9, 161-178].

Speech Assessment for the Classification of Hypokinetic Dysthria in Parkinson Disease

The aim of this thesis is to investigate computerized voice assessment methods to classify between the normal and Dysarthric speech signals. In this proposed system, computerized assessment methods equipped with signal processing and artificial intelligence techniques have been introduced. The sentences used for the measurement of inter-stress intervals (ISI) were read by each subject. These sentences were computed for comparisons between normal and impaired voice. Band pass filter has been used for the preprocessing of speech samples. Speech segmentation is performed using signal energy and spectral centroid to separate voiced and unvoiced areas in speech signal. Acoustic features are extracted from the LPC model and speech segments from each audio signal to find the anomalies. The speech features which have been assessed for classification are Energy Entropy, Zero crossing rate (ZCR), Spectral-Centroid, Mean Fundamental-Frequency (Meanf0), Jitter (RAP), Jitter (PPQ), and Shimmer (APQ). Naïve Bayes (NB) has been used for speech classification. For speech test-1 and test-2, 72% and 80% accuracies of classification between healthy and impaired speech samples have been achieved respectively using the NB. For speech test-3, 64% correct classification is achieved using the NB. The results direct the possibility of speech impairment classification in PD patients based on the clinical rating scale.

A home environment test battery for status assessment in patients with motor fluctuations

Background and aims Evaluating status in patients with motor fluctuations is complex and occasional observations/measurements do not give an adequate picture as to the time spent in different states. We developed a test battery to assess advanced Parkinson patients' status consisting of diary assessments and motor tests. This battery was constructed and implemented on a handheld computer with built-in mobile communication. In fluctuating patients, it should typically be used several times daily in the home environment, over periods of about one week. The aim of this battery is to provide status information in order to evaluate treatment effects in clinical practice and research, follow up treatments and disease progression and predict outcome to optimize treatment strategy. Methods Selection of diary questions was based on a previous study with Duodopa® (DIREQT). Tapping tests (with and without visual cueing) and a spiral drawing test were added. Rapid prototyping was used in development of the user interface. An evaluation with two pilot patients was performed before and after receiving new treatments for advanced disease (one received Duodopa® and one received DBS). Speed and proportion missed taps were calculated for the tapping tests and entropy of the radial drawing velocity was calculated for the spiral tests. Test variables were evaluated using non-parametric statistics. Results Post-treatment improvement was detected in both patients in many of the test variables. Conclusions Although validation work remains, preliminary results are promising and the test battery is currently being evaluated in a long-term health economics study with Duodopa® (DAPHNE).

Automatic and objective assessment of alternating tapping performance in Parkinson’s disease

This paper presents the development and evaluation of a method for enabling quantitative and automatic scoring of alternating tapping performance of patients with Parkinson’s disease (PD). Ten healthy elderly subjects and 95 patients in different clinical stages of PD have utilized a touch-pad handheld computer to perform alternate tapping tests in their home environments. First, a neurologist used a web-based system to visually assess impairments in four tapping dimensions (‘speed’, ‘accuracy’, ‘fatigue’ and ‘arrhythmia’) and a global tapping severity (GTS). Second, tapping signals were processed with time series analysis and statistical methods to derive 24 quantitative parameters. Third, principal component analysis was used to reduce the dimensions of these parameters and to obtain scores for the four dimensions. Finally, a logistic regression classifier was trained using a 10-fold stratified cross-validation to map the reduced parameters to the corresponding visually assessed GTS scores. Results showed that the computed scores correlated well to visually assessed scores and were significantly different across Unified Parkinson’s Disease Rating Scale scores of upper limb motor performance. In addition, they had good internal consistency, had good ability to discriminate between healthy elderly and patients in different disease stages, had good sensitivity to treatment interventions and could reflect the natural disease progression over time. In conclusion, the automatic method can be useful to objectively assess the tapping performance of PD patients and can be included in telemedicine tools for remote monitoring of tapping.

Automatic spiral analysis for objective assessment of motor symptoms in Parkinson's disease

Objective: To develop a method for objective quantification of PD motor symptoms related to Off episodes and peak dose dyskinesias, using spiral data gathered by using a touch screen telemetry device. The aim was to objectively characterize predominant motor phenotypes (bradykinesia and dyskinesia), to help in automating the process of visual interpretation of movement anomalies in spirals as rated by movement disorder specialists. Background: A retrospective analysis was conducted on recordings from 65 patients with advanced idiopathic PD from nine different clinics in Sweden, recruited from January 2006 until August 2010. In addition to the patient group, 10 healthy elderly subjects were recruited. Upper limb movement data were collected using a touch screen telemetry device from home environments of the subjects. Measurements with the device were performed four times per day during week-long test periods. On each test occasion, the subjects were asked to trace pre-drawn Archimedean spirals, using the dominant hand. The pre-drawn spiral was shown on the screen of the device. The spiral test was repeated three times per test occasion and they were instructed to complete it within 10 seconds. The device had a sampling rate of 10Hz and measured both position and time-stamps (in milliseconds) of the pen tip. Methods: Four independent raters (FB, DH, AJ and DN) used a web interface that animated the spiral drawings and allowed them to observe different kinematic features during the drawing process and to rate task performance. Initially, a number of kinematic features were assessed including ‘impairment’, ‘speed’, ‘irregularity’ and ‘hesitation’ followed by marking the predominant motor phenotype on a 3-category scale: tremor, bradykinesia and/or choreatic dyskinesia. There were only 2 test occasions for which all the four raters either classified them as tremor or could not identify the motor phenotype. Therefore, the two main motor phenotype categories were bradykinesia and dyskinesia. ‘Impairment’ was rated on a scale from 0 (no impairment) to 10 (extremely severe) whereas ‘speed’, ‘irregularity’ and ‘hesitation’ were rated on a scale from 0 (normal) to 4 (extremely severe). The proposed data-driven method consisted of the following steps. Initially, 28 spatiotemporal features were extracted from the time series signals before being presented to a Multilayer Perceptron (MLP) classifier. The features were based on different kinematic quantities of spirals including radius, angle, speed and velocity with the aim of measuring the severity of involuntary symptoms and discriminate between PD-specific (bradykinesia) and/or treatment-induced symptoms (dyskinesia). A Principal Component Analysis was applied on the features to reduce their dimensions where 4 relevant principal components (PCs) were retained and used as inputs to the MLP classifier. Finally, the MLP classifier mapped these components to the corresponding visually assessed motor phenotype scores for automating the process of scoring the bradykinesia and dyskinesia in PD patients whilst they draw spirals using the touch screen device. For motor phenotype (bradykinesia vs. dyskinesia) classification, the stratified 10-fold cross validation technique was employed. Results: There were good agreements between the four raters when rating the individual kinematic features with intra-class correlation coefficient (ICC) of 0.88 for ‘impairment’, 0.74 for ‘speed’, 0.70 for ‘irregularity’, and moderate agreements when rating ‘hesitation’ with an ICC of 0.49. When assessing the two main motor phenotype categories (bradykinesia or dyskinesia) in animated spirals the agreements between the four raters ranged from fair to moderate. There were good correlations between mean ratings of the four raters on individual kinematic features and computed scores. The MLP classifier classified the motor phenotype that is bradykinesia or dyskinesia with an accuracy of 85% in relation to visual classifications of the four movement disorder specialists. The test-retest reliability of the four PCs across the three spiral test trials was good with Cronbach’s Alpha coefficients of 0.80, 0.82, 0.54 and 0.49, respectively. These results indicate that the computed scores are stable and consistent over time. Significant differences were found between the two groups (patients and healthy elderly subjects) in all the PCs, except for the PC3. Conclusions: The proposed method automatically assessed the severity of unwanted symptoms and could reasonably well discriminate between PD-specific and/or treatment-induced motor symptoms, in relation to visual assessments of movement disorder specialists. The objective assessments could provide a time-effect summary score that could be useful for improving decision-making during symptom evaluation of individualized treatment when the goal is to maximize functional On time for patients while minimizing their Off episodes and troublesome dyskinesias.

Automatic spiral analysis for objective assessment of motor symptoms in Parkinson's disease

A challenge for the clinical management of advanced Parkinson’s disease (PD) patients is the emergence of fluctuations in motor performance, which represents a significant source of disability during activities of daily living of the patients. There is a lack of objective measurement of treatment effects for in-clinic and at-home use that can provide an overview of the treatment response. The objective of this paper was to develop a method for objective quantification of advanced PD motor symptoms related to off episodes and peak dose dyskinesia, using spiral data gathered by a touch screen telemetry device. More specifically, the aim was to objectively characterize motor symptoms (bradykinesia and dyskinesia), to help in automating the process of visual interpretation of movement anomalies in spirals as rated by movement disorder specialists. Digitized upper limb movement data of 65 advanced PD patients and 10 healthy (HE) subjects were recorded as they performed spiral drawing tasks on a touch screen device in their home environment settings. Several spatiotemporal features were extracted from the time series and used as inputs to machine learning methods. The methods were validated against ratings on animated spirals scored by four movement disorder specialists who visually assessed a set of kinematic features and the motor symptom. The ability of the method to discriminate between PD patients and HE subjects and the test-retest reliability of the computed scores were also evaluated. Computed scores correlated well with mean visual ratings of individual kinematic features. The best performing classifier (Multilayer Perceptron) classified the motor symptom (bradykinesia or dyskinesia) with an accuracy of 84% and area under the receiver operating characteristics curve of 0.86 in relation to visual classifications of the raters. In addition, the method provided high discriminating power when distinguishing between PD patients and HE subjects as well as had good test-retest reliability. This study demonstrated the potential of using digital spiral analysis for objective quantification of PD-specific and/or treatment-induced motor symptoms.

Self-assessment of the outcome of early medical abortion versus clinic follow-up in India : a randomised, controlled, non-inferiority trial

Background: The need for multiple clinical visits remains a barrier to women accessing safe legal medical abortion services. Alternatives to routine clinic follow-up visits have not been assessed in rural low-resource settings. We compared the effectiveness of standard clinic follow-up versus home assessment of outcome of medical abortion in a low-resource setting. Methods: This randomised, controlled, non-inferiority trial was done in six health centres (three rural, three urban) in Rajasthan, India. Women seeking early medical abortion up to 9 weeks of gestation were randomly assigned (1:1) to either routine clinic follow-up or self-assessment at home. Randomisation was done with a computer-generated randomisation sequence, with a block size of six. The study was not blinded. Women in the home-assessment group were advised to use a pictorial instruction sheet and take a low-sensitivity urine pregnancy test at home, 10-14 days after intake of mifepristone, and were contacted by a home visit or telephone call to record the outcome of the abortion. The primary (non-inferiority) outcome was complete abortion without continuing pregnancy or need for surgical evacuation or additional mifepristone and misoprostol. The non-inferiority margin for the risk difference was 5%. All participants with a reported primary outcome and who followed the clinical protocol were included in the analysis. This study is registered with ClinicalTrials.gov, number NCT01827995. Findings: Between April 23, 2013, and May 15, 2014, 731 women were recruited and assigned to clinic follow-up (n=366) or home assessment (n=365), of whom 700 were analysed for the main outcomes (n=336 and n=364, respectively). Complete abortion without continuing pregnancy, surgical intervention, or additional mifepristone and misoprostol was reported in 313 (93%) of 336 women in the clinic follow-up group and 347 (95%) of 364 women in the home-assessment group (difference -2.2%, 95% CI -5.9 to 1.6). One case of haemorrhage occurred in each group (rate of adverse events 0.3% in each group); no other adverse events were noted. Interpretation Home assessment of medical abortion outcome with a low-sensitivity urine pregnancy test is non-inferior to clinic follow-up, and could be introduced instead of a clinic follow-up visit in a low-resource setting.

Clinical evaluation of enalapril maleate and furosemide usage in dogs with degenerative myxomatous mitral valve, CHF functional class Ib

A doença degenerativa mixomatosa da válvula mitral (DDMVM) é uma cardiopatia de alta incidência na clínica médica de pequenos animais, acometendo mormente cães idosos e raças de pequeno porte. Desta forma, foi realizada uma investigação científica objetivando avaliar clinicamente a utilização dos fármacos maleato de enalapril e furosemida em cães com a referida enfermidade na classe funcional Ib da ICC, antes e após a terapêutica implantada. Para isso, utilizaram-se 16 cães portadores da valvulopatia supracitada, distribuídos em dois grupos; com o primeiro recebendo furosemida (n=8) e o segundo maleato de enalapril (n=8), durante 56 dias. Os cães foram avaliados em quatro momentos (T0, T14, T28 e T56 dias) quanto aos sinais clínicos e parâmetros hematológicos e bioquímico-séricos, que incluíram concentrações séricas da enzima conversora da angiotensina (ECA) e aldosterona, como também avaliações radiográficas, eletrocardiográficas, ecodopplercardiográficas e da pressão arterial. Os resultados quanto aos parâmetros clínicos, avaliações hematológicas e bioquímicas séricas não revelaram alterações significativas em ambos os grupos, mas reduções significativas nos valores de ECA e aldosterona no grupo que recebeu o maleato de enalapril foram identificadas. Ao exame radiográfico observou-se reduções nos valores de VHS e na variável onda Pms do eletrocardiograma em ambos os grupos, mas sem alterações nos valores da pressão arterial. Por sua vez, o ecodopplercardiograma evidenciou diminuição significativa das variáveis DIVEd/s nos grupos estudados e na FEC% nos cães que receberam somente enalapril. Portanto, a análise dos resultados encontrados indicou que a monoterapia fundamentada no maleato de enalapril apresentou melhor eficiência no controle do quadro clínico em pacientes da classe funcional Ib da ICC.

Infection of commercial laying hens with Salmonella Gallinarum: clinical, anatomopathological and haematological studies

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Safety Assessment of Potentially Inappropriate Medications (PIM) use in Older People and the Factors Associated with Hospital Admission

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)