Why Most Biomedical Findings Echoed by Newspapers Turn Out to be False: The Case of Attention Deficit Hyperactivity Disorder

Context: Because positive biomedical observations are more often published than those reporting no effect, initial observations are often refuted or attenuated by subsequent studies. Objective: To determine whether newspapers preferentially report on initial findings and whether they also report on subsequent studies. Methods: We focused on attention deficit hyperactivity disorder (ADHD). Using Factiva and PubMed databases, we identified 47 scientific publications on ADHD published in the 1990s and soon echoed by 347 newspapers articles. We selected the ten most echoed publications and collected all their relevant subsequent studies until 2011. We checked whether findings reported in each ‘‘top 10’’ publication were consistent with previous and subsequent observations. We also compared the newspaper coverage of the ‘‘top 10’’ publications to that of their related scientific studies. Results: Seven of the ‘‘top 10’’ publications were initial studies and the conclusions in six of them were either refuted or strongly attenuated subsequently. The seventh was not confirmed or refuted, but its main conclusion appears unlikely. Among the three ‘‘top 10’’ that were not initial studies, two were confirmed subsequently and the third was attenuated. The newspaper coverage of the ‘‘top 10’’ publications (223 articles) was much larger than that of the 67 related studies (57 articles). Moreover, only one of the latter newspaper articles reported that the corresponding ‘‘top 10’’ finding had been attenuated. The average impact factor of the scientific journals publishing studies echoed by newspapers (17.1 n = 56) was higher (p,0.0001) than that corresponding to related publications that were not echoed (6.4 n = 56). Conclusion: Because newspapers preferentially echo initial ADHD findings appearing in prominent journals, they report on uncertain findings that are often refuted or attenuated by subsequent studies. If this media reporting bias generalizes to health sciences, it represents a major cause of distortion in health science communication.

The Effect of a Multi-Component Consultation Intervention on the Pragmatic Language Skills of Students with Symptoms of Attention Deficit Hyperactivity Disorder

The purpose of this research was to determine if a multi-component consultation intervention was effective in improving pragmatic performance in students with ADHD. Participants for this study consisted of 7 children for whom 3 data points were obtained by a parent or 2 data points by a teacher. Changes in pragmatic performance were measured by comparing reports provided by parents or teachers pre- and post- intervention. Descriptive analysis procedures were completed to summarize changes in pragmatic behavior. Results revealed the mean overall change in pragmatic behavior for children in the MCC condition (Χ=1.133) was greater than the change seen in the CAU condition (.334) after 2 months of intervention as per parent reported data. Data indicated improvement in each behavior but incongruence between teachers and parents was found. Results support the hypothesis that the multi-component consultation intervention is effective in improving the pragmatic language performance of children with ADHD.