Qualitative Analysis of the Interdisciplinary Interaction between Data Analysis Specialists and Novice Clinical Researchers

Background: The inherent complexity of statistical methods and clinical phenomena compel researchers with diverse domains of expertise to work in interdisciplinary teams, where none of them have a complete knowledge in their counterpart's field. As a result, knowledge exchange may often be characterized by miscommunication leading to misinterpretation, ultimately resulting in errors in research and even clinical practice. Though communication has a central role in interdisciplinary collaboration and since miscommunication can have a negative impact on research processes, to the best of our knowledge, no study has yet explored how data analysis specialists and clinical researchers communicate over time. Methods/Principal Findings: We conducted qualitative analysis of encounters between clinical researchers and data analysis specialists (epidemiologist, clinical epidemiologist, and data mining specialist). These encounters were recorded and systematically analyzed using a grounded theory methodology for extraction of emerging themes, followed by data triangulation and analysis of negative cases for validation. A policy analysis was then performed using a system dynamics methodology looking for potential interventions to improve this process. Four major emerging themes were found. Definitions using lay language were frequently employed as a way to bridge the language gap between the specialties. Thought experiments presented a series of ""what if'' situations that helped clarify how the method or information from the other field would behave, if exposed to alternative situations, ultimately aiding in explaining their main objective. Metaphors and analogies were used to translate concepts across fields, from the unfamiliar to the familiar. Prolepsis was used to anticipate study outcomes, thus helping specialists understand the current context based on an understanding of their final goal. Conclusion/Significance: The communication between clinical researchers and data analysis specialists presents multiple challenges that can lead to errors.

Effect of tissue Doppler on the accuracy of novice and expert interpreters of Dobutamine echocardiography

The subjective interpretation of dobutamine echocardiography (DBE) makes the accuracy of this technique dependent on the experience of the observer, and also poses problems of concordance between observers. Myocardial tissue Doppler velocity (MDV) may offer a quantitative technique for identification of coronary artery disease, but it is unclear whether this parameter could improve the results of less expert readers and in segments with low interobserver concordance. The aim of this study was to find whether MDV improved the accuracy of wall motion scoring in novice readers, experienced echocardiographers, and experts in stress echocardiography, and to identify the optimal means of integrating these tissue Doppler data in 77 patients who underwent DBE and angiography. New or worsening abnormalities were identified as ischemia and abnormalities seen at rest as scarring. Segmental MDV was measured independently and previously derived cutoffs were applied to categorize segments as normal or ab normal. Five strategies were used to combine MDV and wall motion score, and the results of each reader using each strategy were compared with quantitative coronary angiography. The accuracy of wall motion scoring by novice (68 +/- 3%) and experienced echocardiographers (71 +/- 3%) was less than experts in stress echocardiography (88 +/- 3%, p < 0.001). Various strategies for integration with MDV significantly improved the accuracy of wall motion scoring by novices from 75 +/- 2% to 77 +/- 5% (p < 0.01). Among the experienced group, accuracy improved from 74 +/- 2% to 77 +/- 5% (p < 0.05), but in the experts, no improvement was seen from their baseline accuracy. Integration with MDV also improved discordance related to the basal segments. Thus, use of MDV in all segments or MDV in all segments with wall motion scoring in the apex offers an improvement in sensitivity and accuracy with minimal compromise in specificity. (C) 2001 by Excerpta Medica, Inc.

Voice and speech characteristics and vocal hygiene in novice and professional voice broadcast journalists

Knowledge of differences in voice and speech characteristics between novice and professional broadcasters is essential for effective education of broadcast journalism students. Because newsreaders rely on optimal voice production, information pertaining to vocal hygiene is also important. The first aim of this study was to compare the voice and speech characteristics of professional newsreaders, student newsreaders and control participants. The second aim was to compare the awareness and use of vocal hygiene across these groups. Professional radio newsreaders, broadcast journalism students and two matched control groups were included in the study. Each participant recorded a news bulletin and completed a questionnaire on vocal hygiene. Data analysis of the recording included objective analysis and perceptual ratings by a panel of three judges. Significant student-professional differences were found. Compared to both the students and the control groups, the professional newsreaders had greater variation in speaking fundamental frequency, a faster rate of speech, fewer pronunciation errors and higher perceptual ratings on vocal quality, emphasis, continuity, phrasing and style of newsreading. Female professional newsreaders had a higher speaking fundamental frequency than both their control participants and the student newsreaders. Comparison of vocal hygiene awareness revealed few significant differences between any of the groups.

The influence of experience and training in a group of novice observers: a jackknife alternative free-response receiver operating characteristic analysis

Purpose - The study evaluates the pre- and post-training lesion localisation ability of a group of novice observers. Parallels are drawn with the performance of inexperienced radiographers taking part in preliminary clinical evaluation (PCE) and ‘red-dot’ systems, operating within radiography practice. Materials and methods - Thirty-four novice observers searched 92 images for simulated lesions. Pre-training and post-training evaluations were completed following the free-response the receiver operating characteristic (FROC) method. Training consisted of observer performance methodology, the characteristics of the simulated lesions and information on lesion frequency. Jackknife alternative FROC (JAFROC) and highest rating inferred ROC analyses were performed to evaluate performance difference on lesion-based and case-based decisions. The significance level of the test was set at 0.05 to control the probability of Type I error. Results - JAFROC analysis (F(3,33) = 26.34, p < 0.0001) and highest-rating inferred ROC analysis (F(3,33) = 10.65, p = 0.0026) revealed a statistically significant difference in lesion detection performance. The JAFROC figure-of-merit was 0.563 (95% CI 0.512,0.614) pre-training and 0.677 (95% CI 0.639,0.715) post-training. Highest rating inferred ROC figure-of-merit was 0.728 (95% CI 0.701,0.755) pre-training and 0.772 (95% CI 0.750,0.793) post-training. Conclusions - This study has demonstrated that novice observer performance can improve significantly. This study design may have relevance in the assessment of inexperienced radiographers taking part in PCE or commenting scheme for trauma.

Three-dimensional technology facilitates surgical performance of novice laparoscopy surgeons: a quantitative assessment on a porcine kidney model

Objective To determine whether the use of 3-dimensional (3D) imaging translates into a better surgical performance of naïve urologic laparoscopic surgeons during pyeloplasty (PY) and partial nephrectomy (PN) procedures. Materials and Methods Eighteen surgeons without any previous laparoscopic experience were randomly assigned to perform PY and PN in a porcine model using initially 2-dimensional (2D) and 3D laparoscopy. A surgical performance score was rated by an "expert" tutor through a modified 5-item global rating scale contemplating operative field view, bimanual dexterity, efficiency, tissue handling, and autonomy. Overall surgical time, complications, subjective perception of participating surgeons, and inconveniences related to the 3D vision were recorded. Results No difference in terms if operative time was found between 2D or 3D laparoscopy for both the PY (P =.51) and the PN (P =.28) procedures. A better rate in terms of surgical performance score was noted by the tutors when the study participants were using 3D vs 2D, for both PY (3.6 [0.8] vs 3.0 [0.4]; P =.034) and PN (3.6 [0.51] vs 3.15 [0.63]; P =.001). No complications occurred in any of the procedures. Most (77.2%) of the participating na??ve laparoscopic surgeons had the perception that 3D laparoscopy was overall easier than 2D. Headache (18.1%), nausea (18.1%), and visual disturbance (18.1%) were the most common issues reported by the surgeons during 3D procedures. Conclusion Despite the absence of translation in a shorter operative time, the use of 3D technology seems to facilitate the surgical performance of naive surgeons during laparoscopic kidney procedures on a porcine model.