Effect of standardized training on the reliability of the Cochrane risk of bias assessment tool: a study protocol

BACKGROUND The Cochrane risk of bias (RoB) tool has been widely embraced by the systematic review community, but several studies have reported that its reliability is low. We aim to investigate whether training of raters, including objective and standardized instructions on how to assess risk of bias, can improve the reliability of this tool. We describe the methods that will be used in this investigation and present an intensive standardized training package for risk of bias assessment that could be used by contributors to the Cochrane Collaboration and other reviewers. METHODS/DESIGN This is a pilot study. We will first perform a systematic literature review to identify randomized clinical trials (RCTs) that will be used for risk of bias assessment. Using the identified RCTs, we will then do a randomized experiment, where raters will be allocated to two different training schemes: minimal training and intensive standardized training. We will calculate the chance-corrected weighted Kappa with 95% confidence intervals to quantify within- and between-group Kappa agreement for each of the domains of the risk of bias tool. To calculate between-group Kappa agreement, we will use risk of bias assessments from pairs of raters after resolution of disagreements. Between-group Kappa agreement will quantify the agreement between the risk of bias assessment of raters in the training groups and the risk of bias assessment of experienced raters. To compare agreement of raters under different training conditions, we will calculate differences between Kappa values with 95% confidence intervals. DISCUSSION This study will investigate whether the reliability of the risk of bias tool can be improved by training raters using standardized instructions for risk of bias assessment. One group of inexperienced raters will receive intensive training on risk of bias assessment and the other will receive minimal training. By including a control group with minimal training, we will attempt to mimic what many review authors commonly have to do, that is-conduct risk of bias assessment in RCTs without much formal training or standardized instructions. If our results indicate that an intense standardized training does improve the reliability of the RoB tool, our study is likely to help improve the quality of risk of bias assessments, which is a central component of evidence synthesis.

Individual Video Training iVT - Development of a National Infrastructure for Video-Supported Learning

Introduction: Video‐Supported Learning is particularly effective when it comes to skills and behaviors. Video registration of patient‐physician interviews, class room instruction or practical skills allow it to learners themselves, their peers, and their tutors to assess the quality of the learner's performance, to give specific feedback, and to make suggestions for improvement. Methods: In Switzerland, four pedagogical universities and two medical faculties joined to initiate the development of a national infrastructure for Video Supported Learning. The goal was to have a system that is simple to use, has most steps automated, provides the videos over the Internet, and has a sophisticated access control. Together with SWITCH, the national IT‐Support‐Organisation for Swiss Universities, the program iVT (Individual Video Training) was developed by integrating two preexisting technologies. The first technology is SWITCHcast, a podcast system. With SWITCHcast, videos are automatically uploaded to a server as soon as the registration is over. There the videos are processed and converted to different formats. The second technology is the national Single Logon System AAI (Authentification and Authorization Infrastructure) that enables iVT to link each video with the corresponding learner. The learner starts the registration with his Single Logon. Thus, the video can unambiguously be assigned. Via his institution's Learning Management System (LMS), the learner can access his video and give access to his video to peers and tutors. Results: iVT is now used at all involved institutions. The system works flawlessly. In Bern, we use iVT for the communications skills training in the forth and sixth year. Since students meet with patient actors alone, iVT is also used to certify attendance. Students are encouraged to watch the videos of the interview and the feedback of the patient actor. The offer to discuss a video with a tutor was not used by the students. Discussion: We plan to expand the use of iVT by making peer assessment compulsory. To support this, annotation capabilities are currently added to iVT. We also want to use iVT in training of practical skills, again for self as well as for peer assessment.  At present, we use iVT for quality control of patient actor's performance.

Lamb Temporal Bone as a Surgical Training Model of Round Window Cochlear Implant Electrode Insertion

OBJECTIVE The preservation of residual hearing in cochlear implantation opens the door for optimal functional results. This atraumatic surgical technique requires training; however, the traditional human cadaveric temporal bones have become less available or unattainable in some institutions. This study investigates the suitability of an alternative model, using cadaveric lamb temporal bone, for surgical training of atraumatic round window electrode insertion. INTERVENTION A total of 14 lamb temporal bones were dissected for cochlear implantation by four surgeons. After mastoidectomy, visualization, and drilling of the round window niche, an atraumatic round window insertion of a Medel Flex24 electrode was performed. Electrode insertion depth and position were verified by computed tomography scans. MAIN OUTCOME MEASURE All cochleas were successfully implanted using the atraumatic round window approach; however, surgical access through the mastoid was substantially different when compared human anatomy. The mean number of intracochlear electrode contacts was 6.5 (range, 4-11) and the mean insertion depth 10.4 mm (range, 4-20 mm), which corresponds to a mean angular perimodiolar insertion depth of 229 degrees (range 67-540°). Full insertion of the electrode was not possible because of the smaller size of the lamb cochlea in comparison to that of the human. CONCLUSION The lamb temporal bone model is well suited as a training model for atraumatic cochlear implantation at the level of the round window. The minimally pneumatized mastoid as well as the smaller cochlea can help prepare a surgeon for difficult cochlear implantations. Because of substantial differences to human anatomy, it is not an adequate training model for other surgical techniques such as mastoidectomy and posterior tympanotomy as well as full electrode insertion.

Education of tobacco use prevention and cessation for dental professionals--a paradigm shift

The use of tobacco continues to be a substantial risk factor in the development and progression of oral cancer, periodontitis, implant failure and poor wound healing. Dental and dental hygiene education providers have made great advances towards the incorporation of tobacco education into their curricula in recent years. Unfortunately, however, both medical and dental education research has consistently reported schools providing only basic knowledge-based curricula that rarely incorporate more effective, behaviourally-based components affecting long-term change. The limited training of oral healthcare students, at least in part, is reflected in practising dental professionals continuing to report offering incomplete tobacco interventions. In order to prepare the next generation of oral healthcare providers, this paper proposes a paradigm shift in how tobacco use prevention and cessation (TUPAC) may be incorporated into existing curricula. It is suggested that schools should carefully consider: to what level of competency should TUPAC be trained in dental and dental hygiene schools; the importance of establishing rapport through good communication skills; the core knowledge level for TUPAC; suggested instructional and assessment strategies; the importance of continuing professional education for the enhancement of TUPAC.

Is computer-assisted telephone triage safe? A prospective surveillance study in walk-in patients with non-life-threatening medical conditions

Background Patients often establish initial contact with healthcare institutions by telephone. During this process they are frequently medically triaged. Purpose To investigate the safety of computer-assisted telephone triage for walk-in patients with non-life-threatening medical conditions at an emergency unit of a Swiss university hospital. Methods This prospective surveillance study compared the urgency assessments of three different types of personnel (call centre nurses, hospital physicians, primary care physicians) who were involved in the patients' care process. Based on the urgency recommendations of the hospital and primary care physicians, cases which could potentially have resulted in an avoidable hazardous situation (AHS) were identified. Subsequently, the records of patients with a potential AHS were assessed for risk to health or life by an expert panel. Results 208 patients were enrolled in the study, of whom 153 were assessed by all three types of personnel. Congruence between the three assessments was low. The weighted κ values were 0.115 (95% CI 0.038 to 0.192) (hospital physicians vs call centre), 0.159 (95% CI 0.073 to 0.242) (primary care physicians vs call centre) and 0.377 (95% CI 0.279 to 0.480) (hospital vs primary care physicians). Seven of 153 cases (4.57%; 95% CI 1.85% to 9.20%) were classified as a potentially AHS. A risk to health or life was adjudged in one case (0.65%; 95% CI 0.02% to 3.58%). Conclusion Medical telephone counselling is a demanding task requiring competent specialists with dedicated training in communication supported by suitable computer technology. Provided these conditions are in place, computer-assisted telephone triage can be considered to be a safe method of assessing the potential clinical risks of patients' medical conditions.

A robotic system to train activities of daily living in a virtual environment

In the past decade, several arm rehabilitation robots have been developed to assist neurological patients during therapy. Early devices were limited in their number of degrees of freedom and range of motion, whereas newer robots such as the ARMin robot can support the entire arm. Often, these devices are combined with virtual environments to integrate motivating game-like scenarios. Several studies have shown a positive effect of game-playing on therapy outcome by increasing motivation. In addition, we assume that practicing highly functional movements can further enhance therapy outcome by facilitating the transfer of motor abilities acquired in therapy to daily life. Therefore, we present a rehabilitation system that enables the training of activities of daily living (ADL) with the support of an assistive robot. Important ADL tasks have been identified and implemented in a virtual environment. A patient-cooperative control strategy with adaptable freedom in timing and space was developed to assist the patient during the task. The technical feasibility and usability of the system was evaluated with seven healthy subjects and three chronic stroke patients.

Evaluative comparison of physician-based vs. patient-based outcomes in posterior lumbar fusion

Posterior lumbar fusion is a frequently performed procedure in spinal surgery. High percentages of good and excellent results are indicated by physicians. On the other hand patient-based outcomes are reported. Little is known about the correlations of these two assessment types. We aimed at their comparison. The analysis included 1013 patients with degenerative spinal disease or spondylolisthesis from an international spine registry, treated with posterior lumbar fusion. All patients were pre/postop assessed by physician-based McNab criteria (‘excellent’, ‘good’, ‘fair’, ‘poor’). Of these patients, 210 (mean age 61 years; 57% females) were in addition assessed by patient-based Oswestry Disability Index (ODI). The remaining 803 patients (mean age 59 years; 56% females) were assessed by patient-based Core Outcome Measure Index (COMI), including Visual Analogue Scale (VAS) for back and leg pain as well as verbal self-rating (‘helped a lot’, ‘helped’, ‘helped only little’, ‘didn’t help’, ‘made things worse’). McNab criteria were compared to the Minimal Clinically Important Difference (MCID) in ODI (12.8), in VAS back (1.2) and leg pain (1.6). We investigated the correlations between McNab criteria and these patient-based outcomes. In the ‘excellent’ group as rated by physicians, the proposed MCID was reached in 83% of patients for ODI, in 69% for VAS back and in 83% for VAS leg pain. All patients said the treatment had ‘helped’ or ‘helped a lot’. In the ‘good’ group 56% (ODI), 66% (back pain) and 86% (leg pain) reached the MCID. 96% of patients perceived the treatment as positive. In the ‘fair’ group 37% (ODI), 55% (back pain) and 63% (leg pain) reached the MCID. 49% had positive treatment considerations. The ‘poor’ group revealed 30% (ODI), 35% (back pain) and 44% (leg pain) of patients with reached MCID. Only 15% rated the treatment as positive. The Spearman correlation coefficients between McNab criteria on the one hand and ODI, back and leg pain as well as patients’ verbal self-rating on the other hand were 0.57, 0.37, 0.36 and 0.46 respectively. The comparison of physician and patient-based outcomes showed the highest correlations between McNab criteria and ODI, somewhat weaker correlations with patients’ self-rating and the weakest correlations with back and leg pain. Based on these findings, physicians’ evaluation of patient outcomes can be considered a valuable part of patient assessment, corresponding very well with patients’ perceptions of success or failure of spinal surgery.

Tumor classification of six common cancer types based on proteomic profiling by MALDI imaging

In clinical diagnostics, it is of outmost importance to correctly identify the source of a metastatic tumor, especially if no apparent primary tumor is present. Tissue-based proteomics might allow correct tumor classification. As a result, we performed MALDI imaging to generate proteomic signatures for different tumors. These signatures were used to classify common cancer types. At first, a cohort comprised of tissue samples from six adenocarcinoma entities located at different organ sites (esophagus, breast, colon, liver, stomach, thyroid gland, n = 171) was classified using two algorithms for a training and test set. For the test set, Support Vector Machine and Random Forest yielded overall accuracies of 82.74 and 81.18%, respectively. Then, colon cancer liver metastasis samples (n = 19) were introduced into the classification. The liver metastasis samples could be discriminated with high accuracy from primary tumors of colon cancer and hepatocellular carcinoma. Additionally, colon cancer liver metastasis samples could be successfully classified by using colon cancer primary tumor samples for the training of the classifier. These findings demonstrate that MALDI imaging-derived proteomic classifiers can discriminate between different tumor types at different organ sites and in the same site.

Controversies in the treatment of ingrown nails

Ingrown toenails are one of the most frequent nail disorders of young persons. They may negatively influence daily activities, cause discomfort and pain. Since more than 1000 years, many different treatments have been proposed. Today, conservative and surgical methods are available, which, when carried out with expertise, are able to cure the disease. Packing, taping, gutter treatment, and nail braces are options for relatively mild cases whereas surgery is exclusively done by physicians. Phenolisation of the lateral matrix horn is now the safest, simplest, and most commonly performed method with the lowest recurrence rate. Wedge excisions can no longer be recommended.

Validity evidence and reliability of a Simulated Patient Feedback Instrument

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Methods Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. Results All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. Conclusions The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Complementary and conventional medicine in Switzerland: comparing characteristics of general practitioners

OBJECTIVES: Do structural characteristics of general practitioners (GPs) who practice complementary medicine (CAM) differ from those GPs who do not? Assessed characteristics included experience and professional integration of general practitioners (GPs), workload, medical activities, and personal and technical resources of practices. The investigated CAM disciplines were anthroposophic medicine, homoeopathy, traditional Chinese medicine, neural therapy and herbal medicine. MATERIAL AND METHODS: We designed a cross-sectional study with convenience and stratified samples of GPs providing conventional (COM) and/or complementary primary care in Switzerland. The samples were taken from the database of the Swiss medical association (FMH) and from CAM societies. Data were collected using a postal questionnaire. RESULTS: Of the 650 practitioners who were included in the study, 191 were COM, 167 noncertified CAM and 292 certified CAM physicians. The proportion of females was higher in the population of CAM physicians. Gender-adjusted age did not differ between CAM and COM physicians. Nearly twice as many CAM physicians work part-time. Differences were also seen for the majority of structural characteristics such as qualification of physicians, type of practice, type of staff, and presence of technical equipment. CONCLUSION: The study results show that structural characteristics of primary health care do differ between CAM and COM practitioners. We assumed that the activities of GPs are defined essentially by analyzed structures. The results are to be considered for evaluations in primary health care, particularly when quality of health care is assessed.

Patient satisfaction of primary care for musculoskeletal diseases: A comparison between Neural Therapy and conventional medicine

Background The main objective of this study was to assess and compare patient satisfaction with Neural Therapy (NT) and conventional medicine (COM) in primary care for musculoskeletal diseases. Methods A cross-sectional study in primary care for musculoskeletal disorders covering 77 conventional primary care providers and 18 physicians certified in NT with 241 and 164 patients respectively. Patients and physicians documented consultations and patients completed questionnaires at a one-month follow-up. Physicians documented duration and severity of symptoms, diagnosis, and procedures. The main outcomes in the evaluation of patients were: fulfillment of expectations, perceived treatment effects, and patient satisfaction. Results The most frequent diagnoses belonged to the group of dorsopathies (39% in COM, 46% in NT). We found significant differences between NT and COM with regard to patient evaluations. NT patients documented better fulfilment of treatment expectations and higher overall treatment satisfaction. More patients in NT reported positive side effects and less frequent negative effects than patients in COM. Also, significant differences between NT and COM patients were seen in the quality of the patient-physician interaction (relation and communication, medical care, information and support, continuity and cooperation, facilities availability, and accessibility), where NT patients showed higher satisfaction. Differences were also found with regard to the physicians' management of disease, with fewer work incapacity attestations issued and longer consultation times in NT. Conclusion Our findings show a significantly higher treatment and care-related patient satisfaction with primary care for musculoskeletal diseases provided by physicians practising Neural Therapy.

Diagnosis and treatment of peripartum bleeding

Severe peripartum hemorrhage (PPH) contributes to maternal morbidity and mortality and is one of the most frequent emergencies in obstetrics, occurring at a prevalence of 0.5-5.0%. Detection of antepartum risk factors is essential in order to implement preventive measures. Proper training of obstetric staff and publication of recommendations and guidelines can effectively reduce the frequency of PPH and its resulting morbidity and mortality. Therefore, an interdisciplinary expert committee was formed, with members from Germany, Austria, and Switzerland, to summarize recent scientific findings. An up-to-date presentation of the importance of embolization and of the diagnosis of coagulopathy in PPH is provided. Furthermore, the committee recommends changes in the management of PPH including new surgical options and the off-label use of recombinant factor VIIa.

Effects of cognitive behavioral stress management on HIV-1 RNA, CD4 cell counts and psychosocial parameters of HIV-infected persons

OBJECTIVE: To determine the effects of cognitive-behavioral stress management (CBSM) training on clinical and psychosocial markers in HIV-infected persons. METHODS: A randomized controlled trial in four HIV outpatient clinics of 104 HIV-infected persons taking combination antiretroviral therapy (cART), measuring HIV-1 surrogate markers, adherence to therapy and well-being 12 months after 12 group sessions of 2 h CBSM training. RESULTS: Intent-to-treat analyses showed no effects on HIV-1 surrogate markers in the CBSM group compared with the control group: HIV-1 RNA < 50 copies/ml in 81.1% [95% confidence interval (CI), 68.0-90.6] and 74.5% (95% CI, 60.4-85.7), respectively (P = 0.34), and mean CD4 cell change from baseline of 53.0 cells/microl (95% CI, 4.1-101.8) and 15.5 cells/microl (95% CI, -34.3 to 65.4), respectively (P = 0.29). Self-reported adherence to therapy did not differ between groups at baseline (P = 0.53) or at 12 month's post-intervention (P = 0.47). Significant benefits of CBSM over no intervention were observed in mean change of quality of life scores: physical health 2.9 (95% CI, 0.7-5.1) and -0.2 (95% CI, -2.1 to 1.8), respectively (P = 0.05); mental health 4.8 (95% CI, 1.8-7.3) and -0.5 (95% CI, -3.3 to 2.2) (P = 0.02); anxiety -2.1 (95% CI, -3.6 to -1.0) and 0.3 (95% CI, -0.7 to 1.4), respectively (P = 0.002); and depression -2.1 (95% CI, -3.2 to -0.9) and 0.02 (95% CI, -1.0 to 1.1), respectively (P = 0.001). Alleviation of depression and anxiety symptoms were most pronounced among participants with high psychological distress at baseline. CONCLUSION: CBSM training of HIV-infected persons taking on cART does not improve clinical outcome but has lasting effects on quality of life and psychological well-being.

Non-robotic thoracoscopic internal mammary artery preparation in the pig. A training model

Notwithstanding non-robotic, thoracoscopic preparation of the internal mammary artery (IMA) is a difficult surgical task, an appropriate experimental training model is lacking. We evaluated the young domestic pig for this purpose. Four domestic female pigs (30-40 kg body weight) were used for this study. Bilateral thoracoscopic preparation of the IMA was carried out under continuous, pressure controlled CO(2) insufflation. A 30 degrees rigid thoracoscope was inserted through a 10-mm port in the 5th/6th intercostal space (ICS) dorsally to the posterior axillary line. The dissection instrument (Ultracision Harmonic Scalpel) was inserted (5-mm port) in the 7th ICS at the posterior axillary line and the endo-forceps (5-mm port) in the 5th ICS at the posterior axillary line. Thoracoscopic IMA preparation in pig resulted more difficult than in man. A total of seven IMAs were prepared in their full intrathoracic length. A change in the preparation technique (lateral detachment of the endothoracic muscle) improved the safety of the procedure, allowing all four respective IMAs to be prepared safely, while the initial technique ensued an injury for 2 out of 3 vessels. The described young domestic pig model is suitable for experimental training of bilateral thoracoscopic IMA preparation.