Quality assurance of simulated patient feedback in communication training for fourth-year medical students

Introduction In our program, simulated patients (SPs) give feedback to medical students in the course of communication skills training. To ensure effective training, quality control of the SPs’ feedback should be implemented. At other institutions, medical students evaluate the SPs’ feedback for quality control (Bouter et al., 2012). Thinking about implementing quality control for SPs’ feedback in our program, we wondered whether the evaluation by students would result in the same scores as evaluation by experts. Methods Consultations simulated by 4th-year medical students with SPs were video taped including the SP’s feedback to the students (n=85). At the end of the training sessions students rated the SPs’ performance using a rating instrument called Bernese Assessment for Role-play and Feedback (BARF) containing 11 items concerning feedback quality. Additionally the videos were evaluated by 3 trained experts using the BARF. Results The experts showed a high interrater agreement when rating identical feedbacks (ICCunjust=0.953). Comparing the rating of students and experts, high agreement was found with regard to the following items: 1. The SP invited the student to reflect on the consultation first, Amin (= minimal agreement) 97% 2. The SP asked the student what he/she liked about the consultation, Amin = 88%. 3. The SP started with positive feedback, Amin = 91%. 4. The SP was comparing the student with other students, Amin = 92%. In contrast the following items showed differences between the rating of experts and students: 1. The SP used precise situations for feedback, Amax (=maximal agreement) 55%, Students rated 67 of SPs’ feedbacks to be perfect with regard to this item (highest rating on a 5 point Likert scale), while only 29 feedbacks were rated this way by the experts. 2. The SP gave precise suggestions for improvement, Amax 75%, 62 of SPs’ feedbacks obtained the highest rating from students, while only 44 of SPs’ feedbacks achieved the highest rating in the view of the experts. 3. The SP speaks about his/her role in the third person, Amax 60%. Students rated 77 feedbacks with the highest score, while experts judged only 43 feedbacks this way. Conclusion Although evaluation by the students was in agreement with that of experts concerning some items, students rated the SPs’ feedback more often with the optimal score than experts did. Moreover it seems difficult for students to notice when SPs talk about the role in the first instead of the third person. Since precision and talking about the role in the third person are important quality criteria of feedback, this result should be taken into account when thinking about students’ evaluation of SPs’ feedback for quality control. Bouter, S., E. van Weel-Baumgarten, and S. Bolhuis. 2012. Construction and Validation of the Nijmegen Evaluation of the Simulated Patient (NESP): Assessing Simulated Patients’ Ability to Role-Play and Provide Feedback to Students. Academic Medicine: Journal of the Association of American Medical Colleges

The trouble with quality filtering based on relative Cramér-Rao lower bounds.

Cramér Rao Lower Bounds (CRLB) have become the standard for expression of uncertainties in quantitative MR spectroscopy. If properly interpreted as a lower threshold of the error associated with model fitting, and if the limits of its estimation are respected, CRLB are certainly a very valuable tool to give an idea of minimal uncertainties in magnetic resonance spectroscopy (MRS), although other sources of error may be larger. Unfortunately, it has also become standard practice to use relative CRLB expressed as a percentage of the presently estimated area or concentration value as unsupervised exclusion criterion for bad quality spectra. It is shown that such quality filtering with widely used threshold levels of 20% to 50% CRLB readily causes bias in the estimated mean concentrations of cohort data, leading to wrong or missed statistical findings-and if applied rigorously-to the failure of using MRS as a clinical instrument to diagnose disease characterized by low levels of metabolites. Instead, absolute CRLB in comparison to those of the normal group or CRLB in relation to normal metabolite levels may be more useful as quality criteria. Magn Reson Med, 2015. © 2015 Wiley Periodicals, Inc.

BSRN Toolbox V2.0 - a tool to create quality checked output files from BSRN datasets and station-to-archive files

The BSRN Toolbox is a software package supplied by the WRMC and is freely available to all station scientists and data users. The main features of the package include a download manager for Station- to-Archive files, a tool to convert files into human readable TAB-separated ASCII-tables (similar to those output by the PANGAEA database), and a tool to check data sets for violations of the "BSRN Global Network recommended QC tests, V2.0" quality criteria. The latter tool creates quality codes, one per measured value, indicating if the data are "physically possible," "extremely rare," or if "intercomparison limits are exceeded." In addition, auxiliary data such as solar zenith angle or global calculated from diffuse and direct can be output. All output from the QC tool can be visualized using PanPlot (doi:10.1594/PANGAEA.816201).

Quality of pharmaceutical advertising and gender bias in medical journals (1998-2008): a review of the scientific literature

Objective: To review the scientific literature on pharmaceutical advertising aimed at health professionals in order to determine whether gender bias has decreased and the quality of information in pharmaceutical advertising has improved over time. Methods: We performed a content analysis of original articles dealing with medical drug promotion (1998-2008), according to quality criteria such as (a) the number, validity and accessibility of bibliographic references provided in pharmaceutical advertising and (b) the extent to which gender representations were consistent with the prevalence of the diseases. Databases: PUBMED, Medline, Scopus, Sociological Abstract, Eric and LILACS. Results: We reviewed 31 articles that analyzed advertising in medical journals from 1975-2005 and were published between 1998 and 2008. We found that the number of references used to support pharmaceutical advertising claims increased from 1975 but that 50% of these references were not valid. There was a tendency to depict men in paid productive roles, while women appeared inside the home or in non-occupational social contexts. Advertisements for psychotropic and cardiovascular drugs overrepresented women and men respectively. Conclusions: The use of bibliographic references increased between 1998 and 2008. However, representation of traditional male-female roles was similar in 1975 and 2005. Pharmaceutical advertisements may contribute to reinforcing the perception that certain diseases are associated with the most frequently portrayed sex.

Quality of life instruments in studies of menorrhagia: a systematic review

BACKGROUND: The use of quality of life (QoL) instruments in menorrhagia research is increasing but there is concern that not enough emphasis is placed on patient-focus in these measurements, i.e. on issues which are of importance to patients and reflect their experiences and concerns (clinical face validity). The objective was to assess the quality of QoL instruments in studies of menorrhagia. STUDY DESIGN: A systematic review of published research. Papers were identified through MEDLINE (1966-April 2000), EMBASE (1980-April 2000), Science Citation Index (1981-April 2000), Social Science Citation Index (1981-April 2000), CINAHL (1982-1999) and PsychLIT (1966-1999), and by manual searching of bibliographies of known primary and review articles. Studies were selected if they assessed women with menorrhagia for life quality, either developing QoL instruments or applying them as an outcome measure. Selected studies were assessed for quality of their QoL instruments, using a 17 items checklist including 10 items for clinical face validity (issues of relevance to patients' expectations and concerns) and 7 items for measurement properties (such as reliability, responsiveness, etc.). RESULTS: A total of 19 articles, 8 on instrument development and 11 on application, were included in the review. The generic Short Form 36 Health Survey Questionnaire (SF36) was used in 12/19 (63%) studies. Only two studies developed new specific QoL instruments for menorrhagia but they complied with 7/17 (41%) and 10/17 (59%) of the quality criteria. Quality assessment showed that only 7/19 (37%) studies complied with more than half the criteria for face validity whereas 17/19 (90%) studies complied with more than half of the criteria for measurement properties (P = 0.0001). CONCLUSION: Among existing QoL instruments, there is good compliance with the quality criteria for measurement properties but not with those for clinical face validity. There is a need to develop methodologically sound disease specific QoL instruments in menorrhagia focussing both on face validity and measurement properties.

Quality of life instruments in studies of menorrhagia: a systematic review

BACKGROUND: The use of quality of life (QoL) instruments in menorrhagia research is increasing but there is concern that not enough emphasis is placed on patient-focus in these measurements, i.e. on issues which are of importance to patients and reflect their experiences and concerns (clinical face validity). The objective was to assess the quality of QoL instruments in studies of menorrhagia. STUDY DESIGN: A systematic review of published research. Papers were identified through MEDLINE (1966-April 2000), EMBASE (1980-April 2000), Science Citation Index (1981-April 2000), Social Science Citation Index (1981-April 2000), CINAHL (1982-1999) and PsychLIT (1966-1999), and by manual searching of bibliographies of known primary and review articles. Studies were selected if they assessed women with menorrhagia for life quality, either developing QoL instruments or applying them as an outcome measure. Selected studies were assessed for quality of their QoL instruments, using a 17 items checklist including 10 items for clinical face validity (issues of relevance to patients' expectations and concerns) and 7 items for measurement properties (such as reliability, responsiveness, etc.). RESULTS: A total of 19 articles, 8 on instrument development and 11 on application, were included in the review. The generic Short Form 36 Health Survey Questionnaire (SF36) was used in 12/19 (63%) studies. Only two studies developed new specific QoL instruments for menorrhagia but they complied with 7/17 (41%) and 10/17 (59%) of the quality criteria. Quality assessment showed that only 7/19 (37%) studies complied with more than half the criteria for face validity whereas 17/19 (90%) studies complied with more than half of the criteria for measurement properties (P = 0.0001). CONCLUSION: Among existing QoL instruments, there is good compliance with the quality criteria for measurement properties but not with those for clinical face validity. There is a need to develop methodologically sound disease specific QoL instruments in menorrhagia focussing both on face validity and measurement properties.

Quality Estimation of e-Learning Systems

Existing approaches to quality estimation of e-learning systems are analyzed. The “layered” approach for quality estimation of e-learning systems enhanced with learning process modeling and simulation is presented. The method of quality estimation using learning process modeling and quality criteria are suggested. The learning process model based on extended colored stochastic Petri net is described. The method has been implemented in the automated system of quality estimation of e-learning systems named “QuAdS”. Results of approbation of the developed method and quality criteria are shown. We argue that using learning process modeling for quality estimation simplifies identifying lacks of an e-learning system for an expert.

An Objective Framework to Test the Quality of Candidate Indicators of Good Environmental Status

Large efforts are on-going within the EU to prepare the Marine Strategy Framework Directive’s (MSFD) assessment of the environmental status of the European seas. This assessment will only be as good as the indicators chosen to monitor the eleven descriptors of good environmental status (GEnS). An objective and transparent framework to determine whether chosen indicators actually support the aims of this policy is, however, not yet in place. Such frameworks are needed to ensure that the limited resources available to this assessment optimize the likelihood of achieving GEnS within collaborating states. Here, we developed a hypothesis-based protocol to evaluate whether candidate indicators meet quality criteria explicit to the MSFD, which the assessment community aspires to. Eight quality criteria are distilled from existing initiatives, and a testing and scoring protocol for each of them is presented. We exemplify its application in three worked examples, covering indicators for three GEnS descriptors (1, 5 and 6), various habitat components (seaweeds, seagrasses, benthic macrofauna and plankton), and assessment regions (Danish, Lithuanian and UK waters). We argue that this framework provides a necessary, transparent and standardized structure to support the comparison of candidate indicators, and the decision-making process leading to indicator selection. Its application could help identify potential limitations in currently available candidate metrics and, in such cases, help focus the development of more adequate indicators. Use of such standardized approaches will facilitate the sharing of knowledge gained across the MSFD parties despite context-specificity across assessment regions, and support the evidence-based management of European seas.

An Objective Framework to Test the Quality of Candidate Indicators of Good Environmental Status

Large efforts are on-going within the EU to prepare the Marine Strategy Framework Directive’s (MSFD) assessment of the environmental status of the European seas. This assessment will only be as good as the indicators chosen to monitor the eleven descriptors of good environmental status (GEnS). An objective and transparent framework to determine whether chosen indicators actually support the aims of this policy is, however, not yet in place. Such frameworks are needed to ensure that the limited resources available to this assessment optimize the likelihood of achieving GEnS within collaborating states. Here, we developed a hypothesis-based protocol to evaluate whether candidate indicators meet quality criteria explicit to the MSFD, which the assessment community aspires to. Eight quality criteria are distilled from existing initiatives, and a testing and scoring protocol for each of them is presented. We exemplify its application in three worked examples, covering indicators for three GEnS descriptors (1, 5 and 6), various habitat components (seaweeds, seagrasses, benthic macrofauna and plankton), and assessment regions (Danish, Lithuanian and UK waters). We argue that this framework provides a necessary, transparent and standardized structure to support the comparison of candidate indicators, and the decision-making process leading to indicator selection. Its application could help identify potential limitations in currently available candidate metrics and, in such cases, help focus the development of more adequate indicators. Use of such standardized approaches will facilitate the sharing of knowledge gained across the MSFD parties despite context-specificity across assessment regions, and support the evidence-based management of European seas.

Some Remarks on Quality in Interpreting, Interpreting Modes and the Interpreter’s Role

Quality in interpreting is a hotly debated issue whose complexity is determined by a mix of factors. In this article I analyze it in the light of the role played by interpreters, stressing how the constraints imposed by the different interpreting modes, the different roles actually played by professionals (who become more or less visible, even within the same assignment) and the expectations they generate require the adoption of a flexible perspective when it comes to identifying and assessing quality criteria and drafting professional codes that are open enough to adjust to diverse communicative settings and to the dynamic character of quality.

Impact of parenteral nutrition standardization on costs and quality in adult patients

Background: Parenteral nutrition (PN) is a costly therapy that can also be associated with serious complications. Therefore, efforts are focusing on reducing rate of complications, and costs related to PN. Objective: The aim was to analyze the effect of the implementation of PN standardization on costs and quality criteria. Secondary aim was to assess the use of individualized PN based on patient's clinical condition. Methods: We compare the use of PN before and after the implementation of PN standardization. Demographic, clinical and PN characteristics were collected. Costs analysis was performed to study the costs associated to the two different periods. Quality criteria included were: 1) PN administration; 2) nutrition assessment (energy intake between 20-35 kcal/kg/day; protein contribution according to nitrogen balance); 3) safety and complications (hyperglycemia, hypertriglyceridemia, hepatic complications, catheter-related infection); 4) global efficacy (as serum albumin increase). Chi-square test was used to compare percentages; logistic regression analysis was performed to evaluate the use of customized PN. Results: 296 patients were included with a total of 3,167 PN compounded. During the first period standardized PN use was 47.5% vs 85.7% within the second period (p < 0.05). No differences were found in the quality criteria tested. Use of individualized PN was related to critical care patients, hypertriglyceridemia, renal damage, and long-term PN. Mean costs of the PN decreased a 19.5%. Annual costs savings would be € 86,700. Conclusions: The use of customized or standard PN has shown to be efficient and flexible to specific demands; however customized PN was significantly more expensive.

Effect of coinfection with STDs and of STD treatment on HIV shedding in genital-tract secretions - Systematic review and data synthesis

Objective: To determine whether coinfection with sexually transmitted diseases (STD) increases HIV shedding in genital-tract secretions, and whether STD treatment reduces this shedding. Design: Systematic review and data synthesis of cross-sectional and cohort studies meeting. predefined quality criteria. Main Outcome Measures: Proportion of patients with and without a STD who had detectable HIV in genital secretions, HIV toad in genital secretions, or change following STD treatment. Results: Of 48 identified studies, three cross-sectional and three cohort studies were included. HIV was detected significantly more frequently in participants infected with Neisseria gonorrhoeae (125 of 309 participants, 41%) than in those without N gonorrhoeae infection (311 of 988 participants, 32%; P = 0.004). HIV was not significantly more frequently detected in persons infected with Chlamydia trachomatis (28 of 67 participants, 42%) than in those without C trachomatis infection (375 of 1149 participants, 33%; P = 0.13). Median HIV load reported in only one study was greater in men with urethritis (12.4 x 10(4) versus 1.51 x 10(4) copies/ml; P = 0.04). In the only cohort study in which this could be fully assessed, treatment of women with any STD reduced the proportion of those with detectable HIV from 39% to 29% (P = 0.05), whereas this proportion remained stable among controls (15-17%), A second cohort study reported fully on HIV load; among men with urethritis, viral load fell from 12.4 to 4.12 x 10(4) copies/ml 2 weeks posttreatment, whereas viral load remained stable in those without urethritis. Conclusion: Few high-quality studies were found. HIV is detected moderately more frequently in genital secretions of men and women with a STD, and HIV load is substantially increased among men with urethritis, Successful STD treatment reduces both of these parameters, but not to control levels. More high-quality studies are needed to explore this important relationship further.

Arg72Pro TP53 polymorphism and cancer susceptibility: a comprehensive meta-analysis of 302 case-control studies

Arg72Pro is a common polymorphism in TP53, showing differences in its biological functions. Case-control studies have been performed to elucidate the role of Arg72Pro in cancer, although the results are conflicting and heterogeneous. Here, we analyzed pooled data from case-control studies to determine the role of Arg72Pro in different cancer sites. We performed a systematic review and meta-analysis of 302 case-control studies that analyzed Arg72Pro in cancer susceptibility. Odds ratios were estimated for different tumor sites using distinct genetic models, and the heterogeneity between studies was explored using I(2) values and meta-regression. We adopted quality criteria to classify the studies. Subgroup analyses were done for tumor sites according to ethnicity, histological, and anatomical sites. Results indicated that Arg72Pro is associated with higher susceptibility to cancer in some tumor sites, mainly hepatocarcinoma. For some tumor sites, quality of studies was associated with the size of genetic association, mainly in cervical, head and neck, gastric, and lung cancer. However, study quality did not explain the observed heterogeneity substantially. Meta-regression showed that ethnicity, allelic frequency and genotyping method were responsible for a substantial part of the heterogeneity observed. Our results suggest ethnicity and histological and anatomical sites may modulate the penetrance of Arg72Pro in cancer susceptibility. This meta-analysis denotes the importance for more studies with good quality and that the covariates responsible for heterogeneity should be controlled to obtain a more conclusive response about the function of Arg72Pro in cancer.

Are tryptophan and 5-hydroxytryptophan effective treatments for depression? A meta-analysis

Objective: To review the literature regarding the effectiveness of 5-hydroxytryptophan (5-HT) and L-tryptophan in the treatment of unipolar depression. Methods: A systematic review of the literature from 1966 to 2000 using the search terms 'tryptophan', 5-hydroxytryptophan', '5-HTP', '5-HT' and 'depression'. We extracted and grouped data for meta-analysis by pooling odds ratios (OR) and relative risks where possible. Results: One hundred and eight studies were located of which only two studies, one of 5-HT and one of L-tryptophan, with a total of 64 patients met sufficient quality criteria to be included. These studies suggest 5-HT and L-tryptophan are better than placebo at alleviating depression (Peto OR = 4.1, 95% CI = 1.3-13.2). However, the small size of the studies, and the large number of inadmissible, poorly executed studies, casts doubt on the result from potential publication bias, and suggests that they are insufficiently evaluated to assess their effectiveness. Conclusions: A large body of evidence was subjected to very basic criteria for assessing reliability and validity, and was found to largely be of insufficient quality to inform clinical practice. More well-designed studies are urgently required to enable an assessment of what may be an effective class of agents.

WHAT IS THE USE OF A SINGLE-CASE STUDY IN MANAGEMENT RESEARCH?

The purpose of this article is to present a defense of the use of single case studies in management research. The defense is necessary because this type of research has been relegated to a secondary role, or even rejected, by many researchers, who consider it unscientific. Evidence of this low status is the fact that most reputable academic journals in management publish few articles based on single-case studies. In this paper, we examine in detail the objections to the use of such cases in management research. We show the efforts made by some researchers to answer these objections and we show quality criteria for research that are alternatives to the criteria used in the so-called "scientific method." Our analysis suggests that a better understanding - by researchers with different methodological preferences - of the arguments for each particular use of the single-case study as a research method would allow a better dialogue between researchers and benefit management research as a whole.