Script concordance test: uma proposta de avaliação do raciocínio gerencial da enfermagem em situações de incertezas

Pós-graduação em Enfermagem - FMB

Developing an alternative response format for the script concordance test

Introduction: Clinical reasoning is essential for the practice of medicine. In theory of development of medical expertise it is stated, that clinical reasoning starts from analytical processes namely the storage of isolated facts and the logical application of the ‘rules’ of diagnosis. Then the learners successively develop so called semantic networks and illness-scripts which finally are used in an intuitive non-analytic fashion [1], [2]. The script concordance test (SCT) is an example for assessing clinical reasoning [3]. However the aggregate scoring [3] of the SCT is recognized as problematic [4]. The SCT`s scoring leads to logical inconsistencies and is likely to reflect construct-irrelevant differences in examinees’ response styles [4]. Also the expert panel judgments might lead to an unintended error of measurement [4]. In this PhD project the following research questions will be addressed: 1. How does a format look like to assess clinical reasoning (similar to the SCT but) with multiple true-false questions or other formats with unambiguous correct answers, and by this address the above mentioned pitfalls in traditional scoring of the SCT? 2. How well does this format fulfill the Ottawa criteria for good assessment, with special regards to educational and catalytic effects [5]? Methods: 1. In a first study it shall be assessed whether designing a new format using multiple true-false items to assess clinical reasoning similar to the SCT-format is arguable in a theoretically and practically sound fashion. For this study focus groups or interviews with assessment experts and students will be undertaken. 2. In an study using focus groups and psychometric data Norcini`s and colleagues Criteria for Good Assessment [5] shall be determined for the new format in a real assessment. Furthermore the scoring method for this new format shall be optimized using real and simulated data.

Étude exploratoire du potentiel diagnostique des questions d’un test de concordance de scripts (TCS) pour évaluer le raisonnement clinique infirmier (RCI)

L'enseignement, l'apprentissage et l'évaluation du raisonnement clinique en sciences infirmières est un défi pour les éducateurs de cette profession et leurs étudiants. Depuis plusieurs décennies, les chercheurs et les éducateurs dans le domaine des sciences de la santé ont travaillé pour élaborer des instruments d'évaluation dans le but de pouvoir mesurer le raisonnement clinique (Charlin, Bordage & Van der Vleuten, 2003). Plusieurs études semblent appuyer le test de concordance de script (TCS) en termes de validité, fiabilité, faisabilité et applicabilité pour plusieurs disciplines et différents contextes (Carrière & al, 2009). Deschênes et ses collaborateurs (2006; Deschênes, Charlin, Gagnon & Goudreau, 2011) ont mis au point et validé un TCS spécifiquement pour le raisonnement clinique en sciences infirmières (RCI). Comme l'évaluation a un impact important sur les stratégies d'apprentissage des étudiants (Sibert et al, 2001; Durak, Caliskan & Bor, 2007), les outils d'évaluation valides et fiables qui permettraient l'identification des problèmes spécifiques dans le développement du raisonnement clinique en sciences infirmières seraient très utiles pour guider les décisions concernant l'éducation (Gierl, 2007). Nous avons donc mené une étude pour explorer le potentiel diagnostique des questions d'un TCS. La question de recherche est la suivante: «Dans quelle mesure chaque question d’un TCS visant à évaluer le RCI peut-elle être reliée à des catégories et des stratégies de pensée spécifiques?" Avec une sous-question: «Comment peut-on décrire le potentiel diagnostique d’un TCS pour évaluer le RCI?". Nous avons fait une deuxième analyse de contenu des données qui ont été obtenues dans une étude précédente dans laquelle cinq vignettes (15 questions) du TCS de Deschênes (2006) ont été utilisées. Les résultats ont montré les catégories et stratégies de pensées utilisées pour répondre à certaines questions du TCS selon les groupes de participants. Aussi, nos résultats ont permis de découvrir des disparités importantes entre les groupes, notamment que le RCI des expertes est si différent des étudiantes, qu’il ne peut servir de référence. Enfin, cette étude démontre que le TCS a un potentiel diagnostique niveau par niveau (1ère, 2e, 3e année et expertes) et non d’un niveau à un autre.

L’évaluation du raisonnement clinique des résidents en hématologie par l’approche de concordance de script

La pratique de l’hématologie, comme celle de toute profession, implique l’acquisition d’un raisonnement adéquat. Se basant sur une théorie de psychologie cognitive, le test de concordance de script (TCS) a été développé et validé comme un instrument permettant d’évaluer le raisonnement clinique dans diverses spécialités médicales. Le but de cette étude était d’examiner l’utilité et les paramètres psychométriques d’un TCS en hématologie. Nous avons construit un TCS composé de 60 questions que nous avons administré à 15 résidents juniors (R1 à R3 en médecine interne), 46 résidents séniors (R4, R5 et R6 en hématologie) et 17 hématologues à travers le Canada. Après optimisation, le TCS comptait 51 questions. Sa consistance interne mesurée par le coefficient de Cronbach alpha était 0.83. Le test était en mesure de discriminer entre les résidents selon leur niveau de formation. Les questions contenant des images (n=10) semblaient avoir un potentiel discriminatoire plus élevé. Les scores obtenus par les résidents séniors corrélaient modéremment avec ceux obtenus à un test conventionnel d’hématologie composé de questions à choix multiples et à courte réponse (r de Pearson = 0.42; p=0.02). Le TCS a été complété en 36 minutes en moyenne et a été bien reçu par les participants. Le TCS est un instrument d’évaluation utile et valide en hématologie. Il peut être utilisé à des fins formatives en aidant au suivi de la progression des résidents. Il pourrait aussi être combiné à d’autres instruments d’évaluation à des fins sanctionnelles, ou encore, en éducation médicale continue.

Développement de tests mesurant les habiletés de perception et d'interprétation des radiographies pulmonaires

Mémoire numérisé par la Division de la gestion de documents et des archives de l'Université de Montréal

Diversity and stability of fishes (Teleostei) in a temporary river of the Brazilian semiarid region

The effects of hydrological disturbances by flooding and drought on the diversity and stability in a temporary river fish community in the Brazilian semiarid region were analyzed over the 1996 hydrological cycle. Twelve collections of fishes were made during the wet and dry phases, and 789 individuals of 16 species were collected. Diversity was measured using Simpson's Index (S) and community stability was analyzed by the variation in abundance using Kendall's W concordance test. Fish diversity in the Taperoá river was subjected to hydrological disturbances by flooding and drought. During the wet phase the diversity was higher (S = 0.855) than during the dry phase (S = 0.771). The community was considered stable during the whole annual hydrological cycle (W = 0.418 p < 0.001), but a higher stability in the community was found during the dry phase. During the dry phase the number of dominant species was smaller than during the wet phase.

EXAMINING HOW SAME-GENDER AND MIXED-GENDER COUPLES NAVIGATE SEXUAL ISSUES IN THEIR RELATIONSHIPS

Sexual scripts—the definitions and expectations that individuals hold for sexual interactions—are thought to play an important role in the maintenance of sexual well-being. Sexual scripts can be rigid or flexible, and they can be concordant or discordant between members of a couple. Sex therapists support sexual script flexibility for maintaining sexual and relationship satisfaction when couples are navigating sexual issues. However, empirical research examining the role of sexual script flexibility and the degree of script concordance/discordance in couples’ sexual well-being has been limited, due in part to the limited measures available. Furthermore, within the existing research, there has been an unfortunate tendency to exclude individuals in same-gender relationships – perpetuating the long-standing knowledge gap in the literature on positive sexuality in diverse relationships. To address these gaps in the literature, we conducted a series of online studies that recruited individuals in diverse relationships. A measure of individual sexual script flexibility in response to sexual issues was developed (Chapter 2); in addition, the structure of an existing measure assessing couple sexual scripts in response to a sexual issue was evaluated (Chapter 3). Chapter 4 examined how individuals in diverse relationships compared on measures of individual sexual script flexibility and on couple sexual scripts. Findings suggest that there are more similarities than differences across diverse couples. Chapter 5 explored how flexibility in an individual’s approach to sexual issues relates to sexual well-being, specifically by assessing sexual communication and partner responses as mediators. Results suggest that individual sexual script flexibility relates to sexual well-being through reciprocal partner processes. Collectively, this research program suggests that more similarities than differences exist between individuals in same- and mixed-gender relationships, and that partners are important to consider in the relationship between individual sexual script flexibility and sexual well-being. These findings have implications for sex and couple therapy; these results emphasize the importance of interventions that target both members of the couple, and further our understanding of sexuality in same- and mixed-gender relationships.

Le test de concordance de script (TCS) explore-t-il des processus de raisonnement clinique différents de ceux du QCM à contexte riche (basés sur des cas cliniques) ? : et si oui, quels sont-ils ?

Mémoire numérisé par la Division de la gestion de documents et des archives de l'Université de Montréal

Western blotting using Strongyloides ratti antigen for the detection of IgG antibodies as confirmatory test in human strongyloidiasis

The present study was conducted to evaluate the frequency of antigenic components recognized by serum IgG antibodies in Western blotting (WB) using a Strongyloides ratti larval extract for the diagnosis of human strongyloidiasis. In addition, the WB results were compared to the enzyme-linked immunosorbent assay (ELISA) and the indirect immunofluorescence antibody test (IFAT) results. Serum samples of 180 individuals were analyzed (80 with strongyloidiasis, 60 with other intestinal parasitoses, and 40 healthy individuals). S. ratti was obtained from fecal culture of experimentally infected Rattus rattus. For IFAT, S. ratti larvae were used as antigen and S. ratti larval antigenic extracts were employed in WB and ELISA. Eleven S. ratti antigenic components were predominantly recognized by IgG antibodies in sera of patients with strongyloidiasis. There was a positive concordance for the three tests in 87.5% of the cases of strongyloidiasis. The negative concordance in the three tests was 94% and 97.5%, in patients with other intestinal parasitoses and healthy individuals, respectively. In cases of positive ELISA and negative IFAT results, diagnosis could be confirmed by WB. ELISA, IFAT, and WB using S. ratti antigens showed a high rate of sensitivity and specificity. In conclusion, WB using S. ratti larval extract was able to recognize 11 immunodominant antigenic components, showing to be a useful tool to define the diagnosis in cases of equivocal serology.

Evaluation of an enzyme-linked immunoelectrotransfer blot test for the confirmatory serodiagnosis of human toxocariasis

To improve the serodiagnosis of human toxocariasis, a sensitive and specific enzyme-linked immunoelectrotransfer blot (EITB-IgG) test was developed and evaluated using Toxocara canislarvae excretory-secretory antigens for detecting anti-Toxocara IgG antibodies. The EITB-IgG profile of toxocariasis was characterized by comparing 27 sera from patients with toxocariasis, 110 sera from healthy subjects and 186 sera from patients with other helminth diseases (ascariasis, ancylostomiasis, trichuriasis, enterobiasis, strongyloidiasis, hymenolepiasis, diphyllobothriasis, taeniasis, cysticercosis, hydatidosis and fascioliasis). Antigenic bands of 24, 28, 30, 35, 56, 117, 136 and 152 kDa were predominantly recognized in sera from all patients with toxocariasis. However, only bands of 24-35 kDa were highly specific for Toxocara infection (98.3%), whereas other antigenic bands observed displayed cross-reactivity. Additionally, when the results of the EITB-IgG test were compared to those of the ELISA-IgG test, a 100% concordance was observed for positive results in human toxocariasis cases. The concordance for negative results between the two tests for healthy subjects and patients with other helminth diseases were 96.3% and 53.7%, respectively, showing that the EITB-IgG test has a higher specificity than ELISA. In conclusion, the EITB-IgG test is a very useful tool to confirm the serological diagnosis of human toxocariasis.

Development of a Real-time PCR test for porcine group A rotavirus diagnosis

Group A Rotavirus (RVA) is one of the most common causes of diarrhea in humans and several animal species. A SYBR-Green Real-Time polymerase chain reaction (PCR) was developed to diagnose RVA from porcine fecal samples, targeting amplification of a 137-bp fragment of nonstructural protein 5 (NSP5) gene using mRNA of bovine NADH-desidrogenase-5 as exogenous internal control. Sixty-five samples were tested (25 tested positive for conventional PCR and genetic sequencing). The overall agreement (kappa) was 0.843, indicating 'very good' concordance between tests, presenting 100% of relative sensitivity (25+ Real Time PCR/25+ Conventional PCR) and 87.5% of relative sensitivity (35- Real Time PCR/40- Conventional PCR). The results also demonstrated high intra- and inter-assay reproducibility (coefficient of variation ≤1.42%); thus, this method proved to be a fast and sensitive approach for the diagnosis of RVA in pigs.

Evaluation of the cytotoxic and genotoxic potential of water from the River Paraíba do Sul, in Brazil, with the Allium cepa L. test

This work investigated the cytotoxic and genotoxic potential of water from the River Paraíba do Sul (Brazil) using Allium cepa roots. An anatomo-morphological parameter (root length), mitotic indices, and frequency of micronuclei were analysed. Eight bulbs were chosen at random for treatment for 24 to 120 hours with the River water collected in the years of 2005 and 2006 from sites in the cities of Tremembé and Aparecida (São Paulo state, Brazil). Daily measurements of the length of the roots grown from each bulb were carried out throughout the experiment. Mitotic index (MI) and frequency of micronuclei (MN) were determined for 2000 cells per root, using 3-5 root tips from other bulbs (7-10). Only in the roots treated with samples of the River water collected in 2005 in Tremembé city was there a decrease in the root length growth compared to the respective control. However, a reduction in MI values was verified for both sites analysed for that year. Considering the data involving root length growth and especially MI values, a cytotoxic potential is suggested for the water of the River Paraíba do Sul at Tremembé and Aparecida, in the year of 2005. On the other hand, since in this year the MN frequency was not affected with the river water treatments, genotoxicity is not assumed for the river water sampled at the aforementioned places.

Comparison between the 1% and 2% ibopamine provocative test in primary open-angle glaucoma patients: sensitivity, specificity and tolerability

PURPOSE: To compare intraocular pressure (IOP) rise in normal individuals and primary open-angle glaucoma patients and the safety and efficacy of ibopamine eye drops in different concentrations as a provocative test for glaucoma. METHODS: Glaucoma patients underwent (same eye) the ibopamine provocative test with two concentrations, 1% and 2%, in a random sequence at least 3 weeks apart, but not more than 3 months. The normal individuals were randomly submitted to one of the concentrations of ibopamine (1% and 2%). The test was considered positive if there was an IOP rise greater than 3 or 4 mmHg at 30 or 45 minutes to test which subset of the test has the best sensitivity (Se)/specificity (Sp). RESULTS: There was no statistically significant difference in any of the IOP measurements, comparing 1% with 2% ibopamine. The IOP was significantly higher at 30 and 45 minutes with both concentrations (p<0.001). The best sensitivity/specificity ratio was achieved with the cutoff point set as greater than 3 mmHg at 45 minutes with 2% ibopamine (area under the ROC curve: 0.864, Se: 84.6%; Sp:73.3%). All patients described a slight burning after ibopamine's instillation. CONCLUSION: 2% ibopamine is recommended as a provocative test for glaucoma. Because both concentrations have similar ability to rise IOP, 1% ibopamine may be used to treat ocular hypotony.

Applying a new version of the Brazilian-Portuguese UPSIT smell test in Brazil

Standardized olfactory tests are now available to quantitatively assess disorders of olfaction. A Brazilian-Portuguese version of the University of Pennsylvania Smell Identification Test (UPSIT) is currently being developed specifically for the Brazilian population. The most recent Brazilian-Portuguese version of the UPSIT (UPSIT-Br2) was administered to 88 Brazilian subjects who had no history of neurological or otorhinolaryngological disease. UPSIT-Br2 scores decreased with age, were lower in men than in women, and were lower in subjects with lower income. The degree to which the poorer performance of subjects with lower socio-economic status reflects lack of familiarity with test items is not known. Although this version of the UPSIT provides a sensitive and useful test of smell function for the Brazilian population, a revision of some test items is needed to achieve comparable norms to those found using the North American UPSIT in the United States.