Étude exploratoire du potentiel diagnostique des questions d’un test de concordance de scripts (TCS) pour évaluer le raisonnement clinique infirmier (RCI)

L'enseignement, l'apprentissage et l'évaluation du raisonnement clinique en sciences infirmières est un défi pour les éducateurs de cette profession et leurs étudiants. Depuis plusieurs décennies, les chercheurs et les éducateurs dans le domaine des sciences de la santé ont travaillé pour élaborer des instruments d'évaluation dans le but de pouvoir mesurer le raisonnement clinique (Charlin, Bordage & Van der Vleuten, 2003). Plusieurs études semblent appuyer le test de concordance de script (TCS) en termes de validité, fiabilité, faisabilité et applicabilité pour plusieurs disciplines et différents contextes (Carrière & al, 2009). Deschênes et ses collaborateurs (2006; Deschênes, Charlin, Gagnon & Goudreau, 2011) ont mis au point et validé un TCS spécifiquement pour le raisonnement clinique en sciences infirmières (RCI). Comme l'évaluation a un impact important sur les stratégies d'apprentissage des étudiants (Sibert et al, 2001; Durak, Caliskan & Bor, 2007), les outils d'évaluation valides et fiables qui permettraient l'identification des problèmes spécifiques dans le développement du raisonnement clinique en sciences infirmières seraient très utiles pour guider les décisions concernant l'éducation (Gierl, 2007). Nous avons donc mené une étude pour explorer le potentiel diagnostique des questions d'un TCS. La question de recherche est la suivante: «Dans quelle mesure chaque question d’un TCS visant à évaluer le RCI peut-elle être reliée à des catégories et des stratégies de pensée spécifiques?" Avec une sous-question: «Comment peut-on décrire le potentiel diagnostique d’un TCS pour évaluer le RCI?". Nous avons fait une deuxième analyse de contenu des données qui ont été obtenues dans une étude précédente dans laquelle cinq vignettes (15 questions) du TCS de Deschênes (2006) ont été utilisées. Les résultats ont montré les catégories et stratégies de pensées utilisées pour répondre à certaines questions du TCS selon les groupes de participants. Aussi, nos résultats ont permis de découvrir des disparités importantes entre les groupes, notamment que le RCI des expertes est si différent des étudiantes, qu’il ne peut servir de référence. Enfin, cette étude démontre que le TCS a un potentiel diagnostique niveau par niveau (1ère, 2e, 3e année et expertes) et non d’un niveau à un autre.

Comparabilité entre modalités d’évaluation TIC et papier-crayon : cas de productions écrites en français en cinquième secondaire au Québec

Au niveau méthodologique, ce travail innove en combinant plusieurs moyens d'observation complémentaires sur le processus d'écriture et sur le processus de correction. Les observations qualitatives ainsi recueillies sont retranscrites en les combinant selon l'ordre chronologique d'apparition, puis elles sont traitées et analysées sous le logiciel QDA Miner.

Les croyances des enseignants et leurs pratiques relativement à l’évaluation de l’oral : étude de cas de deux enseignants de français de 3e secondaire

Depuis quelques années, plusieurs didacticiens du français se penchent sur l’enseignement et l’évaluation de l’oral, mais peu d’informations sont encore disponibles concernant les pratiques effectives des enseignants à cet égard. Notre recherche vise à décrire les croyances de deux enseignants de français au secondaire et leurs pratiques au sujet de l’évaluation de l’oral, plus particulièrement de l’oral dans une situation d’interaction entre pairs. Une entrevue dirigée a permis d’avoir accès à leurs croyances et à leurs pratiques déclarées, alors que le think-aloud a été employé pour observer leur pratique d’évaluation, à l’étape du jugement, d’une situation d’interaction entre pairs. Nos résultats montrent que, du point de vue de leurs croyances, les enseignants ont tous deux des préoccupations concernant les tâches et les instruments d’évaluation, et que leurs pratiques d’évaluation déclarées sont assez semblables en ce qui a trait aux tâches retenues, à leur fréquence et à l’intention poursuivie. Du côté de leurs pratiques d’évaluation observées à l’étape du jugement, nous exposons de façon détaillée les gestes d’enseignants en situation authentique, en identifiant les principaux processus cognitifs et métacognitifs impliqués dans cette tâche complexe. Des divergences entre les deux enseignants ont été observées relativement à leurs croyances, pratiques déclarées et pratiques observées durant le jugement. Tout d’abord, les critères retenus pour l’évaluation (pratique déclarée) ne tiennent pas toujours compte de ce qu’ils croient important d’enseigner en classe (croyance). De plus, malgré une pratique déclarée positive concernant l’autoévaluation, ces enseignants n’y ont peu ou pas eu recours durant leur jugement. Enfin, les gestes de l’un, durant le jugement, tendaient vers la posture d’instructeur-contrôleur, alors que ceux de l’autre s’inscrivaient davantage dans la posture de conseiller-didacticien. De façon générale, nous constatons que les pratiques de ces enseignants sont plus influencées par les situations rencontrées en tant qu’élèves et les traditions d’enseignement de la discipline que par le programme en vigueur.

Adaptación de un programa de desarrollo socio-cognitivo para niños con deprivaciones socio-ambientales.

Adaptar el programa think aloud (pensar en voz alta) de Bash y Camp a las necesidades cognitivas de alumnos procedentes de medios socio-ambientalmente deprivados, con el fin de facilitar la adquisición de estrategias de resolución de problemas tanto cognitivos como sociales; conjugando para ello la metodología cognitivo-conductual de dicho programa con los planteamientos que sobre el desarrollo socio-cognitivo presenta la Escuela de Ginebra. Formulan 3 hipótesis. 25 alumnos pertenecientes al programa de educación compensatoria, con edades comprendidas entre los 5 y 7 años, escolarizados en centros públicos de Palencia capital. Utilizan un diseño cuasiexperimental de grupo control no equivalente. Realizan una fase de pretest o evaluación inicial, aplican el programa de desarrollo socio-cognitivo, evaluan y por último efectuan un seguimiento. Las variables utilizadas son: 1. V. D.; Habilidad para resolver problemas sociales, habilidad para resolver problemas cognitivos, 2. V. I.; Aplicación del programa de desarrollo socio-cognitivo, 3. V. C.; Aplicación del programa por 4 profesores, teorías educativas y estilos de enseñanza. 1. Batería de habilidades sociales en la solución de problemas interpersonales para ciclo inicial; prueba de inducción de causas, prueba de generación de alternativas, prueba de identificación de sentimientos, prueba de estrategias medios-fines, 2. Escala para la medición de las estrategias de resolución de problemas cognitivos, 3. Cuestionario para padres, 4. Escala de inteligencia de Wechsler para preescolar y primaria (WPPSI), 5. Hoja de registro del estilo de enseñanza del profesor, 6. Cuestionario de las teorías implícitas de la educación, 7. Escala de evaluación de programas de entrenamiento, 8. Cuestionario de evaluación de la intervención por unidades, 9. Cuestionario de evaluación de la intervención global, 10. Indicadores de evaluación por unidades, 11. Programa de entrenamiento socio-cognitivo. Análisis intragrupo, análisis intergrupo, análisis de la varianza de dos clasificaciones por rangos de Friedman, prueba de rangos y pares igualados de Wilcoxon, tablas. 1. Los sujetos del grupo experimental comparados con ellos mismos mejoran en la resolución de problemas tanto sociales como cognitivos. 2. Los sujetos del grupo experimental comparados con los del grupo control mejoran en la resolución de problemas sociales y en la resolución de problemas cognitivos en el apartado de entrada de la información, en el procesamiento y salida de la información se aprecian simplemente ciertos avances cualitativos. 3. El programa de entrenamiento sirve para que los alumnos progresen en aspectos atencionales, en inhibición de conductas impulsivas y en estrategias de autocontrol. 4. El profesorado considera que el programa motiva a los niños y que se inserta perfectamente en la actividad curricular ordinaria, facilitando la generalización de lo aprendido.

Are discourse comprehension and cognitive processes influenced by the type of language language (English and Spanish)? A cross-language study based on elaborative inferences generation

Resumen basado en el de la publicación

Making the tacit explicit: children's strategies for classroom writing

A key highlight of this study is generating evidence of children ‘making aware the unaware’, making tacit knowledge explicit. The research explores the levels of awareness in thinking used by eight 7–8 year-old children when engaged in school-based genre writing tasks. The focus is on analysing children’s awareness of their thought processes, using a framework originally devised by Swartz and Perkins (1989), in order to investigate ways in which children can transform their tacit knowledge to explicit within the writing process. Classroom ‘think aloud’ protocols are used to help children ‘manage their knowledge transfer’, to speak the unspoken. In their framework Swartz and Perkins distinguish between four levels of thought that they view as hierarchical and ‘increasingly metacognitive.’ However, there is little evidence in this study to show that levels of awareness in thinking are increasingly progressive and observations made during the study suggest that young writers move in and out of the suggested levels of thinking during different elements of a writing task. The reasons for this may depend on a number of factors which are noted in this paper. Evidence does suggest children in this age group are consciously aware of their own and others’ thought processes both with and without adult prompting. By using collaborative talk, their awareness of these thought processes is highlighted enabling the co-construction and integration of new ideas into their existing knowledge base.

Är explicit undervisning nyckeln till ökad läsförståelse? : En kvalitativ intervjustudie om hur fem lärare i F–3 beskriver sin undervisning i läsförståelse och lässtrategier

Resultaten av de senaste PIRLS-undersökningarna visar att svenska elevers läsförståelse har försämrats under senare år. Enligt forskning bör undervisningen vara inriktad på lässtrategier för att elever ska utveckla läsförståelse. För att eleverna ska lära sig använda olika lässtrategier självständigt när de tolkar text och skapar mening behöver de undervisas explicit. Undervisningen bör vara strukturerad och varierad samtidigt som läraren stöttar eleverna och anpassar undervisningen efter deras individuella behov. Syftet med studien har varit att undersöka hur lärare i F–3 undervisar i läsförståelse och lässtrategier för att se vilka förtjänster och brister som finns. Studiens metod är kvalitativ och för att samla in material har fem halvstrukturerade intervjuer genomförts med fem verksamma lärare, fyra klasslärare och en specialpedagog, fördelade på fyra olika skolor. Resultaten visar att lärare använder sig av olika undervisningsmetoder när de undervisar i läsförståelse, såsom en läsande klass, think-aloud, cirkelmodellen och Chambers modell för boksamtal. Det som tycks genomsyra lärarnas undervisning i läsförståelse är kommunikation, vilket är nära sammankopplat med studiens teoretiska utgångspunkt, det sociokulturella perspektivet. Enligt lärarna samtalar de mycket med eleverna om texter, och de verkar försöka anpassa undervisningen efter elevernas individuella behov genom att välja texter som eleverna har förkunskaper i och om. När de undervisar explicit tycks lärarna diskutera olika lässtrategiers nyttoanvändning genom att samtala om hur och varför olika lässtrategier är lämpliga att använda i olika sammanhang. Enligt lärarna erbjuds eleverna undervisning i olika gruppkonstellationer såsom arbete i helklass, halvklass, mindre grupper, parvis och enskilt. Lärarna tycks vara tydliga i sin undervisning för att eleverna ska bli medvetna om i vilket syfte de ska läsa.

A aprendizagem de inglês mediada por jogos eletrônicos do tipo MMORPG

Massively Multiplayer Online Role-Playing Games (MMORPGs) are role-playing games that, through the Internet, can integrate thousands of players interacting at the same time in at least one virtual world. This way, these games can provide, further than fun, a greater familiarity with the additional language and opportunity to improve the linguistic proficiency in a real context. Hence, what is proposed in this study is extended knowledge about the learning of an additional language mediated by MMORPGs for teachers to know how, if relevant, to present, use or encourage this practice to their students. Based on this major purpose, we seek to answer the following research questions: (a) what distinguishes the learning profile of the gamers and non-gamers; (b) if MMORPGs can, through a hybrid and systematic approach, assist the development of proficiency of the additional language and (c) what the think-aloud protocols show about the learning mediated by the MMORPG Allods Online. Following an experimental method (NUNAN, 1997), 16 students of the curricular component Reading and Writing Practices in English Language have comprised the control group and 17 students of the same class formed the experimental group and were submitted to a pre and post-test adapted from the Key English Test (KET) by the Cambridge University (2008). The tests were conducted before and after a period of 5 weeks of 3 hours of practice with Allods Online a week (experimental group), and classes of the curricular component (both groups). A quantitative analysis of the questionnaires about the exposure to English profiles of the participants, a quantitative analysis of the tests scores and a qualitative analysis of the thinkaloud protocols collected during the experiment were conducted based on the theories of (a) motivation (GARDNER, 1985, WILLIAMS & BURDEN, 1997, BROWN, 2007, HERCULANO-HOUZEL, 2005); (b) active learning (GASS, 1997, GEE, 2008, MATTAR, 2010); (c) interaction and collaborative learning (KRASHEN, 1991, GASS, 1997, VYGOTSKY, 1978); (d) situated learning (DAMASIO, 1994; 1999; 2003, BROWN, 2007, GEE, 2003) and (e), tangential learning (PORTNOW, 2008; MATTAR, 2010). The results indicate that the participants of the experimental group (gamers) seem to be more engaged in tangential English learning activities, such as playing games, listening to music in English, communicating with foreigners and reading in English. We also deduced that the period of experiment possibly generated positive results on the gamers proficiency scores, mainly in the parts related to orthographic development, reading and comprehension, writing with focus on content and orthographic accuracy. Lastly, the think-aloud protocols presented evidences that the gamers have engaged in active English language learning, they have interacted in English with other players, and learned linguistic aspects through the experience with the MMORPG Allods Online

Aprendizagem dos alunos de 5º ano do ensino fundamental em aritmética e suas dificuldades na resolução de problemas com estrutura multiplicativa

The topic in this work involving the resolution of problems with structure multiplicativa emerged from discussions carried out on the difficulties encountered by students of the first cycle of the Fundamental School in Mathematics, mainly in respect of the arithmetic. The research had as objective to investigate the main difficulties presented by these students when they are faced with a task for a resolution of problems with multiplicativa structure. Were participants, in the first stage of the study, 20 students of the fifth year of the Fundamental School of a state school of public education of the State of Sao Paulo. These students have an assessment containing ten problems with structure multiplicativa answered a questionnaire regarding of mathematics. In the second stage, were selected two students to participate in the think aloud. The data analysis showed that the difficulties presented by the participants were: 1- difficulty to read and interpret the set of problems; 2- select the operation correct; 3- to operate correctly; 4 – Trouble writing

Web-Usability aus linguistischer und formaler Sicht : am Beispiel von universitären Websites

Ein Tag ohne Internet ist für viele kaum vorstellbar. Das Spektrum der Internetnutzer ist breiter geworden und damit sind die Ansprüche an die Websites massiv angestiegen. Die Entscheidung auf einer Website zu bleiben oder auf einer anderen zu suchen fällt innerhalb von wenigen Sekunden. Diese Entscheidung ist sowohl vom Website-Design als auch von dem dargestellten Inhalt abhängig. Die Auswertung, wie schnell der Benutzer Online-Informationen finden und wie einfach er sie verstehen kann, ist die Aufgabe von Web-Usability-Testing. Für das Finden und Verstehen von Informationen sind die computertechnischen zusammen mit den linguistischen Aspekten zuständig. In der Usability-Forschung liegt jedoch der Fokus bislang weitgehend auf der Bewertung der computer¬linguistischen und ästhetischen Aspekte der Websites. In den Hintergrund gedrängt wurden dabei die linguistischen Aspekte. Im Vergleich sind diese weniger systematisch erforscht und in Usability-Richtlinien kaum zu finden. Stattdessen stößt man überwiegend auf allgemeine Empfehlungen. Motiviert davon hat die vorliegende Arbeit das Ziel, Die Web-Usability systematisch sowohl aus linguistischer als auch aus formaler Sicht zu erforschen. Auf linguistischer Ebene wurde in Anlehnung an die Zeichentheorie von Morris die Web-Usability analysiert und der Begriff Linguistische Web-Usability eingeführt. Auf Basis dieser Analyse sowie einer literaturstudie ‘literature review’ mehrerer Usability-Richtlinien wurde ein Kriterienkatalog entwickelt. Bei der Umsetzung dieses Kriterienkatalogs im Rahmen einer Usability-Studie wurde die Website der Universität Johannes Gutenberg-Universität Mainz (JGU) im Usability-Labor unter Anwendung der Methode Eye-Tracking zusammen mit der Think-Aloud-Methode und der Retrospective-Think-Aloud-Methode getestet. Die empirischen Ergebnisse zeigen, dass die linguistischen Usability-Probleme genau wie die formalen die Benutzer hindern, die gesuchten Informationen zu finden, oder zumindest ihre Suche verlangsamen. Dementsprechend sollten die linguistischen Perspektiven in die Usability-Richtlinien miteinbezogen werden.

Perceived difficulty and time effectiveness in translation: a comparison of machine translation post-editing and translation memory use

Con il presente studio si è inteso analizzare l’impatto dell’utilizzo di una memoria di traduzione (TM) e del post-editing (PE) di un output grezzo sul livello di difficoltà percepita e sul tempo necessario per ottenere un testo finale di alta qualità. L’esperimento ha coinvolto sei studenti, di madrelingua italiana, del corso di Laurea Magistrale in Traduzione Specializzata dell’Università di Bologna (Vicepresidenza di Forlì). I partecipanti sono stati divisi in tre coppie, a ognuna delle quali è stato assegnato un estratto di comunicato stampa in inglese. Per ogni coppia, ad un partecipante è stato chiesto di tradurre il testo in italiano usando la TM all’interno di SDL Trados Studio 2011. All’altro partecipante è stato chiesto di fare il PE completo in italiano dell’output grezzo ottenuto da Google Translate. Nei casi in cui la TM o l’output non contenevano traduzioni (corrette), i partecipanti avrebbero potuto consultare Internet. Ricorrendo ai Think-aloud Protocols (TAPs), è stato chiesto loro di riflettere a voce alta durante lo svolgimento dei compiti. È stato quindi possibile individuare i problemi traduttivi incontrati e i casi in cui la TM e l’output grezzo hanno fornito soluzioni corrette; inoltre, è stato possibile osservare le strategie traduttive impiegate, per poi chiedere ai partecipanti di indicarne la difficoltà attraverso interviste a posteriori. È stato anche misurato il tempo impiegato da ogni partecipante. I dati sulla difficoltà percepita e quelli sul tempo impiegato sono stati messi in relazione con il numero di soluzioni corrette rispettivamente fornito da TM e output grezzo. È stato osservato che usare la TM ha comportato un maggior risparmio di tempo e che, al contrario del PE, ha portato a una riduzione della difficoltà percepita. Il presente studio si propone di aiutare i futuri traduttori professionisti a scegliere strumenti tecnologici che gli permettano di risparmiare tempo e risorse.

Exploring the validity and reliability of a questionnaire for evaluating virtual patient design with a special emphasis on fostering clinical reasoning

Background: The design of Virtual Patients (VPs) is essential. So far there are no validated evaluation instruments for VP design published. Summary of work: We examined three sources of validity evidence of an instrument to be filled out by students aimed at measuring the quality of VPs with a special emphasis on fostering clinical reasoning: (1) Content was examined based on theory of clinical reasoning and an international VP expert team. (2) Response process was explored in think aloud pilot studies with students and content analysis of free text questions accompanying each item of the instrument. (3) Internal structure was assessed by confirmatory factor analysis (CFA) using 2547 student evaluations and reliability was examined utilizing generalizability analysis. Summary of results: Content analysis was supported by theory underlying Gruppen and Frohna’s clinical reasoning model on which the instrument is based and an international VP expert team. The pilot study and analysis of free text comments supported the validity of the instrument. The CFA indicated that a three factor model comprising 6 items showed a good fit with the data. Alpha coefficients per factor were 0,74 - 0,82. The findings of the generalizability studies indicated that 40-200 student responses are needed in order to obtain reliable data on one VP. Conclusions: The described instrument has the potential to provide faculty with reliable and valid information about VP design. Take-home messages: We present a short instrument which can be of help in evaluating the design of VPs.

Exploring the validity and reliability of a questionnaire for evaluating virtual patient design with a special emphasis on fostering clinical reasoning

Background: Virtual patients (VPs) are increasingly used to train clinical reasoning. So far, no validated evaluation instruments for VP design are available. Aims: We examined the validity of an instrument for assessing the perception of VP design by learners. Methods: Three sources of validity evidence were examined: (i) Content was examined based on theory of clinical reasoning and an international VP expert team. (ii) The response process was explored in think-aloud pilot studies with medical students and in content analyses of free text questions accompanying each item of the instrument. (iii) Internal structure was assessed by exploratory factor analysis (EFA) and inter-rater reliability by generalizability analysis. Results: Content analysis was reasonably supported by the theoretical foundation and the VP expert team. The think-aloud studies and analysis of free text comments supported the validity of the instrument. In the EFA, using 2547 student evaluations of a total of 78 VPs, a three-factor model showed a reasonable fit with the data. At least 200 student responses are needed to obtain a reliable evaluation of a VP on all three factors. Conclusion: The instrument has the potential to provide valid information about VP design, provided that many responses per VP are available.

Measuring Spatial Presence: Introducing and Validating the Pictorial Presence SAM

The aim of the present study was to develop a pictorial presence scale using selfassessment- manikins (SAM). The instrument assesses presence sub-dimensions (selflocation and possible actions) as well as presence determinants (attention allocation, spatial situation model, higher cognitive involvement, and suspension of disbelief). To qualitatively validate the scale, think-aloud protocols and interviews (n = 12) were conducted. The results reveal that the SAM items are quickly filled out as well as easily, intuitively, and unambiguously understood. Furthermore, the instrument’s validity and sensitivity was quantitatively examined in a two-factorial design (n = 317). Factors were medium (written story, audio book, video, and computer game) and distraction (non-distraction vs. distraction). Factor analyses reveal that the SAM presence dimensions and determinants closely correspond to those of the MEC Spatial Presence Questionnaire, which was used as a comparison measure. The findings of the qualitative and quantitative validation procedures show that the Pictorial Presence SAM successfully assesses spatial presence. In contrast to the verbal questionnaire data (MEC), the significant distraction effect suggests that the new scale is even more sensitive. This points out that the scale can be a useful alternative to existing verbal presence selfreport measures.

Improving the Assessment of Communication Skills at the Swiss Federal Licensing Exam: Results of a Student's Needs Assessment

Introduction With a three year project the assessment of communication skills within the Swiss Federal Licensing Examinations (FLE) shall be improved. As a first step a needs assessment among communication experts and medical students of the Swiss Medical Faculties will be performed. In this presentation the results of the students’ needs assessment will be presented. Methods A bilingual student’s online questionnaire will be developed by an expert panel taking relevant literature, the Swiss Catalogue of Learning Objectives and other consensus statements for communication (e.g., the European and Basler consensus statements) into account. With a think aloud study response process validity evidence will be sought. The questionnaire will focus on the following topics related to communication skills: (1) What has been taught?, (2) What has been assessed in the faculty exams?, (3) What has been assessed in the FLE?, (4) What should have been assessed in the FLE and how should the assessment be improved? Results Results of the students’ needs assessment will be available by the end of 2015 and be presented. Conclusions/ Take-home message We hope for valuable input for improving the assessment of communications skills within the FLE also from the students’ side. Results of the needs assessment from the students and experts will be combined and taken as input for an international expert symposium on how to improve the communication skills assessment within the FLE.