Application of cognitive diagnosis models to competency-based situational judgment tests

Resumen tomado de la publicaci??n

Le défi de l’intégration de l’approche par compétences lors de la sélection : conception d’un test de jugement situationnel ciblant le rôle CanMEDS de collaborateur pour la sélection au niveau postdoctoral en médecine

Introduction : L’approche par compétences est maintenant bien ancrée dans l’enseignement au niveau de la formation médicale postdoctorale. Dans ce contexte, un système de sélection également axé sur les compétences pourrait être avantageux. L’objectif principal de ce projet était de concevoir un TJS ciblant le rôle CanMEDS de collaborateur pour la sélection au niveau postdoctoral en médecine interne (MI) et en médecine familiale (MF). Méthodologie : Des entrevues d’incidents critiques ont été réalisées auprès de résidents juniors en MI ou en MF afin de générer les items du TJS. Trois leaders de l’approche par compétences ont révisé le contenu du test. Les items ont été analysés pour identifier la compétence principale du rôle CanMEDS de collaborateur, le contexte ainsi que les membres de l’équipe interprofessionnelle représentés dans les vignettes. La clé de correction a été déterminée par un panel composé de 11 experts. Cinq méthodes de notation ont été comparées. Résultats : Sept entrevues ont été réalisées. Après révision, 33 items ont été conservés dans le TJS. Les compétences clés du rôle CanMEDS de collaborateur, les contextes et les divers membres de l’équipe interprofessionnelle étaient bien distribués au travers des items. La moyenne des scores des experts variait entre 43,4 et 75,6 % en fonction des différentes méthodes de notation. Le coefficient de corrélation de Pearson entre les cinq méthodes de notation variait entre 0,80 et 0,98. Conclusion : Ce projet démontre la possibilité de concevoir un TJS utilisant le cadre CanMEDS comme trame de fond pour l’élaboration de son contenu. Ce test, couplé à une approche globale de sélection basée sur les compétences, pourrait éventuellement améliorer le pouvoir prédictif du processus de sélection au niveau de la formation médicale postdoctorale.

Moral judgment competence of medical students: a transcultural study

The authors conducted a cross-sectional short-term study using Lind's Moral Judgment Test (MJT) to compare moral judgment competence (C-score) among students from a medical school in the Northeast region of Brazil and a medical school in the Northern region of Portugal. This study compares the C-scores of groups in the first and eighth semesters of study within each medical school and groups from corresponding semesters between the two medical schools. This study also evaluates the influence of such factors as age and gender on moral competence. A regression of moral judgment competence among the students in their eighth semester versus the students in the first semester of Brazilian medical school (p < 0.001) and a stagnation of moral competence among students in their eighth semester versus the first semester students in the Portuguese medical school (p = 0.06) were observed. For both the first semester and eighth semester groups, the students in the Portuguese medical school had higher C-scores than the students in the Brazilian medical school. In the analysis of the students' performances in terms of MJT dilemmas, the phenomenon of moral segmentation was observed in all of the groups, and the students performed better on the worker's dilemma than on the doctor's dilemma. Among students in the same semester of study, older students had lower C-scores. There was generally no significant difference between men's and women's C-scores. © 2013 Springer Science+Business Media Dordrecht.

A teoria de Kohlberg sobre o desenvolvimento do raciocínio moral e os instrumentos de avaliação de juízo e competência moral em uso no Brasil

O presente artigo tem por objetivo abordar as bases, finalidades e composição de dois instrumentos de avaliação de juízo moral: a Moral Judgment Interview (MJI) e o Defining Issues Test (DIT), e um de competência moral: o Moral Judgment Test (MJT). Retoma a teoria do desenvolvimento moral de Kohlberg que fundamenta esses instrumentos, assim como os últimos estudos realizados com os mesmos. A MJI é uma entrevista semiestruturada que avalia o nível de juízo moral. O DIT é um teste objetivo que mede a proporção de respostas pós-convencionais. O MJT é um instrumento objetivo, que avalia a competência moral. Destaca-se a crescente utilização desses instrumentos em pesquisas sobre moralidade.

A validação do Teste de Juízo Moral (MJT) para diferentes culturas: o caso brasileiro

The present article deals with the adaptation of the Moral Judgment Test (MJT) for the Portuguese language. The principles of the test, its format and the process of content, construct and criterion validation are presented. In the same way, reliability is discussed using Brazilian research results that produced the necessity of elaborating another dilemma to compose the MJT-xt (extended).

Competência moral e perfil de profissionais que atendem o adolescente em conflito com a lei

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Uso de alcool e competência moral em universitários

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

A formação ética do educador: competência e juízo moral de graduandos de pedagogia

Traditionally, undergraduate education emphasizes theory and technique. The ethical education of the professional who will act in society is placed at most in a discipline related to professional´s deontology. Ethical discussions are developed in a bored way and the mission of educating students is considered fulfilled. Based on this analysis, the principal purpose of this study was to verify if the training provided by university has some influence on the development of students’ moral judgment and moral competence. The participants were 540 undergraduate students from the first and the last year of education from Pedagogy course from two universities of São Paulo state, one of them was public and the other private. The instruments were Defining Issues Test (DIT-2) and Moral Judgment Test (MJT-xt). The results indicated that the training received did not lead to significant improvement of their capacity to reflect about moral issues.

Competência de juízo moral dos estudantes de medicina: um estudo piloto

The authors conducted a cross-sectional short-term study using Lind's Moral Judgment Test (MJT) to compare the moral judgment competence (C-score) among students in the first and eighth semesters from a medical school in the Northeast region of Brazil. This study also evaluated the influence of such factors as age and gender on moral competence. A difference equal to or greater than 5.0 points (absolute effect-size) on the C-score was considered significant. A regression of moral judgment competence among the students in their eighth semester in relation to the students in the first semester (C-score: 20.5 and 26.2 points, respectively) was observed. In the analysis of the students' performances in terms of MJT dilemmas, the phenomenon of moral segmentation was observed in both semesters, and the students performed better on the worker's dilemma than on the doctor's dilemma. Among students in the same semester of study, older students had lower C-scores. When comparing performance by gender, there was no significant difference between men's and women's C-scores. The finding of regression or stagnation in moral competence among the medical students demands deep reflection by those who work with the political-pedagogical projects of medical schools and by the entire faculty, in order to seek strategies to reverse this condition.

Ética, justiça e democracia em sala de aula: o desenvolvimento e a experiência de um novo método de discussão de dilemas morais para a educação

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Investigation of Escape and Negative Student Behaviors Related to Florida State High Stakes Test Preparation in Miami-Dade County Public High Schools, having been approved in respect to style and intellectual content, is referred to you for judgment

The purpose of this study was to determine whether there was a relationship between pressure to perform on state mandated, high-stakes tests and the rate of student escape behavior defined as the number of school suspensions and absences. The state assigned grade of a school was used as a surrogate measure of pressure with the assumption that pressure increased as the school grade decreased. Student attendance and suspension data were gathered from all 33 of the regular public high schools in Miami-Dade County Public Schools. The research questions were: Is the number of suspensions highest in the third quarter, when most FCAT preparation takes place for each of the 3 school years 2007-08 through 2009-10? How accurately does the high school’s grade predict the number of suspensions and number of absences during each of the 4 school years 2005-06 through 2008-09? The research questions were answered using repeated measures analysis of variance for research question #1 and non-linear multiple regression for research question #2. No significant difference could be found between the numbers of suspensions in each of the grading periods nor was there a relationship between the number of suspensions and school grade. A statistically significant relationship was found between student attendance and school grade. When plotted, this relationship was found to be quadratic in nature and formed a loose inverted U for each of the four years during which data were collected. This indicated that students in very high and very low performing schools had low levels of absences while those in the midlevel of the distribution of school performance (C schools) had the greatest rates of absence. Identifying a relationship between the pressures associated with high stakes testing and student escape behavior suggests that it might be useful for building administrators to reevaluate test preparation activities and procedures being used in their building and to include anxiety reducing strategies. As a relationship was found, it sets the foundation for future studies to identify whether testing related activities are impacting some students emotionally and are causing unintended consequences of testing mandates.

The Federal circuit in Bilski : the machine-or-transformation test

In a much anticipated judgment, the Federal Circuit has sought to clarify the standards applicable in determining whether a claimed method constitutes patent-eligible subject matter. In Bilski, the Federal Circuit identified a test to determine whether a patentee has made claims that pre-empt the use of a fundamental principle or an abstract idea or whether those claims cover only a particular application of a fundamental principle or abstract idea. It held that the sole test for determining subject matter eligibility for a claimed process under § 101 is that: (1) it is tied to a particular machine or apparatus, or (2) it transforms a particular article into a different state or thing. The court termed this the “machine-or-transformation test.” In so doing it overruled its earlier State Street decision to the extent that it deemed its “useful, tangible and concrete result” test as inadequate to determine whether an alleged invention recites patent-eligible subject matter.

The relationship between creativity and moral judgment

A sample of 50 male and female subjects ranging in age from 12 to 73 were divided into three groups according to the scale of maturity of moral judgment developed by Lawrence Kohlberg. Subjects were also tested on a measure of creativity developed by Torrance after the formulations of Guilford in order to test the hypothesis that the re^- lationship between creativity and maturity of moral judgment is curvilinear. Researchers have failed to develop any working hypothesis concerning the relationship between creativity and moral judgment or postulate any consistent theoretical framework concerning the possible relationship between these two constructs. The empirical investigation involved a scientific testing of a random selection of elementary subjects9 high school adolescents, and creative adults. Tests included Kohlberg8s Moral dilemmas and Guilford's Product Improvement Task. A trend analysis was conducted to reveal whether or not a curvilinear relationship existed between the independent variable (Moral Maturity Stages) and the de~ pe dent variable (creativity performance under each level). Curvilinear trends were observed in two out of four creativity subscales but were not statistically significant. It was concluded that these contradictory findings were due to the relatively small number of subjects tested, the narrow range or moral judgment scores, and the limited conception of creativity defined by the creativity measure used (The Product Improvement Task). It was suggested that an instrument assessing an identity status would be most useful as well as a creativity measure better suited for a theory of creativity essentially developmental in perspective.

The typic in Kant’s critique of practical reason : moral judgment and symbolic representation

Comment pouvons-nous représenter un principe moral universel de manière à le rendre applicable à des cas concrets ? Ce problème revêt une forme aiguë dans la philosophie morale d’Emmanuel Kant (1724-1804), tout particulièrement dans sa théorie du jugement moral, car il soutient que l’on doit appliquer la loi morale « suprasensible » à des actions dans le monde sensible afin de déterminer celles-ci comme moralement bonnes ou mauvaises. Kant aborde ce problème dans un chapitre de la Critique de la raison pratique (1788) intitulé « De la typique de la faculté de juger pratique pure » (KpV 5: 67-71). La première partie de la thèse vise à fournir un commentaire compréhensif et détaillé de ce texte important, mais trop peu étudié. Étant donné que la loi morale, en tant qu’Idée suprasensible de la raison, ne peut pas être appliquée directement à des actions dans l’intuition sensible, Kant a recours à une forme particulière de représentation indirecte et symbolique. Sa solution inédite consiste à fournir la faculté de juger avec un « type [Typus] », ou analogue formel, de la loi morale. Ce type est la loi de la causalité naturelle : en tant que loi, il sert d’étalon formel pour tester l’universalisabilité des maximes ; et, en tant que loi de la nature, il peut aussi s’appliquer à toute action dans l’expérience sensible. Dès lors, le jugement moral s’effectue par le biais d’une expérience de pensée dans laquelle on se demande si l’on peut vouloir que sa maxime devienne une loi universelle d’une nature contrefactuelle dont on ferait soi-même partie. Cette expérience de pensée fonctionne comme une « épreuve [Probe] » de la forme des maximes et, par ce moyen, du statut moral des actions. Kant soutient que tout un chacun, même « l’entendement le plus commun », emploie cette procédure pour l’appréciation morale. De plus, la typique prémunit contre deux menaces à l’éthique rationaliste de Kant, à savoir l’empirisme (c’est-à-dire le conséquentialisme) et le mysticisme. La seconde partie de la thèse se penche sur l’indication de Kant que la typique « ne sert que comme un symbole ». Un bon nombre de commentateurs ont voulu assimiler la typique à la notion d’« hypotypose symbolique » présentée dans le § 59 de la Critique de la faculté de juger (1790). La typique serait un processus de symbolisation esthétique consistant à présenter, de façon indirecte, la représentation abstraite de la loi morale sous la forme d’un symbole concret et intuitif. Dans un premier chapitre, cette interprétation est présentée et soumise à un examen critique qui cherche à montrer qu’elle est erronée et peu judicieuse. Dans le second chapitre, nous poursuivons une voie d’interprétation jusqu’ici ignorée, montrant que la typique a de plus grandes continuités avec la notion d’« anthropomorphisme symbolique », une procédure strictement analogique introduite auparavant dans les Prolégomènes (1783). Nous en concluons, d’une part, que la typique fut un moment décisif dans l’évolution de la théorie kantienne de la représentation symbolique et que, d’autre part, elle marque la réalisation, chez Kant, d’une conception proprement critique de la nature et de la morale comme deux sphères distinctes, dont la médiation s’opère par le biais des concepts de loi et de conformité à la loi (Gesetzmässigkeit). En un mot, la typique s’avère l’instrument par excellence du « rationalisme de la faculté de juger ».

Defining Issues Test-2: fidedignidade da versão brasileira e ponderações acerca de seu uso em pesquisas sobre moralidade

Este estudo teve como objetivo avaliar a fidedignidade da tradução e adaptação brasileira do Definig Issues Test (DIT) -2, assim como realizar algumas ponderações sobre a utilização desse instrumento e do DIT -1 em pesquisas sobre moralidade. Os testes DIT-1 e DIT-2 foram aplicados em 621 jovens brasileiros, proporcionalmente distribuídos conforme a cidade de procedência (Floriano/PI, Erechim/RS e Marília/SP), o tipo de escola (pública e particular) e o ano escolar freqüentado (8º ano do ensino fundamental e 3º ano do ensino médio). em relação à fidedignidade, notou-se que, apesar de os valores alcançados serem próximos àquele obtido na tradução e adaptação do DIT-1, revelam-se bem menores que os verificados nas versões originais americanas. Na verificação das pontuações alcançadas nos testes, foi observada a existência de tendências distintas no interior da amostra investigada, marcadas pelas variáveis controladas. Foram tecidas considerações sobre a validade e a interpretação desses testes.