Unresolved Problems with the "I", the "A" and the "T": Logical and Psychometric Critique of the Implicit Association Test (IAT)

The Implicit Association Test (IAT) had already gained the status of a prominent assessment procedure before its psychometric properties and underlying task structure were understood. The present critique addresses five major problems that arise when the IAT is used for diagnostic inferences: (1) the asymmetry of causal and diagnostic inferences; (2) the viability of the underlying association model; (3) the lack of a testable model underlying IAT-based inferences; (4) the difficulties of interpreting difference scores; and (5) the susceptibility of the IAT to deliberate faking and strategic processing. Based on a theoretical reflection of these issues, and a comprehensive survey of published IAT studies, it is concluded that a number of uncontrolled factors can produce (or reduce) significant IAT scores independently of the personality attribute that is supposed to be captured by the IAT procedure.

Implicit priming of picture naming : a theoretical and methodological note on the implicit priming task. 'Potenciación implícita del nombrado de imágenes : una nota teórica y metodológica sobre la tarea de pontenciación implícita'.

Resumen tomado de la revista

Cognitive inertia and the implicit association test

The authors review the implicit association test (IAT), its use in marketing, and the methodology and validity issues that surround it. They focus on a validity problem that has not been investigated previously, namely, the impact of cognitive inertia on IAT effects. Cognitive inertia refers to the difficulty in switching from one categorization rule to another, which causes IAT effects to depend on the order of administration of the two IAT blocks. In Study 1, the authors observe an IAT effect when the compatible block precedes the incompatible block but not when it follows the incompatible block. In Studies 2 and 3, the IAT effect changes its sign when the order of the blocks reverses. Cognitive inertia distorts individual IAT scores and diminishes the correlations between IAT scores and predictor variables when the block order is counterbalanced between subjects. Study 4 shows that counterbalancing the block order repeatedly within subjects can eliminate cognitive inertia effects on the individual level. The authors conclude that researchers should either interpret IAT scores at the aggregate level or, if individual IAT scores are of interest, counterbalance the block order repeatedly within subjects.

How do indirect measures of evaluation work? Evaluating the inference of prejudice in the Implicit Association Test

There has been significant interest in indirect measures of attitudes like the Implicit Association Test (IAT), presumably because of the possibility of uncovering implicit prejudices. The authors derived a set of qualitative predictions for people's performance in the IAT on the basis of random walk models. These were supported in 3 experiments comparing clearly positive or negative categories to nonwords. They also provided evidence that participants shift their response criterion when doing the IAT. Because of these criterion shifts, a response pattern in the IAT can have multiple causes. Thus, it is not possible to infer a single cause (such as prejudice) from IAT results. A surprising additional result was that nonwords were treated as though they were evaluated more negatively than obviously negative items like insects, suggesting that low familiarity items may generate the pattern of data previously interpreted as evidence for implicit prejudice.

Activity of primate inferotemporal neurons related to a sought target in pair-association task.

Visual long-term memory in primates has been assessed by using the pair-association (PA) task, in which a subject retrieves and chooses the paired associate of a cue picture. Our previous studies on single neurons in the anterior inferotemporal (AIT) cortex suggested their roles in representing paired associates in the mind. To test the possibility that the delay activity of AIT neurons is related to a particular picture as a sought target, we devised the PA with color switch (PACS) task. In the PACS task, the necessity for memory retrieval and its initiation time were controlled by a color switch in the middle of the delay period. A control task, in which there is no color switch, corresponds to the conventional delayed matching-to-sample (DMS) task where the monkey chooses the same picture as a cue. We found that AIT neurons started to respond just after the color switch in the PACS task, when the cue-optimal picture's associate was presented as a cue. In contrast, they showed no response change in the DMS task. We confirmed that this effect is not due to the visual response to colors. Furthermore, when the cue-optimal picture was presented as a cue, these neurons showed suppression after the color switch in the PACS task. These results suggest that the activity of AIT neurons mediates gating mechanisms that preferentially pass information about a sought target, even when the sought target is retrieved from long-term memory.

Workplace gender discrimination and the implicit association test

Women are under-represented at senior levels within organisations. They also fareless well than their male counterparts in reward and career opportunities. Attitudestoward women in the workplace are thought to underpin these disparities and moreand more organisations are introducing attitude measures into diversity and inclusioninitiatives to: 1) raise awareness amongst employees of implicit attitudes, 2) educateemployees on how these attitudes can influence behaviour and 3) re-measure theattitude after an intervention to assess whether the attitude has changed. TheImplicit Association Test (IAT: Greenwald, et al., 1998) is the most popular tool usedto assess attitudes. However, questions over the predictive validity of the measurehave been raised and the evidence for the real world impact of the implicit attitudes islimited (Blanton et al., 2009; Landy, 2008; Tetlock & Mitchell, 2009; Wax, 2010).Whilst there is growing research in the area of race, little research has explored theability of the IAT to predict gender discrimination. This thesis addresses thisimportant gap in the literature. Three empirical studies were conducted. The firststudy explored whether gender IATs were predictive of personnel decisions thatfavour men and whether affect- and cognition-based gender IATs were equallypredictive of behaviour. The second two studies explored the predictive validity ofthe IAT in comparison to an explicit measure of one type of gender attitude,benevolent sexism. The results revealed implicit gender attitudes were stronglyheld. However, they did not consistently predict behaviour across the studies.Overall, the results suggest that the IAT may only predict workplace genderdiscrimination in a very select set of circumstances. The attitude component that anIAT assesses, the personnel decision and participant demographics all impact thepredictive validity of the tool. The interplay between the IAT and behaviour thereforeappears to be more complex than is assumed.

Autistic traits moderate the impact of reward learning on social behaviour

A deficit in empathy has been suggested to underlie social behavioural atypicalities in autism. A parallel theoretical account proposes that reduced social motivation (i.e., low responsivity to social rewards) can account for the said atypicalities. Recent evidence suggests that autistic traits modulate the link between reward and proxy metrics related to empathy. Using an evaluative conditioning paradigm to associate high and low rewards with faces, a previous study has shown that individuals high in autistic traits show reduced spontaneous facial mimicry of faces associated with high vs. low reward. This observation raises the possibility that autistic traits modulate the magnitude of evaluative conditioning. To test this, we investigated (a) if autistic traits could modulate the ability to implicitly associate a reward value to a social stimulus (reward learning/conditioning, using the Implicit Association Task, IAT); (b) if the learned association could modulate participants’ prosocial behaviour (i.e., social reciprocity, measured using the cyberball task); (c) if the strength of this modulation was influenced by autistic traits. In 43 neurotypical participants, we found that autistic traits moderated the relationship of social reward learning on prosocial behaviour but not reward learning itself. This evidence suggests that while autistic traits do not directly influence social reward learning, they modulate the relationship of social rewards with prosocial behaviour

Human Preferences for Symmetry: Subjective Experience, Cognitive Conflict and Cortical Brain Activity

This study examines the links between human perceptions, cognitive biases and neural processing of symmetrical stimuli. While preferences for symmetry have largely been examined in the context of disorders such as obsessive-compulsive disorder and autism spectrum disorders, we examine various these phenomena in non-clinical subjects and suggest that such preferences are distributed throughout the typical population as part of our cognitive and neural architecture. In Experiment 1, 82 young adults reported on the frequency of their obsessive-compulsive spectrum behaviors. Subjects also performed an emotional Stroop or variant of an Implicit Association Task (the OC-CIT) developed to assess cognitive biases for symmetry. Data not only reveal that subjects evidence a cognitive conflict when asked to match images of positive affect with asymmetrical stimuli, and disgust with symmetry, but also that their slowed reaction times when asked to do so were predicted by reports of OC behavior, particularly checking behavior. In Experiment 2, 26 participants were administered an oddball Event-Related Potential task specifically designed to assess sensitivity to symmetry as well as the OC-CIT. These data revealed that reaction times on the OC-CIT were strongly predicted by frontal electrode sites indicating faster processing of an asymmetrical stimulus (unparallel lines) relative to a symmetrical stimulus (parallel lines). The results point to an overall cognitive bias linking disgust with asymmetry and suggest that such cognitive biases are reflected in neural responses to symmetrical/asymmetrical stimuli.

Redefining Attitude Importance: The Possible Existence of Associative and Subjective Types of Importance Under a Global Definition

Traditionally, importance has been measured using subjective measures. The present thesis explores the possibility of a second type of importance, designated as “associative importance”. A new measure, the IIAT, was designed to capture the strength of association between an object and the attribute of importance. This thesis then evaluated the validity of the IIAT via an intervention paradigm in 2 studies, and by using the measure to predict a memory outcome in 2 other studies. Subjective measures of importance were also included in these studies and correlations between subjective measures and IIAT results were examined. Across all 4 studies, subjective-objective correlations were weak to modest and non-significant. The intervention studies provided promising evidence that interventions do affect associative importance as measured by the IIAT. The prediction studies provided somewhat mixed, but encouraging evidence that the IIAT may be able to predict memory performance. Notably, subjective measures were not able to predict memory performance at all, whereas the IIAT was able to predict some memory indices. Overall, there is some evidence supporting the existence of an associative importance construct, and that the IIAT provides valid results that are nonetheless different from that of subjective measures of attitude importance.

Reducing implicit prejudice by blurring intergroup boundaries

In two experiments we examined whether and when blurring intergroup boundaries reduces implicit prejudice. In Experiment 1 we observed that when participants first completed a task in which they generated characteristics that overlapped between an ingroup and an outgroup they showed less implicit bias as measured by an Implicit Association Test. In Experiment 2 we found that the effectiveness of blurring intergroup boundaries for reducing implicit bias was moderated by pretask levels of ingroup identification. We discuss these findings in the context of extending differentiation-based interventions for reducing explicit bias to the domain of implicit attitudes.

Implicit attitudes and self-concepts towards transgression and aggression: Differences between male community and offender adolescents, and associations with psychopathic traits.

Research suggests that implicit attitudes play a key role in the occurrence of antisocial behaviours. This study assessed implicit attitudes and self-concepts related to aggression and transgression in community and offender adolescents, using a new set of Implicit Association Tests (IATs), and examined their association with of psychopathic traits. Thirty-six offenders and 66 community adolescents performed 4 IATs assessing 1) implicit attitudes about a) aggression and b) transgression as good, and 2) implicit self-concepts about a) aggression and b) transgression as self-descriptive. They filled in self-report questionnaires: the Youth Psychopathic Traits Inventory, the Child Behaviour Checklist, and explicit measures of their attitudes and self-concepts towards transgression and aggression. Results showed few differences between community and offender adolescents on implicit attitudes and self-concepts, and unexpected negative associations between some implicit attitudes and psychopathic traits, while the association was positive for the corresponding explicit attitudes. Possible explanations of these findings are discussed.

Implicit memory: intention and awareness revisited

One of the major developments in memory research in the past decade or so has been a growing interest in implicit memory – task performance that is not accompanied by conscious or intentional recollection. In this article, we examine evidence for perceptual and conceptual implicit memory, using the accepted definitions, and suggest that there is in fact a lack of strong evidence for implicit memory in normal subjects. If more convincing evidence cannot be obtained, one solution might be to modify the current terminology. We suggest that the term implicit memory might have outgrown its usefulness as an overall descriptor.

Tracking the implicit self using event-related potentials

Negative biases in implicit self-evaluation are thought to be detrimental to subjective well-being and have been linked to various psychological disorders, including depression. An understanding of the neural processes underlying implicit self-evaluation in healthy subjects could provide a basis for the investigation of negative biases in depressed patients, the development of differential psychotherapeutic interventions, and the estimation of relapse risk in remitted patients. We thus studied the brain processes linked to implicit self-evaluation in 25 healthy subjects using event-related potential (ERP) recording during a self-relevant Implicit Association Test (sIAT). Consistent with a positive implicit self-evaluation in healthy subjects, they responded significantly faster to the congruent (self-positive mapping) than to the incongruent sIAT condition (self-negative mapping). Our main finding was a topographical ERP difference in a time window between 600 and 700 ms, whereas no significant differences between congruent and incongruent conditions were observed in earlier time windows. This suggests that biases in implicit self-evaluation are reflected only indirectly, in the additional recruitment of control processes needed to override the positive implicit self-evaluation of healthy subjects in the incongruent sIAT condition. Brain activations linked to these control processes can thus serve as an indirect measure for estimating biases in implicit self-evaluation. The sIAT paradigm, combined with ERP, could therefore permit the tracking of the neural processes underlying implicit self-evaluation in depressed patients during psychotherapy.

Using partially structured attitude measures to enhance the attitude-behavior relationship

This article recalls a classic scheme for categorizing attitude measures. One particular group of measures, those that rely on respondents' interpretations of partially structured stimuli, has virtually disappeared from attitude research. An attitude measure based on respondents' interpretation of partially structured stimuli is considered. Four studies employing such a measure demonstrate that it predicts unique variance in self-reported and actual behavior, beyond that predicted by explicit and contemporary implicit measures and regardless of whether the attitude object under consideration is wrought with social desirability concerns. Implications for conceptualizing attitude measurement and attitude-behavior relations are discussed.