Unresolved Problems with the "I", the "A" and the "T": Logical and Psychometric Critique of the Implicit Association Test (IAT)

The Implicit Association Test (IAT) had already gained the status of a prominent assessment procedure before its psychometric properties and underlying task structure were understood. The present critique addresses five major problems that arise when the IAT is used for diagnostic inferences: (1) the asymmetry of causal and diagnostic inferences; (2) the viability of the underlying association model; (3) the lack of a testable model underlying IAT-based inferences; (4) the difficulties of interpreting difference scores; and (5) the susceptibility of the IAT to deliberate faking and strategic processing. Based on a theoretical reflection of these issues, and a comprehensive survey of published IAT studies, it is concluded that a number of uncontrolled factors can produce (or reduce) significant IAT scores independently of the personality attribute that is supposed to be captured by the IAT procedure.

Complex visual hallucinations and attentional performance in eye disease and dementia: a test of the Perception and Attention Deficit model

OBJECTIVE This study aimed to test the prediction from the Perception and Attention Deficit model of complex visual hallucinations (CVH) that impairments in visual attention and perception are key risk factors for complex hallucinations in eye disease and dementia. METHODS Two studies ran concurrently to investigate the relationship between CVH and impairments in perception (picture naming using the Graded Naming Test) and attention (Stroop task plus a novel Imagery task). The studies were in two populations-older patients with dementia (n = 28) and older people with eye disease (n = 50) with a shared control group (n = 37). The same methodology was used in both studies, and the North East Visual Hallucinations Inventory was used to identify CVH. RESULTS A reliable relationship was found for older patients with dementia between impaired perceptual and attentional performance and CVH. A reliable relationship was not found in the population of people with eye disease. CONCLUSIONS The results add to previous research that object perception and attentional deficits are associated with CVH in dementia, but that risk factors for CVH in eye disease are inconsistent, suggesting that dynamic rather than static impairments in attentional processes may be key in this population.

A test of the Bolton-Scheinkman-Xiong hypothesis of how speculation affects the vesting time of options granted to directors

This paper investigates empirically the Bolton, Scheinkman, and Xiong (2006) hypothesis, according to which initial shareholders may provide incentives to managers to take actions that stimulate speculative bubbles. We test this hypothesis with data on up to 8,544 directors and up to 1,677 companies between 2004-2008. Using vesting time as a measure of the short-term performance weighting in CEO compensation and various alternative measures of the extent of speculation, the findings support the hypothesis: vesting time decreases with more intensive speculation. The results prove robust in various empirical model specifications.

Assessing the function of the fronto-parietal attention network: Insights from resting-state fMRI and the attentional network test

In the recent past, various intrinsic connectivity networks (ICN) have been identified in the resting brain. It has been hypothesized that the fronto-parietal ICN is involved in attentional processes. Evidence for this claim stems from task-related activation studies that show a joint activation of the implicated brain regions during tasks that require sustained attention. In this study, we used functional magnetic resonance imaging (fMRI) to demonstrate that functional connectivity within the fronto-parietal network at rest directly relates to attention. We applied graph theory to functional connectivity data from multiple regions of interest and tested for associations with behavioral measures of attention as provided by the attentional network test (ANT), which we acquired in a separate session outside the MRI environment. We found robust statistical associations with centrality measures of global and local connectivity of nodes within the network with the alerting and executive control subfunctions of attention. The results provide further evidence for the functional significance of ICN and the hypothesized role of the fronto-parietal attention network. Hum Brain Mapp , 2013. © 2013 Wiley Periodicals, Inc.

Reporting standards for studies of diagnostic test accuracy in dementia: The STARDdem Initiative.

OBJECTIVE To provide guidance on standards for reporting studies of diagnostic test accuracy for dementia disorders. METHODS An international consensus process on reporting standards in dementia and cognitive impairment (STARDdem) was established, focusing on studies presenting data from which sensitivity and specificity were reported or could be derived. A working group led the initiative through 4 rounds of consensus work, using a modified Delphi process and culminating in a face-to-face consensus meeting in October 2012. The aim of this process was to agree on how best to supplement the generic standards of the STARD statement to enhance their utility and encourage their use in dementia research. RESULTS More than 200 comments were received during the wider consultation rounds. The areas at most risk of inadequate reporting were identified and a set of dementia-specific recommendations to supplement the STARD guidance were developed, including better reporting of patient selection, the reference standard used, avoidance of circularity, and reporting of test-retest reliability. CONCLUSION STARDdem is an implementation of the STARD statement in which the original checklist is elaborated and supplemented with guidance pertinent to studies of cognitive disorders. Its adoption is expected to increase transparency, enable more effective evaluation of diagnostic tests in Alzheimer disease and dementia, contribute to greater adherence to methodologic standards, and advance the development of Alzheimer biomarkers.

A pilot test of the new Swiss regulatory procedure for categorizing clinical trials by risk: A randomized controlled trial

BACKGROUND/AIMS Several countries are working to adapt clinical trial regulations to align the approval process to the level of risk for trial participants. The optimal framework to categorize clinical trials according to risk remains unclear, however. Switzerland is the first European country to adopt a risk-based categorization procedure in January 2014. We assessed how accurately and consistently clinical trials are categorized using two different approaches: an approach using criteria set forth in the new law (concept) or an intuitive approach (ad hoc). METHODS This was a randomized controlled trial with a method-comparison study nested in each arm. We used clinical trial protocols from eight Swiss ethics committees approved between 2010 and 2011. Protocols were randomly assigned to be categorized in one of three risk categories using the concept or the ad hoc approach. Each protocol was independently categorized by the trial's sponsor, a group of experts and the approving ethics committee. The primary outcome was the difference in categorization agreement between the expert group and sponsors across arms. Linear weighted kappa was used to quantify agreements, with the difference between kappas being the primary effect measure. RESULTS We included 142 of 231 protocols in the final analysis (concept = 78; ad hoc = 64). Raw agreement between the expert group and sponsors was 0.74 in the concept and 0.78 in the ad hoc arm. Chance-corrected agreement was higher in the ad hoc (kappa: 0.34 (95% confidence interval = 0.10-0.58)) than in the concept arm (0.27 (0.06-0.50)), but the difference was not significant (p = 0.67). LIMITATIONS The main limitation was the large number of protocols excluded from the analysis mostly because they did not fit with the clinical trial definition of the new law. CONCLUSION A structured risk categorization approach was not better than an ad hoc approach. Laws introducing risk-based approaches should provide guidelines, examples and templates to ensure correct application.

Subjective perception of sleepiness in a driving simulator is different from that in the Maintenance of Wakefulness Test.

OBJECTIVE To test whether sleep-deprived, healthy subjects who do not always signal spontaneously perceived sleepiness (SPS) before falling asleep during the Maintenance of Wakefulness Test (MWT) would do so in a driving simulator. METHODS Twenty-four healthy subjects (20-26 years old) underwent a MWT for 40 min and a driving simulator test for 1 h, before and after one night of sleep deprivation. Standard electroencephalography, electrooculography, submental electromyography, and face videography were recorded simultaneously to score wakefulness and sleep. Subjects were instructed to signal SPS as soon as they subjectively felt sleepy and to try to stay awake for as long as possible in every test. They were rewarded for both "appropriate" perception of SPS and staying awake for as long as possible. RESULTS After sleep deprivation, seven subjects (29%) did not signal SPS before falling asleep in the MWT, but all subjects signalled SPS before falling asleep in the driving simulator (p <0.004). CONCLUSIONS The previous results of an "inaccurate" SPS in the MWT were confirmed, and a perfect SPS was shown in the driving simulator. It was hypothesised that SPS is more accurate for tasks involving continuous feedback of performance, such as driving, compared to the less active situation of the MWT. Spontaneously perceived sleepiness in the MWT cannot be used to judge sleepiness perception while driving. Further studies are needed to define the accuracy of SPS in working tasks or occupations with minimal or no performance feedback.

The impact of the position effect on the factorial structure of the Culture Fair Test (CFT)

The Culture Fair Test (CFT) is a psychometric test of fluid intelligence consisting of four subtests; Series, Classification, Matrices, and Topographies. The four subtests are only moderately intercorrelated, doubting the notion that they assess the same construct (i.e., fluid intelligence). As an explanation of these low correlations, we investigated the position effect. This effect is assumed to reflect implicit learning during testing. By applying fixed-links modeling to analyze the CFT data of 206 participants, we identified position effects as latent variables in the subtests; Classification, Matrices, and Topographies. These position effects were disentangled from a second set of latent variables representing fluid intelligence inherent in the four subtests. After this separation of position effect and basic fluid intelligence, the latent variables representing basic fluid intelligence in the subtests Series, Matrices, and Topographies could be combined to one common latent variable which was highly correlated with fluid intelligence derived from the subtest Classification (r=.72). Correlations between the three latent variables representing the position effects in the Classification, Matrices, and Topographies subtests ranged from r=.38 to r=.59. The results indicate that all four CFT subtests measure the same construct (i.e., fluid intelligence) but that the position effect confounds the factorial structure

Screening for Language Disorders in Stroke: German Validation of the Language Screening Test (LAST)

BACKGROUND Screening of aphasia in acute stroke is crucial for directing patients to early language therapy. The Language Screening Test (LAST), originally developed in French, is a validated language screening test that allows detection of a language deficit within a few minutes. The aim of the present study was to develop and validate two parallel German versions of the LAST. METHODS The LAST includes subtests for naming, repetition, automatic speech, and comprehension. For the translation into German, task constructs and psycholinguistic criteria for item selection were identical to the French LAST. A cohort of 101 stroke patients were tested, all of whom were native German speakers. Validation of the LAST was based on (1) analysis of equivalence of the German versions, which was established by administering both versions successively in a subset of patients, (2) internal validity by means of internal consistency analysis, and (3) external validity by comparison with the short version of the Token Test in another subset of patients. RESULTS The two German versions were equivalent as demonstrated by a high intraclass correlation coefficient of 0.91. Furthermore, an acceptable internal structure of the LAST was found (Cronbach's α = 0.74). A highly significant correlation (r = 0.74, p < 0.0001) between the LAST and the short version of the Token Test indicated good external validity of the scale. CONCLUSION The German version of the LAST, available in two parallel versions, is a new and valid language screening test in stroke.