Sensitivity and Bias within the Binary Signal Detection Theory, BSDT

Similar to classic Signal Detection Theory (SDT), recent optimal Binary Signal Detection Theory (BSDT) and based on it Neural Network Assembly Memory Model (NNAMM) can successfully reproduce Receiver Operating Characteristic (ROC) curves although BSDT/NNAMM parameters (intensity of cue and neuron threshold) and classic SDT parameters (perception distance and response bias) are essentially different. In present work BSDT/NNAMM optimal likelihood and posterior probabilities are analytically analyzed and used to generate ROCs and modified (posterior) mROCs, optimal overall likelihood and posterior. It is shown that for the description of basic discrimination experiments in psychophysics within the BSDT a ‘neural space’ can be introduced where sensory stimuli as neural codes are represented and decision processes are defined, the BSDT’s isobias curves can simultaneously be interpreted as universal psychometric functions satisfying the Neyman-Pearson objective, the just noticeable difference (jnd) can be defined and interpreted as an atom of experience, and near-neutral values of biases are observers’ natural choice. The uniformity or no-priming hypotheses, concerning the ‘in-mind’ distribution of false-alarm probabilities during ROC or overall probability estimations, is introduced. The BSDT’s and classic SDT’s sensitivity, bias, their ROC and decision spaces are compared.

Grid-texture mechanisms in human vision:contrast detection of regular sparse micro-patterns requires specialist templates

Previous work has shown that human vision performs spatial integration of luminance contrast energy, where signals are squared and summed (with internal noise) over area at detection threshold. We tested that model here in an experiment using arrays of micro-pattern textures that varied in overall stimulus area and sparseness of their target elements, where the contrast of each element was normalised for sensitivity across the visual field. We found a power-law improvement in performance with stimulus area, and a decrease in sensitivity with sparseness. While the contrast integrator model performed well when target elements constituted 50–100% of the target area (replicating previous results), observers outperformed the model when texture elements were sparser than this. This result required the inclusion of further templates in our model, selective for grids of various regular texture densities. By assuming a MAX operation across these noisy mechanisms the model also accounted for the increase in the slope of the psychometric function that occurred as texture density decreased. Thus, for the first time, mechanisms that are selective for texture density have been revealed at contrast detection threshold. We suggest that these mechanisms have a role to play in the perception of visual textures.

The transducer model for contrast detection and discrimination: formal relations, implications, and an empirical test.

The transducer function mu for contrast perception describes the nonlinear mapping of stimulus contrast onto an internal response. Under a signal detection theory approach, the transducer model of contrast perception states that the internal response elicited by a stimulus of contrast c is a random variable with mean mu(c). Using this approach, we derive the formal relations between the transducer function, the threshold-versus-contrast (TvC) function, and the psychometric functions for contrast detection and discrimination in 2AFC tasks. We show that the mathematical form of the TvC function is determined only by mu, and that the psychometric functions for detection and discrimination have a common mathematical form with common parameters emanating from, and only from, the transducer function mu and the form of the distribution of the internal responses. We discuss the theoretical and practical implications of these relations, which have bearings on the tenability of certain mathematical forms for the psychometric function and on the suitability of empirical approaches to model validation. We also present the results of a comprehensive test of these relations using two alternative forms of the transducer model: a three-parameter version that renders logistic psychometric functions and a five-parameter version using Foley's variant of the Naka-Rushton equation as transducer function. Our results support the validity of the formal relations implied by the general transducer model, and the two versions that were contrasted account for our data equally well.

The role of parametric assumptions in adaptive Bayesian estimation.

Variants of adaptive Bayesian procedures for estimating the 5% point on a psychometric function were studied by simulation. Bias and standard error were the criteria to evaluate performance. The results indicated a superiority of (a) uniform priors, (b) model likelihood functions that are odd symmetric about threshold and that have parameter values larger than their counterparts in the psychometric function, (c) stimulus placement at the prior mean, and (d) estimates defined as the posterior mean. Unbiasedness arises in only 10 trials, and 20 trials ensure constant standard errors. The standard error of the estimates equals 0.617 times the inverse of the square root of the number of trials. Other variants yielded bias and larger standard errors.

Stopping rules in Bayesian adaptive threshold estimation

Threshold estimation with sequential procedures is justifiable on the surmise that the index used in the so-called dynamic stopping rule has diagnostic value for identifying when an accurate estimate has been obtained. The performance of five types of Bayesian sequential procedure was compared here to that of an analogous fixed-length procedure. Indices for use in sequential procedures were: (1) the width of the Bayesian probability interval, (2) the posterior standard deviation, (3) the absolute change, (4) the average change, and (5) the number of sign fluctuations. A simulation study was carried out to evaluate which index renders estimates with less bias and smaller standard error at lower cost (i.e. lower average number of trials to completion), in both yes–no and two-alternative forced-choice (2AFC) tasks. We also considered the effect of the form and parameters of the psychometric function and its similarity with themodel function assumed in the procedure. Our results show that sequential procedures do not outperform fixed-length procedures in yes–no tasks. However, in 2AFC tasks, sequential procedures not based on sign fluctuations all yield minimally better estimates than fixed-length procedures, although most of the improvement occurs with short runs that render undependable estimates and the differences vanish when the procedures run for a number of trials (around 70) that ensures dependability. Thus, none of the indices considered here (some of which are widespread) has the diagnostic value that would justify its use. In addition, difficulties of implementation make sequential procedures unfit as alternatives to fixed-length procedures.

Does time ever fly or slow down? The difficult interpretation of psychophysical data on time perception.

Time perception is studied with subjective or semi-objective psychophysical methods. With subjective methods, observers provide quantitative estimates of duration and data depict the psychophysical function relating subjective duration to objective duration. With semi-objective methods, observers provide categorical or comparative judgments of duration and data depict the psychometric function relating the probability of a certain judgment to objective duration. Both approaches are used to study whether subjective and objective time run at the same pace or whether time flies or slows down under certain conditions. We analyze theoretical aspects affecting the interpretation of data gathered with the most widely used semi-objective methods, including single-presentation and paired-comparison methods. For this purpose, a formal model of psychophysical performance is used in which subjective duration is represented via a psychophysical function and the scalar property. This provides the timing component of the model, which is invariant across methods. A decisional component that varies across methods reflects how observers use subjective durations to make judgments and give the responses requested under each method. Application of the model shows that psychometric functions in single-presentation methods are uninterpretable because the various influences on observed performance are inextricably confounded in the data. In contrast, data gathered with paired-comparison methods permit separating out those influences. Prevalent approaches to fitting psychometric functions to data are also discussed and shown to be inconsistent with widely accepted principles of time perception, implicitly assuming instead that subjective time equals objective time and that observed differences across conditions do not reflect differences in perceived duration but criterion shifts. These analyses prompt evidence-based recommendations for best methodological practice in studies on time perception.

Psychometric properties of the Child Health Assessment Questionnaire (CHAQ) applied to children and adolescents with cerebral palsy

Background: Cerebral palsy (CP) patients have motor limitations that can affect functionality and abilities for activities of daily living (ADL). Health related quality of life and health status instruments validated to be applied to these patients do not directly approach the concepts of functionality or ADL. The Child Health Assessment Questionnaire (CHAQ) seems to be a good instrument to approach this dimension, but it was never used for CP patients. The purpose of the study was to verify the psychometric properties of CHAQ applied to children and adolescents with CP. Methods: Parents or guardians of children and adolescents with CP, aged 5 to 18 years, answered the CHAQ. A healthy group of 314 children and adolescents was recruited during the validation of the CHAQ Brazilian-version. Data quality, reliability and validity were studied. The motor function was evaluated by the Gross Motor Function Measure (GMFM). Results: Ninety-six parents/guardians answered the questionnaire. The age of the patients ranged from 5 to 17.9 years (average: 9.3). The rate of missing data was low(< 9.3%). The floor effect was observed in two domains, being higher only in the visual analogue scales (<= 35.5%). The ceiling effect was significant in all domains and particularly high in patients with quadriplegia (81.8 to 90.9%) and extrapyramidal (45.4 to 91.0%). The Cronbach alpha coefficient ranged from 0.85 to 0.95. The validity was appropriate: for the discriminant validity the correlation of the disability index with the visual analogue scales was not significant; for the convergent validity CHAQ disability index had a strong correlation with the GMFM (0.77); for the divergent validity there was no correlation between GMFM and the pain and overall evaluation scales; for the criterion validity GMFM as well as CHAQ detected differences in the scores among the clinical type of CP (p < 0.01); for the construct validity, the patients' disability index score (mean: 2.16; SD: 0.72) was higher than the healthy group ( mean: 0.12; SD: 0.23)(p < 0.01). Conclusion: CHAQ reliability and validity were adequate to this population. However, further studies are necessary to verify the influence of the ceiling effect on the responsiveness of the instrument.

Monitoring stress tolerance and occurrences of upper respiratory illness in basketball players by means of psychometric tools and salivary biomarkers

The aim of the study was to evaluate the possible relationships between stress tolerance, training load, banal infections and salivary parameters during 4 weeks of regular training in fifteen basketball players. The Daily Analysis of Life Demands for Athletes` questionnaire (sources and symptoms of stress) and the Wisconsin Upper Respiratory Symptom Survey were used on a weekly basis. Salivary cortisol and salivary immunoglobulin A (SIgA) were collected at the beginning (before) and after the study, and measured by enzyme-linked immunosorbent assay (ELISA). Ratings of perceived exertion (training load) were also obtained. The results from ANOVA with repeated measures showed greater training loads, number of upper respiratory tract infection episodes and negative sensation to both symptoms and sources of stress, at week 2 (p < 0.05). Significant increases in cortisol levels and decreases in SIgA secretion rate were noted (before to after). Negative sensations to symptoms of stress at week 4 were inversely and significantly correlated with SIgA secretion rate. A positive and significant relationship between sources and symptoms of stress at week 4 and cortisol levels were verified. In summary, an approach incorporating in conjunction psychometric tools and salivary biomarkers could be an efficient means of monitoring reaction to stress in sport. Copyright (C) 2010 John Wiley & Sons, Ltd.

Evaluation of the psychometric properties of the Social Phobia Inventory in university students

Objective: The aim of the study was to study the psychometric properties of the Social Phobia Inventory (SPIN) in its version for the context of Brazilian adults. Methods: A sample of Brazilian university students from the general population (n = 2314) and a sample of university students identified as cases (n = 88) and noncases (n = 90) of social phobia were assessed, using as a parameter the Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition. The different instruments were applied individually in the presence of a rater. Results: The SPIN showed adequate internal consistency (.63-.90) and concurrent validity with different instruments of auto- and hetero-evaluation of social phobia. Discriminative validity showed 0.84 to 0.86 sensitivity and 0.84 to 0.87 specificity for cutoff notes between 19 and 21. Factorial analysis showed the presence of a variable number of factors as a function of the different samples. Conclusions: The version of the SPIN studied is quite adequate for use in the context of Brazilian university students, favoring the screening of social phobia. However, further studies using more diverse samples are needed. (C) 2010 Elsevier Inc. All rights reserved.

Bladder cancer index: cross-cultural adaptation into Spanish and psychometric evaluation.

BACKGROUND The Bladder Cancer Index (BCI) is so far the only instrument applicable across all bladder cancer patients, independent of tumor infiltration or treatment applied. We developed a Spanish version of the BCI, and assessed its acceptability and metric properties. METHODS For the adaptation into Spanish we used the forward and back-translation method, expert panels, and cognitive debriefing patient interviews. For the assessment of metric properties we used data from 197 bladder cancer patients from a multi-center prospective study. The Spanish BCI and the SF-36 Health Survey were self-administered before and 12 months after treatment. Reliability was estimated by Cronbach's alpha. Construct validity was assessed through the multi-trait multi-method matrix. The magnitude of change was quantified by effect sizes to assess responsiveness. RESULTS Reliability coefficients ranged 0.75-0.97. The validity analysis confirmed moderate associations between the BCI function and bother subscales for urinary (r = 0.61) and bowel (r = 0.53) domains; conceptual independence among all BCI domains (r ≤ 0.3); and low correlation coefficients with the SF-36 scores, ranging 0.14-0.48. Among patients reporting global improvement at follow-up, pre-post treatment changes were statistically significant for the urinary domain and urinary bother subscale, with effect sizes of 0.38 and 0.53. CONCLUSIONS The Spanish BCI is well accepted, reliable, valid, responsive, and similar in performance compared to the original instrument. These findings support its use, both in Spanish and international studies, as a valuable and comprehensive tool for assessing quality of life across a wide range of bladder cancer patients.

Cross-Cultural Adaptation and Validation of the Spinal Function Sort (SFS) for French- and German-Speaking Patients with Back Complaints

Aim: Functional subjective evaluation through questionnaire is fundamental, but not often realized in patients with back complaints, notably because of lack of validated tools, in accordance with recognized psychometric criteria. The Spinal Function Sort (SFS), developed according to actual standards, was only validated in English. The aim of this study is to translate, adapt and validate the French and German version of the SFS.Method and material: The translation and cross-cultural adaptation were performed following the methodology proposed by the American Association of Orthopedist Surgeon. A total of 344 patients, presenting varied back complaints (especially degenerative and traumatic), took part in this study in a tertiary French- (n=87; mean age 44y; 17 women) and German-speaking (n=257; mean age 41y; 53 women) center. Test-retest reliability was quantified using the intraclass correlation coefficient (ICC) and construct validity was assessed by estimating the Pearson's correlation with the SF-36 physical and mental scales, the Visual Analogue Scale for Pain Intensity (VAS), and subscales of the Hospital Anxiety and Depression Scale (HADS).Results: Respectively for the French and German version, ICC were 0.98 and 0.94. Correlations 0.63 and 0.67 with the SF-36 Physical Functioning subscale; 0.60 and 0.52 with the SF-36 Physical Summary Scale ; -0.33 and -0.51 with the VAS ; -0.08 and 0.25 with the SF-36 Mental Health scale; 0.01 and 0.28 with the SF-36 Mental Summary Scale; -0.26 and -0.42 with the HADS depression; -0.17 and -0.45 with the HADS anxiety.Discussion: For both the French and German version of the SFS, the reliability was excellent. Convergent construct validity with SF-36 physical scales is good, moderated with the VAS. We find out a low correlation with SF-36 mental scales (divergent construct validity). We find out a low correlation with HADS subscales in the French version, and a moderate one in the German version. Selection bias, chronicity of the complaints, as well as cultural differences could explain these results. In conclusion, both the French and German version of the SFS are valid and reliable for evaluation of perceived functional capacity for patients with back complaints.

The assessment of visual short-term memory in considering the underlying processes and their relation to psychometric intelligence

By means of fixed-links modeling the present study assessed processes involved in visual short-term memory functioning and investigates how these processes are related to intelligence. Using a color change detection task, short-term memory demands increased across three experimental conditions as a function of number of presented stimuli. We measured amount of information retained in visual short-term memory by hit rate as well as speed of visual short-term memory scanning by reaction time. For both measures, fixed-links modeling revealed a constant process reflecting processes irrespective of task manipulation as well as two increasing processes reflecting the increasing short-term memory demands. For visual short-term memory scanning, a negative association between intelligence and the constant process was found but no relationship between intelligence and the increasing processes. Thus, basic processing speed, rather than speed influenced by visual short-term memory demands, differentiates between high- and low-intelligent individuals. Intelligence was positively related to the experimental processes of shortterm memory retention but not to the constant process. In sum, significant associations with intelligence were only obtained when the specific processes of short-term memory were decomposed emphasizing the importance of a thorough assessment of cognitive processes when investigating their relation to intelligence.

Individual differences in working memory capacity explain the relationship between general discrimination ability and psychometric intelligence

The close association between psychometric intelligence and general discrimination ability (GDA), conceptualized as latent variable derived from performance on different sensory discrimination tasks, is empirically well-established but theoretically widely unclear. The present study contrasted two alternative explanations for this association. The first explanation is based on what Spearman (1904) referred to as a central function underlying this relationship in the sense of the g factor of intelligence and becoming most evident in GDA. In this case, correlations between different aspects of cognitive abilities, such as working memory (WM) capacity, and psychometric intelligence should be mediated by GDA if their correlation is caused by g. Alternatively, the second explanation for the relationship between psychometric intelligence and GDA proceeds from fMRI studies which emphasize the role of WM functioning for sensory discrimination. Given the well-known relationship between WM and psychometric intelligence, the relationship between GDA and psychometric intelligence might be attributed to WM. The present study investigated these two alternative explanations at the level of latent variables. In 197 young adults, a model in which WM mediated the relationship between GDA and psychometric intelligence described the data better than a model in which GDA mediated the relationship between WM and psychometric intelligence. Moreover, GDA failed to explain portions of variance of psychometric intelligence above and beyond WM. These findings clearly support the view that the association between psychometric intelligence and GDA must be understood in terms of WM functioning.

Elucidating the Functional Relationship Between Working Memory Capacity and Psychometric Intelligence: A Fixed-Links Modeling Approach for Experimental Repeated-Measures Designs

Numerous studies reported a strong link between working memory capacity (WMC) and fluid intelligence (Gf), although views differ in respect to how close these two constructs are related to each other. In the present study, we used a WMC task with five levels of task demands to assess the relationship between WMC and Gf by means of a new methodological approach referred to as fixed-links modeling. Fixed-links models belong to the family of confirmatory factor analysis (CFA) and are of particular interest for experimental, repeated-measures designs. With this technique, processes systematically varying across task conditions can be disentangled from processes unaffected by the experimental manipulation. Proceeding from the assumption that experimental manipulation in a WMC task leads to increasing demands on WMC, the processes systematically varying across task conditions can be assumed to be WMC-specific. Processes not varying across task conditions, on the other hand, are probably independent of WMC. Fixed-links models allow for representing these two kinds of processes by two independent latent variables. In contrast to traditional CFA where a common latent variable is derived from the different task conditions, fixed-links models facilitate a more precise or purified representation of the WMC-related processes of interest. By using fixed-links modeling to analyze data of 200 participants, we identified a non-experimental latent variable, representing processes that remained constant irrespective of the WMC task conditions, and an experimental latent variable which reflected processes that varied as a function of experimental manipulation. This latter variable represents the increasing demands on WMC and, hence, was considered a purified measure of WMC controlled for the constant processes. Fixed-links modeling showed that both the purified measure of WMC (β = .48) as well as the constant processes involved in the task (β = .45) were related to Gf. Taken together, these two latent variables explained the same portion of variance of Gf as a single latent variable obtained by traditional CFA (β = .65) indicating that traditional CFA causes an overestimation of the effective relationship between WMC and Gf. Thus, fixed-links modeling provides a feasible method for a more valid investigation of the functional relationship between specific constructs.

Psychometric assessment of recovery from mild traumatic brain injury

The Rapid Screen of Concussion (RSC) is a brief psychometric test battery, designed to provide a functional criterion to aid clinical diagnosis of mild traumatic brain injury (mTBI). The present research aimed to examine the utility of this instrument for assessing recovery after mTBI. Three studies were conducted. In Study 1, Discriminant Function Analysis was performed to determine how well the RSC differentiated uninjured controls (N¼16), from mTBI patients (N¼22) and moderate to severe TBI patients (N¼14), several months post-injury. As predicted, moderate to severe TBI patients achieved lower scores than the mTBI and control groups. The RSC also successfully differentiated between each of the diagnostic groups, yielding an overall correct classification rate of 75%. Study 2 examined the predictive utility of the RSC in the mTBI sample (N¼22). Acute injury performance on the RSC was correlated with post-injury scores at an average of 5.5 months post-injury. Statistically significant partial correlation coefficients (r¼0.53r¼0.80) were found for each of the subtests, showing that low acute RSC scores were predictive of poor recovery scores on the RSC after mTBI. In the third study, Reliable Change Indices were calculated on the RSC subtests to examine individual patterns of recovery from mTBI. While 17 of the 23 participants made a significant improvement on their acute injury DSST scores (74%), only 13 of 25 made a significant improvement on the Rapid Sentence Judgement Test (52%), highlighting differential recovery of function, and challenging the notion of full recovery from mTBI within 3 months. These overall results offer support for the construct and predictive validity of the RSC and demonstrate that inexpensive tests of brain function may be useful for managing mTBI acutely for prognosis.