The Schizophrenia Proneness Instrument, Child and Youth version (SPI-CY): Practicability and discriminative validity

Background Basic symptom (BS) criteria have been suggested to complement ultra-high risk (UHR) criteria in the early detection of psychosis in adults and in children and adolescents. To account for potential developmental particularities and a different clustering of BS in children and adolescents, the Schizophrenia Proneness Instrument, Child and Youth version (SPI-CY) was developed. Aims The SPI-CY was evaluated for its practicability and discriminative validity. Method The SPI-CY was administered to 3 groups of children and adolescents (mean age 16; range=8–18; 61% male): 23 at-risk patients meeting UHR and/or BS criteria (AtRisk), 22 clinical controls (CC), and 19 children and adolescents from the general population (GPS) matched to AtRisk in age, gender, and education. We expected AtRisk to score highest on the SPI-CY, and GPS lowest. Results The groups differed significantly on all 4 SPI-CY subscales. Pairwise post-hoc comparisons confirmed our expectations for all subscales and, at least on a descriptive level, most items. Pairwise subscale differences indicated at least moderate group effects (r≥0.37) which were largest for Adynamia (0.52≤r≥0.70). Adynamia also performed excellent to outstanding in ROC analyses (0.813≤AUC≥0.981). Conclusion The SPI-CY could be a helpful tool for detecting and assessing BS in the psychosis spectrum in children and adolescents, by whom it was well received. Furthermore, its subscales possess good discriminative validity. However, these results require validation in a larger sample, and the psychosis-predictive ability of the subscales in different age groups, especially the role of Adynamia, will have to be explored in longitudinal studies.

Validity evidence and reliability of a Simulated Patient Feedback Instrument

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Methods Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. Results All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. Conclusions The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.