Exploring the effects of a universal classroom management training programme on teacher and child behaviour: a group randomised controlled trial and cost analysis

Teachers frequently struggle to cope with conduct problems in the classroom. The aim of this study was to assess the effectiveness of the Incredible Years Teacher Classroom Management Training Programme for improving teacher competencies and child adjustment. The study involved a group randomised controlled trial which included 22 teachers and 217 children (102 boys and 115 girls). The average age of children included in the study was 5.3 years (standard deviation = 0.89). Teachers were randomly allocated to an intervention group (n = 11 teachers; 110 children) or a waiting-list control group (n = 11; 107 children). The sample also included 63 ‘high-risk’ children (33 intervention; 30 control), who scored above the cut-off (>12) on the Strengths and Difficulties Questionnaire for abnormal socioemotional and behavioural difficulties. Teacher and child behaviours were assessed at baseline and 6 months later using psychometric and observational measures. Programme delivery costs were also analysed. Results showed positive changes in teachers’ self-reported use of positive classroom management strategies (effect size = 0.56), as well as negative classroom management strategies (effect size = −0.43). Teacher reports also highlight improvements in the classroom behaviour of the high-risk group of children, while the estimated cost of delivering the Incredible Years Teacher Classroom Management Training Programme was modest. However, analyses of teacher and child observations were largely non-significant. A need for further research exploring the effectiveness and cost-effectiveness of the Incredible Years Teacher Classroom Management Training Programme is indicated.

Testing the psychometric properties of two self-report clinical competence scales for nursing students.

Background: It is important to assess the clinical competence of nursing students to gauge their educational needs. Competence can be measured by self-assessment tools; however, Anema and McCoy (2010) contend that currently available measures should be further psychometrically tested.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.
Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to investigate structural validity and scale properties; convergent and discriminant validity and reliability were also tested for each scale.
Results: MSA analysis identified that the NCQ is a unidimensional scale with strong scale scalability coefficients Hs =0.581; but limited item rankability HT =0.367. The SECP scale MSA suggested that the scale could be potentially split into two unidimensional scales (SECP28 and SECP7), each with good/reasonable scalablity psychometric properties as summed scales but negligible/very limited scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/SECP scores produced evidence of discriminant and convergent validity; good internal reliability was also found: NCQ α = 0.93, SECP28 α = 0.96 and SECP7 α=0.89.

Discussion: In line with previous research further evidence of the NCQ’s reliability and validity was demonstrated. However, as the SECP findings are new and the sample small with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.
Conclusions: Measurement of perceived self-competence could start early in a nursing programme to support students’ development of clinical competence. Further testing of the SECP scale with larger nursing student samples from different programme years is indicated.

References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

Testing the psychometric properties of Kidscreen-27 with Irish children of low socio-economic status

Background

Kidscreen-27 was developed as part of a cross-cultural European Union-funded project to standardise the measurement of children’s health-related quality of life. Yet, research has reported mixed evidence for the hypothesised 5-factor model, and no confirmatory factor analysis (CFA) has been conducted on the instrument with children of low socio-economic status (SES) across Ireland (Northern and Republic).

Method

The data for this study were collected as part of a clustered randomised controlled trial. A total of 663 (347 male, 315 female) 8–9-year-old children (M = 8.74, SD = .50) of low SES took part. A 5- and modified 7-factor CFA models were specified using the maximum likelihood estimation. A nested Chi-square difference test was conducted to compare the fit of the models. Internal consistency and floor and ceiling effects were also examined.

Results

CFA found that the hypothesised 5-factor model was an unacceptable fit. However, the modified 7-factor model was supported. A nested Chi-square difference test confirmed that the fit of the 7-factor model was significantly better than that of the 5-factor model. Internal consistency was unacceptable for just one scale. Ceiling effects were present in all but one of the factors.

Conclusions

Future research should apply the 7-factor model with children of low socio-economic status. Such efforts would help monitor the health status of the population.

Parental involvement in sport: psychometric development and empirical test of a theoretical model

The purposes of the present multistudy were to develop and provide initial construct validity for measures based on the model of parental involvement in sport (Study 1) and examine structural relationships among the constructs of the model (Study 2). In Study 1 (nparents = 342, nathletes = 223), a confirmatory factor analysis was used to verify the psychometric properties of the measures. Content and construct validity were evaluated, as well individual and composite reliability. Multi-group analysis with two independent samples provided evidence of factorial invariance. In Study 2 (nparents = 754, nathletes = 438), structural equation modeling analysis supported the hypothesised model in which athletes’ perceptions of parents’ behaviours mediated the relationship between parents’ reported behaviours and the athletes’ psychological variables conducive to their achievement in sport. The findings provide support for the parental involvement in sport model and demonstrate the role of perceptions of parents’ behaviours on young athletes’ cognitions in sport.

Development and preliminary psychometric properties of the Care Experience Feedback Improvement Tool (CEFIT).

Objective To develop a structurally valid and reliable, yet brief measure of patient experience of hospital quality of care, the Care Experience Feedback Improvement Tool (CEFIT). Also, to examine aspects of utility of CEFIT. Background Measuring quality improvement at the clinical interface has become a necessary component of healthcare measurement and improvement plans, but the effectiveness of measuring such complexity is dependent on the purpose and utility of the instrument used. Methods CEFIT was designed from a theoretical model, derived from the literature and a content validity index (CVI) procedure. A telephone population surveyed 802 eligible participants (healthcare experience within the previous 12 months) to complete CEFIT. Internal consistency reliability was tested using Cronbach's α. Principal component analysis was conducted to examine the factor structure and determine structural validity. Quality criteria were applied to judge aspects of utility. Results CVI found a statistically significant proportion of agreement between patient and practitioner experts for CEFIT construction. 802 eligible participants answered the CEFIT questions. Cronbach's α coefficient for internal consistency indicated high reliability (0.78). Interitem (question) total correlations (0.28–0.73) were used to establish the final instrument. Principal component analysis identified one factor accounting for 57.3% variance. Quality critique rated CEFIT as fair for content validity, excellent for structural validity, good for cost, poor for acceptability and good for educational impact. Conclusions CEFIT offers a brief yet structurally sound measure of patient experience of quality of care. The briefness of the 5-item instrument arguably offers high utility in practice. Further studies are needed to explore the utility of CEFIT to provide a robust basis for feedback to local clinical teams and drive quality improvement in the provision of care experience for patients. Further development of aspects of utility is also required.

Children's Separation Anxiety Scale (CSAS): Psychometric Properties

This study describes the psychometric properties of the Children's Separation Anxiety Scale (CSAS), which assesses separation anxiety symptoms in childhood. Participants in Study 1 were 1,908 schoolchildren aged between 8 and 11. Exploratory factor analysis identified four factors: worry about separation, distress from separation, opposition to separation, and calm at separation, which explained 46.91% of the variance. In Study 2, 6,016 children aged 8–11 participated. The factor model in Study 1 was validated by confirmatory factor analysis. The internal consistency (α = 0.82) and temporal stability (r = 0.83) of the instrument were good. The convergent and discriminant validity were evaluated by means of correlations with other measures of separation anxiety, childhood anxiety, depression and anger. Sensitivity of the scale was 85% and its specificity, 95%. The results support the reliability and validity of the CSAS.

Psychometric properties of the oral health impact profile and new methodological approach

Objective: Evaluate the validity, reliability, and factorial invariance of the complete Portuguese version of the Oral Health Impact Profile (OHIP) and its short version (OHIP-14). Methods: A total of 1,162 adults enrolled in the Faculty of Dentistry of Araraquara/UNESP participated in the study; 73.1% were women; and the mean age was 40.7 ± 16.3 yr. We conducted a confirmatory factor analysis, where χ2/df, comparative fit index, goodness of fit index, and root mean square error of approximation were used as indices of goodness of fit. The convergent validity was judged from the average variance extracted and the composite reliability, and the internal consistency was estimated by Cronbach standardized alpha. The stability of the models was evaluated by multigroup analysis in independent samples (test and validation) and between users and nonusers of dental prosthesis. Results: We found best-fitting models for the OHIP-14 and among dental prosthesis users. The convergent validity was below adequate values for the factors “functional limitation” and “physical pain” for the complete version and for the factors “functional limitation” and “psychological discomfort” for the OHIP-14. Values of composite reliability and internal consistency were below adequate in the OHIP-14 for the factors “functional limitation” and “psychological discomfort.” We detected strong invariance between test and validation samples of the full version and weak invariance for OHIP-14. The models for users and nonusers of dental prosthesis were not invariant for both versions. Conclusion: The reduced version of the OHIP was parsimonious, reliable, and valid to capture the construct “impact of oral health on quality of life,” which was more pronounced in prosthesis users.

Development and psychometric evaluation of the basic electrocardiogram interpretation self-efficacy scale

Purpose: Research suggests that nurses and nursing students lack competence in basic electrocardiogram (ECG) interpretation. Self-efficacy is considered to be paramount in the development of one's competence. The aim of this study was to develop and psychometrically evaluate a scale to assess self-efficacy of nursing students in basic ECG interpretation. Materials and methods: Observational cross-sectional study with a convenience sample of 293 nursing students. The basic ECG interpretation self-efficacy scale (ECG-SES) was developed and psychometrically tested in terms of reliability (internal consistency and temporal stability) and validity (content, criterion and construct). The ECG-SES’ internal consistency was explored by calculating the Cronbach's alpha coefficient (α); its temporal stability was investigated by calculating the Pearson correlation coefficient (r) between the participants’ results on a test–retest separated by a 4-week interval. The content validity index of the items (I-CVI) and the scale (S-CVI) was calculated based on the reviews of a panel of 16 experts. Criterion validity was explored by correlating the participants’ results on the ECG-SES with their results on the New General Self-Efficacy Scale (NGSE). 1 Construct validity was investigated by performing Principal Component Analysis (PCA) and known-group analysis. Results: The excellent reliability of the ECG-SES was evidenced by its internal consistency (α = 0.98) and its temporal stability at the 4-week re-test (r = 0.81; p < 0.01). The ECG-SES’ content validity was also excellent (all items’ I-CVI = 0.94–1; S-CVI = 0.99). A strong, significant correlation between the NGSE and the ECG-SES (r = 0.70; p < 0.01) showed its criterion validity. Corroborating the ECG-SES’ construct validity, PCA revealed that all its items loaded on a single factor that explained 74.6% of the total variance found. Furthermore, known-groups analysis showed the ECG-SES’ ability to detect expected differences in self-efficacy between groups with different training experiences (p < 0.01). Conclusion: The ECG-SES showed excellent psychometric properties for measuring the self-efficacy of nursing students in basic ECG interpretation.

The State of our Toolbox: A Meta-analysis of Reliability Measurement Precision

My study investigated internal consistency estimates of psychometric surveys as an operationalization of the state of measurement precision of constructs in industrial and organizational (I/O) psychology. Analyses were conducted of samples used in research articles published in the Journal of Applied Psychology between 1975 and 2010 in five year intervals (K = 934) from 480 articles yielding 1427 coefficients. Articles and their respective samples were coded for test-taker characteristics (e.g., age, gender, and ethnicity), research settings (e.g., lab and field studies), and actual tests (e.g., number of items and scale anchor points). A reliability and inter-item correlations depository was developed for I/O variables and construct groups. Personality measures had significantly lower inter-item correlations than other construct groups. Also, internal consistency estimates and reporting practices were evaluated over time, demonstrating an improvement in measurement precision and missing data.

Rasch analysis of the routines-based interview implementation checklist

The Routines-Based Interview (RBI) is useful for developing functional outcomes/goals, for establishing strong relationships with families, and for assessing the family’s true needs. In this study, the authors investigated the psychometric properties of the RBI Implementation Checklist, conducted by 120 early intervention professionals, specifically looking at the probability of correct responses on the items as a logistic function of the difference between the person and the item parameters.We selected Rasch analysis (Rasch, 1980) for this study so we could answer questions about both how themeasure performed and how the interviewers performed and we related these performances to one another. Results indicate that scores on the RBI Implementation Checklist were reliable. The checklist could possibly benefit from more difficult items to measure the true performance of the few people who had scores higher than the most difficult items and also from additional items that focus on the family.

Psychometric properties of the Iranian version of the premature ejaculation diagnostic tool

Introduction Premature ejaculation (PE) is one of the most prevalent male sexual problems. The Premature Ejaculation Diagnostic Tool (PEDT) is a suitable patient-reported outcome measure for the assessment of PE. Aim To examine the psychometric proporties of a translated and culturally adapted version of the PEDT in a sample of Iranian men suffering from PE. Methods Two independent samples were compared, one including patients with PE based on the DSM-IV-TR criteria (n = 269) and the other including healthy men without PE (n = 289). A backward–forward translation procedure was used to translate the PEDT into Persian. Both samples were asked to fill in the PEDT twice—at baseline and 4 weeks later. Main Outcome Measures Internal consistency, test–retest reliability, convergent validity, factor structure, measurement invariance across sexual health status (i.e., between men with and without PE). Results Mean ages of men without and with PE were 34.9 and 35.3 years, respectively. Cronbach's alpha coefficient for the total PEDT score was 0.89. All items and the total score were remarkably consistent between the two measurement points. All five PEDT items correlated at r = 0.40 or greater with their own scale, indicating good convergent validity. There was a high and significant correlation (r = −0.82, P  < 0.001) between the PEDT score and IELT. Healthy men reported lower scores (fewer complaints) on the PEDT compared with the PE group. A single-factor model was found to be best-fitting in the exploratory factor analysis; this was confirmed by confirmatory factor analysis. The PEDT was invariant across sexual health status and perceived similarly by men with and without PE. Conclusion The results provide evidence for good reliability and validity of the Iranian version of the PEDT. The questionnaire therefore represents a suitable tool for screening PE in Iranian men.

Quinn’s Leadership Roles: A Confirmatory Factor Analysis Study in Portuguese Health Services

Purpose: To evaluate psychometric properties of Quinn’s leadership questionnaire (CFV questionnaire; 1988) to the Portuguese health services. Design: Cross-sectional study, using the Quinn’s leadership questionnaire, administered to registered nurses and physicians in Portuguese health care services (N = 687). Method: Self-administered survey applied to two samples. In the first (of convenience; N = 249 Portuguese health professionals) were performed exploratory factor and reliability analysis to the CFV questionnaire. In the second sample (stratified; N = 50 surgical units of 33 Portuguese hospitals) was performed confirmatory factor analysis using LISREL 8.80. Findings: The first sample supported an eight-factor solution accounting for 65.46% of the variance, in an interpretable factorial structure (loadings> .50), with Cronbach’s α upper than .79. This factorial structure, replicated with the second sample, showed reasonable fit for each of the 8 leadership roles, quadrants, and global model. The models evidenced, generally, nomological validity, with scores between good and acceptable (.235 < x2/df < 2.055 e .00 < RMSEA < .077). Conclusions: Quinn’s leadership questionnaire presented good reliability and validity for the eight leadership roles, showing to be suitable for use in hospital health care context. Key-Words: Leadership; Quinn’s CVF questionnaire; health services; Quinn’s competing values.

Analysis Of The Dna Fourier Transform-infrared Microspectroscopic Signature Using An All-reflecting Objective.

The Fourier transform-infrared (FT-IR) signature of dry samples of DNA and DNA-polypeptide complexes, as studied by IR microspectroscopy using a diamond attenuated total reflection (ATR) objective, has revealed important discriminatory characteristics relative to the PO2(-) vibrational stretchings. However, DNA IR marks that provide information on the sample's richness in hydrogen bonds have not been resolved in the spectral profiles obtained with this objective. Here we investigated the performance of an all reflecting objective (ARO) for analysis of the FT-IR signal of hydrogen bonds in DNA samples differing in base richness types (salmon testis vs calf thymus). The results obtained using the ARO indicate prominent band peaks at the spectral region representative of the vibration of nitrogenous base hydrogen bonds and of NH and NH2 groups. The band areas at this spectral region differ in agreement with the DNA base richness type when using the ARO. A peak assigned to adenine was more evident in the AT-rich salmon DNA using either the ARO or the ATR objective. It is concluded that, for the discrimination of DNA IR hydrogen bond vibrations associated with varying base type proportions, the use of an ARO is recommended.

Effect Of Platform Connection And Abutment Material On Stress Distribution In Single Anterior Implant-supported Restorations: A Nonlinear 3-dimensional Finite Element Analysis.

Although various abutment connections and materials have recently been introduced, insufficient data exist regarding the effect of stress distribution on their mechanical performance. The purpose of this study was to investigate the effect of different abutment materials and platform connections on stress distribution in single anterior implant-supported restorations with the finite element method. Nine experimental groups were modeled from the combination of 3 platform connections (external hexagon, internal hexagon, and Morse tapered) and 3 abutment materials (titanium, zirconia, and hybrid) as follows: external hexagon-titanium, external hexagon-zirconia, external hexagon-hybrid, internal hexagon-titanium, internal hexagon-zirconia, internal hexagon-hybrid, Morse tapered-titanium, Morse tapered-zirconia, and Morse tapered-hybrid. Finite element models consisted of a 4×13-mm implant, anatomic abutment, and lithium disilicate central incisor crown cemented over the abutment. The 49 N occlusal loading was applied in 6 steps to simulate the incisal guidance. Equivalent von Mises stress (σvM) was used for both the qualitative and quantitative evaluation of the implant and abutment in all the groups and the maximum (σmax) and minimum (σmin) principal stresses for the numerical comparison of the zirconia parts. The highest abutment σvM occurred in the Morse-tapered groups and the lowest in the external hexagon-hybrid, internal hexagon-titanium, and internal hexagon-hybrid groups. The σmax and σmin values were lower in the hybrid groups than in the zirconia groups. The stress distribution concentrated in the abutment-implant interface in all the groups, regardless of the platform connection or abutment material. The platform connection influenced the stress on abutments more than the abutment material. The stress values for implants were similar among different platform connections, but greater stress concentrations were observed in internal connections.