EVIDENCE OF VALIDITY OF THE LSB-50: CROSS-VALIDATION, FACTORIAL INVARIANCE AND EXTERNAL CRITERION ANALYSIS

The aim of this paper was to obtain evidence of the validity of the LSB-50 (de Rivera & Abuín, 2012), a screening measure of psychopathology, in Argentinean adolescents. The sample consisted of 1002 individuals (49.7% male; 50.3% female) between 12 and 18 years-old (M = 14.98; SD = 1.99). A cross-validation study and factorial invariance studies were performed in samples divided by sex and age to test if a seven-factor structure that corresponds to seven clinical scales (Hypersensitivity, Obsessive-Compulsive, Anxiety, Hostility, Somatization, Depression, and Sleep disturbance) was adequate for the LSB-50. The seven-factor structure proved to be suitable for all the subsamples. Next, the fit of the seven-factor structure was studied simultaneously? in the aforementioned subsamples through hierarchical models that imposed different constrains of equivalency?. Results indicated the invariance of the seven clinical dimensions of the LSB-50. Ordinal alphas showed good internal consistency for all the scales. Finally, the correlations with a diagnostic measure of psychopathology (PAI-A) indicated moderate convergence. It is concluded that the analyses performed provide robust evidence of construct validity for the LSB-50

Developing a primary care patient measure of safety (PC PMOS): a modified Delphi process and face validity testing

BACKGROUND: Patients are a valuable source of information about ways to prevent harm in primary care and are in a unique position to provide feedback about the factors that contribute to safety incidents. Unlike in the hospital setting, there are currently no tools that allow the systematic capture of this information from patients. The aim of this study was to develop a quantitative primary care patient measure of safety (PC PMOS). METHODS: A two-stage approach was undertaken to develop questionnaire domains and items. Stage 1 involved a modified Delphi process. An expert panel reached consensus on domains and items based on three sources of information (validated hospital PMOS, previous research conducted by our study team and literature on threats to patient safety). Stage 2 involved testing the face validity of the questionnaire developed during stage 1 with patients and primary care staff using the 'think aloud' method. Following this process, the questionnaire was revised accordingly. RESULTS: The PC PMOS was received positively by both patients and staff during face validity testing. Barriers to completion included the length, relevance and clarity of questions. The final PC PMOS consisted of 50 items across 15 domains. The contributory factors to safety incidents centred on communication, access to care, patient-related factors, organisation and care planning, task performance and information flow. DISCUSSION: This is the first tool specifically designed for primary care settings, which allows patients to provide feedback about factors contributing to potential safety incidents. The PC PMOS provides a way for primary care organisations to learn about safety from the patient perspective and make service improvements with the aim of reducing harm in this setting. Future research will explore the reliability and construct validity of the PC PMOS.

The Gambling Urge Scale : reliability and validity in a clinical population

The aim of this study was to establish reliability and validity of the Gambling Urge Scale (GUS) in a clinical population of problem gamblers. This cohort study was conducted in South Australia between March 2008 and March 2009. Participants were problem gamblers aged ≥18 years (n = 158) who were seeking treatment from a range of gambling help services. Measures included gambling urge, problem gambling screening, gambling behaviour and problems caused by gambling, such as personal health and relationships. The psychometric properties investigated were internal reliability, criterion-related validity, concurrent validity and construct validity. Results showed high internal consistency for GUS (α = 0.93) and significant item-rest correlations ranging from 0.72 to 0.86. For criterion-related validity, a GUS cut score of three correctly classified 81.13% of participants as problem gambling with sensitivity 84.75% and specificity 76.6%. Concurrent validity was significant with a number of gambling-related symptoms and problems including psychological disturbance, work and social functioning and gambling-related cognitions (p < 0.001). An insignificant correlation was found between gambling urge and sensation seeking traits (p = 0.663). When controlling for gender and age the instrument was shown to have significant predictive properties for different levels of gambling severity (p < 0.001). A principal component analysis for the one component showed an overall explained variance of 75.54%. These findings indicate that GUS is a valid and reliable instrument for problem gambling screening, to measure treatment outcomes and may predict relapse in problem gambling.

Validity and reliability of a pictorial instrument for assessing perceived motor competence in Portuguese children

BACKGROUND: It is important to assess young children's perceived Fundamental Movement Skill (FMS) competence in order to examine the role of perceived FMS competence in motivation toward physical activity. Children's perceptions of motor competence may vary according to the culture/country of origin; therefore, it is also important to measure perceptions in different cultural contexts. The purpose was to assess the face validity, internal consistency, test-retest reliability and construct validity of the 12 FMS items in the Pictorial Scale for Perceived Movement Skill Competence for Young Children (PMSC) in a Portuguese sample.

METHODS: Two hundred one Portuguese children (girls, n = 112), 5 to 10 years of age (7.6 ± 1.4), participated. All children completed the PMSC once. Ordinal alpha assessed internal consistency. A random subsamples (n = 47) were reassessed one week later to determine test-retest reliability with Bland-Altman method. Children were asked questions after the second administration to determine face validity. Construct validity was assessed on the whole sample with a Bayesian Structural Equation Modelling (BSEM) approach. The hypothesized theoretical model used the 12 items and two hypothesized factors: object control and locomotor skills.

RESULTS: The majority of children correctly identified the skills and could understand most of the pictures. Test-retest reliability analysis was good, with an agreement ration between 0.99 and 1.02. Ordinal alpha values ranged from acceptable (object control 0.73, locomotor 0.68) to good (all FMS 0.81). The hypothesized BSEM model had an adequate fit.

CONCLUSIONS: The PMSC can be used to investigate perceptions of children's FMS competence. This instrument can also be satisfactorily used among Portuguese children.

Validity and reliability of the international fItness scale (IFIS) in a population-based sample of schoolchildren in Bogota, Colombia: The FUPRECOL study

The International FItness Scale (IFIS) is a self-reported measure of physical fitness that could easily. This scale has been validated in children, adolescents, and young adults; however, it is unknown whether the IFIS represents a valid and reliable estimate of physical fitness in Latino-American youth population. In the present study we aimed to examine the validity and reliability of the IFIS on a population-based sample of schoolchildren in Bogota, Colombia. Participants were 1,875 Colombian youth (56.2% girls) aged 9 to 17.9 years old. We measured adiposity markers (body fat, waist-to-height ratio, skinfold thicknesses and BMI), blood pressure, lipids profile, fasting glucose, and physical fitness level (self reported and measured). Also, a validated cardiometabolic risk index was used. An age- and sex-matched sample of 229 Schoolchildren originally not included in the study sample fulfilled IFIS twice for reliability purposes. Our data suggest that both measured and self-reported overall fitness were associated inversely with adiposity indicators and a cardiometabolic risk score. Overall, schoolchildren who self-reported “good” and “very good” fitness had better measured fitness than those who reported “very poor” and “poor” fitness (all p<0.001). Test–retest reliability of IFIS items was also good, with an average weighted Kappa of 0.811. Therefore, our findings suggest that self-reported fitness, as assessed by IFIS, is a valid, reliable, and health-related measure, and it can be a good alternative for future use in large studies with Latin-schoolchildren from Colombia.

The study process questionnaire : a revalidation study

The Study Process Questionnaire (Biggs, 1987) has been widely used in studies investigating learning behaviours in tertiary education. Many of the studies that have used the instrument have investigated the construct validity of the SPQ using a variety of factor analytic methods and techniques in an atheoretical way. Contrary to this method, Burnett and Dart (1997) argued that the hypothesised structure of a scale should be used when assessing the construct validity of an existing instrument. This study investigated the factor structure of the SPQ using a theoretical approach and found strong support for the three approaches to learning structure of the instrument.

The development of a clinical learning environment scale

Within nursing, there is a strong demand for high-quality, cost-effective clinical education experiences that facilitate student learning in the clinical setting The clinical learning environment (CLE) is the interactive network of forces within the clinical setting that influence the students'clinical learning outcomes The identification of factors that characterize CLE could lead to strategies that foster the factors most predictive of desirable student learning outcomes and ameliorate those which may have a negative impact on student outcomes The CLE scale is a 23-item instrument with five subscales staff–student relationships, nurse manager commitment, patient relationships, interpersonal relationships, and student satisfaction These factors have strong substantive face validity and construct validity, as determined by confirmatory factor analysis Reliability coefficients range from high (0 85) to marginal (0 63) The CLE scale provides the educator with a valid and reliable instrument to evaluate affectively relevant factors in the CLE, direct resources to areas where improvement may be required, and nurture those areas functioning well It will assist in the application of resources in a cost-effective, efficient, productive manner, and will ensure that the clinical learning experience offers the nursing student the best possible learning outcomes

The Children's Depression Scale : assessment of factor structure with data from a normal population

A study investigated the reliability and construct validity of the Children's Depression Scale. The revised subscales were shown to have strong construct and face validity and high reliability.

Extending the IS-Impact Model into the higher education sector

The study addresses known limitations of what may be the most important dependent variable in Information Systems (IS) research; IS-Success or IS-Impact. The study is expected to force a deeper understanding of the broad notions of IS success and impact. The aims of the research are to: (1) enhance the robustness and minimize limitations of the IS-Impact model, and (2) introduce and operationalise a more rigorously validated IS Impact measurement model to Universities, as a reliable model for evaluating different Administrative Systems. In extending and further generalizing the IS-Impact model, the study will address contemporary validation issues.

Patterns of engagement in workplace learning amongst employees from social sectors

Continuous learning and development has become increasingly important in the information age. However, employees with limited formal education in lower status occupations may be disadvantaged in their opportunities for development, as their jobs tend to require more limited knowledge and skills. In mature age, such workers may be subject to cumulative disadvantage with respect to work related learning and development, as well as negative stereotyping. This thesis concerns work related learning and development from a lifespan development psychology perspective. Development across the lifespan is grounded in biocultural co-constructivism. That is, the reciprocal influences of the individual and environment produce change in the individual. Existing theories and models of adaptive development attempt to explain how developmental resources are allocated across the lifespan. These included the Meta- theory of Selective Optimisation with Compensation, Dual Process Model of Self Regulation, and Developmental Regulation via Optimisation and Primary and Secondary Control. These models were integrated to create the Model of Adaptive Development for Work Related Learning. The Learning and Development Survey (LDS) was constructed to measure the hypothesised processes of adaptive development for work related learning, which were individual goal selection, individual goal engagement, individual goal disengagement, organisational opportunities (selection and engagement), and organisational constraints. Data collection was undertaken in two phases: the pilot study and the main study. The objective of the pilot study was to test the LDS on a target population of 112 employees from a local government organisation. Exploratory factor analysis reduced the pilot version of the survey to 38 items encompassing eight constructs which covered the processes of the model of adaptive development for work related learning. In the main study, the Revised Learning and Development Survey (R-LDS) was administered to another group of 137 employees from the local government organisation, as well as 110 employees from a private healthcare organisation. The purpose of the main study was to validate the R-LDS on two different groups to provide evidence of stability, and compare survey scores according to age and occupational status to determine construct validity. Findings from the main study indicated that only four constructs of the R-LDS were stable, which were organisational opportunities – selection, individual goal engagement, organisational constraints – disengagement and organisational opportunities – engagement. In addition, MANOVA studies revealed that the demographic variables affected organisational opportunities and constraints in the workplace, although individual goal engagement was not influenced by age. The findings from the pilot and main study partially supported the model of adaptive development for work related learning. Given that only four factors displayed adequate reliability in terms of internal consistency and stability, the findings suggest that individual goal selection and individual goal disengagement are less relevant to work related learning and development. Some recent research which emerged during the course of the current study has suggested that individual goal selection and individual goal disengagement are more relevant when goal achievement is impeded by biological constraints such as ageing. However, correlations between the retained factors support the model of adaptive development for work related learning, and represent the role of biocultural co-constructivism in development. Individual goal engagement was positively correlated with both opportunity factors (selection and engagement), while organisational constraints – disengagement was negatively correlated with organisational opportunities – selection. Demographic findings indicated that higher occupational status was associated with more opportunities for development. Age was associated with fewer opportunities or greater constraints for development, especially for lower status workers.

Validation of an Australian sign language instrument of outcome measurement for adults in mental health settings

Objective: There are currently no adult mental health outcome measures that have been translated into Australian sign language (Auslan). Without a valid and reliable Auslan outcome measure, empirical research into the efficacy of mental health interventions for sign language users is unattainable. To address this research problem the Outcome Rating Scale (ORS), a measure of general functioning, was translated into Auslan and recorded on to digital video disk for use in clinical settings. The purpose of the present study was therefore to examine the reliability, validity and acceptability of an Auslan version of the ORS (ORS-Auslan). Method: The ORS-Auslan was administered to 44 deaf people who use Auslan as their first language and who identify as members of a deaf community (termed ‘Deaf’ people) on their first presentation to a mental health or counselling facility and to 55 Deaf people in the general community. The community sample also completed an Auslan version of the Depression Anxiety Stress Scale-21 (DASS-21). Results: t-Tests indicated significant differences between the mean scores for the clinical and community sample. Internal consistency was acceptable given the low number of items in the ORS-Auslan. Construct validity was established by significant correlations between total scores on the DASS-21-Auslan and ORS-Auslan. Acceptability of ORS-Auslan was evident in the completion rate of 93% compared with 63% for DASS-21-Auslan. Conclusions: This is the only Auslan outcome measure available that can be used across a wide variety of mental health and clinical settings. The ORS-Auslan provides mental health clinicians with a reliable and valid, brief measure of general functioning that can significantly distinguish between clinical and non-clinical presentations for members of the Deaf community.

Teachers’ attitudes toward reporting child sexual abuse : problems with existing research leading to new scale development

This paper details a systematic literature review identifying problems in extant research relating to teachers’ attitudes towards reporting child sexual abuse, and offers a model for new attitude scale development and testing. Scale development comprised a five-phase process grounded in contemporary attitude theories including: a) developing the initial item pool; b) conducting a panel review; c) refining the scale via an expert focus group; d) building content validity through cognitive interviews; e) assessing internal consistency via field testing. The resulting 21-item scale displayed construct validity in preliminary testing. The scale may prove useful as a research tool, given the theoretical supposition that attitudes may be changed with time, context, experience, and education. Further investigation with a larger sample is warranted.

Validating the IS-Impact model in Australasian universities

This paper presents a novel study that aims to contribute to understanding the phenomenon of Enterprise Systems (ES) evaluation in Australasian universities. The proposed study addresses known limitations of arguably the most significant dependent variable in the Information System (IS) field - IS Success or IS-Impact. This study adopts the IS-Impact measurement model, reported by Gable et al. (2008), as the primary commencing theory-base and applies research extension strategy described by Berthon et al. (2002); extending both theory and the context. This study employs a longitudinal, multi-method research design, with two interrelated phases – exploratory and confirmatory. The exploratory phase aims to investigate the applicability and sufficiency of the IS-Impact dimensions and measures in the new context. The confirmatory phase will gather quantitative data to statistically validate IS-Impact model as a formative index.

Initial psychometric evaluation of the Wayfinding Effectiveness Scale

This study evaluates three versions of the Wayfinding Effectiveness Scale (WES), developed to differentiate problems of wayfinding and wandering behavior of community-residing elders with dementia (EWD), in 266 dyads (EWD and caregiver) recruited from Alzheimer's Association chapters. Factor analyses yield a five-factor solution (explained variance = 62.6%): complex wayfinding goals, analytic strategies, global strategies, simple wayfinding goals, and being stimulus bound. Overall, internal consistencies are high: WES (.94-.95), and subscales are stable across all versions. Testretest reliability is acceptable for the overall WES and two subscales (complex and simple wayfinding goals) for the care recipient current behavior version. Construct validity is supported by the pattern of correlations among subscales and analyses of variance (ANOVAs) showing significant differences among the care recipient (current vs. prior behavior) and caregiver versions overall and for all subscales. Results support the WES as a valid and reliable measure of wayfinding effectiveness in persons with dementia.

Safety in occupational driving : development of a driver behaviour scale for the workplace context

International statistics indicate that occupational, or work-related driving, crashes are the most common cause of workplace injury, death, and absence from work. The majority of research examining unsafe driver behavior in the workplace has relied on general road safety questionnaires. However, past research has failed to consider the organizational context in the use of these questionnaires, and as such, there is ambiguity in the dimensions constituting occupational driving. Using a theoretical model developed by Hockey (1993, 1997), this article proposes and validates a new scale of occupational driver behavior. This scale incorporates four dimensions of driver behavior that are influenced by demanding workplace conditions; speeding, rule violation, inattention, and driving while tired. Following a content validation process, three samples of occupational drivers in Australia were used to assess the scale. Data from the first sample (n=145) were used to reduce the number of scale items and provide an assessment of the factorial validity of the scale. Data from the second sample (n=645) were then used to confirm the factor structure and psychometric properties of the scale including reliability and construct validity. Finally, data from the third sample (n=248) were used to establish criterion validity. The results indicated that the scale is a reliable and valid measure of occupational driver behavior.