Assessing the construct validity and reliability of the parental perception on antibiotics (PAPA) scales

Background: The overuse of antibiotics is becoming an increasing concern. Antibiotic resistance, which increases both the burden of disease, and the cost of health services, is perhaps the most profound impact of antibiotics overuse. Attempts have been made to develop instruments to measure the psychosocial constructs underlying antibiotics use, however, none of these instruments have undergone thorough psychometric validation. This study evaluates the psychometric properties of the Parental Perceptions on Antibiotics (PAPA) scales. The PAPA scales attempt to measure the factors influencing parental use of antibiotics in children. Methods: 1111 parents of children younger than 12 years old were recruited from primary schools’ parental meetings in the Eastern Province of Saudi Arabia from September 2012 to January 2013. The structure of the PAPA instrument was validated using Confirmatory Factor Analysis (CFA) with measurement model fit evaluated using the raw and scaled χ2, Goodness of Fit Index, and Root Mean Square Error of Approximation. Results: A five-factor model was confirmed with the model showing good fit. Constructs in the model include: Knowledge and Beliefs, Behaviors, Sources of information, Adherence, and Awareness about antibiotics resistance. The instrument was shown to have good internal consistency, and good discriminant and convergent validity. Conclusion: The availability of an instrument able to measure the psychosocial factors underlying antibiotics usage allows the risk factors underlying antibiotic use and overuse to now be investigated.

Parents’ self-efficacy, outcome expectations, and self-reported task performance when managing atopic dermatitis in children: Instrument reliability and validity

BACKGROUND: Support and education for parents faced with managing a child with atopic dermatitis is crucial to the success of current treatments. Interventions aiming to improve parent management of this condition are promising. Unfortunately, evaluation is hampered by lack of precise research tools to measure change. OBJECTIVES: To develop a suite of valid and reliable research instruments to appraise parents' self-efficacy for performing atopic dermatitis management tasks; outcome expectations of performing management tasks; and self-reported task performance in a community sample of parents of children with atopic dermatitis. METHODS: The Parents' Eczema Management Scale (PEMS) and the Parents' Outcome Expectations of Eczema Management Scale (POEEMS) were developed from an existing self-efficacy scale, the Parental Self-Efficacy with Eczema Care Index (PASECI). Each scale was presented in a single self-administered questionnaire, to measure self-efficacy, outcome expectations, and self-reported task performance related to managing child atopic dermatitis. Each was tested with a community sample of parents of children with atopic dermatitis, and psychometric evaluation of the scales' reliability and validity was conducted. SETTING AND PARTICIPANTS: A community-based convenience sample of 120 parents of children with atopic dermatitis completed the self-administered questionnaire. Participants were recruited through schools across Australia. RESULTS: Satisfactory internal consistency and test-retest reliability was demonstrated for all three scales. Construct validity was satisfactory, with positive relationships between self-efficacy for managing atopic dermatitis and general perceived self-efficacy; self-efficacy for managing atopic dermatitis and self-reported task performance; and self-efficacy for managing atopic dermatitis and outcome expectations. Factor analyses revealed two-factor structures for PEMS and PASECI alike, with both scales containing factors related to performing routine management tasks, and managing the child's symptoms and behaviour. Factor analysis was also applied to POEEMS resulting in a three-factor structure. Factors relating to independent management of atopic dermatitis by the parent, involving healthcare professionals in management, and involving the child in the management of atopic dermatitis were found. Parents' self-efficacy and outcome expectations had a significant influence on self-reported task performance. CONCLUSIONS: Findings suggest that PEMS and POEEMS are valid and reliable instruments worthy of further psychometric evaluation. Likewise, validity and reliability of PASECI was confirmed.

Cross-cultural adaptation, reliability and validity of the Spanish version of the upper limb functional index

Background The Upper Limb Functional Index (ULFI) is an internationally widely used outcome measure with robust, valid psychometric properties. The purpose of study is to develop and validate a ULFI Spanish-version (ULFI-Sp). Methods A two stage observational study was conducted. The ULFI was cross-culturally adapted to Spanish through double forward and backward translations, the psychometric properties were then validated. Participants (n = 126) with various upper limb conditions of >12 weeks duration completed the ULFI-Sp, QuickDASH and the Euroqol Health Questionnaire 5 Dimensions (EQ-5D-3 L). The full sample determined internal consistency, concurrent criterion validity, construct validity and factor structure; a subgroup (n = 35) determined reliability at seven days. Results The ULFI-Sp demonstrated high internal consistency (α = 0.94) and reliability (r = 0.93). Factor structure was one-dimensional and supported construct validity. Criterion validity with the EQ-5D-3 L was fair and inversely correlated (r = −0.59). The QuickDASH data was unavailable for analysis due to excessive missing responses. Conclusions The ULFI-Sp is a valid upper limb outcome measure with similar psychometric properties to the English language version.

Extending the validity of the Feeding Practices and Structure Questionnaire

Background Feeding practices are commonly examined as potentially modifiable determinants of children’s eating behaviours and weight status. Although a variety of questionnaires exist to assess different feeding aspects, many lack thorough reliability and validity testing. The Feeding Practices and Structure Questionnaire (FPSQ) is a tool designed to measure early feeding practices related to non-responsive feeding and structure of the meal environment. Face validity, factorial validity, internal reliability and cross-sectional correlations with children’s eating behaviours have been established in mothers with 2-year-old children. The aim of the present study was to further extend the validity of the FPSQ by examining factorial, construct and predictive validity, and stability. Methods Participants were from the NOURISH randomised controlled trial which evaluated an intervention with first-time mothers designed to promote protective feeding practices. Maternal feeding practices (FP) and child eating behaviours were assessed when children were aged 2 years and 3.7 years (n=388). Confirmatory Factor analysis, group differences, predictive relationships, and stability were tested. Results The original 9-factor structure was confirmed when children were aged 3.7±0.3 years. Cronbach’s alpha was above the recommended 0.70 cut-off for all factors except Structured Meal Timing, Over Restriction and Distrust in Appetite which were 0.58, 0.67 and 0.66 respectively. Allocated group differences reflected behaviour consistent with intervention content and all feeding practices were stable across both time points (range of r= 0.45-0.70). There was some evidence for the predictive validity of factors with 2 FP showing expected relationships, 2 FP showing expected and unexpected relationships and 5 FP showing no relationship. Conclusions Reliability and validity was demonstrated for most subscales of the FPSQ. Future validation is warranted with culturally diverse samples and with fathers and other caregivers. The use of additional outcomes to further explore predictive validity is recommended as well as testing construct validity and test-retest reliability of the questionnaire.

Development, reliability and validity of the queensland evaluation of wheelchair skills (QEWS)

- Objectives To develop and test a valid and reliable assessment of wheelchair skills for individuals with spinal cord injuries (SCI); the Queensland Evaluation of Wheelchair Skills (QEWS). - Setting Hospital, Australia. - Methods Phase 1: Four Delphi panel rounds with clinical experts were used to develop the QEWS. Phase 2: Intra-rater and inter-rater reliability of the QEWS items were examined in 100 people with SCI. Phase 3a: Concurrent validity was investigated by examining the association between QEWS total scores and physiotherapists’ global ratings of wheelchair skill performance. Phase 3b: Construct validity was tested in 20 people with recent SCI by examining change in QEWS total scores between when they first mobilised in a wheelchair and scores obtained 10 weeks later. - Results Phase 1: The QEWS was developed. Phase 2: The intra-class correlation coefficients reflecting the intra-rater reliability and the inter-rater reliability for the QEWS total score were 1.00 and 0.98, with scores being within one point of each other 96 and 91% of the time, respectively. Phase 3a: The QEWS total scores were comparable with the global rating of wheelchair skill performance (r2=0.93). Phase 3b: The QEWS scores changed by a median (interquartile range (IQR)) of 4 (1 to 6) points over the 10-week period following first wheelchair mobilisation. - Conclusion The QEWS is a valid and reliable tool for measuring wheelchair skills in individuals with SCI. The QEWS is efficient and practical to administer and does not require specialised equipment.

The study process questionnaire : a revalidation study

The Study Process Questionnaire (Biggs, 1987) has been widely used in studies investigating learning behaviours in tertiary education. Many of the studies that have used the instrument have investigated the construct validity of the SPQ using a variety of factor analytic methods and techniques in an atheoretical way. Contrary to this method, Burnett and Dart (1997) argued that the hypothesised structure of a scale should be used when assessing the construct validity of an existing instrument. This study investigated the factor structure of the SPQ using a theoretical approach and found strong support for the three approaches to learning structure of the instrument.

The development of a clinical learning environment scale

Within nursing, there is a strong demand for high-quality, cost-effective clinical education experiences that facilitate student learning in the clinical setting The clinical learning environment (CLE) is the interactive network of forces within the clinical setting that influence the students'clinical learning outcomes The identification of factors that characterize CLE could lead to strategies that foster the factors most predictive of desirable student learning outcomes and ameliorate those which may have a negative impact on student outcomes The CLE scale is a 23-item instrument with five subscales staff–student relationships, nurse manager commitment, patient relationships, interpersonal relationships, and student satisfaction These factors have strong substantive face validity and construct validity, as determined by confirmatory factor analysis Reliability coefficients range from high (0 85) to marginal (0 63) The CLE scale provides the educator with a valid and reliable instrument to evaluate affectively relevant factors in the CLE, direct resources to areas where improvement may be required, and nurture those areas functioning well It will assist in the application of resources in a cost-effective, efficient, productive manner, and will ensure that the clinical learning experience offers the nursing student the best possible learning outcomes

The Children's Depression Scale : assessment of factor structure with data from a normal population

A study investigated the reliability and construct validity of the Children's Depression Scale. The revised subscales were shown to have strong construct and face validity and high reliability.

Extending the IS-Impact Model into the higher education sector

The study addresses known limitations of what may be the most important dependent variable in Information Systems (IS) research; IS-Success or IS-Impact. The study is expected to force a deeper understanding of the broad notions of IS success and impact. The aims of the research are to: (1) enhance the robustness and minimize limitations of the IS-Impact model, and (2) introduce and operationalise a more rigorously validated IS Impact measurement model to Universities, as a reliable model for evaluating different Administrative Systems. In extending and further generalizing the IS-Impact model, the study will address contemporary validation issues.

Patterns of engagement in workplace learning amongst employees from social sectors

Continuous learning and development has become increasingly important in the information age. However, employees with limited formal education in lower status occupations may be disadvantaged in their opportunities for development, as their jobs tend to require more limited knowledge and skills. In mature age, such workers may be subject to cumulative disadvantage with respect to work related learning and development, as well as negative stereotyping. This thesis concerns work related learning and development from a lifespan development psychology perspective. Development across the lifespan is grounded in biocultural co-constructivism. That is, the reciprocal influences of the individual and environment produce change in the individual. Existing theories and models of adaptive development attempt to explain how developmental resources are allocated across the lifespan. These included the Meta- theory of Selective Optimisation with Compensation, Dual Process Model of Self Regulation, and Developmental Regulation via Optimisation and Primary and Secondary Control. These models were integrated to create the Model of Adaptive Development for Work Related Learning. The Learning and Development Survey (LDS) was constructed to measure the hypothesised processes of adaptive development for work related learning, which were individual goal selection, individual goal engagement, individual goal disengagement, organisational opportunities (selection and engagement), and organisational constraints. Data collection was undertaken in two phases: the pilot study and the main study. The objective of the pilot study was to test the LDS on a target population of 112 employees from a local government organisation. Exploratory factor analysis reduced the pilot version of the survey to 38 items encompassing eight constructs which covered the processes of the model of adaptive development for work related learning. In the main study, the Revised Learning and Development Survey (R-LDS) was administered to another group of 137 employees from the local government organisation, as well as 110 employees from a private healthcare organisation. The purpose of the main study was to validate the R-LDS on two different groups to provide evidence of stability, and compare survey scores according to age and occupational status to determine construct validity. Findings from the main study indicated that only four constructs of the R-LDS were stable, which were organisational opportunities – selection, individual goal engagement, organisational constraints – disengagement and organisational opportunities – engagement. In addition, MANOVA studies revealed that the demographic variables affected organisational opportunities and constraints in the workplace, although individual goal engagement was not influenced by age. The findings from the pilot and main study partially supported the model of adaptive development for work related learning. Given that only four factors displayed adequate reliability in terms of internal consistency and stability, the findings suggest that individual goal selection and individual goal disengagement are less relevant to work related learning and development. Some recent research which emerged during the course of the current study has suggested that individual goal selection and individual goal disengagement are more relevant when goal achievement is impeded by biological constraints such as ageing. However, correlations between the retained factors support the model of adaptive development for work related learning, and represent the role of biocultural co-constructivism in development. Individual goal engagement was positively correlated with both opportunity factors (selection and engagement), while organisational constraints – disengagement was negatively correlated with organisational opportunities – selection. Demographic findings indicated that higher occupational status was associated with more opportunities for development. Age was associated with fewer opportunities or greater constraints for development, especially for lower status workers.

Validation of an Australian sign language instrument of outcome measurement for adults in mental health settings

Objective: There are currently no adult mental health outcome measures that have been translated into Australian sign language (Auslan). Without a valid and reliable Auslan outcome measure, empirical research into the efficacy of mental health interventions for sign language users is unattainable. To address this research problem the Outcome Rating Scale (ORS), a measure of general functioning, was translated into Auslan and recorded on to digital video disk for use in clinical settings. The purpose of the present study was therefore to examine the reliability, validity and acceptability of an Auslan version of the ORS (ORS-Auslan). Method: The ORS-Auslan was administered to 44 deaf people who use Auslan as their first language and who identify as members of a deaf community (termed ‘Deaf’ people) on their first presentation to a mental health or counselling facility and to 55 Deaf people in the general community. The community sample also completed an Auslan version of the Depression Anxiety Stress Scale-21 (DASS-21). Results: t-Tests indicated significant differences between the mean scores for the clinical and community sample. Internal consistency was acceptable given the low number of items in the ORS-Auslan. Construct validity was established by significant correlations between total scores on the DASS-21-Auslan and ORS-Auslan. Acceptability of ORS-Auslan was evident in the completion rate of 93% compared with 63% for DASS-21-Auslan. Conclusions: This is the only Auslan outcome measure available that can be used across a wide variety of mental health and clinical settings. The ORS-Auslan provides mental health clinicians with a reliable and valid, brief measure of general functioning that can significantly distinguish between clinical and non-clinical presentations for members of the Deaf community.

Teachers’ attitudes toward reporting child sexual abuse : problems with existing research leading to new scale development

This paper details a systematic literature review identifying problems in extant research relating to teachers’ attitudes towards reporting child sexual abuse, and offers a model for new attitude scale development and testing. Scale development comprised a five-phase process grounded in contemporary attitude theories including: a) developing the initial item pool; b) conducting a panel review; c) refining the scale via an expert focus group; d) building content validity through cognitive interviews; e) assessing internal consistency via field testing. The resulting 21-item scale displayed construct validity in preliminary testing. The scale may prove useful as a research tool, given the theoretical supposition that attitudes may be changed with time, context, experience, and education. Further investigation with a larger sample is warranted.

Validating the IS-Impact model in Australasian universities

This paper presents a novel study that aims to contribute to understanding the phenomenon of Enterprise Systems (ES) evaluation in Australasian universities. The proposed study addresses known limitations of arguably the most significant dependent variable in the Information System (IS) field - IS Success or IS-Impact. This study adopts the IS-Impact measurement model, reported by Gable et al. (2008), as the primary commencing theory-base and applies research extension strategy described by Berthon et al. (2002); extending both theory and the context. This study employs a longitudinal, multi-method research design, with two interrelated phases – exploratory and confirmatory. The exploratory phase aims to investigate the applicability and sufficiency of the IS-Impact dimensions and measures in the new context. The confirmatory phase will gather quantitative data to statistically validate IS-Impact model as a formative index.

Initial psychometric evaluation of the Wayfinding Effectiveness Scale

This study evaluates three versions of the Wayfinding Effectiveness Scale (WES), developed to differentiate problems of wayfinding and wandering behavior of community-residing elders with dementia (EWD), in 266 dyads (EWD and caregiver) recruited from Alzheimer's Association chapters. Factor analyses yield a five-factor solution (explained variance = 62.6%): complex wayfinding goals, analytic strategies, global strategies, simple wayfinding goals, and being stimulus bound. Overall, internal consistencies are high: WES (.94-.95), and subscales are stable across all versions. Testretest reliability is acceptable for the overall WES and two subscales (complex and simple wayfinding goals) for the care recipient current behavior version. Construct validity is supported by the pattern of correlations among subscales and analyses of variance (ANOVAs) showing significant differences among the care recipient (current vs. prior behavior) and caregiver versions overall and for all subscales. Results support the WES as a valid and reliable measure of wayfinding effectiveness in persons with dementia.