Abstracting by constructing and revising a ‘partially correct construct’ : a case study

This study draws on data from a broader video-stimulated interview study of the role of optimism in collaborative problem solving. It examines the activity of a Grade 5 student, Tom, whose initial constructing activity resulted in a ‘Partially Correct Construct’. Insistent questioning from another group member pressuring for clarification led to Tom developing a ‘more correct construct’ with further potential for revision. This paper raises questions about influences that can stimulate or inhibit construct refinement.

Reliability and validity of the system for observing children's activity and relationships during play (SOCARP)

Background: Children frequently engage in diverse activities that are broadly defined as play, but little research has documented children’s activity levels during play and how they are influenced by social contexts. Assessing potentially modifiable conditions that influence play behavior is needed to design optimal physical activity interventions.

Methods: System for Observing Children’s Activity and Relationships during Play (SOCARP) was developed to simultaneously assess children’s physical activity, social group sizes, activity type, and social behavior during play. One hundred and fourteen children (48 boys, 66 girls; 42% overweight) from 8 elementary schools were observed during recess over 24 days, with 12 days videotaped for reliability purposes. Ninety-nine children wore a uni-axial accelerometer during their observation period.

Results: Estimated energy expenditure rates from SOCARP observations and mean accelerometer counts were significantly correlated (r = .67; P < .01), and interobserver reliabilities (ie, percentage agreement) for activity level (89%), group size (88%), activity type (90%) and interactions (88%) met acceptable criteria. Both physical activity and social interactions were influenced by group size, activity type, and child gender and body weight status.

Conclusions: SOCARP is a valid and reliable observation system for assessing physical activity and play behavior in a recess context.

The development and validation of Australian indices of child development — part II : validity support

The two outcome indices described in a companion paper (Sanson et al., Child Indicators Research, 2009) were developed using data from the Longitudinal Study of Australian Children (LSAC). These indices, one for infants and the other for 4 year to 5 year old children, were designed to fill the need for parsimonious measures of children’s developmental status to be used in analyses by a broad range of data users and to guide government policy and interventions to support young children’s optimal development. This paper presents evidence from Wave 1data from LSAC to support the validity of these indices and their three domain scores of Physical, Social/Emotional, and Learning. Relationships between the indices and child, maternal, family, and neighborhood factors which are known to relate concurrently to child outcomes were examined. Meaningful associations were found with the selected variables, thereby demonstrating the usefulness of the outcome indices as tools for understanding children’s development in their family and socio-cultural contexts. It is concluded that the outcome indices are valuable tools for increasing understanding of influences on children’s development, and for guiding policy and practice to optimize children’s life chances.

Critical appraisal of health literacy indices revealed variable underlying constructs, narrow content and psychometric weaknesses

Objective
Health literacy refers to an individual's ability to seek, understand, and use health information. A range of indices exist that purport to measure health literacy across individuals and populations. This study aimed to review the development and content of existing indices and to critically appraise their properties.

Study Design and Setting
Using standardized search terms, published generic health literacy indices (1990–2008) were identified. Using a methodological framework, each was evaluated for purpose, validity (face, content, construct), reliability, responsiveness, feasibility, and generalizability.

Results
Nineteen instruments were evaluated. Three measurement approaches were identified: direct testing of individual abilities, self-report of abilities, and population-based proxy measures. Composition of underlying constructs and content varied widely across instruments, and none appeared to fully measure a person's ability to seek, understand, and use health information. The content was focused primarily on reading comprehension and numeracy; scoring categories were poorly defined and may not be mutually exclusive, and few indices had been assessed for reliability.

Conclusion
Health literacy is not consistently measured, making it difficult to interpret and compare health literacy at individual and population levels. Empirical evidence demonstrating validity and reliability of existing indices is required, and more comprehensive health literacy instruments need to be developed.

The convergent validity of two sensory processing scales used with school - age children : comparing the sensory profile and the sensory processing measure

Abstract: Aim: To investigate the convergent validity between the Sensory Profile, the Sensory Profile School Companion, and the Home and Main Classroom Forms of the Sensory Processing Measure.

Method: Thirty mothers completed the Sensory Profile and the Sensory Processing Measure - Home Form on one child each. Nineteen teachers of the same children completed the Sensory Profile School Companion and the Sensory Processing Measure - Main Classroom Form.

Results: The Sensory Profile and the Sensory Processing Measure - Home Form were significantly correlated (rho=0.86, p less-than .01). The Sensory Profile School Companion and Sensory Processing Measure - Main Classroom Form were also significantly correlated (rho=.74, p less-than .01).

Conclusion: The two sets of sensory processing scales had moderate levels of convergent validity.

Validity and relevance of the pack hike wildland firefighter work capacity test: a review

Fighting wildland fire is a physically demanding occupation. Wildland firefighters need to be physically fit to work safely and productively. To determine whether personnel are fit for duty, many firefighting agencies employ physical competency tests, such as the pack hike test (PHT). The PHT involves a 4.83-km hike over level terrain carrying a 20.4-kg pack within a 45-min period. The PHT was devised to test the job readiness of US wildland firefighters but is also currently used by some fire agencies in Australia and Canada. This review discusses the history and development of the PHT with emphasis on the process of test validation. Research-based training advice for the PHT is given, as well as discussion of the risks associated with completing the PHT. Different versions and modifications to the PHT have emerged in recent years and these are discussed with regard to their validity. Finally, this review addresses the relevance and validity of the PHT for Australian and Canadian wildland firefighters.

Investigating directionality for a media consumption construct : establishing the utility of confirmatory vanishing tetrad analysis

Purpose – When assessing the psychometric properties of measures and estimate relations among latent variables, many studies in the social sciences (including management and marketing) often fail to comprehensively appraise the directionality of indicants. Such failures can lead to model misspecification and inaccurate parameter estimates. The purpose of this paper is to apply a post hoc test called confirmatory vanishing tetrad analysis (CTA hereafter) to a single construct called mass media consumption information exposure, which antecedent studies conceptually posited to be a formative (causative) representation.
Design/methodology/approach – This paper analyses a consumer sample of 585 US respondents and applies the CTA test to a single construct by its inclusion in various matrices within a statistical analysis system-macro that takes into account nonnormal data characteristics. The matrices are derived from Mplus 5 through the estimation of a single-factor congeneric model. The CTA test calculates a test statistic similar to an asymptotic x2 distribution with degrees of freedom equal to the number of nonredundant tetrads tested.
Findings – The preliminary data analyses reveal that the data characteristics are nonnormal which is not uncommon in social research. The CTA results reveal that the reflective (emergent) item orientation cannot be fully ruled out as being the correct model representation. This is in contrast to prior theoretical conceptual work which would strongly support this construct being a formative representation.
Originality/value – Insofar as the authors are aware, there is no paper with a particular focus on how the CTA might not provide sound results with a demonstrated example. The paper makes a valuable contribution by discussing modelling philosophy and a procedure for directionality testing. The authors advocate the implementation of pre and post hoc tests as a key component of standard research practice.

Credible commitments in R&D collaborations : a testing exercise with a troublesome construct

The findings reported here are part of a larger study on cross-sector R&D collaborations in the Australian Cooperative Research Centre (CRC) Programme. The study has sought to explain project partners’ collaboration experience using a theoretical model which was empirically tested with a survey of CRC project leaders. A key hypothesis was that the higher the level of relational trust amongst the partners in a collaborative project, the more positive would be the partners’ experience of the project. The construct of “credible commitments”, which is widely used in the inter-organisational literature, was posed in the model as an antecedent of relational trust and positively related to it. No support was found for the hypothesis. The findings are discussed and future areas of research.

Testing a multidimensional theory of person-environment fit

The current study examines the validity of a multidimensional Person-Environment (PE) fit model proposed by Jansen and Kristof-Brown (2006). The overall aim of the paper is to test the model's factor structure and influences upon outcome measures. A panel of organizational employees from a wide range of companies and locations were asked to complete a survey (n = 1,875) measuring five discrete dimensions of perceptual PE fit (Person-Organization, Person-People, Person-Job, Person-Group, and Person-Vocation) and three outcomes (organizational commitment, intention to leave, and job satisfaction). The first sequence of analysis tested the proposed model using Confirmatory Factor Analysis (CFA) statistical approaches. Model comparisons showed that Jansen and Kristof-Brown's (2006) original model in which the five dimensions of fit coalesce into a multidimensional construct was a poor fit with the data, but that a model in which the five dimensions of fit operate independently fit the data well. The second sequence of analysis found that the model without the multidimensional construct strongly predicted the outcomes of commitment, job satisfaction, and intention to leave. This paper discusses the implication of this research in relation to the PE fit literature.

Psychometric properties of a scale to measure investment in the sick role : the Illness Cognitions Scale

Rationale, aims and objectives A person’s beliefs about their illness may contribute to recovery and prognosis. Some degree of acceptance of illness and its impact is necessary to integrate the presence of a chronic disorder into one’s lifestyle and adhere to necessary components of illness management; however, some individuals can become ‘stuck’ and have difficulty adjusting out of the sick role. Inventories exist to measure illness cognitions, attitudes and behaviours as they relate to hypochondria and psychosomatic illness, but there is no extant measure of sick role inertia.We describe the psychometric properties of a new scale, the Illness Cognitions Scale (ICS), a metric of investment in the sick role.

Methods The ICS was administered to 97 individuals with bipolar or schizoaffective disorder, and the psychometric properties of the scale measured. Dimensionality was assessed using Principal Components Analysis with Oblimin rotation.

Results The scale has a strong internal consistency, with a Cronbach’s alpha of 0.858. Results of a factor analysis suggested the presence of one main factor, with three other smaller, related sub-factors, capturing aspects of maladaptive illness beliefs.

Conclusion The ICS is a 17-item, internally validated scale measuring difficulty adjusting out of the sick role. The scale predominantly measures a single construct. Further research on external validity of the ICS is required as well as determination of the clinical significance and patient acceptability of the scale.

The validity and internal structure of the bipolar depression rating scale (BDRS): data from a clinical trial of N-acetylcysteine as adjunctive therapy in bipolar disorder

Background: The phenomenology of unipolar and bipolar disorders differ in a number of ways, such as the presence of mixed states and atypical features. Conventional depression rating instruments are designed to capture the characteristics of unipolar depression and have limitations in capturing the breadth of bipolar disorder.

Method: The Bipolar Depression Rating Scale (BDRS) was administered together with the Montgomery Asberg Rating Scale (MADRS) and Young Mania Rating Scale (YMRS) in a double-blind randomised placebo-controlled clinical trial of N-acetyl cysteine for bipolar disorder (N = 75).

Results: A factor analysis showed a two-factor solution: depression and mixed symptom clusters. The BDRS has strong internal consistency (Cronbach's alpha = 0.917), the depression cluster showed robust correlation with the MADRS (r = 0.865) and the mixed subscale correlated with the YMRS (r = 0.750).

Conclusion: The BDRS has good internal validity and inter-rater reliability and is sensitive to change in the context of a clinical trial.

The validity of the CGI severity and improvement scales as measures of clinical effectiveness suitable for routine clinical use

Objective The Clinical Global Impression Scale (CGI) is established as a core metric in psychiatric research. This study aims to test the validity of CGI as a clinical outcome measure suitable for routine use in a private inpatient setting.

Methods The CGI was added to a standard battery of routine outcome measures in a private psychiatric hospital. Data were collected on consecutive admissions over a period of 24 months, which included clinical diagnosis, demographics, service utilization and four routine measures (CGI, HoNOS, MHQ-14 and DASS-21) at both admission and discharge. Descriptive and comparative data analyses were performed.

Results Of 786 admissions in total, there were 624 and 614 CGI-S ratings completed at the point of admission and discharge, respectively, and 610 completed CGI-I ratings. The admission and discharge CGI-S scores were correlated (r = 0.40), and the indirect improvement measures obtained from their differences were highly correlated with the direct CGI-I scores (r = 0.71). The CGI results reflected similar trends seen in the other three outcome measures.

Conclusions The CGI is a valid clinical outcome measure suitable for routine use in an inpatient setting. It offers a number of advantages, including its established utility in psychiatric research, sensitivity to change, quick and simple administration, utility across diagnostic groupings, and reliability in the hands of skilled clinicians.

The validity of the 21-item version of the depression anxiety stress scales as a routine outcome measure

Objective: This study aimed to test the validity of the 21-item Depression Anxiety Stress Scales (DASS-21) as a routine clinical outcome measure in the private in-patient setting. We hypothesized that it would be a suitable routine outcome instrument in this setting.

Method: All in-patients treated at a private psychiatric hospital over a period of 24 months were included in the study. Data were collected on demographics, service utilization, diagnosis and a set of four routine measures both at admission and discharge. These measures consisted of the Clinical Global Impressions (CGI) scales, Health of the Nation Outcome Scales (HoNOS), the Mental Health Questionnaire (MHQ-14) and DASS-21. The results of these measures were compared.

Results: Of 786 admissions in total, the number of fully completed (ie paired admission and discharge) data sets for the DASS-21 depression, anxiety and stress subscales were 337, 328 and 347, respectively. All subscales showed statistically significant reductions in mean scores from admission to discharge (P < 0.001) and were significantly correlated with all MHQ-14 subscales and significantly related to CGI scale categories. The total DASS-21 and total HoNOS scores were also significantly correlated.

Conclusions: The findings from the present study support the validity of DASS-21 as a routine clinical outcome measure in the private in-patient setting.

Corporate image in the leisure services sector

Purpose – This paper seeks to empirically examine the relationship between corporate image and customer satisfaction in the leisure services sector. It also aims to examine the mediating impact of employees and servicescape on this relationship.
Design/methodology/approach – Data were collected from a sample of 195 individuals who had visited an Australian zoological garden over a specified time period. Confirmatory factor analysis was used to test the validity of the measures, whilst structural equation modelling and multiple regression were used in hypothesis testing.
Findings – Findings reveal that corporate image has a significant positive relationship with customer satisfaction. Although the results indicate that the relationship between corporate image and customer satisfaction is not mediated by either servicescape or employees, they imply that corporate image and employees directly influence customer satisfaction.
Research limitations/implications – A single-case study design was implemented, limiting the generalisability of the findings. This provides an opportunity for replication of the model in other leisure services environments and services contexts outside the leisure services industry.
Practical implications – The findings reinforce the need for leisure services operators to prioritise the development of a strong, clear corporate image. The extended analysis illustrates that the disaggregated dimensions of corporate image are valuable to consider in terms of directing managerial strategy. Employees and servicescape are key aspects of the service offer on which management needs to focus to ensure that their desired corporate image is communicated and reinforced.
Originality/value – This study addresses an identified need to further examine the relationship between corporate image and customer satisfaction. It also contributes to corporate branding research by broadening the conceptualisation of the corporate image construct. Moreover, this study contributes to the corporate image literature by examining the mediating factors of employees and servicescape.