Cross-validation of the factorial structure of the Neighborhood Environment Walkability Scale (NEWS) and its abbreviated form (NEWS-A)

Background : The Neighborhood Environment Walkability Scale (NEWS) and its abbreviated form (NEWS-A) assess perceived environmental attributes believed to influence physical activity. A multilevel confirmatory factor analysis (MCFA) conducted on a sample from Seattle, WA showed that, at the respondent level, the factor-analyzable items of the NEWS and NEWS-A measured 11 and 10 constructs of perceived neighborhood environment, respectively. At the census blockgroup (used by the US Census Bureau as a subunit of census tracts) level, the MCFA yielded five factors for both NEWS and NEWS-A. The aim of this study was to cross-validate the individual- and blockgroup-level measurement models of the NEWS and NEWS-A in a geographical location and population different from those used in the original validation study.

Methods : A sample of 912 adults was recruited from 16 selected neighborhoods (116 census blockgroups) in the Baltimore, MD region. Neighborhoods were stratified according to their socio-economic status and transport-related walkability level measured using Geographic Information Systems. Participants self-completed the NEWS. MCFA was used to cross-validate the individual- and blockgroup-level measurement models of the NEWS and NEWS-A.

Results : The data provided sufficient support for the factorial validity of the original individual-level measurement models, which consisted of 11 (NEWS) and 10 (NEWS-A) correlated factors. The original blockgroup-level measurement model of the NEWS and NEWS-A showed poor fit to the data and required substantial modifications. These included the combining of aspects of building aesthetics with safety from crime into one factor; the separation of natural aesthetics and building aesthetics into two factors; and for the NEWS-A, the separation of presence of sidewalks/walking routes from other infrastructure for walking.

Conclusion : This study provided support for the generalizability of the individual-level measurement models of the NEWS and NEWS-A to different urban geographical locations in the USA. It is recommended that the NEWS and NEWS-A be scored according to their individual-level measurement models, which are relatively stable and correspond to constructs commonly used in the urban planning and transportation fields. However, prior to using these instruments in international and multi-cultural studies, further validation work across diverse non-English speaking countries and populations is needed.

Describing and supporting effective science teaching and learning in Australian schools - validation issues

Constructivism is a wide school of thought and its view on learning has important implications to both teaching and learning. Taking a constructivist view of learning to explain interdisciplinary education may help teachers understand the process of building concepts and learning among students as well as the implementation of assessment tasks. Based on a constructivist view of learning, this paper illustrates the assessment aspect of interdisciplinary learning using concrete examples of students' work collected from the Schools Around the World (SAW) project. SAW is an international project which was established in order to set standards for students' work and to stimulate the sharing of teaching ideas among teachers from nine participating nations or regions, with an aim to promote professional development among teachers. This paper attempts to introduce the background of interdisciplinary learning and its assessment methods and hopes to stimulate professional discussion in this respect among teachers.

Development and validation of the physical disability sexual and body esteem scale

The Physical Disability Sexual and Body Esteem (PDSBE) scale was developed to assess respondents' capacity to feel positive about their sexuality and their body while living with a physical impairment. The current paper presents four studies that were conducted to develop and assess the psychometric properties of the 10 item PDSBE scale. The first study was an exploratory factor analysis involving 348 participants with physical disabilities. The factors were: Sexual Esteem, Attractiveness to Others, and Body Esteem. The second study was a confirmatory factor analysis, with a total of 338 participants. This analysis confirmed the factor structure established in study 1. The third study revealed good test-retest reliability on a total of 47 participants with physical disabilities. The final study was conducted with 748 participants with physical disabilities and showed that the PDSBE had high reliability and good convergent and divergent validity. Mean scores showed that women scored significantly higher than men on the total PDSBE scale and on the Sexual Esteem and Attractiveness to Others subscales. Future applications for the PDSBE scale are discussed.

Do logbooks influence recall of physical activity in validation studies?

Purpose: To examine whether physical activity logbooks influence estimates of validity of 7-d recall physical activity questionnaires. Methods: A  convenience sample of 551 adults aged 18–75 yr wore an MTI  accelerometer for seven consecutive days and were then randomly administered two of four 7-d recall physical activity questionnaires that varied in length and format (Active Australia Survey (AAS), long and short  International Physical Activity Questionnaires (IPAQ-L and IPAQ-S), and Behavioral Risk Factor Surveillance System (BRFSS)). A subsample of 75% concurrently completed a physical activity logbook. Results: Correlations (rho) between self-reported and measured duration of moderate- and vigorous-intensity activity and total activity were similar among participants who received a logbook and those who did not for each of the four instruments. There was also no interaction between assessment method (survey, accelerometer) and the assignment of a logbook. For the IPAQ-L, however, variability in the difference between accelerometer data and responses to the vigorous items was smaller among those assigned a logbook (F = 4.128, df = 260, P = 0.043). Overall, there were no differences in percent agreement or kappa for participation in sufficient levels of physical activity according to receipt of a logbook for any of the surveys. Conclusion: The process of self-monitoring through completion of a logbook does not appear to influence estimates of validity for brief or long questionnaires with global questions. Whereas the magnitude of error in accuracy of recall of particular types of activity may be reduced by completion of a logbook that is similar in structure to the survey being validated, this does not appear to influence overall estimates of validity.

What does it meme? The exegesis as valorisation and validation of creative arts research

This paper will draw on Richard Dawkin's idea of the 'meme' to discuss how the creative arts exegesis can operate as valorisation and validation of creative arts research. According to Dawkins, the rate and fecundity of replication permits an artefact to achieve recognition and stability as a meme within a culture. The value and application of traditional forms of research is underpinned by a secondary order of production, publication, that establishes visibility of the work and articulates its empirical processes and findings as sources of social benefit and cultural enhancement.

In the arts, conventional modes of valorisation such as the gallery system, reviews and criticism focus on the artistic product and hence, lack sustained engagement with the creative processes as models of research. Such engagement is necessary to articulate and validate studio practices as modes of enquiry.

A crucial question to initiate this engagement is: 'What did the studio process reveal that could not have been revealed by any other mode of enquiry?'

Re-versioning of the studio process and its significant moments through the exegesis locates the work within the broader field of practice and theory. It is also part of the replication process that establishes the creative arts as a stable research discipline, able to withstand peer and wider assessment. The exegesis is a primary means of realising creative arts research as 'meme'.

Validation of the use of input-output data for embodied energy analysis of the Australian construction industry

This paper evaluates a recently developed hybrid method for the embodied energy analysis of the Australian construction industry. It was found that the truncation associated with process analysis can be up to 80%, whilst the use of input-output analysis alone does not always provide a perfect model for replacing process data. There is also a considerable lack in the quantity and possibly quality of process data currently available. These findings suggest that current best-practice methods are sufficiently accurate for most typical applications, but this is heavily dependant upon data quality and availability. The hybrid method evaluated can be used for the optimisation of embodied energy and for identifying opportunities for improvements in energy efficiency.

Emotional intelligence and teaching : further validation evidence

Further evidence is presented to demonstrate the validity of a new measure of emotional intelligence: Reactions to Teaching Situations (RTS). Using criterion-related groups of high and low scorers on the RTS, it is shown that high scorers give more responses coded as emotional intelligence in their answers to sentence completion tasks relating to ten situations found in teaching. The questions of convergent and discriminant validity is tackled by examination of correlations of emotional intelligence scores and scores on the Multiple Intelligences Checklist for Adults (MICA) and information processing preferences as measured by the Myers-Briggs Type Indicator (MBTI). The results confirm that emotional intelligence (as assessed by the RTS) bears significant relationships to both intrapersonal and interpersonal intelligences and also to linguistic intelligence, but emotional intelligence shows no significant relationships with the MBTI preferences.

Simulation and experimental validation of a ring spinning process

Ring spinning is the most important system of making high quality yarns in the textile industry. Yarn tension affects yarn breakage, which in turn affects yarn productivity in ring spinning. Accurate information about how various spinning parameters affect yarn tension is essential for the optimisation of the ring spinning process. In this paper, a program to simulate the ring spinning process was developed using MATLAB, which can predict yarn tension under given spinning conditions. The simulation results were verified with experimental results obtained from ring spinning cotton and wool yarns.

The development and validation of the impact of multiple sclerosis scale and the symptoms of multiple sclerosis scale

Objective

To develop and validate the Impact of Multiple Sclerosis Scale (IMSS) and the Symptoms of Multiple Sclerosis Scale (SMSS) using the Extended Disability Status Scale (EDSS) for construct validity.
Design

Panel design involving test-retest over 4 months.
Setting

A mailed survey.
Participants

Volunteers with a diagnosis of multiple sclerosis (MS) recruited from an MS support service in Australia: 193 people (mean age, 39y) and 150 people participated at time 1 and time 2, respectively.
Interventions

Not applicable.
Main Outcome Measures

Principal components analyses, the Cronbach α, and descriptive statistics for the 2 scales; correlations for construct validity with the EDSS and retest; and confirmatory factor analysis to test the stability of IMSS and SMSS components over time.
Results

The IMSS yielded 5 independent and reliable components; the SMSS yielded 3 components; both component structures were stable over time. These scales showed convergent validity with the EDSS.
Conclusions

The IMSS and SMSS are psychometrically sound scales suitable for clinical and research purposes to assess the symptoms and impact of MS.

Validation of a food-frequency questionnaire assessment of carotenoid and vitamin E intake using weighed food records and plasma biomarkers: the method of triads model.

Background: Reliability or validity studies are important for the evaluation of measurement error in dietary assessment methods. An approach to validation known as the method of triads uses triangulation techniques to calculate the validity coefficient of a food-frequency questionnaire (FFQ).

Objective: To assess the validity of an FFQ estimates of carotenoid and vitamin E intake against serum biomarker measurements and weighed food records (WFRs), by applying the method of triads. Design: The study population was a sub-sample of adult participants in a randomised controlled trial of b-carotene and sunscreen in the prevention of skin cancer. Dietary intake was assessed by a self-administered FFQ and a WFR. Nonfasting blood samples were collected and plasma analysed for five carotenoids (a-carotene, b-carotene, b-cryptoxanthin, lutein, lycopene) and vitamin E. Correlation coefficients were calculated between each of the dietary methods and the validity coefficient was calculated using
the method of triads. The 95% confidence intervals for the validity coefficients were estimated using bootstrap sampling.

Results: The validity coefficients of the FFQ were highest for a-carotene (0.85) and lycopene (0.62), followed by b-carotene (0.55) and total carotenoids (0.55), while the lowest validity coefficient was for lutein (0.19). The method of triads could not be used for b-cryptoxanthin and vitamin E, as one of the three underlying correlations was negative.

Conclusions: Results were similar to other studies of validity using biomarkers and the method of triads. For many dietary factors, the upper limit of the validity coefficients was less than 0.5 and therefore only strong relationships between dietary exposure and disease will be detected.

The potentialities of focus groups in e-business research : theory validation

Focus groups enable the rapid and timely collation, integration and assembly of the views of a variety of different types of stakeholders into plausible theory. This paper examines the usefulness of the focus group as an e-business research method, using a case study of focus group deployment for the purpose of theory validation as its illustration. Our results suggest that a focus group can be effective as a strategy in e-business research, while providing the relevance and multidisciplinary approach found lacking in more common empirical methods. We provide a set of guidelines for effective focus groups in e-business research.

Validation of the use of Australian input-output data for building embodied energy simulation

Traditional!y, the simulation of buildings has focused 011 operational energy consumption in an attempt to determine the potential for energy savings. Whilst operational energy of Australian buildings accounts for around 20% of total energy consumption nationally, embodied energy represents 20 to 50 times the annual operational energy of 1110st Australian buildings. Lower values have been shown through a number of studies that have analysed the embodied energy of buildings and their products, however these have now shown to be incomplete in system boundary. Many of these studies have used traditional embodied energy analysis methods, such as process analysis and input-output analysis, Hybrid embodied energy analysis methods have been developed, but these need to be compared and validated. This paper reports on preliminary work on this topic. The findings so far suggest that current best-practice methods are sufficiently accurate for most typical applications, but this is heavily dependant upon data quality and availability.

The effect of attitudes and experience on respondent answers to demographic questions in on-line surveys

Survey response rates and response quality are declining in most markets, threatening the viability of many established research techniques. One attempt to combat this has been to make survey completion more convenient for respondents, with on-line surveys being an example of this. This paper looks at respondent attitudes to demographic questions in on-line surveys – questions that are crucial for many analysis practices and yet often have the highest non-completion rates. The exploratory survey conducted here (n=198) examined attitudes towards surveys and empirically examined the reasons behind non-completion and intentions to give misleading information. The results suggest that general attitudes towards providing demographic data in on-line surveys are related to the likely response behaviour, and the more uncomfortable someone claims to be with providing this data, the more likely they will be to either omit a response or exit the survey altogether. Past experience with on-line surveys increases the chances of respondents answering completely and accurately and in most cases, significantly reduces the likelihood of exiting the survey completely if asked these questions. Finally, there is some evidence that providing broad categorical response options is preferred to more specific categories or open text boxes, and this may represent the best technique for improving response rates and quality.