Preliminary reliability and validity testing of a self-efficacy questionnaire for Chinese family caregivers

Objectives: To develop and test preliminary reliability and validity of a Self-Efficacy Questionnaire for Chinese Family Caregivers (SEQCFC). Methods: A cross-sectional survey of 196 family caregivers (CGs) of people with dementia (CGs) was conducted to determine the factor structure of a SEQCFC of people with dementia. Following factor analyses, preliminary testing was performed, including internal consistency, 4-week test retest reliability, and construct and convergent validity. Results: Factor analyses with direct oblimin rotation were performed. Eight items were removed and five subscales(selfefficacy for gathering information about treatment, symptoms and health care; obtaining support; responding to behaviour disturbances; managing household, personal and medical care; and managing distress associated with caregiving) were identified. The Cronbach’s alpha coefficients for the whole scale and for each subscale were all over 0.80. The 4-week testretest reliabilities for the whole scale and for each subscale ranged from 0.64 to 0.85. The convergent validity was acceptable. Conclusions: Evidence for the preliminary testing of the SEQCFC was encouraging. A future follow-up study using confirmatory factor analysis with a new sample from different recruitment centres in Shanghai will be conducted. Future psychometric property testings of the questionnaire will be required for CGs from other regions of mainland China.

Testing the psychometric properties of the Brisbane Practice Environment Measure using Exploratory Factor Analysis and Confirmatory Factor Analysis in an Australian registered nurse population

A cross-sectional survey was conducted, and the construct validity and reliability of the Brisbane Practice Environment Measure in an Australian sample of registered nurses were examined. Nurses were randomly selected from the database of an Australian nursing organization. The original 33 items of the Brisbane Practice Environment Measure were utilized to inform the psychometric properties using confirmatory factor analysis. The Cronbach's alpha was 0.938 for the total scale and ranged 0.657–0.887 for the subscales. A five-factor structure of the measure was confirmed, χ2 = 944.622, (P < 0.01), χ2/d.f. ratio = 2.845, Tucker Lewis Index 0.929, Root Mean Square Error = 0.061 and Comparative Fit Index = 0.906. The selected 28 items of the measure proved reliable and valid in measuring effects of the practice environment upon Australian nurses. The implications are that regular measurement of the practice environment using these 28 items might assist in the development of strategies which might improve job satisfaction and retention of registered nurses in Australia.

Extending the validity of the Feeding Practices and Structure Questionnaire

Background Feeding practices are commonly examined as potentially modifiable determinants of children’s eating behaviours and weight status. Although a variety of questionnaires exist to assess different feeding aspects, many lack thorough reliability and validity testing. The Feeding Practices and Structure Questionnaire (FPSQ) is a tool designed to measure early feeding practices related to non-responsive feeding and structure of the meal environment. Face validity, factorial validity, internal reliability and cross-sectional correlations with children’s eating behaviours have been established in mothers with 2-year-old children. The aim of the present study was to further extend the validity of the FPSQ by examining factorial, construct and predictive validity, and stability. Methods Participants were from the NOURISH randomised controlled trial which evaluated an intervention with first-time mothers designed to promote protective feeding practices. Maternal feeding practices (FP) and child eating behaviours were assessed when children were aged 2 years and 3.7 years (n=388). Confirmatory Factor analysis, group differences, predictive relationships, and stability were tested. Results The original 9-factor structure was confirmed when children were aged 3.7±0.3 years. Cronbach’s alpha was above the recommended 0.70 cut-off for all factors except Structured Meal Timing, Over Restriction and Distrust in Appetite which were 0.58, 0.67 and 0.66 respectively. Allocated group differences reflected behaviour consistent with intervention content and all feeding practices were stable across both time points (range of r= 0.45-0.70). There was some evidence for the predictive validity of factors with 2 FP showing expected relationships, 2 FP showing expected and unexpected relationships and 5 FP showing no relationship. Conclusions Reliability and validity was demonstrated for most subscales of the FPSQ. Future validation is warranted with culturally diverse samples and with fathers and other caregivers. The use of additional outcomes to further explore predictive validity is recommended as well as testing construct validity and test-retest reliability of the questionnaire.

Neonatal palliative care attitude scale : development of an instrument to measure the barriers to and facilitators of palliative care in neonatal nursing

OBJECTIVE The aim of this research project was to obtain an understanding of the barriers to and facilitators of providing palliative care in neonatal nursing. This article reports the first phase of this research: to develop and administer an instrument to measure the attitudes of neonatal nurses to palliative care. METHODS The instrument developed for this research (the Neonatal Palliative Care Attitude Scale) underwent face and content validity testing with an expert panel and was pilot tested to establish temporal stability. It was then administered to a population sample of 1285 neonatal nurses in Australian NICUs, with a response rate of 50% (N 645). Exploratory factor-analysis techniques were conducted to identify scales and subscales of the instrument. RESULTS Data-reduction techniques using principal components analysis were used. Using the criteria of eigenvalues being 1, the items in the Neonatal Palliative Care Attitude Scale extracted 6 factors, which accounted for 48.1% of the variance among the items. By further examining the questions within each factor and the Cronbach’s of items loading on each factor, factors were accepted or rejected. This resulted in acceptance of 3 factors indicating the barriers to and facilitators of palliative care practice. The constructs represented by these factors indicated barriers to and facilitators of palliative care practice relating to (1) the organization in which the nurse practices, (2) the available resources to support a palliative model of care, and (3) the technological imperatives and parental demands. CONCLUSIONS The subscales identified by this analysis identified items that measured both barriers to and facilitators of palliative care practice in neonatal nursing. While establishing preliminary reliability of the instrument by using exploratory factor-analysis techniques, further testing of this instrument with different samples of neonatal nurses is necessary using a confirmatory factor-analysis approach.

Review of refugee mental health assessment: Best practices and recommendations

This article focuses on mental health assessment of refugees in clinical, educational and administrative-legal settings in order to synthesise research and practice designed to enhance and promote further development of culturally appropriate clinical assessment services during the refugee resettlement process. It specifically surveys research published over the last 25 years into the development, reliability measurement and validity testing of assessment instruments, which have been used with children, adolescents and adults from refugee backgrounds, prior to or following their arrival in a resettlement country, to determine whether the instruments meet established crosscultural standards of conceptual, functional, linguistic, technical and normative equivalence. The findings suggest that, although attempts have been made to develop internally reliable, appropriately normed tests for use with refugees from diverse cultural and linguistic backgrounds, matters of conceptual and linguistic equivalence and test–retest reliability are often overlooked. Implications of these oversights for underreporting refugees' mental health needs are considered. Efforts should also be directed towards development of culturally comparable, valid and reliable measures of refugee children's mental health and of refugee children's and adults' psychoeducational, neuropsychological and applied memory capabilities.

Educational stress among Chinese adolescents : measurement, risk factors and associations with mental health

Academic pressure among adolescents is a major risk factor for poor mental health and suicide and other harmful behaviours. While this is a worldwide phenomenon, it appears to be especially pronounced in China and other East Asian countries. Despite a growing body of research into adolescent mental health in recent years, the multiple constructs within the ‘educational stress’ phenomenon have not been clearly articulated in Chinese contexts. Further, the individual, family, school and peer influencing factors for educational stress and its associations with adolescent mental health are not well understood. An in-depth investigation may provide important information for the ongoing educational reform in Mainland China with a special focus on students’ mental health and wellbeing. The primary goal of this study was to examine the relative contribution of educational stress to poor mental health, in comparison to other well-known individual, family, school and peer factors. Another important task was to identify significant risk factors for educational stress. In addition, due to the lack of a culturally suitable instrument for educational stress in this population, a new tool – the Educational Stress Scale for Adolescents (ESSA) was initially developed in this study and tested for reliability and validity. A self-administered questionnaire was used to collect information from convenient samples of secondary school students in Shandong, China. The pilot survey was conducted with 347 students (grades 8 and 11) to test the psychometric properties of the ESSA and other scales or questions in the questionnaire. Based on factor analysis and reliability and validity testing, the 16-item scale (the ESSA) with five factors showed adequate to good internal consistency, 2-week test-retest reliability, and satisfactory concurrent and predictive validity. Its factor structure was further demonstrated in the main survey with a confirmatory factor analysis illustrating a good fit of the proposed model based on a confirmatory factor analysis. The reliabilities of other scales and questions were also adequate to be used in this study. The main survey was subsequently conducted with a sample of 1627 secondary school (grades 7-12) students to examine the influencing factors of educational stress and its associations with mental health outcomes, including depression, happiness and suicidal behaviours. A wide range of individual, family, school and peer factors were found to have a significant association with the total ESSA and subscale scores. Most of the strong factors for academic stress were school or study-related, including rural school location, low school connectedness, perceived poor academic grades and frequent emotional conflicts with teachers and peers. Unexpectedly, family and parental factors, such as parental bonding, family connectedness and conflicts with parents were found to have little or no association with educational stress. Educational stress was the most predictive variable for depression, but was not strongly associated with happiness. It had a strong association with suicide ideation but not with suicide attempts. Among five subscales of the ESSA, ‘Study despondency’ score had the strongest associations with these mental health measures. Surprising, two subscales, ‘Self-expectation’ and ‘Worry about grades’ showed a protective effect on suicidal behaviours. An additional analysis revealed that although academic pressure was the most commonly reported reason for suicidal thinking, the occurrence of problems in peer relationships such as peer teasing and bullying, and romantic problems had a much stronger relationship with actual attempts. This study provides some insights into the nature and health implications of educational stress among Chinese adolescents. Findings in this study suggest that interventions on educational stress should focus on school environment and academic factors. Intervention programs focused on educational stress may have a high impact on the prevalence of common mental disorders such as depression. Efforts to increase perceived happiness however should cover a wider range of individual, family and school factors. The importance of healthy peer relationships should be adequately emphasised in suicide prevention. In addition, the newly developed scale (the ESSA) demonstrates sound psychometric properties and is expected to be used in future research into academic-related stress among secondary school adolescents.

Consumer perceptions of trade show effectiveness : scale development and validation within a B2C context

Purpose This paper develops and estimates a model to measure consumer perceptions of trade show effectiveness. Design/methodology/approach Data were collected at three separate B2C trade shows. Study 1 (n=47) involved field interviews with data subjected to qualitative item generation and content analysis. Study 2 data (n=147) were subjected to exploratory factor analysis and item-total correlation to identify a preliminary factor structure for the effectiveness construct and to test for reliability. In Study 3 (n=592), confirmatory factor analysis was undertaken to more rigorously test the factor structure and generalise across industries. Validity testing was also performed. Findings A three-dimensional factor structure for assessing consumer visitors’ perceptions of trade show effectiveness was produced incorporating research, operational, and entertainment components. Research limitations/implications Data were collected in Australia and results may not generalise across cultural boundaries. Practical implications The resulting measurement model may be used as a reliable post-hoc diagnostic tool to identify areas of trade show effectiveness where specific performance improvements are needed. Results indicate that exhibitors and organisers of B2C trade shows should consider effectiveness as a multidimensional phenomenon with entertainment, product / industry research, and the facilitation of purchase decision-making processes and problem resolution being key objectives for consumer attendees. These elements of effectiveness should each be addressed by exhibitors and organisers in planning their displays and events. Originality/value This is the first study to provide an empirically valid model for assessing trade show effectiveness from the consumer visitor’s perspective.

Using textual analysis with Concept Inventories to identify root causes of misconceptions

Engineers must have deep and accurate conceptual understanding of their field and Concept inventories (CIs) are one method of assessing conceptual understanding and providing formative feedback. Current CI tests use Multiple Choice Questions (MCQ) to identify misconceptions and have undergone reliability and validity testing to assess conceptual understanding. However, they do not readily provide the diagnostic information about students’ reasoning and therefore do not effectively point to specific actions that can be taken to improve student learning. We piloted the textual component of our diagnostic CI on electrical engineering students using items from the signals and systems CI. We then analysed the textual responses using automated lexical analysis software to test the effectiveness of these types of software and interviewed the students regarding their experience using the textual component. Results from the automated text analysis revealed that students held both incorrect and correct ideas for certain conceptual areas and provided indications of student misconceptions. User feedback also revealed that the inclusion of the textual component is helpful to students in assessing and reflecting on their own understanding.

Arabic translation, adaptation and modification of the dialysis symptom index for chronic kidney disease stages four and five

Background Symptom burden in chronic kidney disease (CKD) is poorly understood. To date, the majority of research focuses on single symptoms and there is a lack of suitable multidimensional symptom measures. The purpose of this study was to modify, translate, cross-culturally adapt and psychometrically analyse the Dialysis Symptom Index (DSI). Methods The study methods involved four phases: modification, translation, pilot-testing with a bilingual non-CKD sample and then psychometric testing with the target population. Content validity was assessed using an expert panel. Inter-rater agreement, test-retest reliability and Cronbach’s alpha coefficient were calculated to demonstrate reliability of the modified DSI. Discriminative and convergent validity were assessed to demonstrate construct validity. Results Content validity index during translation was 0.98. In the pilot study with 25 bilingual students a moderate to perfect agreement (Kappa statistic = 0.60-1.00) was found between English and Arabic versions of the modified DSI. The main study recruited 433 patients CKD with stages 4 and 5. The modified DSI was able to discriminate between non-dialysis and dialysis groups (p < 0.001) and demonstrated convergent validity with domains of the Kidney Disease Quality of Life short form. Excellent test-retest and internal consistency (Cronbach’s α = 0.91) reliability were also demonstrated. Conclusion The Arabic version of the modified DSI demonstrated good psychometric properties, measures the multidimensional nature of symptoms and can be used to assess symptom burden at different stages of CKD. The modified instrument, renamed the CKD Symptom Burden Index (CKD-SBI), should encourage greater clinical and research attention to symptom burden in CKD.

Discount rates in disarray : evidence on flawed goodwill impairment testing

Carlin and Finch, this issue, compare goodwill impairment discount rates used by a sample of large Australian firms with ‘independently’ generated discount rates. Their objective is to empirically determine whether managers opportunistically select goodwill discount rates subsequent to the 2005 introduction of International Financial Reporting Standards (IFRS) in Australia. This is a worthwhile objective given that IFRS introduced an impairment regime, and within this regime, discount rate selection plays a key role in goodwill valuation decisions. It is also timely to consider the goodwill valuation issue. Following the recent downturn in the economy, there is a high probability that many firms will be forced to write down impaired goodwill arising from boom period acquisitions. Hence, evidence of bias in rate selection is likely to be of major concern to investors, policymakers and corporate regulators. Carlin and Finch claim their findings provide evidence of such bias. In this commentary I review the validity of their claims.

A validated self-administered female pelvic floor questionnaire

Introduction and hypothesis: The aim of this study was to validate a self-administered version of the already validated interviewer-administered Australian pelvic floor questionnaire. Methods: The questionnaire was completed by 163 women attending an urogynecological clinic. Face and convergent validity was assessed. Reliability testing and comparison with the interviewer-administered version was performed in a subset of 105 patients. Responsiveness was evaluated in a subset of 73 women. Results: Missing data did not exceed 4% for any question. Cronbach’s alpha coefficients were acceptable in all domains. Kappa coefficients for the test–retest analyses varied from 0.64–1.0. Prolapse symptoms correlated significantly with the pelvic organ prolapse quantification. Urodynamics confirmed the reported symptom stress incontinence in 70%. The self and interviewer administered questionnaires demonstrated equivalence. Effect sizes ranged from 0.6 to 1.4. Conclusions: This self-administered pelvic floor questionnaire assessed pelvic floor function in a reproducible and valid fashion and due to its responsiveness, can be used for routine clinical assessment and outcome research.

Part-time job design : symptom and solution for a changing work environment

Part-time work presents a conundrum. Across industrialised countries, there has been significant growth in part-time work as a solution to resolving the diverse interests of employers, workers and families in managing time and resources. However, there are intrinsic disadvantages associated with part-time work; notably with pay and career prospects, which impact the same stakeholders it is intended to benefit. These disadvantages are particularly evident in professional services organisations, due to strong cultural norms of long work hours, single-focused commitment to work and 24x7 availability. There are indications, both in research and practice, that the design of part-time work arrangements could be improved to address some of the disadvantages associated with part-time work, and to challenge norms and dated assumptions that influence the structure of professional work. This study explored the changes made when professional service workers move from a full-time to part-time arrangement. The study drew on a recently proposed framework for work design, which extended previous models to reflect substantial changes in the contemporary work environment. The framework proved to be a useful perspective from which to explore the design of part-time work, principally because it integrated previously disconnected areas of literature and practice through a broader focus on the context of work. Exploration of the differences between part-time and full-time roles, and comparisons between part-time roles in similar types of work, provided insights into the design of professional part-time work. Analysis revealed that having a better understanding of design characteristics may help explain disadvantages associated with professional part-time work, and that some full-time roles can be more easily adapted to part-time arrangements than others. Importantly, comparisons revealed that even roles that are considered difficult to undertake on a part-time basis can potentially be re-designed to be more effective. Through empirical testing of the framework, a contextualised work design model is presented that may guide further research and the practice of crafting part-time arrangements. The findings also suggest that poor work design may lead to the symptoms associated with professional part-time work, and that improved work design may be a potential solution to these structural constraints.

Validity and use of the UV index : Report from the UVI working group, Schloss Hohenkammer, Germany, 5-7 December 2011

The adequacy of the UV Index (UVI), a simple measure of ambient solar ultraviolet (UV) radiation, has been questioned on the basis of recent scientific data on the importance of vitamin D for human health, the mutagenic capacity of radiation in the UVA wavelength, and limitations in the behavioral impact of the UVI as a public awareness tool. A working group convened by ICNIRP and WHO met to assess whether modifications of the UVI were warranted and to discuss ways of improving its effectiveness as a guide to healthy sun-protective behavior. A UV Index greater than 3 was confirmed as indicating ambient UV levels at which harmful sun exposure and sunburns could occur and hence as the threshold for promoting preventive messages. There is currently insufficient evidence about the quantitative relationship of sun exposure, vitamin D, and human health to include vitamin D considerations in sun protection recommendations. The role of UVA in sunlight-induced dermal immunosuppression and DNA damage was acknowledged, but the contribution of UVA to skin carcinogenesis could not be quantified precisely. As ambient UVA and UVB levels mostly vary in parallel in real life situations, any minor modification of the UVI weighting function with respect to UVA-induced skin cancer would not be expected to have a significant impact on the UV Index. Though it has been shown that the UV Index can raise awareness of the risk of UV radiation to some extent, the UVI does not appear to change attitudes to sun protection or behavior in the way it is presently used. Changes in the UVI itself were not warranted based on these findings, but rather research testing health behavior models, including the roles of self-efficacy and self-affirmation in relation to intention to use sun protection among different susceptible groups, should be carried out to develop more successful strategies toward improving sun protection behavior. Health Phys. 103(3):301-306; 2012

Current status of pharmacogenomics testing for anti-tumor drug therapies : approaches to non-melanoma skin cancer

Skin cancer is one of the most commonly occurring cancer types, with substantial social, physical, and financial burdens on both individuals and societies. Although the role of UV light in initiating skin cancer development has been well characterized, genetic studies continue to show that predisposing factors can influence an individual's susceptibility to skin cancer and response to treatment. In the future, it is hoped that genetic profiles, comprising a number of genetic markers collectively involved in skin cancer susceptibility and response to treatment or prognosis, will aid in more accurately informing practitioners' choices of treatment. Individualized treatment based on these profiles has the potential to increase the efficacy of treatments, saving both time and money for the patient by avoiding the need for extensive or repeated treatment. Increased treatment responses may in turn prevent recurrence of skin cancers, reducing the burden of this disease on society. Currently existing pharmacogenomic tests, such as those that assess variation in the metabolism of the anticancer drug fluorouracil, have the potential to reduce the toxic effects of anti-tumor drugs used in the treatment of non-melanoma skin cancer (NMSC) by determining individualized appropriate dosage. If the savings generated by reducing adverse events negate the costs of developing these tests, pharmacogenomic testing may increasingly inform personalized NMSC treatment.