A protocol for advanced psychometric assessment of surveys

Background and Purpose. In this paper, we present a protocol for advanced psychometric assessments of surveys based on the Standards for Educational and Psychological Testing. We use the Alberta Context Tool (ACT) as an exemplar survey to which this protocol can be applied.

Methods. Data mapping, acceptability, reliability, and validity are addressed. Acceptability is assessed with missing data frequencies and the time required to complete the survey. Reliability is assessed with internal consistency coefficients and information functions. A unitary approach to validity consisting of accumulating evidence based on instrument content, response processes, internal structure, and relations to other variables is taken. We also address assessing performance of survey data when aggregated to higher levels (e.g., nursing unit).

Discussion. In this paper we present a protocol for advanced psychometric assessment of survey data using the Alberta Context Tool (ACT) as an exemplar survey; application of the protocol to the ACT survey is underway. Psychometric assessment of any survey is essential to obtaining reliable and valid research findings. This protocol can be adapted for use with any nursing survey.

Psychometric validation of the Self-Care Inventory-Revised (SCI-R) in UK adults with type 2 diabetes using data from the AT.LANTUS follow-on study.

Background:
Achieving optimal outcomes in type 2 diabetes (T2DM) involves several demanding self-care behaviours, e.g. managing diet, activity, medications, monitoring glucose levels, footcare. The Self-Care Inventory-Revised (SCI-R) is valid for use in people with T2DM in the US. Our aim was to determine its suitability for use in the UK.

Cross-cultural adaption of the Health Educaiton Impact Questionnaire: experimental study showed expert committee, not back-translation, added value

Objectives
To assess the contribution of back-translation and expert committee to the content and psychometric properties of a translated multidimensional questionnaire.

Study Design and Setting
Recommendations for questionnaire translation include back-translation and expert committee, but their contribution to measurement properties is unknown. Four English to French translations of the Health Education Impact Questionnaire were generated with and without committee or back-translation. Face validity, acceptability, and structural properties were compared after random assignment to people with rheumatoid arthritis (N = 1,168), chronic renal failure (N = 2,368), and diabetes (N = 538). For face validity, 15 bilingual people compared translations quality with the original. Psychometric properties were examined using confirmatory factor analysis (metric and scalar invariance) and item response theory.

Results
Qualitatively, there were five types of translation errors: style, intensity, frequency/time frame, breadth, and meaning. Bilingual assessors ranked best the translations with committee (P = 0.0026). All translations had good structural properties (root mean square error of approximation <0.05; comparative fit index [CFI], ≥0.899; and Tucker–Lewis index, ≥0.889). Full measurement invariance was observed between translations (ΔCFI ≤ 0.01) with metric invariance between translations and original (lowest ΔCFI = 0.022 between fully constrained models and models with free intercepts). Item characteristic curve analyses revealed no significant differences.

Conclusion
This is the first experimental evidence that back-translation has moderate impact, whereas expert committee helps to ensure accurate content.

Researching maternal, neonatal and child health service use in rural and pastoralist Ethiopia: A key informant research approach

Like many nations in sub-Saharan Africa, Ethiopia has both a high neonatal mortality rate and maternal mortality ratio and is unlikely to meet Millennium Development Goals 4 and 5 by 2015. This working paper examines how Key Informant Research (KIR) in rural and pastoralist Ethiopia will identify facilitators and barriers to the use of maternal, neonatal and child health services. The methodology is informed by Participative Ethnographic Evaluation Research (PEER) and Key Informant Monitoring (KIM). Key Informant Research (KIR) training will provide research skills to Health Extension Workers (HEWs) and Non-government organisation (NGO) staff to enable them to develop research questions, collect data and participate in preliminary data analysis. This will enable the identification of strategies that improve the identification of risk, enhance early referral, increase access, affordability and acceptability of skilled birthing services in rural and pastoralist Ethiopia.

Supporting national transition in Myanmar with development assistance

Myanmar is undergoing significant political reforms and socio-political changes, which have been more rapid and broad than anticipated by most commentators. While ongoing reforms face significant obstacles and vested interests, and is far from assured, reform to date has already significantly altered the international relations of the state. From a development perspective, the growing international acceptability of the regime has begun to change donor attitudes, with development assistance rather than merely humanitarian aid now being discussed, and the conditionality attached to international assistance changing. This paper explores these changes in donor policies toward Myanmar, examining the prospects for development partnership with relevant government programs and agencies, and analysing the ways and sectors development assistance may be able to be used to strengthen the ongoing reform and national transition.

Socio-demographic and work setting correlates of poor mental health in a population sample of working Victorians: application in evidence-based intervention priority setting

Interventions to promote mental health in the workplace are rapidly gaining acceptability as a means to prevent, screen, treat and effectively manage the growing disease burden of depression and anxiety among working people. The objective of this study was to identify socio-demographic and work setting correlates of poor mental health to consider alongside other evidence in priority setting for workplace mental health promotion (MHP). Multiple logistic regression was used to model the probability of poor mental health (SF-12) in relation to socio-demographic (gender, age, education, marital status and occupational skill level) and employment factors (workplace size and type, industrial sector, employment arrangement and working hours) in a population-based cross-sectional survey of 1051 working Victorians. As a result, poor mental health was (21% prevalence overall) higher in working females than in males and decreased with increasing age. Only one employment factor was significant in demographically adjusted multivariate analyses, showing an increase in the odds of poor mental health with increasing working hours. It is concluded that based on the prevalence of poor mental health, Victorian work settings with high proportions of younger workers, and younger working women in particular, should be prioritized for workplace MHP. Thus, together with other research demonstrating particularly poor psychosocial working conditions for young working women, sectors with an over-representation of this group (e.g. service sector) could be prioritized for workplace MHP alongside young and blue-collar males (also a priority due to low mental healthcare service use).

Duration of unemployment and suicide in Australia over the period 1985–2006: an ecological investigation by sex and age during rising versus declining national unemployment rates

Background The relationship between unemployment and suicide may be sensitive to demographic factors, national unemployment rates, and length of time without employment. This study investigated these factors in relation to suicide in Australia for the period 1985–2006, in an ecological study. Methods The outcome variable was annual suicide rate by age group, sex and the eight states and territories over 22 years of observation (total observations=1760). The main predictor variable was the average duration of unemployment in the population, categorised into three time periods (<2 weeks, 2–4 weeks, >4 weeks). Poisson regression models were used to investigate the relationship between duration of unemployment and suicide over the years 1985–2006 in a series of cross-sectional analyses. Interaction analyses indicated significant differences during periods of declining or increasing labour market opportunity and by age group. Results During periods of declining unemployment rates in the country, longer durations of unemployment were associated with higher male suicide rates. During periods of increasing unemployment in the country, longer unemployment duration was associated with lower male suicide rates. Effect modification was also apparent by age-group, with stronger associations between unemployment duration and male suicide evident in those aged 25–34 and 55–64, and weaker associations in those aged 15–24 and 44–54 years. Longer length of unemployment was not associated with an increase in female suicide rates. Conclusions The labour market opportunities in Australia modified the effect of duration of unemployment on suicide, and the effect was more prominent in men and older age groups. This may reflect social norms and acceptability about unemployment, as well as life-stage influences associated with transitions into and out of the labour market.

Cardiovascular disease self-management: pilot testing of an mHealth healthy eating program

Cardiac rehabilitation (CR) is crucial in the management of cardiovascular disease (CVD), yet attendance is poor. Mobile technology (mHealth) offers a potential solution to increase reach of CR. This paper presents two development studies to determine mobile phone usage in adults with CVD and to evaluate the acceptability of an mHealth healthy eating CR program. Methods: CR attendees were surveyed to determine mobile phone usage rates. A second single-subject pilot study investigated perceptions of a 4-week theory-based healthy eating mHealth program and explored pre-post changes in self-efficacy. Results: 74 adults with CVD completed the survey (50/74 male; mean age 63 ± 10). Nearly all had mobile phones (70/74; 95%) and used the Internet (69/74; 93%), and most were interested in receiving CR by text message (57/74; 77%). 20 participants took part in the healthy eating pilot study. Participants read all/most of the text messages, and most (19/20) thought using mobile technology was a good way to deliver the program. The website was not widely used as visiting the website was reported to be time consuming. Exploratory t-tests revealed an increase in heart healthy eating self-efficacy post program, in particular the environmental self-efficacy subset (Mean = 0.62, SD = 0.74, p = 0.001). Conclusions: Text messaging was seen as a simple and acceptable way to deliver nutrition information and behavior change strategies; however, future research is needed to determine the effectiveness of such programs.

A high performance position sensorless surface permanent magnet synchronous motor drive based on flux angle

A position sensorless Surface Permanent Magnet Synchronous Motor (SPMSM) drive based on flux angle is presented in this paper. The motor equations are written in rotor fixed d-q reference frame. A PID controller is used to process the speed error to generate the reference torque current keeping the magnetizing current fixed. The estimated stator flux using Recurrent Neural Network (RNN) is used to find out the rotor position. The flux angle and the reference current phasor angle are used in vector rotator to generate the reference phase currents. Hysteresis current controller block controls the switching of the 3-phase inverter to apply voltage to the motor stator. Simulation studies on different operating conditions indicate the acceptability of the drive system. The drive system only requires a speed transducer and is free from position sensor requirement. The proposed control scheme is robust under load torque disturbances and motor parameter variations. It is also simple and low cost to implement in a practical environment.

Vector control of a position sensorless SPMSM drive with RNN based stator flux estimator

A position sensorless Surface Permanent Magnet Synchronous Motor (SPMSM) drive based on single layer Recurrent Neural Network (RNN) is presented in this paper. The motor equations are written in rotor fixed d-q reference frame. A PID controller is used to process the speed error to generate the reference torque current keeping the magnetizing current fixed. The RNN estimator is used to estimate flux components along the stator fixed stationary axes. The flux angle and the reference current phasor angle are used in vector rotator to generate the reference phase currents. Hysteresis current controller block controls the switching of the three phase inverter to apply voltage to the motor stator. Simulation studies on different operating conditions indicate the acceptability of the drive system. The proposed estimator can be used to accurately measure the motor fluxes and rotor angle over a wide speed range. The proposed control scheme is robust under load torque disturbances and motor parameter variations. It is also simple and low cost to implememnt in a practical environment

Does screening high school students for psychological distress, deliberate self-harm, or suicidal ideation cause distress--and is it acceptable? An Australian-based study

Programs designed to detect students at risk of depression and suicidality have shown success (Shaffer et al., 2004). The current study sought to examine whether or not such a program was acceptable to participants and whether or not it caused distress. Participants were boys aged 14 to 16. Participants were assessed using an on-line questionnaire; acceptability was measured via postal questionnaire. Of 272 participants, 31 (11.4%) were considered at-risk; 13 required ongoing support, 8 of whom had not previously sought help. Overall screening did not appear to cause significant undue distress, although some differences were evident between at-risk and not at-risk students. All participants found the program acceptable. When conducted carefully, early detection programs can be an effective and acceptable method of identifying at-risk adolescents.

Using internet enabled mobile devices and social networking technologies to promote exercise as an intervention for young first episode psychosis patients

Young people with first episode psychosis are at an increased risk for a range of poor health outcomes. In contrast to the growing body of evidence that suggests that exercise therapy may benefit the physical and mental health of people diagnosed with schizophrenia, there are no studies to date that have sought to extend the use of exercise therapy among patients with first episode psychosis. The aim of the study is to test the feasibility and acceptability of an exercise program that will be delivered via internet enabled mobile devices and social networking technologies among young people with first episode psychosis.

The impact of interventions to prevent obesity or improve obesity related behaviours in children (0-5 years) from socioeconomically disadvantaged and/or indigenous families: a systematic review

Background
Children from disadvantaged families including those from low socioeconomic backgrounds and Indigenous families have higher rates of obesity, making early intervention a priority. The aim of this study was to systematically review the literature to examine the effectiveness of interventions to prevent obesity or improve obesity related behaviours in children 0-5 years from socioeconomically disadvantaged or Indigenous families.

Methods
Searches of major electronic databases identified articles published from 1993–2013 targeting feeding practices, anthropometric, diet, activity or sedentary behaviour outcomes. This was supplemented with snowballing from existing reviews and primary studies. Data extraction was undertaken by one author and cross checked by another. Quality assessments included both internal and external validity.

Results
Thirty-two studies were identified, with only two (both low quality) in Indigenous groups. Fourteen studies had a primary aim to prevent obesity. Mean differences between intervention and control groups ranged from -0.29 kg/m2 to -0.54 kg/m2 for body mass index (BMI) and -2.9 to -25.6% for the prevalence of overweight/obesity. Interventions initiated in infancy (under two years) had a positive impact on obesity related behaviours (e.g. diet quality) but few measured the longer-term impact on healthy weight gain. Findings amongst pre-schoolers (3–5 years) were mixed, with the more successful interventions requiring high levels of parental engagement, use of behaviour change techniques, a focus on skill building and links to community resources. Less than 10% of studies were high quality. Future studies should focus on improving study quality, including follow-up of longer-term anthropometric outcomes, assessments of cost effectiveness, acceptability in target populations and potential for implementation in routine service delivery.

Conclusion
There is an urgent need for further research on effective obesity prevention interventions for Indigenous children. The findings from the growing body of intervention research focusing on obesity prevention amongst young children from socioeconomically disadvantaged families suggest intervention effects are modest but promising. Further high quality studies with longer term follow up are required.

Iterative development of Stand Up Australia : a multi-component intervention to reduce workplace sitting

Sitting, particularly in prolonged, unbroken bouts, is widespread within the office workplace, yet few interventions have addressed this newly-identified health risk behaviour. This paper describes the iterative development process and resulting intervention procedures for the Stand Up Australia research program focusing on a multi-component workplace intervention to reduce sitting time. The development of Stand Up Australia followed three phases. 1) Conceptualisation: Stand Up Australia was based on social cognitive theory and social ecological model components. These were operationalised via a taxonomy of intervention strategies and designed to target multiple levels of influence including: organisational structures (e.g. via management consultation), the physical work environment (via provision of height-adjustable workstations), and individual employees (e.g. via face-to-face coaching). 2) Formative research: Intervention components were separately tested for their feasibility and acceptability. 3) Pilot studies: Stand Up Comcare tested the integrated intervention elements in a controlled pilot study examining efficacy, feasibility and acceptability. Stand Up UQ examined the additional value of the organisational- and individual-level components over height-adjustable workstations only in a three-arm controlled trial. In both pilot studies, office workers’ sitting time was measured objectively using activPAL3 devices and the intervention was refined based on qualitative feedback from managers and employees. Results and feedback from participants and managers involved in the intervention development phases suggest high efficacy, acceptance, and feasibility of all intervention components. The final version of the Stand Up Australia intervention includes strategies at the organisational (senior management consultation, representatives consultation workshop, team champions, staff information and brainstorming session with information booklet, and supportive emails from managers to staff), environmental (height-adjustable workstations), and individual level (face-to-face coaching session and telephone support). Stand Up Australia is currently being evaluated in the context of a cluster-randomised controlled trial at the Department of Human Services (DHS) in Melbourne, Australia. Stand Up Australia is an evidence-guided and systematically developed workplace intervention targeting reductions in office workers’ sitting time.

Study protocol for a randomised controlled trial of internet-based cognitive-behavioural therapy for obsessive-compulsive disorder.

Obsessive-Compulsive Disorder (OCD) is a common chronic psychiatric disorder that constitutes a leading cause of disability. Although Cognitive-Behaviour Therapy (CBT) has been shown to be an effective treatment for OCD, this specialised treatment is unavailable to many due to access issues and the social stigma associated with seeing a mental health specialist. Internet-based psychological treatments have shown to provide effective, accessible and affordable treatment for a range of anxiety disorders, and two Randomised Controlled Trials (RCTs) have demonstrated the efficacy and acceptability of internet-based CBT (iCBT) for OCD, as compared to waitlist or supportive therapy. Although these initial findings are promising, they do not isolate the specific effect of iCBT. This paper details the study protocol for the first randomised control trial evaluating the efficacy of therapist-assisted iCBT for OCD, as compared to a matched control intervention; internet-based therapist-assisted progressive relaxation training (iPRT). It will aim to examine whether therapist-assisted iCBT is an acceptable and efficacious treatment, and to examine how effectiveness is influenced by patient characteristics.