RQF publication quality measures: methodoligical issues

The Research Quality Framework uses Thomson-ISI citation benchmarks as its main set of objective measures of research quality. The Thomson-ISI measures rely on identifying a core set of journals in which the major publications for a discipline are to be found. The core for a discipline is determined by applying a nontransparent process that is partly based on Bradford’s Law (1934). Yet Bradford was not seeking measures about quality of publications or journals. How valid then is it to base measures of publication quality on Bradford’s Law? We explore this by returning to Bradford’s Law and subsequent related research asking ‘what is Bradford’s Law really about?’ We go further, and ask ‘does Bradford’s Law apply in Information Systems?’ We use data from John Lamp’s internationally respected Index of Information Systems Journals to explore the latter question. We have found that Information Systems may have a core of journals only a subset of which is also in the list of Thomson-ISI journals. There remain many unanswered questions about the RQF metrics based on Thomson-ISI and their applicability to information systems.

Parents with psychosis : a pilot study examining self-report measures related to family functioning

The aims of this study were to examine the utility of various self-report instruments related to family functioning in families where a parent has a psychotic disorder, and to explore associations between these instruments and symptoms in the parent. Twenty-one parents with a psychotic disorders participated in the study. All participants were able to complete the questionnaires and the majority of parents reported levels of parental competence in the average range. Most parents (90%) perceived themselves to be effective parents, however 30% reported low levels of satisfaction with the parenting role. There were significant associations between objective measures of negative symptoms and self-report scores related to problems in ways of coping, and problems with parent-child interactions. Many individuals with psychosis were able to report areas of perceived need related to their role as parents and to the functioning of their families, however there are several limitations in the use of these instruments in this setting.

Pregnant women's alcohol consumption : the predictive utility of intention to drink and prepregnancy drinking behaviour

Objective: This study had two aims: (1) to examine pregnant women's alcohol consumption across time from prepregnancy until childbirth and (2) to explore whether prepregnancy drinking and intention to drink predict prenatal alcohol consumption while controlling for relevant demographic variables.

Methods: At 17–21 weeks, 248 pregnant women completed questions about demographics, intention to drink alcohol during the subsequent pregnancy, and retrospective measures of prepregnancy and early pregnancy consumption. After this time, calendars were sent fortnightly assessing daily alcohol consumption until birth.

Results: For women who drank both prepregnancy and postpregnancy confirmation, average fortnight alcohol consumption in the first weeks of pregnancy was lower than during prepregnancy, and consumption continued to decrease between gestational weeks 1 and 8, particularly following pregnancy confirmation, after which it remained relatively stable. When predicting whether women drank in late pregnancy, intention accounted for unique variance after controlling for income and prepregnancy drinking. For women who drank after pregnancy confirmation, prepregnancy drinking quantity significantly predicted intention to drink, which in turn predicted fortnight alcohol consumption in later pregnancy, after controlling for prepregnancy drinking and income.

Conclusions: Findings highlight the need to measure alcohol consumption at multiple time points across pregnancy, the need for educating and supporting women to reduce consumption when planning pregnancies, and the usefulness of intention to drink as a predictor of drinking during pregnancy.

Neighborhood road environments and physical activity among youth : the CLAN Study

We examined associations between objective measures of the local road environment and physical activity (including active transport) among youth. There is little empirical evidence of the impact of the road environment on physical activity among children/adolescents in their neighborhoods. Most recent studies have examined perceptions rather than objective measures of the road environment. This was a cross-sectional study of children aged 8–9 years (n = 188) and adolescents aged 13–15 years (n  = 346) who were participants in the 3-year follow-up of the Children Living in Active Neighborhoods (CLAN) longitudinal study in Melbourne, Australia. At baseline (2001), they were recruited from 19 state primary schools in areas of varying socioeconomic status across Melbourne. Habitual walking/cycling to local destinations was parent-reported for children and self-reported for adolescents, while moderate-to-vigorous physical activity (MVPA) outside school hours was recorded using accelerometers. Road environment features in each participant’s neighborhood (area of radius 800 m around the home) were measured objectively using a geographical information system. Regression analyses found no associations between road environment variables and children’s likelihood of making at least seven walking/cycling trips per week to neighborhood destinations. Adolescent girls residing in neighborhoods with two to three traffic/pedestrian lights were more likely to make seven or more walking/cycling trips per week as those whose neighborhoods had fewer traffic lights (OR: 2.7; 95% CI: 1.2–6.2). For adolescent boys, residing on a cul-de-sac, compared with a through road, was associated with increases in MVPA of 9 min after school, 5 min in the evenings, and 22 min on weekend days. Speed humps were positively associated with adolescent boys’ MVPA during evenings. The road environment influences physical activity among youth in different ways, according to age group, sex and type of physical activity.

The association between physical activity and depressive symptoms in young women : a review

Objective : This review synthesises results of studies examining the association between physical activity (PA) and depressive symptoms and the effects of PA intervention studies on depression among young women.
Methods : A search of electronic databases and bibliographic searches of observational and intervention studies was conducted that included women between the ages of 18 and 35.
Results : A total of eight observational and five intervention studies were identified. Evidence from observational studies indicated that physical activity was inversely associated with depressive symptoms in young women. Even a small amount of physical activity was found to be associated with reduced depressive symptoms. No clear dose–response relationship was shown. Evidence from intervention studies indicated that physical activity reduced depressive symptoms. Direct study comparisons were difficult due to variations in study methods and measures. The studies provided little or no information on understanding dose–response effects or on the mechanisms involved.
Conclusion : The limited number of studies examining physical activity and depressive symptoms in young women and the methodological problems identified in a number of these studies, make it difficult to draw firm conclusions. However, this review suggests that engaging in even low levels of physical activity may be protective against depressive symptoms in young women. There is a need for objective measures of physical activity in future studies, particularly with a focus on those with clinical depression in non-student populations.

Social value measurement and nonprofit organizations: preliminary views of nonprofit and foundation managers

This paper examines how managers of nonprofit organizations and foundations view the measurement of the social value of these organizations. In exploratory interviews, we found that the managers generally agree that objective measures are desired where and when possible, but recognise the difficulties in developing an assessment that enables comparisons across the nonprofit sector. These difficulties, as well as the implications for developing assessments of social value for nonprofit organizations, are discussed

Occupational health and safety management systems : system types and effectiveness

The aim of this thesis is to develop a framework to evaluate the relative performance of different types of health and safety management system. This objective is an analytical one, but it stems from a policy issue of public importance. Over the past decade Australia, like other countries, has seen the emergence and growth of interest in developing health and safety management systems. But are they all the same, and if not, do they differ in their effectiveness? The thesis does not seek to give a definitive answer to these questions. Given the novelty of the phenomenon and the lack of research on this subject, the research is exploratory. An hypothesis about the effectiveness of different health and safety management systems is developed rather than tested. The thesis proceeds by first defining health and safety management systems as a combination of the planning and review, the management arrangements, the consultative arrangements and the specific program elements that work together in an integrated way to improve health and safety performance. A research procedure is described involving twenty exploratory case studies. The thesis then - develops - from the literature and the case study research - an analytical framework to evaluate the performance of different health and safety management systems. That framework has two parts. First is a typology of health and safety management systems. This is constructed from two distinctions - between 'safe place' and 'safe person' approaches to health and safety; and between 'innovative' and traditional' management methods and structures. These distinctions yield four types of system. The typology was applied to the case studies which yielded a reasonable fit in most instances. The second part of the framework is a 'process evaluation' technique akin to Quality standards. Derived from the Victorian SafetyMAP audit criteria, the "e;process evaluation tool "e; is preferred to traditional outcome measures such as incident or claim rates. Using this measure, the twenty case study enterprises were classified as above average, average or below average in performance. These results correlated poorly with traditional incident trend and benchmark measures. The two elements of the framework are then combined to explore the relationship between the different types of system and their performance. Evidence from the twenty case studies showed a tendency for innovative/safe place firms to perform better than traditional/safe person firms. This finding can form the basis for a hypothesis that may be subject to statistical testing on a generalisable sample. In addition five 'best practice' cases were selected and subjected to a cross case analysis to search for common characteristics that might explain their performance. This analysis suggests the importance of a number of factors: senior managers who drive health and safety change and mobilise all possible resources in the pursuit of change; health and safety representatives who work with managers in a 'joint regulatory relationship' across system activities; the involvement of employees more generally, but not as a substitute for action by managers and health and safety representatives; a comprehensive approach to elimination of all hazards; and the introduction of innovative programs to continually improve systems and facilitate employee involvement in health and safety.

Novel strategies to promote children's physical activities and reduce sedentary behavior

Physical activity and sedentary behavior (performed primarily while sitting) play a key role in the current and future health of young people. Most health evidence and intervention strategies targeting reductions in children’s sedentary behavior have focused on television viewing, with mixed evidence as to the effectiveness of these strategies and of the importance of television viewing for children’s health. Evidence from studies with adults using objective measures of sedentary behavior suggests that accumulated sedentary time is independently associated with metabolic health; importantly, emerging evidence suggests that the manner in which the sedentary behavior is accrued (ie, frequency of interruptions to time spent sedentary) may also have independent effects on health. Potential novel intervention approaches to reduce children’s sedentary time include activity breaks during class time at school, delivery of active lessons and homework, and changes to the classroom environment. Further evidence of the importance of sedentary time (both total accumulation and frequency of interruptions) on children’s health is required. Future studies should assess the effectiveness of interventions targeting organizational and pedagogical changes in schools as well as using homework to engage with families in more active ways.

Dog ownership, dog walking and children's and parents' physical activity

This study aimed to determine cross-sectional associations of dog ownership, dog walking, and physical activity (PA) among children and their parents. Objective measures of PA were obtained for children ages 5-6 and 10-12 years from 19 primary schools across Melbourne, Australia. Parents self-reported their PA, dog ownership, and frequency of dog walking: 53% of families owned a dog, 41% of children who owned a dog did not walk their dog at all, and 32% reported never or rarely walking their dog as a family. Dog ownership was associated with an additional 29 min/day in PA among younger girls, and 70 and 59 min/week more in PA among mothers of younger boys and older girls, respectively. Among mothers of older girls, dog owners were 1.6 times as likely to meet PA guidelines. Mothers with older boys and girls, and fathers with younger boys, who reported walking the dog regularly as a family, spent more time in PA (105, 90, and 158 more min/week, respectively). Promoting dog ownership and dog walking among children and as a family are potential strategies for increasing PA participation in some families.

Data obtained from the health in pregnancy and post birth study

Data is being obtained via a randomised controlled trial to measure the efficacy of specialised health coaching intervention designed to prevent excessive gestational weight gain and postpartum weight retention among women.

The study will collect data via a self-report questionnaire (available in hardcopy and online) at 5 time points across pregnancy and post-birth, including Pregnancy (16 -32 weeks gestation) and Postpartum period (6 weeks to 12 months post-birth). Objective measures are obtained by researchers in a consulting room in a clinic room within a hospital antenatal clinic. Hospital records are also accessed via the Bed Optimization System (BOS). Data obtained includes: demographic information (e.g., education, income), objective measures of height, weight and waist circumference, healthcare resource use general distress and psychopathology (stress, anxiety, depression), exercise and dietary habits, motivation/readiness to change, body dissatisfaction, labour experiences and birth outcomes.

Development and validation of the Agents' Socially Desirable Responding (ASDR) scale

While the marketing discipline has advanced knowledge by augmenting objective measures of marketing performance with survey-solicited subjective measures, it has not adequately attended to potential response biases. The authors’ review of the literature highlights the need for a valid measure of socially desirable responding that can be used in detecting social desirability bias in managers’ responses to subjective performance measures. Agents’ Socially Desirable Responding (ASDR) scale development and validation procedures are described. Validation efforts reveal the psychometric properties of the eight-item ASDR scale and provide evidence of its utility.

Recommendations for a trans-European dietary assessment method in children between 4 and 14 years

Background/Objectives: The main objective of European Food Consumption Validation (EFCOVAL)-child Project is to define and evaluate a trans-European methodology for undertaking national representative dietary surveys among children in the age group of 4–14 years. In the process of identifying the best dietary assessment methodologies, experts were brought together at a workshop. The paper presents the discussion of the best available method and the final recommendations for a trans-European dietary assessment method among 4- to 14-year-old children.
Subjects/Methods: The starting point was to investigate whether the method (two non-consecutive 24-h dietary recalls (24-HDRs)) suggested for the adults in European Food Consumption Survey Method (EFCOSUM) would be usable for children in
the age group between 4 and 14 years. However, all available dietary assessment methods were included in the discussion to ensure that the final recommendation would be based on the best evidence. Six criteria were defined and used as additional
guidance in the process.
Results: The literature does not give a clear recommendation on the dietary assessment methods that are most suitable for children in the age group of 4–14 years. Nevertheless, on the basis of the literature, the recommendations were separated for preschoolers (4–6 years) and schoolchildren (7–14 years).
Conclusion: For preschoolers, two non-consecutive days of a structured food record are recommended, using a (for children adapted) picture booklet and household measures for portion-size estimation. For schoolchildren, repeated 24-HDRs are recommended, using a picture booklet and household measures for portion-size estimation. In addition, the child should bring a booklet to register what is eaten out of home. One parent should assist the schoolchild at the 24-HDR interview, and therefore face-to-face interviews are required.

Reliability and validity of psychosocial and environmental correlates measures of physical activity and screen-based behaviors among Chinese children in Hong Kong

Background : Insufficient participation in physical activity and excessive screen time have been observed among Chinese children. The role of social and environmental factors in shaping physical activity and sedentary behaviors among Chinese children is under-investigated. The purpose of the present study was to assess the reliability and validity of a questionnaire to measure child- and parent-reported psychosocial and environmental correlates of physical activity and screen-based behaviors among Chinese children in Hong Kong.

Methods : A total of 303 schoolchildren aged 9-14 years and their parents volunteered to participate in this study and 160 of them completed the questionnaire twice within an interval of 10 days. Intraclass correlation coefficients (ICCs), kappa statistics, and percent agreement were performed to evaluate test-retest reliability of the continuous and categorical variables, respectively. Exploratory factor analyses (EFAs) were conducted to assess convergent validity of the emergent scales. Cronbach's alpha and ICCs were performed to assess internal and test-retest reliability of the emergent scales. Criterion validity was assessed by correlating psychosocial and environmental measures with self-reported physical activity and screen-based behaviors, measured by a validated questionnaire.

Results : Reliability statistics for both child- and parent-reported continuous variables showed acceptable consistency for all of the ICC values greater than 0.70. Kappa statistics showed fair to perfect test-retest reliability for the categorical items. Adequate internal consistency and test-retest reliability were observed in most of the emergent scales. Criterion validity assessed by correlating psychosocial and environmental measures with child-reported physical activity found associations with physical activity in the self-efficacy scale (r = 0.25, P < 0.05), the peer support for physical activity scale (r = 0.25, P < 0.05) and home physical activity environmental (r = 0.14, P < 0.05). Children's screen-based behaviors were associated with the family support for physical activity scale (r = -0.22, P < 0.05) and parental role modeling of TV (r = 0.12, P = 0.053).

Conclusions : The findings provide psychometric support for using this questionnaire for examining psychosocial and environmental correlates of physical activity and screen-based behaviors among Chinese children in Hong Kong. Further research is needed to develop more robust measures based on the current questionnaire, especially for peer influence on physical activity and parental rules on screen-based behaviors.

Is the objective food environment associated with perceptions of the food environment?

Objective The present study examined whether objective measures of the food environment are associated with perceptions of the food environment and whether this relationship varies by socio-economic disadvantage.

Design The study is a cross-sectional analysis of self-report surveys and objective environment data. Women reported their perceptions on the nutrition environment. Participants’ homes and food stores were geocoded to measure the objective community nutrition environment. Data on the average price and variety of fruit and vegetables were used to measure the objective consumer nutrition environment.

Setting The study was conducted in Melbourne, Australia, in 2003–2004.

Subjects Data presented are from a sample of 1393 women aged 18–65 years.

Results Overall the match between the perceived and objective environment was poor, underscoring the limitations in using perceptions of the environment as a proxy for the objective environment. Socio-economic disadvantage had limited impact on the relationship between perceived and objective nutrition environment.

Conclusions Further research is needed to understand the determinants of perceptions of the nutrition environment to enhance our understanding of the role of perceptions in nutrition choices and drivers of socio-economic inequalities in nutrition.

The role of objective and subjective evaluation in the production and marketing of goats for meat

Objective and subjective evaluations of goats for meat production are related to important determinants of production and profitability. The most important attributes in assessment of goats for market are: live weight; body condition score; and the age of goats. As goats grow, their carcass and body organs increase in weight in proportion to the empty body weight. For farmers and field workers the linear regression approach for estimating carcass weight by measuring live weight is the most suitable as it accounts for 88 to 97% of the variation in carcass, offal and boneless meat weight. Live weight scales or heart girth tapes should be used and the risks and errors associated with these methods are summarized. The proportion of a live goat that is the carcass, known as dressing percentage, increases from 35% to about 50% as goats grow. The usefulness and errors associated with dressing percentage in field estimation are discussed. A valuable subjective method for estimating the nutritional status of goats is the use of body condition scoring as it accounts for 60 to 67% of the variation in live weight change, carcass weight and fat reserves of goats. A method for body condition scoring and a similar fat scoring system are explained. Body condition score is also associated with mortality risk and reproductive performance of goats. The number of permanent incisors in the lower jaw of goats is a method of estimating the age of goats but is biased by differences in live weights of goats. The value and role of ultrasound scanning the carcasses of goats is summarized. For the marketing of kid meat no permanent incisors should have erupted. Other useful practices for the successful marketing of goat meat are discussed including: knowing market specifications and chemical withholding periods; animal health; prevention of bruising; identification of goats; size of consignments; timeliness; provision of paperwork. A checklist is provided. The use of subjective and objective assessment techniques in evaluating goats for meat production will provide the best results. Where only subjective assessment techniques are available they will provide satisfactory performance provided the skills have been learnt and are applied.