Appraising the quality of randomized controlled trials: inter-rater reliability for the OTseeker evidence database

Rationale and aims 'OTseeker' is an online database of randomized controlled trials (RCTs) and systematic reviews relevant to occupational therapy. RCTs are critically appraised and rated for quality using the 'PEDro' scale. We aimed to investigate the inter-rater reliability of the PEDro scale before and after revising rating guidelines. Methods In study 1, five raters scored 100 RCTs using the original PEDro scale guidelines. In study 2, two raters scored 40 different RCTs using revised guidelines. All RCTs were randomly selected from the OTseeker database. Reliability was calculated using Kappa and intraclass correlation coefficients [ICC (model 2,1)]. Results Inter-rater reliability was 'good to excellent' in the first study (Kappas >= 0.53; ICCs >= 0.71). After revising the rating guidelines, the reliability levels were equivalent or higher to those previously obtained (Kappas >= 0.53; ICCs >= 0.89), except for the item, 'groups similar at baseline', which still had moderate reliability (Kappa = 0.53). In study 2, two PEDro scale items, which had their definitions revised, 'less than 15% dropout' and 'point measures and variability', showed higher reliability. In both studies, the PEDro items with the lowest reliability were 'groups similar at baseline' (Kappas = 0.53), 'less than 15% dropout' (Kappas

Cognitive deficits associated with cancer: A model of subjective and objective outcomes

Cancer and its treatment can affect many different aspects of quality of life. As a construct measured subjectively, quality of life shows an inconsistent relationship with objective outcome measures. That is, sometimes subjective and objective outcomes correspond with each other and sometimes they show little or no relationship. In this article, we propose a model for the relationship between subjective and objective outcomes using the example of cognitive function in people with cancer. The model and the research findings on which it is based help demonstrate that, in some circumstances, subjective measures of cognitive function correlate more strongly with psychosocial variables such as appraisal, coping, and emotions than with objective cognitive function. The model may provide a useful framework for research and clinical practice in quality of life for people with cancer.

Optimization of a transplant model to assess skin reconstitution from stem cell-enriched primary human keratinocyte populations

Given that an important functional attribute of stem cells in vivo is their ability to sustain tissue regeneration, we set out to establish a simple and easy technique to assess this property from candidate populations of human keratinocyte stem cells in an in vivo setting. Keratinocytes were inoculated into devitalized rat tracheas and transplanted subcutaneously into SCID mice, and the epithelial lining regenerated characterized to establish the validity of this heterotypic model. Furthermore, the rate and quality of epidermal tissue reconstitution obtained from freshly isolated unfractionated vs. keratinocyte stem cell-enriched populations was tested as a function of (a) cell numbers inoculated; and (b) the inclusion of irradiated support keratinocytes and dermal cells. Rapid and sustained epidermal tissue regeneration from small numbers of freshly isolated human keratinocyte stem cells validates the utilization of this simple and reliable model system to assay for enrichment of epidermal tissue-reconstituting cells.

Fitness assessment of document model

Document classification is a supervised machine learning process, where predefined category labels are assigned to documents based on the hypothesis derived from training set of labelled documents. Documents cannot be directly interpreted by a computer system unless they have been modelled as a collection of computable features. Rogati and Yang [M. Rogati and Y. Yang, Resource selection for domain-specific cross-lingual IR, in SIGIR 2004: Proceedings of the 27th annual international conference on Research and Development in Information Retrieval, ACM Press, Sheffied: United Kingdom, pp. 154-161.] pointed out that the effectiveness of document classification system may vary in different domains. This implies that the quality of document model contributes to the effectiveness of document classification. Conventionally, model evaluation is accomplished by comparing the effectiveness scores of classifiers on model candidates. However, this kind of evaluation methods may encounter either under-fitting or over-fitting problems, because the effectiveness scores are restricted by the learning capacities of classifiers. We propose a model fitness evaluation method to determine whether a model is sufficient to distinguish positive and negative instances while still competent to provide satisfactory effectiveness with a small feature subset. Our experiments demonstrated how the fitness of models are assessed. The results of our work contribute to the researches of feature selection, dimensionality reduction and document classification.

Validation of the Quality of Life Inventory for patients with anxiety and depression

Background: In 1992, Frisch et al (Psychol Assess. 1992;4:92- 10 1) developed the Quality of Life Inventory (QOLI) to measure the concept of quality of life (QOL) because it has long been thought to be related to both physical and emotional well-being. However, the psychometric properties of the QOLI in clinical populations are still in debate. The present study examined the factor structure of QOLI and reported its validity and reliability in a clinical sample. Method: Two hundred seventeen patients with anxiety and depressive disorders completed the QOLI and additional questionnaires measuring symptoms (Zung Self-rating Depression Scale, Beck Anxiety Inventory, Fear Questionnaire, Depression Anxiety Stress Scale-Stress) and subjective well-being (Satisfaction With Life Scale) were also used. Results: Exploratory factor analysis via the principal components method, with oblique rotation, revealed a 2-factor structure that accounted for 42.73% of the total variance, and a subsequent confirmatory factor analysis suggested a moderate fit of the data to this model. The 2 factors appeared to describe self-oriented QOL and externally oriented QOL. The Cronbach alpha coefficients were 0.85 for the overall QOLI score, 0.81 for the first factor, and 0.75 for the second factor. Conclusion: Consistent evidence was also found to support the concurrent, discriminant, predictive, and criterion-related validity of the QOLI. (c) 2006 Elsevier Inc. All rights reserved.

Quality of service in flexible workflows through process constraints

Workflow technology has delivered effectively for a large class of business processes, providing the requisite control and monitoring functions. At the same time, this technology has been the target of much criticism due to its limited ability to cope with dynamically changing business conditions which require business processes to be adapted frequently, and/or its limited ability to model business processes which cannot be entirely predefined. Requirements indicate the need for generic solutions where a balance between process control and flexibility may be achieved. In this paper we present a framework that allows the workflow to execute on the basis of a partially specified model where the full specification of the model is made at runtime, and may be unique to each instance. This framework is based on the notion of process constraints. Where as process constraints may be specified for any aspect of the workflow, such as structural, temporal, etc. our focus in this paper is on a constraint which allows dynamic selection of activities for inclusion in a given instance. We call these cardinality constraints, and this paper will discuss their specification and validation requirements.

Modelling broccoli development, yield and quality

Broccoli is a vegetable crop of increasing importance in Australia, particularly in south-east Queensland and farmers need to maintain a regular supply of good quality broccoli to meet the expanding market. A predictive model of ontogeny, incorporating climatic data including frost risk, would enable farmers to predict harvest maturity date and select appropriate cultivar – sowing date combinations. To develop procedures for predicting ontogeny, yield and quality, field studies using three cultivars, ‘Fiesta’, ‘Greenbelt’ and ‘Marathon’, were sown on eight dates from 11 March to 22 May 1997, and grown under natural and extended (16 h) photoperiods at the University of Queensland, Gatton Campus. Cultivar, rather than the environment, mainly determined head quality attributes of head shape and branching angle. Yield and quality were not influenced by photoperiod. A better understanding of genotype and environmental interactions will help farmers optimise yield and quality, by matching cultivars with time of sowing. The estimated base and optimum temperature for broccoli development were 0°C and 20 °C, respectively, and were consistent across cultivars, but thermal time requirements for phenological intervals were cultivar specific. Differences in thermal time requirement from floral initiation to harvest maturity between cultivars were small and of little importance, but differences in thermal time requirement from emergence to floral initiation were large. Sensitivity to photoperiod and solar radiation was low in the three cultivars used. This research has produced models to assist broccoli farmers in crop scheduling and cultivar selection in south-east Queensland.

Relationships between quality of experience and participation in diverse performance settingshttp://espace.library.uq.edu.au/workflow/edit_metadata.php?id=382160&wfs_id=778

The flow concept describes a model of enjoyment that has relevance for understanding participation and experience across a wide range of activities (Csikszentmihalyi, 1997). The basic premise of the flow concept is that when challenges and skills are simultaneously balanced and extending the individual, a state of total absorption can occur. Research by Jackson and colleagues has examined the utility of the flow concept to understanding participation and performance in sport settings. Recently, Jackson and Eklund have examined flow in a range of performance settings: sport, exercise, dance, creative and performing arts, and music. In this paper, we present descriptive and construct validity data on how participants in these activities experienced flow, as assessed by the recently revised flow scales: The Dispositional Flow Scale-2 (DFS-2) and Flow State Scale-2 (FSS-2) (Jackson & Eklund, 2002). The fmdings will be discussed in relation to the utility of the flow concept to understanding participation across performance settings.

How does your model grow? An empirical investigation of the effects of ontological clarity and application domain size on query performance

Semantic data models provide a map of the components of an information system. The characteristics of these models affect their usefulness for various tasks (e.g., information retrieval). The quality of information retrieval has obvious important consequences, both economic and otherwise. Traditionally, data base designers have produced parsimonious logical data models. In spite of their increased size, ontologically clearer conceptual models have been shown to facilitate better performance for both problem solving and information retrieval tasks in experimental settings. The experiments producing evidence of enhanced performance for ontologically clearer models have, however, used application domains of modest size. Data models in organizational settings are likely to be substantially larger than those used in these experiments. This research used an experiment to investigate whether the benefits of improved information retrieval performance associated with ontologically clearer models are robust as the size of the application domains increase. The experiment used an application domain of approximately twice the size as tested in prior experiments. The results indicate that, relative to the users of the parsimonious implementation, end users of the ontologically clearer implementation made significantly more semantic errors, took significantly more time to compose their queries, and were significantly less confident in the accuracy of their queries.

The relationship between extra-role behaviours and job burnout for primary school teachers: A preliminary model and development of an organisational citizenship behaviour scale

Recent research on teacher stress in primary schools (e.g. Leonard, Bourke & Schofield, 1999) has shown that higher levels of teacher exhaustion are associated with higher levels of student satisfaction. This paper seeks to explain this surprising finding by considering a construct discussed widely in the organisational literature known as extra-role or organisational citizenship behaviour (OCB). Teacher OCB may include extra efforts to make lessons enjoyable and interesting, organising extra-curricular activities and spending personal time talking with students. The proposed model of analysis also draws on literature relating to job burnout (Maslach, 1982), which generally suggests that the three components of chronic occupational stress - exhaustion, depersonalisation and reduced accomplishment - occur together. However, this paper proposes that although teachers who engage in more OCB experience more exhaustion, they may simultaneously increase their feelings of personal accomplishment and work identification, which may in turn help to avert burnout. It is argued that only with this particular set of job attitudes are the effects of exhaustion caused by high levels of OCB sufficiently buffered to avoid job burnout, and thus positively affect students' quality of school life. The development and piloting of an instrument to measure teachers' OCB will be discussed. The preliminary findings reported herein are part of a larger ongoing study investigating the consequences of stress and OCB in primary school teachers.