A comparison of methods currently used in inclusive design.

Inclusive design has unique challenges because it aims to improve usability for a wide range of users. This typically includes people with lower levels of ability, as well as mainstream users. This paper examines the effectiveness of two methods that are used in inclusive design: user trials and exclusion calculations (an inclusive design inspection method). A study examined three autoinjectors using both methods (n=30 for the user trials). The usability issues identified by each method are compared and the effectiveness of the methods is discussed. The study found that each method identified different kinds of issues, all of which are important for inclusive design. We therefore conclude that a combination of methods should be used in inclusive design rather than relying on a single method. Recommendations are also given for how the individual methods can be used more effectively in this context.

The effectiveness of using patient-reported outcome measures as quality improvement tools

Aim: To investigate the value of using PROMs as quality improvement tools. Methods: Two systematic reviews were undertaken. The first reviewed the quantitative literature on the impact of PROMs feedback and the second reviewed the qualitative literature on the use of PROMs in practice. These reviews informed the focus of the primary research. A cluster randomised controlled trial (PROFILE) examined the impact of providing peer benchmarked PROMs feedback to consultant orthopaedic surgeons on improving outcomes for hip replacement surgery. Qualitative interviews with surgeons in the intervention arm of the trial examined the view of and reactions to the feedback. Results: The quantitative review of 17 studies found weak evidence to suggest that providing PROMs feedback to professionals improves patient outcomes. The qualitative review of 16 studies identified the barriers and facilitators to the use of PROMs based on four themes: practical considerations, attitudes towards the data, methodological concerns and the impact of feedback on care. The PROFILE trial included 11 surgeons and 215 patients in the intervention arm, and 10 surgeons and 217 patients in the control arm. The trial found no significant difference in the Oxford Hip Score between the arms (-0.7, 95% CI -1.9-0.5, p=0.2). Interviews with surgeons revealed mixed opinions about the value of the PROMs feedback and the information did not promote explicit changes to their practice. Conclusion: It is important to use PROMs which have been validated for the specific purpose of performance measurement, consult with professionals when developing a PROMs feedback intervention, communicate with professionals about the objectives of the data collection, educate professionals on the properties and interpretation of the data, and support professionals in using the information to improve care. It is also imperative that the burden of data collection and dissemination of the information is minimised.

A meta-analysis of the effectiveness of intelligent tutoring systems on college students' academic learning

© 2013 American Psychological Association.This meta-analysis synthesizes research on the effectiveness of intelligent tutoring systems (ITS) for college students. Thirty-five reports were found containing 39 studies assessing the effectiveness of 22 types of ITS in higher education settings. Most frequently studied were AutoTutor, Assessment and Learning in Knowledge Spaces, eXtended Tutor-Expert System, and Web Interface for Statistics Education. Major findings include (a) Overall, ITS had a moderate positive effect on college students' academic learning (g = .32 to g = .37); (b) ITS were less effective than human tutoring, but they outperformed all other instruction methods and learning activities, including traditional classroom instruction, reading printed text or computerized materials, computer-assisted instruction, laboratory or homework assignments, and no-treatment control; (c) ITS's effectiveness did not significantly differ by different ITS, subject domain, or the manner or degree of their involvement in instruction and learning; and (d) effectiveness in earlier studies appeared to be significantly greater than that in more recent studies. In addition, there is some evidence suggesting the importance of teachers and pedagogy in ITS-assisted learning.

A comparison of the effectiveness of the team-based learning readiness assessments completed at home to those completed in class.

PURPOSE: The readiness assurance process (RAP) of team-based learning (TBL) is an important element that ensures that students come prepared to learn. However, the RAP can use a significant amount of class time which could otherwise be used for application exercises. The authors administered the TBL-associated RAP in class or individual readiness assurance tests (iRATs) at home to compare medical student performance and learning preference for physiology content. METHODS: Using cross-over study design, the first year medical student TBL teams were divided into two groups. One group was administered iRATs and group readiness assurance tests (gRATs) consisting of physiology questions during scheduled class time. The other group was administered the same iRAT questions at home, and did not complete a gRAT. To compare effectiveness of the two administration methods, both groups completed the same 12-question physiology assessment during dedicated class time. Four weeks later, the entire process was repeated, with each group administered the RAP using the opposite method. RESULTS: The performance on the physiology assessment after at-home administration of the iRAT was equivalent to performance after traditional in-class administration of the RAP. In addition, a majority of students preferred the at-home method of administration and reported that the at-home method was more effective in helping them learn course content. CONCLUSION: The at-home administration of the iRAT proved effective. The at-home administration method is a promising alternative to conventional iRATs and gRATs with the goal of preserving valuable in-class time for TBL application exercises.

Evaluating the effectiveness of Z: The claims made about CICS and where we go from here

There have been few genuine success stories about industrial use of formal methods. Perhaps the best known and most celebrated is the use of Z by IBM (in collaboration with Oxford University's Programming Research Group) during the development of CICS/ESA (version 3.1). This work was rewarded with the prestigious Queen's Award for Technological Achievement in 1992 and is especially notable for two reasons: 1) because it is a commercial, rather than safety- or security-critical, system and 2) because the claims made about the effectiveness of Z are quantitative as well as qualitative. The most widely publicized claims are: less than half the normal number of customer-reported errors and a 9% savings in the total development costs of the release. This paper provides an independent assessment of the effectiveness of using Z on CICS based on the set of public domain documents. Using this evidence, we believe that the case study was important and valuable, but that the quantitative claims have not been substantiated. The intellectual arguments and rationale for formal methods are attractive, but their widespread commercial use is ultimately dependent upon more convincing quantitative demonstrations of effectiveness. Despite the pioneering efforts of IBM and PRG, there is still a need for rigorous, measurement-based case studies to assess when and how the methods are most effective. We describe how future similar case studies could be improved so that the results are more rigorous and conclusive.

A case study of the effectiveness of the electronic survey as a research tool for measuring students' experience of e-learning

This paper uses a case study approach to consider the effectiveness of the electronic survey as a research tool to measure the learner voice about experiences of e-learning in a particular institutional case. Two large scale electronic surveys were carried out for the Student Experience of e-Learning (SEEL) project at the University of Greenwich in 2007 and 2008, funded by the UK Higher Education Academy (HEA). The paper considers this case to argue that, although the electronic web-based survey is a convenient method of quantitative and qualitative data collection, enabling higher education institutions swiftly to capture multiple views of large numbers of students regarding experiences of e-learning, for more robust analysis, electronic survey research is best combined with other methods of in-depth qualitative data collection. The advantages and disadvantages of the electronic survey as a research method to capture student experiences of e-learning are the focus of analysis in this short paper, which reports an overview of large-scale data collection (1,000+ responses) from two electronic surveys administered to students using surveymonkey as a web-based survey tool as part of the SEEL research project. Advantages of web-based electronic survey design include flexibility, ease of design, high degree of designer control, convenience, low costs, data security, ease of access and guarantee of confidentiality combined with researcher ability to identify users through email addresses. Disadvantages of electronic survey design include the self-selecting nature of web-enabled respondent participation, which tends to skew data collection towards students who respond effectively to email invitations. The relative inadequacy of electronic surveys to capture in-depth qualitative views of students is discussed with regard to prior recommendations from the JISC-funded Learners' Experiences of e-Learning (LEX) project, in consideration of the results from SEEL in-depth interviews with students. The paper considers the literature on web-based and email electronic survey design, summing up the relative advantages and disadvantages of electronic surveys as a tool for student experience of e-learning research. The paper concludes with a range of recommendations for designing future electronic surveys to capture the learner voice on e-learning, contributing to evidence-based learning technology research development in higher education.

Correlating Additives to Deterioration and Assessing the Effectiveness of Acrylic Coatings for the Protection of Rubber

Conservators have long been aware of the problems associated with the preservation of rubber objects due to inherent instability that can be attributed, in part, to the presence of additives. Inorganic additives, such as fillers, accelerators, stabilizers, and special ingredients are necessary in manufacturing to alter the properties of natural rubber. These materials all have different interactions with the rubber, and each other, and differing effects on the ageing process. To date, the most effective and accepted methods to preserve rubber are cold, dark storage of objects, or the use of low oxygen environments. While these methods are effective, they greatly limit access. The application of coatings to the surface of rubber objects can slow deterioration and greatly increase the ability of an institution to handle and display rubber objects. While numerous coatings for preventive and interventive treatment have been tested, none have been so successful to warrant routine use. The first section of this research highlighted the relationship between the inclusion of certain additives in natural rubber objects and the accelerated or slowed down overall degradation. In the second part of this research, the acrylic varnishes Golden Polymer Varnish with UVLS, Lascaux Acrylic Transparent Varnish-UV, Sennelier Matte Lacquer with UV Protection, and Liquitex Soluvar Varnish containing ultraviolet light absorbers or stabilizers were tested as a preventative coating for rubber. Through testing the visual and physical properties of the samples, as well as compound analysis the results of this research suggest that acrylic varnishes do provide protection, each to varying degrees. The results also provided insight into the behavior of rubber and these varnishes with continuing light exposure.

Effectiveness of filters in reducing consolidation time in routine laboratory testing

The research reported here is based on the standard laboratory experiments routinely performed in order to measure various geotechnical parameters. These experiments require consolidation of fine-grained samples in triaxial or stress path apparatus. The time required for the consolidation is dependent on the permeability of the soil and the length of the drainage path. The consolidation time is often of the order of several weeks in large clay-dominated samples. Long testing periods can be problematic, as they can delay decisions on design and construction methods. Acceleration of the consolidation process would require a reduction in effective drainage length and this is usually achieved by placing filter drains around the sample. The purpose of the research reported in this paper is to assess if these filter drains work effectively and, if not, to determine what modifications to the filter drains are needed. The findings have shown that use of a double filter reduces the consolidation time several fold.

The cost-effectiveness of the SPHERE intervention for the secondary prevention of coronary heart disease

Objectives: The Secondary Prevention of Heart disEase in geneRal practicE (SPHERE) trial has recently reported. This study examines the cost-effectiveness of the SPHERE intervention in both healthcare systems on the island of Ireland. Methods: Incremental cost-effectiveness analysis. A probabilistic model was developed to combine within-trial and beyond-trial impacts of treatment to estimate the lifetime costs and benefits of two secondary prevention strategies: Intervention - tailored practice and patient care plans; and Control - standardized usual care. Results: The intervention strategy resulted in mean cost savings per patient of 512.77 (95 percent confidence interval [CI], 1086.46-91.98) and an increase in mean quality-adjusted life-years (QALYs) per patient of 0.0051 (95 percent CI, 0.0101-0.0200), when compared with the control strategy. The probability of the intervention being cost-effective was 94 percent if decision makers are willing to pay €45,000 per additional QALY. Conclusions: Decision makers in both settings must determine whether the level of evidence presented is sufficient to justify the adoption of the SPHERE intervention in clinical practice. Copyright © Cambridge University Press 2010.

Contemporary Studies of the Effectiveness of Social Work

This article is based upon an analysis of 95 experimental, quasi-experimental, preexperimental and client-opinion studies of the effectiveness of social work. Three-quarters of these screened studies show positive results within their different methodological conventions. An examination is made of which methods and patterns of helping are correlated with positive outcomes and the implications for practice, training, and management explored.

Testing the effectiveness of commonly-used site curing regimes

A range of seven test methods was used to assess the effectiveness of curing on C30 and C50 Portland cement concretes. Curing was by formwork retention, wrapping in wet hessian or wrapping in polythene for periods of between one and seven days. Specimens from each mix were also subjected to both air and water storage.

The effectiveness of physical activity interventions in socio-economically disadvantaged communities: A systematic review.

OBJECTIVE: Interventions to increase levels of physical activity (PA) in socio-economically disadvantaged communities are needed but little is known about their effectiveness. This review examines the effectiveness of interventions designed to increase PA in these communities and the theoretical frameworks and components used. METHODS: Five databases were searched for papers published in English between January 2000 and December 2010 that reported outcomes of PA interventions in socio-economically disadvantaged communities. Studies targeting individuals with pre-existing disease and not reporting a measure of free-living PA were excluded. Two reviewers independently extracted data and evaluated quality of evidence against pre-defined criteria. RESULTS: Of 478 publications identified, 27 were included. We found that group-based interventions were effective for adults but not for children; evidence for the effectiveness of interventions targeting individuals was insufficient; limited evidence suggested that community-wide interventions produced small changes in PA. Interventions underpinned by any theoretical framework, compared to none, were more likely to be effective. Several effective interventions included education, PA and social support components. CONCLUSION: Compared to other approaches, multi-component adult group-based interventions with theoretical frameworks are most effective in increasing PA in socio-economically disadvantaged communities. More robust evaluations of interventions targeting individuals in these 'hard-to-reach' communities are required. Copyright © 2012. Published by Elsevier Inc.

Effectiveness of using clinical guidelines for conducting palliative care family meetings in Japan

PURPOSE: The purpose of this study is to pilot test the effectiveness of using recently developed clinical guidelines from Australia for conducting palliative care family meetings in Japan. METHODS: Palliative care family meetings were conducted using clinical guidelines with 15 primary family carers of cancer patients who were admitted to an acute care hospital in Japan. Using the pre-family meeting questionnaire, the primary carers were asked to write key concerns to discuss during the family meetings and rate their concerns via a numerical rating scale: how upset/worried they were about the problem, frequency in which problem occurs, life interference with the problem, and the confidence to deal with the problem. Within 3 days after the meeting, the primary carers were asked to complete the post-meeting questionnaire to evaluate the effectiveness of the family meeting. RESULTS: There was a significant improvement in family carers' psychological well-being in the post-meeting questionnaires compared to the pre-meeting questionnaires as follows: how upset/worried they were about the problem, t(14)?=?3.1071, p?

Evaluating the effectiveness of community-based dementia care networks:The Dementia Care Networks' Study

Purpose: The Dementia Care Networks' Study examined the effectiveness of four community-based, not-for-profit dementia networks. The study involved assessing the relationship between the types of administrative and service-delivery exchanges that occurred among the networked agencies and the network members' perception of the effectiveness of these exchanges. Design and Methods: With the use of a case-study method, the evolution, structure, and processes of each network were documented. Social network analysis using a standardized questionnaire completed by member agencies identified patterns of administrative and clinical exchanges among networked agencies. Results: Differences were found between the four networks in terms of their perceptions of service-delivery effectiveness; perceptions of administrative effectiveness did not factor significantly. Exchanges between groups of agencies (cliques) within each of the four networks were found to be more critical than those between individual agencies within each network. Implications: Integration-measured by the types of exchanges within as opposed to across networks-differentiated the four networks studied. This research contributes to our understanding of the use of multiple measures to evaluate the inner workings of service delivery and their impact on elder health and elder health care. Copyright 2005 by The Gerontological Society of America.

Clinical and cost-effectiveness of internal limiting membrane peeling for patients with idiopathic full thickness macular hole. Protocol for a Randomised Controlled Trial:FILMS (Full-thickness macular hole and Internal Limiting Membrane peeling Study)

Background: A full-thickness macular hole (FTMH) is a common retinal condition associated with impaired vision. Randomised controlled trials (RCTs) have demonstrated that surgery, by means of pars plana vitrectomy and post-operative intraocular tamponade with gas, is effective for stage 2, 3 and 4 FTMH. Internal limiting membrane (ILM) peeling has been introduced as an additional surgical manoeuvre to increase the success of the surgery; i.e. increase rates of hole closure and visual improvement. However, little robust evidence exists supporting the superiority of ILM peeling compared with no-peeling techniques. The purpose of FILMS (Full-thickness macular hole and Internal Limiting Membrane peeling Study) is to determine whether ILM peeling improves the visual function, the anatomical closure of FTMH, and the quality of life of patients affected by this disorder, and the cost-effectiveness of the surgery. Methods/Design: Patients with stage 2-3 idiopathic FTMH of less or equal than 18 months duration (based on symptoms reported by the participant) and with a visual acuity = 20/40 in the study eye will be enrolled in this FILMS from eight sites across the UK and Ireland. Participants will be randomised to receive combined cataract surgery (phacoemulsification and intraocular lens implantation) and pars plana vitrectomy with postoperative intraocular tamponade with gas, with or without ILM peeling. The primary outcome is distance visual acuity at 6 months. Secondary outcomes include distance visual acuity at 3 and 24 months, near visual acuity at 3, 6, and 24 months, contrast sensitivity at 6 months, reading speed at 6 months, anatomical closure of the macular hole at each time point (1, 3, 6, and 24 months), health related quality of life (HRQOL) at six months, costs to the health service and the participant, incremental costs per quality adjusted life year (QALY) and adverse events. Discussion: FILMS will provide high quality evidence onthe role of ILM peeling in FTMH surgery. © 2008 Lois et al; licensee BioMed Central Ltd.