Methodological convergence of program evaluation designs

Resumen tomado de la publicación

Planning and evaluation

- identify the importance of planning and evaluation in public health practice - recognise the links between planning and evaluation through the presentation of relevant models - identify the core concepts of needs assessment in public health - describe the evaluation cycle and the importance of an evaluation plan - understand evaluation designs and their application in practice.

Navigating theory, negotiating difference and beating the system : a critical how-to of media assistance evaluation

The wave of democratisation across Europe, Africa, Asia and Latin America in the early 1990s triggered an increase in donor funding to media assistance initiatives, primarily within good governance policy frameworks. However, few media assistance projects have managed to effectively evaluate the impacts of their work. This thesis explores how the impacts of Australian media assistance on social change and governance can be most effectively evaluated and understood. The findings of this research suggest the importance of early investment in participatory planning of evaluation designs, which are then periodically revisited. These evaluation designs should be based on a theoretically sound link between models of change, evaluative questions and methods.

The Weekly Adjustment Indicators Checklist: An Application in the Child Welfare Field

Research on the effectiveness of various home-based interventions implemented in the 1980s and 1990s indicates that results have been equivocal. Because of the unique and complex behavioral challenges presented by each family and the need for individualized treatments and long-term interventions for these families, group research and evaluation designs are often insufficient in assessing effectiveness of home-based interventions. Alternative evaluation strategies are needed. The purpose of this exploratory study was two-fold: (a) to investigate the applicability and acceptability of the Weekly Adjustment Indicators Checklist (WAIC) in monitoring adult and child behaviors and (b) to monitor, on an on-going basis, the progress of a family referred to an urban family preservation and reunification program. The target family on whom data were collected consisted of a 13-year old girl and her foster parent who was her maternal aunt. The findings of this study indicate that the WAIC is applicable in monitoring the progress of children and adults in care and that it has the endorsement of its user, namely, the direct care provider. Other results of the study, limitations of the study, and future research needs are discussed.

Preliminary evaluation of conceptual mechanical designs

Computational Design has traditionally required a great deal of geometrical and parametric data. This data can only be supplied at stages later than conceptual design, typically the detail stage, and design quality is given by some absolute fitness function. On the other hand, design evaluation offers a relative measure of design quality that requires only a sparse representation. Quality, in this case, is a measure of how well a design will complete its task.

The research intends to address the question: "Is it possible to evaluate a mechanical design at the conceptual design phase and be able to make some prediction of its quality?" Quality can be interpreted as success in the marketplace, success in performing the required task, or some other user requirement. This work aims to determine a minimum level of representation such that conceptual designs can be usefully evaluated without needing to capture detailed geometry. This representation will form the model for the conceptual designs that are being considered for evaluation. The method to be developed will be a case-based evaluation system, that uses a database of previous designs to support design exploration. The method will not be able to support novel design as case-based design implies the model topology must be fixed.

Experimental evaluation of layout designs for 3 × 3 MIMO-enabled radio-over-fiber distributed antenna systems

This paper experimentally demonstrates that, for two representative indoor distributed antenna system (DAS) scenarios, existing radio-over-fiber (RoF) DAS installations can enhance the capacity advantages of broadband 3 × 3 multiple-input-multiple-output (MIMO) radio services without requiring additional fibers or multiplexing schemes. This is true for both single-and multiple-user cases with a single base station and multiple base stations. First, a theoretical example is used to illustrate that there is a negligible improvement in signal-to-noise ratio (SNR) when using a MIMO DAS with all N spatial streams replicated at N RAUs, compared with a MIMO DAS with only one of the N streams replicated at each RAU for N ≤ 4. It is then experimentally confirmed that a 3 × 3 MIMO DAS offers improved capacity and throughput compared with a 3 × 3 MIMO collocated antenna system (CAS) for the single-user case in two typical indoor DAS scenarios, i.e., one with significant line-of-sight (LOS) propagation and the other with entirely non-line-of-sight (NLOS) propagation. The improvement in capacity is 3.2% and 4.1%, respectively. Then, experimental channel measurements confirm that there is a negligible capacity increase in the 3 × 3 configuration with three spatial streams per antenna unit over the 3 × 3 configuration with a single spatial stream per antenna unit. The former layout is observed to provide an increase of ∼1% in the median channel capacity in both the single-and multiple-user scenarios. With 20 users and three base stations, a MIMO DAS using the latter layout offers median aggregate capacities of 259 and 233 bit/s/Hz for the LOS and NLOS scenarios, respectively. It is concluded that DAS installations can further enhance the capacity offered to multiple users by multiple 3 × 3 MIMO-enabled base stations. Further, designing future DAS systems to support broadband 3 × 3 MIMO systems may not require significant upgrades to existing installations for small numbers of spatial streams. © 2013 IEEE.

An evaluation of Bayesian designs for dose-escalation studies in healthy volunteers

In this paper, Bayesian decision procedures previously proposed for dose-escalation studies in healthy volunteers are reviewed and evaluated. Modifications are made to the expression of the prior distribution in order to make the procedure simpler to implement and a more relevant criterion for optimality is introduced. The results of an extensive simulation exercise to establish the proper-ties of the procedure and to aid choice between designs are summarized, and the way in which readers can use simulation to choose a design for their own trials is described. The influence of the value of the within-subject correlation on the procedure is investigated and the use of a simple prior to reflect uncertainty about the correlation is explored. Copyright (c) 2005 John Wiley & Sons, Ltd.

Evaluation of cutting patterns produced with air-abrasion systems using different tip designs.

This study assessed cavity preparations produced with different air abrasion tip parameters. Twelve test groups of extracted teeth were prepared to evaluate the parameters of 80 degrees or 45 degrees nozzle angles and 0.38 or 0.48 mm inner tip diameters. All other factors were held constant. A device was made to hold the specimen and air abrasion handpiece that standardized the distance and position relative to the tooth and time of application. The cavities were evaluated by assessing the rounding of the cavosurface margins and cavity floor. Measurements of cavosurface angles and the angle of concavity were made at the deepest portion of the abraded surface using scanning electron micrographs. The cavosurface angles were compared using paired t-test, and the effects of the tip design parameters were analyzed by ANOVA and Duncan's Multiple Range test. From the cavity patterns found in this study, the authors suggest that 80 degrees angle tips are more appropriate than 45 degrees angle tips for making narrow, deep cuts for preventive resin restorations. Conversely, when shallow preparations are needed, as in the case of Class V cavity preparations, cutting patterns of 45 degrees angle tips are more suitable.

Evaluation of reusable cardboard box designs: Biomechanical and perceptual aspects

Reusable cardboard boxes can be ergonomically designed for internal transportation of dry products in industrial settings. In this study we compared the effects of handling a regular commercial box and two cardboard prototypes on upper limb postures through the evaluation of movements, myoelectrical activity, perceived grip acceptability and capacity for reuse. The ergonomic designs provided a more acceptable grip, safer wrist and elbow movements and lower wrist extensors and biceps activity. Biomechanical disadvantages were observed only for one of the prototypes when handling to high surface. The prototypes were durable and suitable for extensive reuse (more than 2000 handlings) in internal industrial transportation. Despite being slightly more expensive than regular cardboard, the prototypes showed good cost-benefit considering their high durability. Relevance to industry: Cardboard boxes can be efficiently redesigned for allowing safer upper limb movements and lower muscle workload in manual materials handling. New designs can also be extensively reused for internal industrial transportation with good cost-benefit. © 2012 Elsevier B.V.

Evaluation of Cage Designs and Feeding Regimes for Honey Bee (Hymenoptera: Apidae) Laboratory Experiments

The aim of this study was to improve cage systems for maintaining adult honey bee (Apis mellifera L.) workers under in vitro laboratory conditions. To achieve this goal, we experimentally evaluated the impact of different cages, developed by scientists of the international research network COLOSS (Prevention of honey bee COlony LOSSes), on the physiology and survival of honey bees. We identified three cages that promoted good survival of honey bees. The bees from cages that exhibited greater survival had relatively lower titers of deformed wing virus, suggesting that deformed wing virus is a significant marker reflecting stress level and health status of the host. We also determined that a leak- and drip-proof feeder was an integral part of a cage system and a feeder modified from a 20-ml plastic syringe displayed the best result in providing steady food supply to bees. Finally, we also demonstrated that the addition of protein to the bees' diet could significantly increase the level ofvitellogenin gene expression and improve bees' survival. This international collaborative study represents a critical step toward improvement of cage designs and feeding regimes for honey bee laboratory experiments.

Comparative study of two laparoscopic instrument tracker designs for motion analysis and image-guided surgery: a technical evaluation

Laparoscopic instrument tracking systems are a key element in image-guided interventions, which requires high accuracy to be used in a real surgical scenario. In addition, these systems are a suitable option for objective assessment of laparoscopic technical skills based on instrument motion analysis. This study presents a new approach that improves the accuracy of a previously presented system, which applies an optical pose tracking system to laparoscopic practice. A design enhancement of the artificial markers placed on the laparoscopic instrument as well as an improvement of the calibration process are presented as a means to achieve more accurate results. A technical evaluation has been performed in order to compare the accuracy between the previous design and the new approach. Results show a remarkable improvement in the fluctuation error throughout the measurement platform. Moreover, the accumulated distance error and the inclination error have been improved. The tilt range covered by the system is the same for both approaches, from 90º to 7.5º. The relative position error is better for the new approach mainly at close distances to the camera system

Resource recovery plant cost estimates : a comparative evaluation of four recent dry-shredding designs /

Bibliography: p. 20.

The use of visual analogue scales to assess motivation to eat in human subjects: a review of their reliability and validity with an evaluation of new hand-held computerized stsytems for temporal tracking of appetite ratings.

This present paper reviews the reliability and validity of visual analogue scales (VAS) in terms of (1) their ability to predict feeding behaviour, (2) their sensitivity to experimental manipulations, and (3) their reproducibility. VAS correlate with, but do not reliably predict, energy intake to the extent that they could be used as a proxy of energy intake. They do predict meal initiation in subjects eating their normal diets in their normal environment. Under laboratory conditions, subjectively rated motivation to eat using VAS is sensitive to experimental manipulations and has been found to be reproducible in relation to those experimental regimens. Other work has found them not to be reproducible in relation to repeated protocols. On balance, it would appear, in as much as it is possible to quantify, that VAS exhibit a good degree of within-subject reliability and validity in that they predict with reasonable certainty, meal initiation and amount eaten, and are sensitive to experimental manipulations. This reliability and validity appears more pronounced under the controlled (but more arti®cial) conditions of the laboratory where the signal : noise ratio in experiments appears to be elevated relative to real life. It appears that VAS are best used in within-subject, repeated-measures designs where the effect of different treatments can be compared under similar circumstances. They are best used in conjunction with other measures (e.g. feeding behaviour, changes in plasma metabolites) rather than as proxies for these variables. New hand-held electronic appetite rating systems (EARS) have been developed to increase reliability of data capture and decrease investigator workload. Recent studies have compared these with traditional pen and paper (P&P) VAS. The EARS have been found to be sensitive to experimental manipulations and reproducible relative to P&P. However, subjects appear to exhibit a signi®cantly more constrained use of the scale when using the EARS relative to the P&P. For this reason it is recommended that the two techniques are not used interchangeably