A process evaluation of the childhood lead poisoning prevention program in Houston, Texas, 1992--1995

A process evaluation of the Houston Childhood Lead Poisoning Prevention Program, 1992-1995, was conducted. The Program's goal is to reduce lead poisoning prevalence. The study proposed to determine to what extent the Program was implemented as planned by measuring how well Program services were actually: (1) received by the intended target population; (2) delivered to children with elevated blood lead levels; (3) delivered in compliance with the Centers for Disease Control and Prevention and Program guidelines and timetables; and (4) able to reduce lead poisoning prevalence among those rescreened. Utilizing a program monitoring design, the Program's pre-collected computer records were reviewed. The study sample consisted of 820 children whose blood lead levels were above 15 micrograms per deciLiter, representing approximately 2.9% of the 28,406 screened over this period. Three blood lead levels from each participant were examined: the initial elevated result; the confirmatory result; and the next rescreen result, after the elevated confirmatory level. Results showed that the Program screened approximately 18% (28,406 of 161,569) of Houston's children under age 6 years for lead poisoning. Based on Chi-square tests of significance, results also showed that lead-poisoned participants were more likely to be younger than 3 years, male and Hispanic, compared to those not lead poisoned. The age, gender and ethnic differences observed were statistically significant (p =.01, p =.00, p =.00). Four of the six Program services: medical evaluations, rescreening, environmental inspections and confirmation, had satisfactory delivery completion rates of 71%-98%. Delivery timetable compliance rates for three of the six services examined: outreach contacts, home visits and environmental inspections were below 32%. However, dangerously elevated blood lead levels fell and lead poisoning prevalence dropped from 3.3% at initial screening to 1.2% among those rescreened, after intervention. From a public health perspective, reductions in lead poisoning prevalence are very meaningful. Based on these findings, the following are recommendations for future research: (1) integrate Program database files by utilizing a computer database management program; (2) target services at Hispanic male children under age 3 years living in the highest risk neighborhoods; (3) increase resources to: improve tracking and documentation of service delivery and provide more non-medical case management and environmental services; and (4) share the evaluation methodology/findings with the Centers for Disease Control and Prevention administrators; the implications may be relevant to other program managers conducting such assessments. ^

Use of empowerment evaluation to determine a sustainability plan for a community-based preconception care program

Women With IMPACT (WWI) is a community-based preconception care educational intervention. WWI is being implemented by the Impacting Maternal and Prenatal Care Together (IMPACT) Collaborative and targets zip codes in Harris County, Texas at high risk for infant mortality, low birthweight, and preterm birth. WWI started March 2012 and continues through August 2013. Three workshop series are planned. This study was conducted with participants and facilitators from the first workshop series. This study aimed to 1) evaluate the WWI program using empowerment evaluation, 2) engage all WWI stakeholders in an empowerment evaluation so the method could be adopted as a participatory evaluation process for future IMPACT activities, and 3) develop recommendations for sustainability of the WWI intervention, based on empowerment evaluation findings and results from the pre/post program evaluation completed by WWI participants. Study participants included WWI participants and facilitators and IMPACT Collaborative Steering Committee members. WWI participants were female, 18-35 year-old, non-pregnant residents of zip codes at high risk of adverse birth outcomes. All other study participants were 18 years or older. A two-phased empowerment evaluation (EE) was utilized in this study. Sessions 1-4 were conducted independently of one another – 3 with participants at different sites and one with the facilitators. The fifth session included WWI participant and facilitator representatives, and IMPACT Steering Committee members. Session 5 built upon the work of the other sessions. Observation notes were recorded during each session. Thematic content analysis was conducted on all EE tables and observation notes. Mission statements drafted by each group focused on improvement of physical and mental health through behavior change and empowerment of all participants. The top 5 overall program components were: physical activity, nutrition, self-worth, in-class communication, and stress. Goals for program improvement were set by EE participants for each of these components. Through thematic content analysis of the tables and observation notes, social support emerged as an important theme of the program among all participant groups. Change to a healthy lifestyle emerged as an important theme in terms of program improvement. Two-phased EE provided an opportunity for all program stakeholders to provide feedback regarding important program components and provide suggestions for program improvement. EE, thematic content analysis, pre/post evaluation results, and inherent program knowledge were triangulated to make recommendations to sustain the program once the initial funding ends. ^

A model for evaluation of generic competences in engineering: application to the problem. Solving competence at the technical University of Madrid.

The competence evaluation promoted by the European High Education Area entails a very important methodological change that requires guiding support to help teachers carry out this new and complex task. In this regard, the Technical University of Madrid (UPM, by its Spanish acronym) has financed a series of coordinated projects with a two-fold objective: a) To develop a model for teaching and evaluating core competences that is useful and easily applicable to its different degrees, and b) to provide support to teachers by creating an area within the Website for Educational Innovation where they can search for information on the model corresponding to each core competence approved by UPM. Information available on each competence includes its definition, the formulation of indicators providing evidence on the level of acquisition, the recommended teaching and evaluation methodology, examples of evaluation rules for the different levels of competence acquisition, and descriptions of best practices. These best practices correspond to pilot tests applied to several of the academic subjects conducted at UPM in order to validate the model. This work describes the general procedure that was used and presents the model developed specifically for the problem-solving competence. Some of the pilot experiences are also summarised and their results analysed

A model for evaluation of generic competences in engineering: application to the problem-solving competence at UPM.

The competence evaluation promoted by the European High Education Area entails a very important methodological change that requires guiding support to help teachers carry out this new and complex task. In this regard, the Technical University of Madrid (UPM, by its Spanish acronym) has financed a series of coordinated projects with a two-fold objective: a) To develop a model for teaching and evaluating core competences that is useful and easily applicable to its different degrees, and b) to provide support to teachers by creating an area within the Website for Educational Innovation where they can search for information on the model corresponding to each core competence approved by UPM. Information available on each competence includes its definition, the formulation of indicators providing evidence on the level of acquisition, the recommended teaching and evaluation methodology, examples of evaluation rules for the different levels of competence acquisition, and descriptions of best practices. These best practices correspond to pilot tests applied to several of the academic subjects conducted at UPM in order to validate the model. This work describes the general procedure that was used and presents the model developed specifically for the problem-solving competence. Some of the pilot experiences are also summarised and their results analysed

Neural bruise prediction models for fruit handling and machinery evaluation.

Some neural bruise prediction models have been implemented in the laboratory, for the most traded fruit species and varieties, allowing the prediction of the acceptability or rejectability for damages, with respect to the EC Standards. Different models have been built for both quasi-static (compression) and dynamic (impact) loads covering the whole commercial ripening period of fruits. A simulation process has been developed gathering the information on laboratory bruise models and load sensor calibrations for different electronic devices (IS-100 and DEA-1, for impact and compression loads respectively). Some evaluation methodology has been designed gathering the information on the mechanical properties of fruits and the loading records of electronic devices. The evaluation system allows to determine the current stage of fruit handling process and machinery.

A web-based application for the management and evaluation of tutoring requests in PBL-based massive laboratories

One important steps in a successful project-based-learning methodology (PBL) is the process of providing the students with a convenient feedback that allows them to keep on developing their projects or to improve them. However, this task is more difficult in massive courses, especially when the project deadline is close. Besides, the continuous evaluation methodology makes necessary to find ways to objectively and continuously measure students' performance without increasing excessively instructors' work load. In order to alleviate these problems, we have developed a web service that allows students to request personal tutoring assistance during the laboratory sessions by specifying the kind of problem they have and the person who could help them to solve it. This service provides tools for the staff to manage the laboratory, for performing continuous evaluation for all students and for the student collaborators, and to prioritize tutoring according to the progress of the student's project. Additionally, the application provides objective metrics which can be used at the end of the subject during the evaluation process in order to support some students' final scores. Different usability statistics and the results of a subjective evaluation with more than 330 students confirm the success of the proposed application.

A meta-avaliação como instrumento para a qualificação da avaliação de políticas públicas de saúde

Trata-se da meta-avaliação de um processo avaliativo desenvolvido por secretários e assessores técnicos municipais de uma região de saúde do estado de São Paulo, com foco nos critérios de utilidade e participação. É uma pesquisa qualitativa, cuja base empírica foi 1) o material produzido em sete oficinas realizadas com os representantes municipais, com vistas à avaliação de um aspecto da linha de cuidados em saúde sob a ótica da integralidade; e 2) as entrevistas semiestruturadas realizadas com os mesmos atores após a finalização do processo avaliativo. Para a avaliação do critério de utilidade, utilizou-se principalmente o referencial de KIRKHART (2000), com o objetivo de ampliar a análise para além do uso instrumental dos achados avaliativos e focá-la na identificação de influências múltiplas exercidas por um fenômeno complexo como um processo avaliativo. A análise do critério participação se deu com base no referencial de COUSINS e WHITMORE (1998), buscando a identificação no material empírico de decisões ou aspectos contextuais que fizeram com que a opção participativa fosse aprofundada ou limitada no processo em foco. O trabalho destaca a importância de explicitar pressupostos que baseiam a metodologia da avaliação/ meta-avaliação escolhida, e a necessidade de se buscar referenciais teóricos de análise compatíveis com a opção realizada, frisando a inexistência de posturas neutras ou estudos totalmente objetivos; e a importância de capacitar avaliadores a acompanharem a demanda dos participantes de um processo participativo com a flexibilidade necessária para conferir-lhe o maior aproveitamento possível. Conclui-se pela viabilidade, com vantagens, da realização de processos participativos locais com gestores na Saúde Pública, destacando a possibilidade de ganhos em formação e o enriquecimento dos processos de negociação em nível do território, de forma coerente à política de construção das regiões de saúde no SUS.

Evaluation of public housing strategies in Mexico City : an exploratory goal programming approach

This thesis describes the development and use of a goal programming methodology for the evaluation of public housjng strategies in Mexico City, The methodology responds to the need to incorporate the location, size and densities of housing projects on the one hand, and "external" constraints such as the ability of low income families to pay for housing, and the amounts of capital and land available, on the other. The provision of low cost housing by public housing agencies in Mexico City is becoming increasingly difficult because there are so many constraints to be met and overcome, the most important of which is the ability of families to pay for housing. Other important limiting factors are the availability of capital and of land plots of the right size in desired locations. The location of public housing projects is significant because it determines the cost and pattern of work trips, which in a metropolitan area such as Mexico City are of considerable importance to both planners and potential. house owners. In addition, since the price of land is closely related to its location, the last factor is also significant in determining the price of the total housing package. Consequently there is a major trade-off between a housing strategy based on the provision of housing at locations close to employment, and the opposite one based on the provjsion of housjng at locations where employment accessibility is poorer but housing can be provided at a lower price. The goal programming evaluation methodology presented in this thesis was developed to aid housing planners to evaluate housing strategies which incorporate the issues raised above,

Participatory Methods for Climate Change and Mental Health Research: Photovoice in Nepal

Background: The relationship between mental health and climate change are poorly understood. Participatory methods represent ethical, feasible, and culturally-appropriate approaches to engage community members for mental health promotion in the context of climate change. Aim: Photovoice, a community-based participatory research methodology uses images as a tool to deconstruct problems by posing meaningful questions in a community to find actionable solutions. This community-enhancing technique was used to elicit experiences of climate change among women in rural Nepal and the association of climate change with mental health. Subjects and methods: Mixed-methods, including in-depth interviews and self-report questionnaires, were used to evaluate the experience of 10 women participating in photovoice. Quantitative tools included Nepali versions of Beck Depression Inventory (BDI) and Beck Anxiety Inventory (BAI) and a resilience scale. Results: In qualitative interviews after photovoice, women reported climate change adaptation and behavior change strategies including environmental knowledge-sharing, group mobilization, and increased hygiene practices. Women also reported beneficial effects for mental health. The mean BDI score prior to photovoice was 23.20 (SD=9.00) and two weeks after completion of photovoice, the mean BDI score was 7.40 (SD=7.93), paired t-test = 8.02, p<.001, n=10. Conclusion: Photovoice, as a participatory method, has potential to inform resources, adaptive strategies and potential interventions to for climate change and mental health.

Avaliação participativa de indicadores de solo e sanidade de cultivos em sistemas de produção na Comunidade Pé de Serra Cedro, no semiárido brasileiro.

RESUMO: A avaliação participativa permite inferir se os sistemas agrícolas necessitam de melhorias e quais conhecimentos podem promover incrementos. Esse trabalho objetivou avaliar diferentes sistemas de produção na Comunidade Pé de Serra Cedro, Sobral-CE, utilizando metodologia participativa com agricultores locais através de indicadores de qualidade do solo e sanidade dos cultivos. Os sistemas de produção avaliados foram quatro, com as seguintes descrições: sistema tradicional: plantio de culturas anuais, com queima da área a 3 anos; sistema tradicional + esterco; sistema tradicional + esterco + leucena; e sistema roçado agroecológico. A inserção de práticas edáficas como aplicação de estercos e implantação de leguminosas incrementaram sistemas de produção tradicionais no semiárido cearense, mesmo em curto prazo de avaliação. A utilização de roçados agroecológicos diferenciou-se para indicadores do solo e sanidade dos cultivos em relação aos manejos tradicionais, com indicador médio para atributos do solo de 8,6 e para sanidade de cultivos em 8,4. [Participatory evaluation indicators of soil and crop shealth in production systems in comunity Pé de Serra Cedro in brazilian semi-arid]. Abstract: Participatory evaluation allows us to infer that the agricultural systems need to be improved and what knowledge can promote increments, thus aimed to evaluate different production systems in the Community Pé de Serra Cedro, Sobral, state of Ceará, Brazil, using participatory methodology with local farmers on soil properties and health of crops. The production systems evaluated were four, with the following descriptions: traditional system: planting annual crops, with burning area to 3 years; traditional system + manure; traditional system + manure + Leucaena leucocephala; and scuffed agroecological system. Inserting soil practices such as manure application and implementation of incresead legumes traditional production systems in semiarid region, even in short-term assessment. The use of agroecological scuffed differed for soil propertie sand health of crops over traditional managements with value 8.6 and 8.4 to soil and plant indicators, respectively.

Overview of the INEX 2010 focused relevance feedback track

The INEX 2010 Focused Relevance Feedback track offered a refined approach to the evaluation of Focused Relevance Feedback algorithms through simulated exhaustive user feedback. As in traditional approaches we simulated a user-in-the loop by re-using the assessments of ad-hoc retrieval obtained from real users who assess focused ad-hoc retrieval submissions. The evaluation was extended in several ways: the use of exhaustive relevance feedback over entire runs; the evaluation of focused retrieval where both the retrieval results and the feedback are focused; the evaluation was performed over a closed set of documents and complete focused assessments; the evaluation was performed over executable implementations of relevance feedback algorithms; and �finally, the entire evaluation platform is reusable. We present the evaluation methodology, its implementation, and experimental results obtained for nine submissions from three participating organisations.

Overview of the INEX 2011 relevance feedback track

The INEX 2011 Relevance Feedback track offered a refined approach to the evaluation of Focused Relevance Feedback algorithms through simulated exhaustive user feedback. Run in largely identical fashion to the Relevance Feedback track in INEX 2010[2], we simulated a user-in-the loop by re-using the assessments of ad-hoc retrieval obtained from real users who assess focused ad-hoc retrieval submissions. We present the evaluation methodology, its implementation, and experimental results obtained for four submissions from two participating organisations. As the task and evaluation methods did not change between INEX 2010 and now, explanations of these details from the INEX 2010 version of the track have been repeated verbatim where appropriate.

“I understand. I am a participant”: Navigating the ‘fuzzy’ boundaries of visual methods in qualitative longitudinal research

In this chapter we discuss how utilising the participatory visual methodology, photovoice, in an aged care context with its unique communal setting raised several ‘fuzzy boundary’ ethical dilemmas. To illustrate these challenges, we draw on immersive field notes from an ongoing qualitative longitudinal research (QLR) exploring the lived experience of aged care from the perspective of older residents, and focus on interactions with one participant, 81 year old Cassie. We explore how the camera, which is integral to the photovoice method, altered the researcher/participant ethical dynamics by becoming a continual ‘connector’ to the researcher. The camera took on a distinct agency, acting as a non-threatening ‘portal’ that lengthened contact, provided informal opportunities to alter the relationship dynamics and enabled unplanned participant revelation.

Metodologia de avaliação de rendimento de aerogeradores de pequeno porte utilizando perfis diários típicos de vento.

O crescimento do uso dos aerogeradores de pequeno porte em áreas urbanas em todo o mundo aponta para um mercado em expansão e extremamente promissor, principalmente no brasil, onde o potencial eólico é grande. tratando-se de máquinas pequenas existe interesse dos consumidores residenciais na sua utilização, seja para economia de energia ou por adesão às fontes alternativas. existe uma grande quantidade de fabricantes no mundo incluindo aerogeradores de alta, média e baixa qualidade. com isso surge a necessidade de criar métodos que avaliem estes produtos quanto ao seu rendimento energético, como ocorrem com as geladeiras, lâmpadas, fogões e outros, a fim de resguardar a qualidade deste equipamento ao consumidor. a proposta é criar um ciclo de teste (ou ciclo de ventos) baseado nos perfis de comportamentos diários de ventos urbano obtidos através de medições reais feitos pelo projeto sonda. esse perfil será usado para testar os aerogeradores de até 1 kw em laboratório, com auxílio de um túnel de vento a fim de determinar o rendimento energético do conjunto gerador, servindo como método para o aprimoramento desses aparelhos. outra possibilidade é o uso desta metodologia no programa brasileiro de etiquetagem, que classifica os produtos em função de sua eficiência energética. este trabalho também pode ser usado para acreditação de laboratórios de certificação que avaliam produtos em função de sua eficiência e/ou rendimento, visto que a acreditação é uma ferramenta estabelecida em escala internacional para gerar confiança na atuação de organizações que executam atividades de avaliação da conformidade.

Metodologia de avaliação do sistema educacional no estado do Rio de Janeiro baseado em lógica nebulosa.

Este trabalho propõe-se a descrever uma metodologia para avaliação do sistema de educação fundamental do Estado do Rio de Janeiro, que utiliza a teoria dos conjuntos nebulosos como base, no processo de inferência para geração do Indicador Avaliação do Sistema Educacional (IASE). A base de dados utilizada para criação do indicador IASE foi extraída de dados obtidos do Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira (INEP). Em seguida, os resultados obtidos são apresentados em um Sistema de informação Geográfica (SIG) possibilitando compreender a correlação de valores alfanuméricos e espacial das informações geradas no sistema nebuloso, de modo apoiar a tomada de decisão das ações governamentais no setor.