Evaluation and Model of a Clinical Librarian Program

Clinical medical librarianship is entering its second decade, but little evaluative data has accrued in the literature. Variations from the original programs and novel new approaches have insured the survival of the program so far. The clinical librarian (CL) forms a vital link between the library and the health care professional, operating as an important information transfer agent. However, to further insure the survival of these vital programs, hard evaluative evidence is needed. The University of Texas Medical Branch (UTMB) at Galveston began a CL Program in 1978/79. An extensive three-year pre/post evaluation study was conducted using a specifically developed evaluation model, which, if adopted by others, will provide the needed comparative data. Both a pilot study, or formative evaluation, and a summative evaluation were conducted. The results of this evaluation confirmed many of the conclusions reported by other CL programs. Eight hypotheses were proposed at the beginning of this study. Data were collected and used to support acceptance or rejection of the null hypotheses, and conclusions were drawn according to the results. Implications relevant to the study conclusions and future trends in medical librarianship are also discussed in the closing chapter.

An evaluation of the personal response system program for the elderly in Harris County, Texas

The Personal Response System Program at Huffington Center on Aging, Baylor College of Medicine, provides emergency call systems for elderly people living independently in Houston, Texas. The goal of the project was to complete a formative evaluation of the Personal Response System Program. The specific aims of the evaluation were three-fold. One aim was to evaluate participant health status and level of disability. The second aim was to develop a health care cost estimation strategy. Finally, a preliminary cost-effectiveness analysis was completed to evaluate the program's impact on health care costs and health status among the elderly target population. ^ The evaluation was a longitudinal, randomized experimental design. After the screening of 120 volunteers for eligibility, clients were asked to complete a written questionnaire and a monthly health service contact diary. Volunteers were contacted by telephone interviewers to collect health status information from 100 eligible clients (83%) on three occasions during the six months of follow-up. ^ Initially, volunteers were randomized to two experimental groups. The two groups were found to be comparable at the beginning of the study. No significant differences were detected related to health status, level of disability, or history of physician visits at baseline. However, the group with the Personal Response System (PRS) device had more adverse health events, higher IADL scores, more frequent use of walkers, lower average health status scores, and fewer community volunteers hours than the usual care comparison group. ^ The health care costs were estimated based on an algorithm adapted from the American Medical Association guidelines. Average total health care costs for the group with the PRS device ($912) were greater than the usual care group ($464). However, median health care values for the PRS group ($263) were similar to the usual care comparison group ($234). The preliminary findings indicated that the use of the PRS device was not associated with health care cost savings. ^ In the preliminary cost-effectiveness analysis, use of the personal response system was found to be associated with increased mental health status among elderly clients. The cost-effectiveness evaluation indicated that the associated cost for six months was $710 per unit increase in mental component score when the $150 PRS subscription was included. However, clients with the PRS device were found to have a greater decline in physical health status during the six-month follow-up. The beneficial effect on mental health status was found to be in contrast to negative findings associated with changes in physical health status. The implications for future research relate to the need to identify risk factors among geriatric populations to better target groups that would most likely benefit from PRS Program enrollment. ^

Team: Bee Me. A formulative evaluation of a negative eating attitudes and behaviors primary prevention curriculum targeted at 5 th grade elementary school girls

Objective. To evaluate a school-based intervention aimed at the primary prevention of negative eating attitudes and behaviors among preadolescent girls, and to revise curriculum lessons based on quantitative and qualitative findings. ^ Intervention Design. A formative evaluation was conducted on four Team: Bee Me curriculum lessons at a Houston elementary school. Evaluation focused on program satisfaction and short-term effect on knowledge and eating attitudes and behaviors. ^ Results. Sixteen girls participated in the five-day project. Statistically significant improvements in overall knowledge were observed (p<0.05), however only modest changes were observed in eating attitudes and behaviors. Program satisfaction was high among student participants and the teacher who implemented it. Insight for future modifications to this program and for similar interventions was provided by the students and teacher. ^ Conclusions. This program led to positive trends in outcome variables; however longer and more intensive testing of this program is needed to better evaluate its effectiveness.^

The use of social media to communicate child health information to low-income parents: A formative study

The Internet, and specifically web 2.0 social media applications, offers an innovative method for communicating child health information to low-income parents. The main objective of this study was to use qualitative data to determine the value of using social media to reach low-income parents with child health information. A qualitative formative evaluation employing focus groups was used to determine the value of using social media for dissemination of child health information. Inclusion criteria included: (1) a parent with a child that attends a school in a designated Central Texas school district; and (2) English-speaking. The students who attend these schools are generally economically disadvantaged and are predominately Hispanic. The classic analysis strategy was used for data analysis. Focus group participants (n=19) were female (95%); White (53%), Hispanic (42%) or African American (5%); and received government assistance (63%). Most had access to the Internet (74%) and were likely to have low health literacy (53%). The most preferred source of child health information was the family pediatrician or general practitioner. Many participants were familiar with social media applications and had profiles on popular social networking sites, but used them infrequently. Objections to social media sites as sources of child health information included lack of credibility and parent time. Social media has excellent potential for reaching low-income parents when used as part of a multi-channel communication campaign. Further research should focus on the most effective type and format of messages that can promote behavior change in this population, such as story-telling. ^

Parent involvement on school advisory councils: A process evaluation at the middle school level

Increasing parental involvement was made an important goal for all Florida schools in educational reform legislation in the 1990's. A forum for this input was established and became known as the School Advisory Council (SAC). To demonstrate the importance of process and inclusion, a south Florida school district and its local teacher's union agreed on the following five goals for SACs: (a) to foster an environment of professional collaboration among all stakeholders, (b) to assist in the preparation and evaluation of the school improvement plan, (c) to address all state and district goals, (d) to serve as the avenue for authentic and representative input from all stakeholders, and (e) to ensure the continued existence of the consensus-building process on all issues related to the school's instructional program. ^ The purpose of this study was to determine to what extent and in what ways the parent members of one south Florida middle school's SAC achieved the five district goals during its first three years of implementation. The primary participants were 16 parents who served as members of the SAC, while 16 non-parent members provided perspective on parent involvement as “outside sources.” Being qualitative by design, factors such as school climate, leadership styles, and the quality of parental input were described from data collected from four sources: parent interviews, a questionnaire of non-parents, researcher observations, and relevant documents. A cross-case analysis of all data informed a process evaluation that described the similarities and differences of intended and observed outcomes of parent involvement from each source using Stake's descriptive matrix model. A formative evaluation of the process compared the observed outcomes with standards set for successful SACs, such as the district's five goals. ^ The findings indicated that parents elected to the SACs did not meet the intended goals set by the state and district. The school leadership did not foster an environment of professional collaboration and authentic decision-making for parents and other stakeholders. The overall process did not include consensus-building, and there was little if any input by parents on school improvement and other important issues relating to the instructional program. Only two parents gave the SAC a successful rating for involving parents in the decision-making process. Although compliance was met in many of the procedural transactions of the SAC, the reactions of parents to their perceived role and influence often reflected feelings of powerlessness and frustration with a process that many thought lacked meaningfulness and productivity. Two conclusions made from this study are as follows: (a) that the role of the principal in the collaborative process is pivotal, and (b) that the normative-re-educative approach to change would be most appropriate for SACs. ^

Parent involvement on school advisory councils: a process evaluation at the middle school level

Increasing parental involvement was made an important goal for all Florida schools in educational reform legislation in the 1990's. A forum for this input was established and became known as the School Advisory Council (SAC). To demonstrate the importance of process and inclusion, a south Florida school district and its local teacher's union agreed on the following five goals for SACs: (a) to foster an environment of professional collaboration among all stakeholders, (b) to assist in the preparation and evaluation of the school improvement plan, (c) to address all state and district goals, (d) to serve as the avenue for authentic and representative input from all stakeholders, and (e) to ensure the continued existence of the consensus-building process on all issues related to the school's instructional program. The purpose of this study was to determine to what extent and in what ways the parent members of one south Florida middle school's SAC achieved the five district goals during its first three years of implementation. The primary participants were 16 parents who served as members of the SAC, while 16 non-parent members provided perspective on parent involvement as "outside sources." Being qualitative by design, factors such as school climate, leadership styles, and the quality of parental input were described from data collected from four sources: parent interviews, a questionnaire of non-parents, researcher observations, and relevant documents. A cross-case analysis of all data informed a process evaluation that described the similarities and differences of intended and observed outcomes of parent involvement from each source using Stake's descriptive matrix model. A formative evaluation of the process compared the observed outcomes with standards set for successful SACs, such as the district's five goals. The findings indicated that parents elected to the SACs did not meet the intended goals set by the state and district. The school leadership did not foster an environment of professional collaboration and authentic decision-making for parents and other stakeholders. The overall process did not include consensus-building, and there was little if any input by parents on school improvement and other important issues relating to the instructional program. Only two parents gave the SAC a successful rating for involving parents in the decision-making process. Although compliance was met in many of the procedural transactions of the SAC, the reactions of parents to their perceived role and influence often reflected feelings of powerlessness and frustration with a process that many thought lacked meaningfulness and productivity. Two conclusions made from this study are as follows: (a) that the role of the principal in the collaborative process is pivotal, and (b) that the normative-re-educative approach to change would be most appropriate for SACs.

L’inclusion scolaire dans l’enseignement primaire: L’évaluative formative comme source de progression collective?

Ce travail s’inscrit dans le champ des recherches concernant les pratiques inclusives en milieu scolaire ordinaire dans l’enseignement primaire. En France, le système éducatif propose de scolariser les élèves à besoins éducatifs particuliers soit en classe ordinaire, soit en classe spécialisée, bien que les gouvernements valorisent l’accueil en milieu ordinaire depuis la loi de 2005. Or, ceci questionne les pratiques des acteurs de l’école sur la prise en charge de ces élèves. Partant des travaux montrant que les enseignants utilisant l’évaluation formative gèrent mieux la diversité des élèves, nous étudions ici dans quelle mesure cette fonction de l’évaluation aiderait les élèves présentant des besoins éducatifs particuliers à acquérir des connaissances grâce aux feedbacks émis lors d’évaluations orales et de corrections collectives. L’analyse des données recueillies à l’aide d’entretiensavec des enseignants et d’observations d’élèves fait ressortir les attitudes des acteurs, les interactions et les régulations. (DIPF/Orig.)

Reaching those most in need: a review of diabetes self-management interventions in disadvantaged populations

There has been increased recognition of the importance of developing diabetes self-management education (DSME) interventions that are effective with under-served and minority populations. Despite several recent studies in this area, there is to our knowledge no systematic review or synthesis of what has been learned from this research. An electronic literature search identified five formative evaluations and ten controlled DSME intervention trials focused on under-served (low-income, minority or aged) populations. The RE-AIM (Reach, Efficacy, Adoption, Implementation, Maintenance) evaluation framework was used to evaluate the controlled studies on the dimensions of reach, efficacy, adoption, implementation, and maintenance. Fifty percent of the studies identified reported on the percentage of patients who participated, and the percentages were highly variable. The methodological quality of the articles was generally good and the short-term results were encouraging, especially on behavioral outcomes. Data on adoption (representativeness of settings and clinicians who participate) and implementation were almost never reported. Studies of modalities in addition to group meetings are needed to increase the reach of DSME with under-served populations. The promising formative evaluation work that has been conducted needs to be extended for more systematic study of the process of intervention implementation and adaptation with special populations. Studies that explicitly address the community context and that address multiple issues related to public health impact of DSME interventions are recommended to enhance long-term results. Copyright (C) 2002 John Wiley Sons, Ltd.

A importância dos fluxos de caixa na análise da solvência, liquidez e visibilidade das empresas

Orientada por: Prof. Doutora Cláudia Lopes

Avaliação de desempenho docente, supervisão e desenvolvimento profissional

Este texto incide sobre o papel da supervisão pedagógica no contexto da avaliação de desempenho docente (ADD), procurando aprofundar a forma como a dimensão formativa da avaliação foi equacionada e desenvolvida nas escolas. Para tal, foram realizados dois estudos num agrupamento de escolas da periferia de Lisboa, abrangendo professores avaliadores e avaliados do 1º e do 2º/3º ciclos. Os estudos tinham como objetivos gerais: i) conhecer asconceções de avaliadores e avaliados sobre os fundamentos e as práticas de avaliação de desempenho desenvolvidas nos seus contextos profissionais; ii) e definir o papel que avaliadores e avaliados atribuem à supervisão neste processo. Para a recolha de dados usou-se a entrevista semi-diretiva, recorrendo-se à análise de conteúdo para tratamento dos dados. O confronto dos resultados das entrevistas permite concluir que as conceções sobre a avaliação de desempenho dos docentes dos diferentes ciclos são semelhantes, mas o processo de avaliação e de supervisão foi vivido de forma distinta. O papel da supervisão na ADD depende, em larga escala, da competência dos avaliadores como supervisores e como professores e é facilitado pela existência prévia de uma cultura de colaboração entre docentes.

Métodos de Avaliação de Aprendizagens em História e Geografia do 3º Ciclo – Um Estudo Comparativo

A avaliação, no contexto de ensino-aprendizagem, ocupa um papel central e fulcral. Subdivide-se em diversas formas e modalidades que nos ajudam a compreender as formas de implementar momentos avaliativos e de conduzir práticas letivas. O presente relatório pretende efetuar uma contextualização teórica de alguns conceitos relacionados com a avaliação – nomeadamente a avaliação sumativa e a avaliação formativa – compreendendo a sua praticabilidade na atividade docente. A Prática de Ensino Supervisionada decorreu em duas escolas diferentes, e a minha prática letiva cingiu-se aos 8º e 9º anos do Ensino Básico. Desta forma, o trabalho apresentado efetua uma comparação entre duas práticas letivas e avaliativas, analisando a sua repercussão ao nível da aprendizagem dos alunos

Learning collaboration in General Internal Medicine: a pilot project for undergraduate students in nursing, physiotherapy and medicine

Background: A form of education called Interprofessional Education (IPE) occurs when two or more professions learn with, from and about each other. The purpose of IPE is to improve collaboration and the quality of care. Today, IPE is considered as a key educational approach for students in the health professions. IPE is highly effective when delivered in active patient care, such as in clinical placements. General internal medicine (GIM) is a core discipline where hospital-based clinical placements are mandatory for students in many health professions. However, few interprofessional (IP) clinical placements in GIM have been implemented. We designed such a placement. Placement design: The placement took place in the Department of Internal Medicine at the CHUV. It involved students from nursing, physiotherapy and medicine. The students were in their last year before graduation. Students formed teams consisting of one student from each profession. Each team worked in the same unit and had to take care of the same patient. The placement lasted three weeks. It included formal IP sessions, the most important being facilitated discussions or "briefings" (3x/w) during which the students discussed patient care and management. Four teams of students eventually took part in this project. Method: We performed a type of evaluation research called formative evaluation. This aimed at (1) understanding the educational experience and (2) assessing the impact of the placement on student learning. We collected quantitative data with pre-post clerkship questionnaires. We also collected qualitative data with two Focus Groups (FG) discussions at the end of the placement. The FG were audiotaped and transcribed. A thematic analysis was then performed. Results: We focused on the qualitative data, since the quantitative data lacked of statistical power due to the small numbers of students (N = 11). Five themes emerged from the FG analysis: (1) Learning of others' roles, (2) Learning collaborative competences, (3) Striking a balance between acquiring one's own professional competences and interprofessional competences, (4) Barriers to apply learnt IP competences in the future and (5) Advantages and disadvantages of IP briefings. Conclusions: Our IP clinical placement in GIM appeared to help students learn other professionals' roles and collaborative skills. Some challenges (e.g. finding the same patient for each team) were identified and will require adjustments.

Evaluación de la formación del profesorado universitario novel

Durante el curso académico 2001-2002 se desarrolló en la Universidad de Barcelona el Curso de Postgrado 'Innovación en la Docencia Universitaria' dirigido al profesorado novel de la misma. Finalizado el programa se hacía imprescindible conocer su contribución a la mejora de la docencia del profesorado debutante. A través de este estudio se pretende, por tanto, identificar y valorar los cambios, transformaciones y mejoras acaecidas en la práctica docente del profesorado novel como consecuencia de su participación en el Postgrado. El presente trabajo recoge estos aspectos articulados en una evaluación diferida del impacto del Curso de Postgrado. El enfoque metodológico usado ha sido cualitativo-fenomenológico En lo que se refiere a los criterios de evaluación, dos han sido los utilizados en este estudio: la utilidad percibida por el profesorado y la transferibilidad del conocimiento elaborado en el curso.

La credibilidad de los sistemas de evaluación formativa en docencia universitaria: un estudio de casos múltiple aplicado a la formación del profesorado

El objetivo de este artículo es estudiar diversos sistemas de evaluación formativa implantados en asignaturas de grado y máster adscritas a facultades de formación del profesorado. Para lograr este propósito, se lleva a cabo un plan de trabajo que adopta el formato de un estudio de casos múltiple. En cada uno de estos casos, los informadores son, por un lado, el profesorado responsable de la asignatura y, por otro, los estudiantes que han realizado las actividades de enseñanza y aprendizaje y que incluso han participado en su evaluación y calificación. Se han utilizado diferentes instrumentos de carácter cualitativo y cuantitativo con la intención de identificar las características principales de los sistemas de evaluación formativa implantados y de constatar los indicadores que permitirán establecer en qué grado los sistemas de evaluación formativa y participativa estudiados son pertinentes y aportan resultados creíbles. Los resultados indican que la credibilidad de estos sistemas de evaluación, además de las calificaciones, también depende de otros indicadores como la calidad del feedback proporcionado por el agente evaluador (docente o estudiante) durante la resolución de las actividades de evaluación, el empoderamiento y la capacidad de estos sistemas para contribuir al desarrollo profesional de los estudiantes. La principal conclusión que se desprende de este estudio se refiere al hecho de que las calificaciones académicas no pueden ser consideradas como el único factor a tener en cuenta para valorar la conveniencia de la evaluación formativa y participativa en docencia universitaria. En este sentido, el principal indicador de la credibilidad de un sistema de evaluación es su capacidad para aportar evidencias del fomento y la adquisición de aprendizajes profundos y competenciales.

Évaluation de la formation accompagnant l'outil de prévention de la prostitution en contexte de gangs : le silence de Cendrillon

Mémoire numérisé par la Division de la gestion de documents et des archives de l'Université de Montréal