The evolution and assessment of pharmaceutical care: Structure, processes, and outcomes

The evolution of pharmaceutical care is identified through a complete review of the literature published in the American Journal of Health-System Pharmacy, the sole comprehensive publication of institutional pharmacy practice. The evolution is categorized according to characteristics of structure (organizational structure, the role of the pharmacist), process (drug delivery systems, formulary management, acquiring drug products, methods to impact drug therapy decisions), and outcomes (cost of drug delivery, cost of drug acquisition and use, improved safety, improved health outcomes) recorded from the 1950s through the 1990s. While significant progress has been made in implementing basic drug distribution systems, levels of pharmacy involvement with direct patient care is still limited.^ A new practice framework suggests enhanced direct patient care involvement through increase in the efficiency and effectiveness of traditional pharmacy services. Recommendations advance internal and external organizational structure relationships that position pharmacists to fully use their unique skills and knowledge to impact drug therapy decisions and outcomes. Specific strategies facilitate expansion of the breadth and scope of each process component in order to expand the depth of integration of pharmacy and pharmaceutical care within the broad healthcare environment. Economic evaluation methods formally evaluate the impact of both operational and clinical interventions.^ Outcome measurements include specific recommendations and methods to increase efficiency of drug acquisition, emphasizing pharmacists' roles that impact physician prescribing decisions. Effectiveness measures include those that improve safety of drug distribution systems, decrease the potential of adverse drug therapy events, and demonstrate that pharmaceutical care can significantly contribute to improvement in overall health status.^ The implementation of the new framework is modeled on a case study at the M.D. Anderson Cancer Center. The implementation of several new drug distribution methods facilitated the redeployment of personnel from distributive functions to direct patient care activities with significant personnel and drug cost reduction. A cost-benefit analysis illustrates that framework process enhancements produced a benefit-to-cost ratio of 7.9. In addition, measures of effectiveness demonstrated significant levels of safety and enhanced drug therapy outcomes. ^

An MBLP model for scheduling assessment centers

Firms aim at assigning qualified and motivated people to jobs. Human resources managers often conduct assessment centers before making such personnel decisions. By means of an assessment center, the potential and skills of job applicants can be assessed more objectively. For the scheduling of such assessment centers, we present a formulation as a mixed-binary linear program and report on computational results for four real-life examples.

Effects of geriatric clinical skills training on the attitudes of medical students.

BACKGROUND Physicians' attitudes, knowledge and skills are powerful determinants of quality of care for older patients. Previous studies found that using educational interventions to improve attitude is a difficult task. No previous study sought to determine if a skills-oriented educational intervention improved student attitudes towards elderly patients. METHODS This study evaluated the effect of a geriatric clinical skills training (CST) on attitudes of University of Bern medical students in their first year of clinical training. The geriatric CST consisted of four 2.5-hour teaching sessions that covered central domains of geriatric assessment (e.g., cognition, mobility), and a textbook used by students to self-prepare. Students' attitudes were the primary outcome, and were assessed with the 14-item University of California at Los Angeles Geriatrics Attitudes Scale (UCLA-GAS) in a quasi-randomized fashion, either before or after geriatric CST. RESULTS A total of 154 medical students participated. Students evaluated before the CST had a median UCLA-GAS overall scale of 49 (interquartile range 44-53). After the CST, the scores increased slightly, to 51 (interquartile range 47-54; median difference 2, 95% confidence interval 0-4, P = 0.062). Of the four validated UCLA-GAS subscales, only the resource distribution subscale was significantly higher in students evaluated after the geriatric CST (median difference 1, 95% confidence interval 0-2, P = 0.005). CONCLUSIONS Teaching that targets specific skills may improve the attitudes of medical students towards elderly patients, though the improvement was slight. The addition of attitude-building elements may improve the effectiveness of future skills-oriented educational interventions.

Formatives Selbst- und Peer-Assessment im Unterricht peripher venöser Venenpunktion

Das Lernen einer Fertigkeit durch Demonstration und anschließendes Üben wird „Modeling“ genannt. Es basiert darauf, die Diskrepanz zwischen dem Soll-Zustand (Demonstration) und dem Ist-Zustand (Üben) zu erkennen und zu beheben. Dafür ist die exakte Analyse der eigenen Fertigkeiten beim Üben unentbehrlich. Entsprechend ist auch bekannt, dass formative Evaluationen wesentlich zum erfolgreichen Lernen beitragen. Wir haben deshalb im Kurs für periphere Venenpunktion im 3. Studienjahr formatives Selbst- und Peer-Assessment eingeführt. Die Struktur des Assessment entspricht einem DOPS (dircect observation of procedural skills). DOPS stammt aus dem Arbeitsplatz-basieren Assessment und beinhaltet die Beurteilung folgender Kriterien: Vorbereitung/Nachsorge, technische Fertigkeit, Asepsis/Sicherheit, klinische Urteilsfähigkeit, Organisation/Effizienz, professionelles Verhalten, Gesamteindruck. Diese Kriterien wurden für den Unterricht konkretisiert (z.B. Vorbereitung mit Beschriftung der Röhrchen, etc.) und den Studierenden als Merkblätter ausgeteilt. Die Studierenden beurteilten ihre eigene Performance bzw. die eines Kommilitonen, gaben sich Feedback und legten individuelle Lernziele zur Verbesserung fest. Dieses Vorgehen hat den Vorteil, dass sowohl der Übende, als auch der beobachtende Kommilitone, die optimale Ausführung der jeweiligen Tätigkeit reflektieren, welches für beide eine Möglichkeit zum Lernen bietet . Bei der Evaluation des Kurses wurden die Handouts mit den Kriterien der DOPS von Teilnehmern von 9 der 10 Gruppen positiv erwähnt. Im Rahmen eines Debriefing mit den studentischen Tutoren wurde jedoch kritisch angemerkt, dass der Prozess der formativen Selbst- und Fremdevaluation den Studierenden im 3. Studienjahr nicht vertraut war. Es war für die Teilnehmer schwierig konkretes Feedback zu geben und individuelle Lernziele festzulegen. Für das kommende Jahr planen wir in Bezug auf den Kurs folgendes: Die Kriterien der korrekten Durchführung einer Fertigkeit zu formulieren wird von den Teilnehmern als hilfreich empfunden und soll deshalb beibehalten werden. Die Studierenden, die dieses Jahr an dem Kurs teilnehmen, haben bereits ein Feedbacktraining absolviert. Der Kurs kann deshalb neu an Vorkenntnisse anknüpfen. Darüber hinaus soll der Prozess der Festlegung der individuellen Lernziele in der Schulung der studentischen Tutoren des Kurses mehr Gewicht erhalten, damit die Tutoren die Teilnehmer hier gezielt unterstützen können.

The new final Clinical Skills examination in human medicine in Switzerland: Essential steps of exam development, implementation and evaluation, and central insights from the perspective of the national Working Group

Objective: Since 2011, the new national final examination in human medicine has been implemented in Switzerland, with a structured clinical-practical part in the OSCE format. From the perspective of the national Working Group, the current article describes the essential steps in the development, implementation and evaluation of the Federal Licensing Examination Clinical Skills (FLE CS) as well as the applied quality assurance measures. Finally, central insights gained from the last years are presented. Methods: Based on the principles of action research, the FLE CS is in a constant state of further development. On the foundation of systematically documented experiences from previous years, in the Working Group, unresolved questions are discussed and resulting solution approaches are substantiated (planning), implemented in the examination (implementation) and subsequently evaluated (reflection). The presented results are the product of this iterative procedure. Results: The FLE CS is created by experts from all faculties and subject areas in a multistage process. The examination is administered in German and French on a decentralised basis and consists of twelve interdisciplinary stations per candidate. As important quality assurance measures, the national Review Board (content validation) and the meetings of the standardised patient trainers (standardisation) have proven worthwhile. The statistical analyses show good measurement reliability and support the construct validity of the examination. Among the central insights of the past years, it has been established that the consistent implementation of the principles of action research contributes to the successful further development of the examination. Conclusion: The centrally coordinated, collaborative-iterative process, incorporating experts from all faculties, makes a fundamental contribution to the quality of the FLE CS. The processes and insights presented here can be useful for others planning a similar undertaking. Keywords: national final examination, licensing examination, summative assessment, OSCE, action research

Evaluation of Medical Students’ Attitudes and Performance of Basic Surgery Skills in a Training Program Using Fresh Human skin, Excised During Body Contouring Surgeries

BACKGROUND: Learning surgical skills in the operating room may be a challenge for medical students. Therefore, more approaches using simulation to enable students to develop their practical skills are required. OBJECTIVES: We hypothesized that (1) there would be a need for additional surgical training for medical students in the pre-final year, and (2) our basic surgery skills training program using fresh human skin would improve medical students' surgical skills. DESIGN: We conducted a preliminary survey of medical students to clarify the need for further training in basic surgery procedures. A new approach using simulation to teach surgical skills on human skin was set up. The procedural skills of 15 randomly selected students were assessed in the operating room before and after participation in the simulation, using Objective Structured Assessment of Technical Skills. Furthermore, subjective assessment was performed based on students' self-evaluation. The data were analyzed using SPSS, version 21 (SPSS, Inc., Chicago, IL). SETTING: The study took place at the Inselspital, Bern University Hospital. PARTICIPANTS: A total of 186 pre-final-year medical students were enrolled into the preliminary survey; 15 randomly selected medical students participated in the basic surgical skills training course on the fresh human skin operating room. RESULTS: The preliminary survey revealed the need for a surgical skills curriculum. The simulation approach we developed showed significant (p < 0.001) improvement for all 12 surgical skills, with mean cumulative precourse and postcourse values of 31.25 ± 5.013 and 45.38 ± 3.557, respectively. The self-evaluation contained positive feedback as well. CONCLUSION: Simulation of surgery using human tissue samples could help medical students become more proficient in handling surgical instruments before stepping into a real surgical situation. We suggest further studies evaluating our proposed teaching method and the possibility of integrating this simulation approach into the medical school curriculum.

Sustained impact of a short small group course with systematic feedback in addition to regular clinical clerkship activities on musculoskeletal examination skills-a controlled study.

BACKGROUND The discrepancy between the extensive impact of musculoskeletal complaints and the common deficiencies in musculoskeletal examination skills lead to increased emphasis on structured teaching and assessment. However, studies of single interventions are scarce and little is known about the time-dependent effect of assisted learning in addition to a standard curriculum. We therefore evaluated the immediate and long-term impact of a small group course on musculoskeletal examination skills. METHODS All 48 Year 4 medical students of a 6 year curriculum, attending their 8 week clerkship of internal medicine at one University department in Berne, participated in this controlled study. Twenty-seven students were assigned to the intervention of a 6×1 h practical course (4-7 students, interactive hands-on examination of real patients; systematic, detailed feedback to each student by teacher, peers and patients). Twenty-one students took part in the regular clerkship activities only and served as controls. In all students clinical skills (CS, 9 items) were assessed in an Objective Structured Clinical Examination (OSCE) station, including specific musculoskeletal examination skills (MSES, 7 items) and interpersonal skills (IPS, 2 items). Two raters assessed the skills on a 4-point Likert scale at the beginning (T0), the end (T1) and 4-12 months after (T2) the clerkship. Statistical analyses included Friedman test, Wilcoxon rank sum test and Mann-Whitney U test. RESULTS At T0 there were no significant differences between the intervention and control group. At T1 and T2 the control group showed no significant changes of CS, MSES and IPS compared to T0. In contrast, the intervention group significantly improved CS, MSES and IPS at T1 (p < 0.001). This enhancement was sustained for CS and MSES (p < 0.05), but not for IPS at T2. CONCLUSIONS Year 4 medical students were incapable of improving their musculoskeletal examination skills during regular clinical clerkship activities. However, an additional small group, interactive clinical skills course with feedback from various sources, improved these essential examination skills immediately after the teaching and several months later. We conclude that supplementary specific teaching activities are needed. Even a single, short-lasting targeted module can have a long lasting effect and is worth the additional effort.

Assessment of English Language Learners Seeking a Graduate Degree in Speech Language Pathology

A shortage of bilingual/bicultural speech language pathologists may reflect a problem with recruitment and retention of bilingual/bicultural students. The purpose of the present study was to survey graduate training programs in speech language pathology to determine typical policies and practices concerning students who apply and are admitted as ELLs. With a growing number of ELL children needing services from a bilingual SLP, it seems that little is being done to address the issue. The problem may be with the reluctance of programs to not only accept ELL students, but there also seems to be a disinclination for any sort of training program to be established for these ELL students. Clinic directors were asked to complete a survey about ELLs seeking clinical training in speech language pathology. In particular, we were interested in obtaining information about whether clinical training programs a) provided opportunities for ELL to participate in clinic, b) assessed the English skills of these students, and c) provided remediation if these students English skills were judged to be less than proficient.

A project to improve the information seeking skills and increase the use of evidence-based research in public health practice

The ability of public health practitioners (PHPs) to work efficiently and effectively is negatively impacted by their lack of knowledge of the broad range of evidence-based practice information resources and tools that can be utilized to guide them in their development of health policies and programs. This project, a three-hour continuing education hands-on workshop with supporting resources, was designed to increase knowledge and skills of these resources. The workshop was presented as a pre-conference continuing education program for the Texas Public Health Association (TPHA) 2008 Annual Conference. Topics included: identification of evidence-based practice resources to aid in the development of policies and programs; identification of sources of publicly available data; utilization of data for community assessments; and accessing and searching the literature through a collection of databases available to all citizens of Texas. Supplemental resources included a blog that served as a gateway to the resources explored during the presentation, a community assessment workbook that incorporates both Healthy People 2010 objectives and links to reliable sources of data, and handouts providing additional instruction on the use of the resources covered during the workshop.^ Before- and after-workshop surveys based on Kirkpatrick's 4-level model of evaluation and the Theory of Planned Behavior were administered. Of the questions related to the trainer, the workshop, and the usefulness of the workshop, participants gave "Good" to "Excellent" responses to all one question. Confidence levels overall increased a statistically significant amount; measurements of attitude, social norms, and control showed no significant differences before and after the workshop. Lastly, participants indicated they were likely to use resources shown during the workshop within a one to three month time period on average. ^ The workshop and creation of supplemental resources served as a pilot for a funded project that will be continued with the development and delivery of four 4-week long webinar-based training sessions to be completed by December 2008. ^

The assessment of standardized training programs in public health preparedness

The Texas Bioterrorism Continuing Education Consortium (BCE) provided National Disaster Life Support (NDLS) training courses throughout the state of Texas in 2005, to help improve knowledge and skills pertaining to bioterrorism and other public health emergencies. The NDLS training courses include curriculum in Basic Disaster Life Support (BDLS) and Core Disaster Life Support (CDLS). A course evaluation which included items assessing ability and willingness of training participants, role of responders, and other variables was mailed to all NDLS participants who provided contact information. An analysis was conducted to determine whether the survey respondents participated in the Hurricanes Katrina and/or Rita relief efforts, as well as to evaluate the impact of the NDLS training courses on the participant's ability and willingness to respond during a disaster. The study population (n = 2150) consisted mostly of nurses (50%) (n=1074). A chi-square test of analysis indicated the following results. Among the survey respondents who took the CDLS course, there was no statically significant difference by occupation pertaining to ability or willingness to respond (x2 [df = 5] = 4.02, p= 0.546); (x2 [df = 5] = 2.45, p = .783). However, there was a statistically significant difference among those respondents who took the BDLS course with respect to ability, and a slightly significant difference with respect to willingness (x2 [df = 5] = 13.35, p = .020 and (x2 = [df = 5] = 10.299, p = .067). These findings are similar to previous studies assessing willingness to respond to a disaster.^ A second analysis was conducted with these survey data to evaluate the implications for disaster response training for the NDLS courses. Results indicated that the majority of disaster responders served in the role for which they were professionally trained (Physicians=68%; Nurses = 50.4%). Nurses, EMT, and Fire professionals served in multiple roles. These results suggest the importance of developing training programs that will prepare professionals to serve in multiple roles. The development of standardized evaluation methods would fill an important gap in assessing impact of national training programs. ^

An assessment of post-disaster psychological stress in hazardous waste operations and emergency response (HAZWOPER) workers

Personnel involved in natural or man-made disaster response and recovery efforts may be exposed to a wide variety of physical and mental stressors that can exhibit long-lasting and detrimental psychopathological outcomes. In a disaster situation, huge numbers of "secondary" responders can be involved in contaminant clean-up and debris removal and can be at risk of developing stress-related mental health outcomes. The Occupational Safety and Health Administration (OSHA) worker training hierarchy typically required for response workers, known as "Hazardous Waste Operations and Emergency Response" (HAZWOPER), does not address the mental health and safety concerns of workers. This study focused on the prevalence of traumatic stress experienced by secondary responders that had received or expressed interest in receiving HAZWOPER training through the National Institute of Environmental Health Sciences Worker Education and Training Program (NIEHS WETP). ^ The study involved the modification of two preexisting and validated survey tools to assess secondary responder awareness of physical, mental, and traumatic stressors on mental health and sought to determine if a need existed to include traumatic stress-related mental health education in the current HAZWOPER training regimen. The study evaluated post-traumatic stress disorder (PTSD), resiliency, mental distress, and negative effects within a secondary responder population of 176 respondents. Elevated PTSD levels were seen in the study population as compared to a general responder population (32.9% positive vs. 8%-22.5% positive). Results indicated that HAZWOPER-trained disaster responders were likely to test positive for PTSD, whereas, untrained responders with no disaster experience and responders who possessed either training or disaster experience only were likely to test PTSD negative. A majority (68.75%) of the population tested below the mean resiliency to cope score (80.4) of the average worker population. Results indicated that those who were trained only or who possessed both training and disaster work experience were more likely to have lower resiliency scores than those with no training or experience. There were direct correlations between being PTSD positive and having worked at a disaster site and experiencing mental distress and negative effects. However, HAZWOPER training status does not significantly correlate with mental distress or negative effect. ^ The survey indicated clear support (91% of respondents) for mental health education. The development of a pre- and post-deployment training module is recommended. Such training could provide responders with the necessary knowledge and skills to recognize the symptomology of PTSD, mental stressors, and physical and traumatic stressors, thus empowering them to employ protective strategies or seek professional help if needed. It is further recommended that pre-deployment mental health education be included in the current HAZWOPER 24- and 40-hour course curriculums, as well as, consideration be given towards integrating a stand-alone post-deployment mental health education training course into the current HAZWOPER hierarchy.^

Computerizing Social-Emotional Assessment for School Readiness: First Steps toward an Assessment Battery for Early Childhood Settings

The transition into formal schooling is a crucial foundation that can set children on a cycle of success or failure in both academic and social domains. A child’s abilities to express healthy emotions, understand emotions of self and others, regulate emotion, attention, and behavior, make good decisions regarding social problems, and engage in a range of prosocial behaviors, all work together to promote a successful school experience. However, many children have deficits in these skills by school entry, and educators lack the requisite tools to identify, track and assess skills these children need to learn. Thus, because social-emotional learning (SEL) is so crucial, assessment tools to pinpoint children’s skills and progress are vitally necessary. Previous work by the authors and other researchers has led to the development of strong assessment tools; however, these tools are often developed solely for research use, not practitioner application. In the following, using our assessment battery as an example, we will discuss the steps necessary to adapt SEL assessment for computer-based administration and optimal utility in early childhood education programs.

Relevance of motion-related assessment metrics in laparoscopic surgery

INTRODUCTION: Motion metrics have become an important source of information when addressing the assessment of surgical expertise. However, their direct relationship with the different surgical skills has not been fully explored. The purpose of this study is to investigate the relevance of motion-related metrics in the evaluation processes of basic psychomotor laparoscopic skills, as well as their correlation with the different abilities sought to measure. METHODS: A framework for task definition and metric analysis is proposed. An explorative survey was first conducted with a board of experts to identify metrics to assess basic psychomotor skills. Based on the output of that survey, three novel tasks for surgical assessment were designed. Face and construct validation study was performed, with focus on motion-related metrics. Tasks were performed by 42 participants (16 novices, 22 residents and 4 experts). Movements of the laparoscopic instruments were registered with the TrEndo tracking system and analyzed. RESULTS: Time, path length and depth showed construct validity for all three tasks. Motion smoothness and idle time also showed validity for tasks involving bi-manual coordination and tasks requiring a more tactical approach respectively. Additionally, motion smoothness and average speed showed a high internal consistency, proving them to be the most task-independent of all the metrics analyzed. CONCLUSION: Motion metrics are complementary and valid for assessing basic psychomotor skills, and their relevance depends on the skill being evaluated. A larger clinical implementation, combined with quality performance information, will give more insight on the relevance of the results shown in this study.

Adaptive neuro-fuzzy inference systems (ANFIS) for supervised classification of competence in MIS based on psychomotor skills

INTRODUCTION: Objective assessment of motor skills has become an important challenge in minimally invasive surgery (MIS) training.Currently, there is no gold standard defining and determining the residents' surgical competence.To aid in the decision process, we analyze the validity of a supervised classifier to determine the degree of MIS competence based on assessment of psychomotor skills METHODOLOGY: The ANFIS is trained to classify performance in a box trainer peg transfer task performed by two groups (expert/non expert). There were 42 participants included in the study: the non-expert group consisted of 16 medical students and 8 residents (< 10 MIS procedures performed), whereas the expert group consisted of 14 residents (> 10 MIS procedures performed) and 4 experienced surgeons. Instrument movements were captured by means of the Endoscopic Video Analysis (EVA) tracking system. Nine motion analysis parameters (MAPs) were analyzed, including time, path length, depth, average speed, average acceleration, economy of area, economy of volume, idle time and motion smoothness. Data reduction was performed by means of principal component analysis, and then used to train the ANFIS net. Performance was measured by leave one out cross validation. RESULTS: The ANFIS presented an accuracy of 80.95%, where 13 experts and 21 non-experts were correctly classified. Total root mean square error was 0.88, while the area under the classifiers' ROC curve (AUC) was measured at 0.81. DISCUSSION: We have shown the usefulness of ANFIS for classification of MIS competence in a simple box trainer exercise. The main advantage of using ANFIS resides in its continuous output, which allows fine discrimination of surgical competence. There are, however, challenges that must be taken into account when considering use of ANFIS (e.g. training time, architecture modeling). Despite this, we have shown discriminative power of ANFIS for a low-difficulty box trainer task, regardless of the individual significances between MAPs. Future studies are required to confirm the findings, inclusion of new tasks, conditions and sample population.

Competence assessment of final year projects for undergraduate telecommunication students

The value of project-based learning has lead to the inclusion of project development activities in engineering courses, being the Final Year Project (FYP) the most remarkable one. Several approaches have been proposed for assessing and grading FYPs but, among them, rubrics are becoming a standard for such type of assessment. However, due to the different characteristics and orientations of the projects (some are more practically oriented, some more theoretically), and the high amount of different competences to be evaluated (knowledge, working capability, communication skills, etc.), the definition of one unique rubric suitable for the evaluation of all FYPs presented in different degree programs, is a big challenge. In a former work, the educational outcomes expected from the FYP were defined and resulted in a proposal for their assessment. Afterwards, the proposal has been tested during one year within an educational innovation-project at the Universidad Politécnica de Madrid which involved the follow-up of 8 undergraduate telecommunication students elaborating their FYPs. In this publication, our experience will be described, based on the emerging work taking place through the formalisation of the process which consisted in the following steps: i) establishment of a schedule for the whole process (publication of FYPs topics, selection of applying students and their enrolment, assignation of a jury to each FYP, elaboration and follow-up of FYPs, final report submission, oral presentation, etc.); ii) design of rubrics for each of three assessment parts: working process, final report and oral presentation; and iii) follow-up and evaluation of the involved FYPs. Finally, problems that appeared during this experience (e.g. administrative aspects, criticisms and suggestions from the students, tutors and juries involved) are discussed and some modifications in the assessment system will be proposed in order to solve or minimize these problems.