An electronic portfolio for quantitative assessment of surgical skills in undergraduate medical education.

BACKGROUND We evaluated a newly designed electronic portfolio (e-Portfolio) that provided quantitative evaluation of surgical skills. Medical students at the University of Seville used the e-Portfolio on a voluntary basis for evaluation of their performance in undergraduate surgical subjects. METHODS Our new web-based e-Portfolio was designed to evaluate surgical practical knowledge and skills targets. Students recorded each activity on a form, attached evidence, and added their reflections. Students self-assessed their practical knowledge using qualitative criteria (yes/no), and graded their skills according to complexity (basic/advanced) and participation (observer/assistant/independent). A numerical value was assigned to each activity, and the values of all activities were summated to obtain the total score. The application automatically displayed quantitative feedback. We performed qualitative evaluation of the perceived usefulness of the e-Portfolio and quantitative evaluation of the targets achieved. RESULTS Thirty-seven of 112 students (33%) used the e-Portfolio, of which 87% reported that they understood the methodology of the portfolio. All students reported an improved understanding of their learning objectives resulting from the numerical visualization of progress, all students reported that the quantitative feedback encouraged their learning, and 79% of students felt that their teachers were more available because they were using the e-Portfolio. Only 51.3% of students reported that the reflective aspects of learning were useful. Individual students achieved a maximum of 65% of the total targets and 87% of the skills targets. The mean total score was 345 ± 38 points. For basic skills, 92% of students achieved the maximum score for participation as an independent operator, and all achieved the maximum scores for participation as an observer and assistant. For complex skills, 62% of students achieved the maximum score for participation as an independent operator, and 98% achieved the maximum scores for participation as an observer or assistant. CONCLUSIONS Medical students reported that use of an electronic portfolio that provided quantitative feedback on their progress was useful when the number and complexity of targets were appropriate, but not when the portfolio offered only formative evaluations based on reflection. Students felt that use of the e-Portfolio guided their learning process by indicating knowledge gaps to themselves and teachers.

An electronic portfolio for quantitative assessment of surgical skills in undergraduate medical education.

BACKGROUND We evaluated a newly designed electronic portfolio (e-Portfolio) that provided quantitative evaluation of surgical skills. Medical students at the University of Seville used the e-Portfolio on a voluntary basis for evaluation of their performance in undergraduate surgical subjects. METHODS Our new web-based e-Portfolio was designed to evaluate surgical practical knowledge and skills targets. Students recorded each activity on a form, attached evidence, and added their reflections. Students self-assessed their practical knowledge using qualitative criteria (yes/no), and graded their skills according to complexity (basic/advanced) and participation (observer/assistant/independent). A numerical value was assigned to each activity, and the values of all activities were summated to obtain the total score. The application automatically displayed quantitative feedback. We performed qualitative evaluation of the perceived usefulness of the e-Portfolio and quantitative evaluation of the targets achieved. RESULTS Thirty-seven of 112 students (33%) used the e-Portfolio, of which 87% reported that they understood the methodology of the portfolio. All students reported an improved understanding of their learning objectives resulting from the numerical visualization of progress, all students reported that the quantitative feedback encouraged their learning, and 79% of students felt that their teachers were more available because they were using the e-Portfolio. Only 51.3% of students reported that the reflective aspects of learning were useful. Individual students achieved a maximum of 65% of the total targets and 87% of the skills targets. The mean total score was 345 ± 38 points. For basic skills, 92% of students achieved the maximum score for participation as an independent operator, and all achieved the maximum scores for participation as an observer and assistant. For complex skills, 62% of students achieved the maximum score for participation as an independent operator, and 98% achieved the maximum scores for participation as an observer or assistant. CONCLUSIONS Medical students reported that use of an electronic portfolio that provided quantitative feedback on their progress was useful when the number and complexity of targets were appropriate, but not when the portfolio offered only formative evaluations based on reflection. Students felt that use of the e-Portfolio guided their learning process by indicating knowledge gaps to themselves and teachers.

The sustainability of a Spanish Regional Virtual Library

Objectives: The Andalusian Health e-Library (BV-SSPA) is the National Health Library in the region of Andalusia (Spain). It is a corporate hospital library created in 2006. The year 2012 is a turning point for the Spanish economy, and the BV-SSPA has to demonstrate that it is cost-effective and sustainable. Methods: Andalusia is a wide Spanish region with more than 8 million inhabitants, more than 100,000 health professionals for 41 hospitals, 1,500 primary health care centers, and 28 centers for nonmedical attention purposes, and the BV-SSPA was created to cover all these health services. It was appointed the only intermediary for contracting electronic resources destined to the Andalusian Health System. Hospitals are not allowed to subscribe any resources, and the same services are offered for the whole system. Results: In 2011, the BV-SSPA reached the biggest electronic health sciences resource collection in Spain: a total amount of 2,431 subscribed titles, besides 8 databases and other scientific information resources. The following goals were also achieved: • Cost-effectiveness: In 2011, the BV-SSPA represented a saving percentage of 25.42% compared to the individual hospital subscription costs if they would have continued their contracting. • Efficiency: Central purchasing has meant for the Andalusian health professionals, the democracy of research resource access. Some services were also created: • integrated and safe remote access to all the library resources independent of the user’s location • citizenship website, where the resources for citizenship are grouped • Centralized Document Supply Service, focusing all the article orders from and for the Andalusian Health System • institutional repository, which contains the whole intellectual, scientific production generated by the Andalusian health professionals • computer application to study the Andalusian health system scientific production • Social media as instrument for communicating with users • science web, a defined space for researchers. Conclusions: Although Andalusia is facing a dreadful economic situation, the BV-SSPA has demonstrated its sustainability: • For 2012 renewals, it carried out a statistics study allowing obtaining enough data for deciding which titles were not being discharged by users. • Titles with no discharges or without impact factor were rejected after strong negotiation with suppliers, as the BV-SSPA after 6 years on, is considered a strong dealer by them. • This meant savings of 14% from the original budget for 2012, which allowed the continuity of the BV-SSPA without decreasing the quality offered to their users.

How to manage a virtual library?

Introduction. The Andalusian Public Health System Virtual Library (Biblioteca Virtual del Sistema Sanitario Público de Andalucía, BV-SSPA) was created in June 2006, after being determined by the II Quality Plan in the key process Guarantee the Knowledge Exchange into the Health System which was established by the Strategy IV, Knowledge Management, 2005-2008. It is a government strategy with its own budget and management with the aim of rationalizing the subscriptions into the Andalusian Health System and democratizing the health professional access to qualify scientific information, regardless of the professional workplace. Andalusia is a wide region with more than 8 million inhabitants, more than 90,000 health professionals for 41 hospitals, 1,500 primary healthcare centres, and 12 centres for non-medical attention purposes, and the Virtual Library was created to cover all this Health Services. Before the creation of the BV-SSPA every centre had its own budget and management decisions concerning scientific resources, with the creation of the BV-SSPA both management and budget were centralized. Objectives. With this work we pretend to analyze if the results after these five years have reached the expectations from an economic point of view and determine if really we can offer a benefit to the Andalusian Professional and Society in general. We will demonstrate the following: - The BV-SSPA supposed a cost reduction. It meant cost-effectiveness. - It resulted in Economics of Scale, as we have every year more resources and services investing a minor proportional amount of money. - In terms of Efficiency it implemented more services than the System had before its creation, we a lower budget. Methods. The BV-SSPA was appointed the only intermediary for contracting electronic resources destined to the Andalusian Health System. This had some consequences which should be analyzed: - Hospitals were not allowed to subscribe any resources. - Services offered for the whole System. - A remote access system was created. - Tools to give more visibility to the Public Health System were developed. - Negotiations techniques changed as the BV-SSPA is stronger than individual hospitals. Results. - The amount of 2,431 electronic reviews, 8 data bases and other scientific information resources at the disposal of the Andalusian Health System Professionals and available worldwide requiring only an internet connection. Before the BV-SSPA, 5,267 titles were subscribed by hospital and 2,967 of them were subscribed repeatedly (by two or more hospitals), this represented more than 55%. The rationalization of the subscription investment has been reached. - The establishment of several important scientific services for the whole territory of Andalusia, not only big hospitals. - The use of appropriate tools through a Web 2.0 and Social Media to be acknowledged by most National Health Professionals. Conclusions. It has been demonstrated that the BV-SSPA has become the Central Unit for purchasing, offering librarian services and a reference for users in terms of knowledge management, but from the point of view of business it has also obtained the following results: - Cost-Effectiveness: Its budget for subscriptions is lower than the hospital former one in a 30% and now more electronic resources are available. - Economics of Scale: Near 95,000 health professionals can access this Virtual Library in 2010. Before its creation Professionals for small hospital and Primary Care centres were not able to access to scientific information subscribed by big hospitals. - Efficiency Besides the central electronic purchasing, services were created for the System, without increasing the expenses: - Remote access to all the library resources independent of the user’s location. The BV-SSPA usage increased in a 147% in 2008, when it was installed. - The Document Supply Service implemented in 2009. - The Institutional Repository which contains the whole intellectual, scientific production generated by the Andalusian Public Health Professionals as a result of their healthcare, research or managing activity. - The creation of an application developed by the BV-SSPA to study the Andalusian Health System Scientific Production. - The visibility of the Andalusian Health System reached thanks to the BV-SSPA, through the numerous events in which it participates and organizes such as the 2nd. European National Digital Libraries of Health Conferences and the National Conference of Health Science Information and Documentation held in Cadiz in 2010; and its profile in social media where it can be contacted by citizens and health professionals all over the world. - Negotiation with electronic resource suppliers is much more advantageous as the BV-SSPA is stronger to deal with them thanks to its consolidated budget, its managing independence and its visibility.

Negotiation Techniques in a Digital Library

The Andalusian eHealth Library (Biblioteca Virtual del Sistema Sanitario Público de Andalucía, BV-SSPA), created in June 2006 as a strategic action of the Andalusian Government with the aim of becoming the engine for the knowledge management of the health system in the region, has meant a radical change of mind in the way libraries can be managed: - As a regional library, it coordinates the 42 document library centers of the hospital network. - It is an organization in charge of its own budget and management. - It is the only intermediary for contracting health science resources. These factors have empowered the library in its dealings with other organizations such as stakeholders, suppliers, universities, etc. The centralization of the purchasing and the librarian network has made this library strong enough to deal with the economic recession and budgetary problems.

Análisis de contenidos de páginas web sobre servicios de control de plagas en salud pública

Introduction: Our goal was to know the web contents and examine the technical information pest control services available to users through their webpages. Method: A total of 70 webpages from biocides services in the province of Málaga (Spain) were analyzed. We used 15 evaluation indicators grouped into 5 parameters relating to data of the service provider; information’s reliability and services; accuracy of content and writing style; technical resources and interaction with the users. As test instruments were used sectoral legislation, official records of products and deliveries, standards and technical guides. Results: Companies showed a remarkable degree of awareness with the implementation and use of new technologies. Aspects negative that they can have an impact on the confidence of users, relating to the reliability of the information and deficiencies associated with the description of the services portfolio and credentials of the companies were identified. The integration and use of collaborative platforms 2.0 was poorly developed and squandered. Discussion: It is possible to improve the trust of users intervening in those aspects that affect the reliability of the information provided on the web.