Self-assessment insufficiently predicts performance in emergency skills

Background: Residents demonstrate a broad range of performance levels for clinical skills, with some at an inadequate level. Adequate self-assessment is important for life long learning. However, its accuracy is questioned extensively. The aim of this study was to evaluate how far the residents’ self-assessment predicts their performance in an expert assessment of emergency skills. Summary of work: Twelve skills were identified as being relevant for the emergency duties of residents in smaller hospitals. Fifteen first-year residents from the departments of internal medicine and general surgery at a district hospital rated their performance on a questionnaire (self-assessment). This was followed by a structured, practical in vivo assessment by an anaesthesiologist (expert assessment). For both, a visual analogue scale from 0 to 10 was used, on which 0 stands for novice and 10 for expert. Predictive validity was described by Spearman’s correlation, which was significant in 3 out of 12 skills only. Median correlation (r) was 0.50 (range 0.16 to 0.93). Conclusion: At the beginning of postgraduate training, self-assessment alone is not sufficient to guide self-directed learning. Take-home message: At the beginning of their residency, physicians need structured feedback in emergency skills which can be offered by anaesthesiologists.

The Development of Social Work as a Speciality and the Profession in Estonia

For Estonia and its people social work is one of the vitally important fields that had to be built up from almost nothing since independence was regained in 1991. During Soviet times social work and social workers did not receive the necessary attention. Severe social problems were denied and kept hidden since according to official communist ideology, life in the Soviet Union was the best in the world and getting better all the time. Social workers did not receive specialised education and their functions were to be carried out by the workers of trade unions and the party, by teachers and by the workers of the personnel departments. In the 1990s big changes, having also an effect on social life, took place in the development of Estonian society. Concepts such as social work and social worker were rediscovered in Estonia. There are certain prerequisites for the success of any activity (including social work). One of the most important ones is being a professional, a worker with thorough preparation. Social work as an occupation requires specialised academic education, which is based on theoretical knowledge and practical skills that have been acquired through theoretical knowledge. Specialised knowledge is a foundation for attaining a specialised qualification. However, at the same time one has to keep in mind that social work as an occupation is constantly changing, there is no absolute knowledge - everything is relative, dynamic and changing (Tamm, 1998). The changing nature of the activity requires reflection by a social worker, who also has to be able to evaluate his/her work and its basis and learn from experiences. Academic specialised education implies also the development of a new professional identity and higher levels of competence. This underlines the necessity of specialised education.

Development of Values after Compulsory School: Work comes first, then family

During school-to-work transition, adolescents develop values and prioritize what is im-portant in their life. Values are concepts or beliefs about desirable states or behaviors that guide the selection or evaluation of behavior and events, and are ordered by their relative importance (Schwartz & Bilsky, 1987). Stressing the important role of values, career re-search has intensively studied the effect of values on educational decisions and early career development (e.g. Eccles, 2005; Hirschi, 2010; Rimann, Udris, & Weiss, 2000). Few re-searchers, however, have investigated so far how values develop in the early career phase and how value trajectories are influenced by individual characteristics. Values can be oriented towards specific life domains, such as work or family. Work values include intrinsic and extrinsic aspects of work (e.g., self-development, cooperation with others, income) (George & Jones, 1997). Family values include the importance of partner-ship, the creation of an own family and having children (Mayer, Kuramschew, & Trommsdroff, 2009). Research indicates that work values change considerably during early career development (Johnson, 2001; Lindsay & Knox, 1984). Individual differences in work values and value trajectories are found e.g., in relation to gender (Duffy & Sedlacek, 2007), parental background (Loughlin & Barling, 2001), personality (Lowry et al., 2012), educa-tion (Battle, 2003), and the anticipated timing of school-to-work transition (Porfeli, 2007). In contrast to work values, research on family value trajectories is rare and knowledge about the development during the school-to-work transition and early career development is lack-ing. This paper aims at filling this research gap. Focusing on family values and intrinsic work values and we expect a) family and work val-ues to change between ages 16 and 25, and b) that initial levels of family and work values as well as value change to be predicted by gender, reading literacy, ambition, and expected du-ration of education. Method. Using data from 2620 young adults (59.5% females), who participated in the Swiss longitudinal study TREE, latent growth modeling was employed to estimate the initial level and growth rate per year for work and family values. Analyses are based on TREE-waves 1 (year 2001, first year after compulsory school) to 8 (year 2010). Variables in the models included family values and intrinsic work values, gender, reading literacy, ambition and ex-pected duration of education. Language region was included as control variable. Results. Family values did not change significantly over the first four years after leaving compulsory school (mean slope = -.03, p =.36). They increased, however, significantly five years after compulsory school (mean slope = .13, p >.001). Intercept (.23, p < .001), first slope (.02, p < .001), and second slope (.01, p < .001) showed significant variance. Initial levels were higher for men and those with higher ambitions. Increases were found to be steeper for males as well as for participants with lower educational duration expectations and reading skills. Intrinsic work values increased over the first four years (mean slope =.03, p <.05) and showed a tendency to decrease in the years five to ten (mean slope = -.01, p < .10). Intercept (.21, p < .001), first slope (.01, p < .001), and second slope (.01, p < .001) showed signifi-cant variance, meaning that there are individual differences in initial levels and growth rates. Initial levels were higher for females, and those with higher ambitions, expecting longer educational pathways, and having lower reading skills. Growth rates were lower for the first phase and steeper for the second phase for males compared to females. Discussion. In general, results showed different patterns of work and family value trajecto-ries, and different individual factors related to initial levels and development after compul-sory school. Developments seem to fit to major life and career roles: in the first years after compulsory school young adults may be engaged to become established in one's job; later on, raising a family becomes more important. That we found significant gender differences in work and family trajectories may reflect attempts to overcome traditional roles, as over-all, women increase in work values and men increase in family values, resulting in an over-all trend to converge.

A project to improve the information seeking skills and increase the use of evidence-based research in public health practice

The ability of public health practitioners (PHPs) to work efficiently and effectively is negatively impacted by their lack of knowledge of the broad range of evidence-based practice information resources and tools that can be utilized to guide them in their development of health policies and programs. This project, a three-hour continuing education hands-on workshop with supporting resources, was designed to increase knowledge and skills of these resources. The workshop was presented as a pre-conference continuing education program for the Texas Public Health Association (TPHA) 2008 Annual Conference. Topics included: identification of evidence-based practice resources to aid in the development of policies and programs; identification of sources of publicly available data; utilization of data for community assessments; and accessing and searching the literature through a collection of databases available to all citizens of Texas. Supplemental resources included a blog that served as a gateway to the resources explored during the presentation, a community assessment workbook that incorporates both Healthy People 2010 objectives and links to reliable sources of data, and handouts providing additional instruction on the use of the resources covered during the workshop.^ Before- and after-workshop surveys based on Kirkpatrick's 4-level model of evaluation and the Theory of Planned Behavior were administered. Of the questions related to the trainer, the workshop, and the usefulness of the workshop, participants gave "Good" to "Excellent" responses to all one question. Confidence levels overall increased a statistically significant amount; measurements of attitude, social norms, and control showed no significant differences before and after the workshop. Lastly, participants indicated they were likely to use resources shown during the workshop within a one to three month time period on average. ^ The workshop and creation of supplemental resources served as a pilot for a funded project that will be continued with the development and delivery of four 4-week long webinar-based training sessions to be completed by December 2008. ^

Specific skills assessment learned by students of building engineering and technical architecture in topics relating to durability and control of concrete structures

In many university courses such as Building Engineering or Technical Architectural, the high density of the contents included in the curriculum, make the student, after graduation, unable to develop the skills already acquired and evaluated in the disciplines of the first courses. From the Group of Educational Innovation at the Polytechnic University of Madrid (UPM) "Teaching of Structural Concrete" (GIEHE) we have conducted a study in which are valued specific skills acquired by students after the first courses of career. We have worked with students from UPM fourth-year career and with Technical Architecture students who have completed their studies and also have completed the Adaptation Course of Technical Architecture to the Building Engineer. The work is part of the Educational Innovation Project funded by the UPM "Integration of training and assessment of generic and specific skills in structural concrete" We have evaluated specific skills learned in the areas of durability and control of structural concrete structures. The results show that overall, students are not able to fully develop the skills already acquired earlier, even being these essential to their professional development. Possibly, the large amount of content taught in these degrees together with a teaching and assessment of "flat profile", ie, which are presented and evaluated with the same intensity as the fundamental and the accessory, are causes enough to cause these results.

Systems and technologies for objective evaluation of technical skills in laparoscopic surgery

Minimally invasive surgery is a highly demanding surgical approach regarding technical requirements for the surgeon, who must be trained in order to perform a safe surgical intervention. Traditional surgical education in minimally invasive surgery is commonly based on subjective criteria to quantify and evaluate surgical abilities, which could be potentially unsafe for the patient. Authors, surgeons and associations are increasingly demanding the development of more objective assessment tools that can accredit surgeons as technically competent. This paper describes the state of the art in objective assessment methods of surgical skills. It gives an overview on assessment systems based on structured checklists and rating scales, surgical simulators, and instrument motion analysis. As a future work, an objective and automatic assessment method of surgical skills should be standardized as a means towards proficiency-based curricula for training in laparoscopic surgery and its certification.

EVA: Endoscopic Video Analysis of the surgical scene for the assessment of MIS psychomotor skills

The present work covers the first validation efforts of the EVA Tracking System for the assessment of minimally invasive surgery (MIS) psychomotor skills. Instrument movements were recorded for 42 surgeons (4 expert, 22 residents, 16 novice medical students) and analyzed for a box trainer peg transfer task. Construct validation was established for 7/9 motion analysis parameters (MAPs). Concurrent validation was determined for 8/9 MAPs against the TrEndo Tracking System. Finally, automatic determination of surgical proficiency based on the MAPs was sought by 3 different approaches to supervised classification (LDA, SVM, ANFIS), with accuracy results of 61.9%, 83.3% and 80.9% respectively. Results not only reflect on the validation of EVA for skills? assessment, but also on the relevance of motion analysis of instruments in the determination of surgical competence.

Developing transferable skills through academic motivation activities

The purpose of this study is to work out how a clear and motivated task goal set for the students can develop several skills that are not only useful in their specific academic contexts but also serve to reinforce links and cooperation with the labor market. The following research on skills was taken during one academic year. The students collected advertisements likely to be selected in a near future by themselves as possibilities to apply for a job. The advertisements selected were 120, and all of them were published on the internet either in jobs links or located by the students themselves in the web-practices of their choice. All the advertisements chosen by the students provided us with a skill list focused on architectural profiles. To conclude, academic research skills versus future motivation jobs positions are fruitful paths to conduct successful students´response at job interviews.

Do Classes in Cooperative Classrooms Have a Positive Influence on Creativity and Teamwork Skills for Engineering Students?

Contributing to the acquisition of professional creativity and teamwork skills has been a special challenge for some of the subjects taught at the Technical University of Madrid (UPM), and this has been a starting point for the work described in this paper. Some professors have intuited that the use of cooperative classrooms could facilitate the acquisition of these skills. We describe the new methodologies applied within cooperative classrooms by some professors, and present the procedure for measuring students’ perception of their own learning outcomes, skill improvements, and overall satisfaction with the use of this kind of classroom. For this project, 250 students enrolled in several subjects answered a questionnaire. The featuresof thesubjectsinvolved intheproject arewidely disparate. We present the results of the statistical analysis with special emphasis on creativity and teamwork skills, and we conclude that the use of cooperative classroom has a positive influence on the acquisition of these skills. This work has the added value of being the first analysis of student perception of the use of cooperative classroom in the acquisition of creativity and teamwork skills.

Performance and Professional Skills in an Online Java Programming Course for Engineering Students

The main purpose of this work is to describe the case of an online Java Programming course for engineering students to learn computer programming and to practice other non-technicalabilities: online training, self-assessment, teamwork and use of foreign languages. It is important that students develop confidence and competence in these skills, which will be required later in their professional tasks and/or in other engineering courses (life-long learning). Furthermore, this paper presents the pedagogical methodology, the results drawn from this experience and an objective performance comparison with another conventional (face-to-face) Java course.

Assessment of University External Internships. Towards a Mixed Model for Measuring the Acquisition of Skills and the Satisfaction of Parties Involved

The continuous improvement of management and assessment processes for curricular external internships has led a group of university teachers specialised in this area to develop a mixed model of measurement that combines the verification of skill acquisition by those students choosing external internships with the satisfaction of the parties involved in that process. They included academics, educational tutors of companies and organisations and administration and services personnel in the latter category. The experience, developed within University of Alicante, has been carried out in the degrees of Business Administration and Management, Business Studies, Economics, Advertising and Public Relations, Sociology and Social Work, all part of the Faculty of Economics and Business. By designing and managing closed standardised interviews and other research tools, validated outside the centre, a system of continuous improvement and quality assurance has been created, clearly contributing to the gradual increase in the number of students with internships in this Faculty, as well as to the improvement in satisfaction, efficiency and efficacy indicators at a global level. As this experience of educational innovation has shown, the acquisition of curricular knowledge, skills, abilities and competences by the students is directly correlated with the satisfaction of those parties involved in a process that takes the student beyond the physical borders of a university campus. Ensuring the latter is a task made easier by the implementation of a mixed assessment method, combining continuous and final assessment, and characterised by its rigorousness and simple management. This report presents that model, subject in turn to a persistent and continuous control, a model all parties involved in the external internships are taking part of. Its short-term results imply an increase, estimated at 15% for the last course, in the number of students choosing curricular internships and, for the medium and long-term, a major interweaving between the academic world and its social and productive environment, both in the business and institutional areas. The potentiality of this assessment model does not lie only in the quality of its measurement tools, but also in the effects from its use in the various groups and in the actions that are carried out as a result of its implementation and which, without any doubt and as it is shown below, are the real guarantee of a continuous improvement.

Development of multidisciplinary workshops between different subjects as an innovative teaching methodology for the acquisition of professional skills of the future architect

The implantation of the new Architecture Degree and the important normative changes in the building sector imply the need to use new teaching methodologies that enhance skills and competences in order to response to the increasing requirements demanded by society to the future architect. The aim of this paper is to present, analyze and discuss the development of multidisciplinary workshops as a new teaching methodology used in several Construction subjects of the Architecture Degree in the University of Alicante. Workshops conceived with the aim to synthesize and complement the technical knowledge acquired by the students during the Degree and to enhance the skills and competencies necessary for the professional practice. With that purpose, we decided to experiment on current subjects of the degree during this academic year, by applying the requirements defined in the future Architecture Degree in a practical way, through workshops between different subjects, superposing the technical knowledge with the resolution of constructive problems in the development of an architectural project. Developing these workshops between subjects we can dissolve the traditional boundaries between different areas of the Degree. This multidisciplinary workshop methodology allows the use of all the global knowledge acquired by students during their studies and at the same time, it enhances students’ ability to communicate and discuss their ideas and solutions in public. It also increases their capacity of self-criticism, and it foments their ability to undertake learning strategies and research in an autonomous way. The used methodology is based on the development of a practical work common to several subjects of different knowledge areas within the "Technology Block" of the future Architecture Degree. Thus, students work approaching the problem in a global way discussing simultaneously with teachers from different areas. By using these new workshops we stimulate an interactive class versus a traditional lecture. Work is evaluated continuously, valuing the participative pupil´s attitude, working in groups in class time, reaching weekly objectives and stimulating the individual responsibility and positive interdependence of the pupil inside the working group. The exercises are designed to improve students’ ability to transmit their ideas and solutions in public, knowing how to discuss and defend their technical resolutions to peers and teachers (Peer Reviewing), their capacity for self-criticism and their capacity to undertake strategies and autonomous learning processes at the same time they develop a personal research into new technologies, systems and materials. Students have shown their majority preference for this teaching methodology by the multidisciplinary workshops offered in the last years, with very satisfactory academic results. In conclusion, it can be verified nowadays the viability of the introduction of new contents and new teaching methodologies necessary for the acquisition of the skills in the future Architecture Degree, through workshops between several subjects that have had a great acceptance in students and positive contrasted academic results.

Is video-case an efficient tool to complement the practical learning in real contexts? Effects on satisfaction and performance in Social Work Degree students

Este documento es un artículo inédito que ha sido aceptado para su publicación. Como un servicio a sus autores y lectores, Alternativas. Cuadernos de trabajo social proporciona online esta edición preliminar. El manuscrito puede sufrir alteraciones tras la edición y corrección de pruebas, antes de su publicación definitiva. Los posibles cambios no afectarán en ningún caso a la información contenida en esta hoja, ni a lo esencial del contenido del artículo.

Actual and preferred work activites of mental health Occupational Therapists: Congruence or Discrepancy

The reform of Australian mental health services has resulted in new models of care and changed work practices for all mental health professionals. Occupational therapists today are as likely to be working in multidisciplinary teams performing a range of generic clinical roles as they are to be working in specialist rehabilitation units. These kinds of changes have taken place in other countries, with anecdotal and some empirical evidence that the changes have resulted in concerns about loss of professional identity and roles. This study sought to identify the current work activities carried out by occupational therapists and to determine whether there was a discrepancy between their actual and desired work activities. It was expected that, overall, they would indicate a preference to do more specialist rehabilitation focused work and less generic case management work. A survey of 196 occupational therapists investigated their actual and preferred work activities in 55 specific roles across four broad categories (senior administration, specialist clinical, general clinical and community development). As expected, the participants indicated that they would prefer to be undertaking more specialist rehabilitation oriented work activities than they were actually doing. Contrary to expectations, they also wished to undertake more rather than less generic clinical work activities, to be more engaged in community development work and to take on more senior and administrative roles. They indicated a preference for less rather than more activity on only 5 of the 55 work roles examined. On examining a subset of 113 participants who reported that 50% or more of their time was spent in case management, there was greater evidence of resistance to generic clinical roles. It was therefore concluded that occupational therapists in Australia are seeking to deploy their specialist skills to a greater degree than the current practice environment permits. They have broadly accepted the generic roles required in multidisciplinary community case management, but those who are actually working in these roles are most likely to have reservations about this kind of work.

Work activities of occupational therapists in Australian mental health services

The aim of this study was to obtain a profile of occupational therapists’ work activities in contemporary Australian mental health services so as to better understand the specific contribution of this profession. The study also aimed to determine whether or not actual work activity was congruent with the preferred roles of occupational therapists. A cross-sectional survey of 196 occupational therapists working in mental health was conducted. For the purposes of the study, a new instrument was developed that evaluated both actual and preferred work roles in four broad categories: administrative, general clinical skills, specialist clinical skills and community development. Respondents were engaged in a greater proportion of generic than discipline-specific work activities. They reported a preference for higher levels of activity in each of the work categories. These findings suggest that, contrary to some previous reports, not only are occupational therapists in Australia engaged in a broad spectrum of non-specialist mental health work activities, but these activities are mostly congruent with their expectations and wishes.