Systems and technologies for objective evaluation of technical skills in laparoscopic surgery

Minimally invasive surgery is a highly demanding surgical approach regarding technical requirements for the surgeon, who must be trained in order to perform a safe surgical intervention. Traditional surgical education in minimally invasive surgery is commonly based on subjective criteria to quantify and evaluate surgical abilities, which could be potentially unsafe for the patient. Authors, surgeons and associations are increasingly demanding the development of more objective assessment tools that can accredit surgeons as technically competent. This paper describes the state of the art in objective assessment methods of surgical skills. It gives an overview on assessment systems based on structured checklists and rating scales, surgical simulators, and instrument motion analysis. As a future work, an objective and automatic assessment method of surgical skills should be standardized as a means towards proficiency-based curricula for training in laparoscopic surgery and its certification.

Performance and Professional Skills in an Online Java Programming Course for Engineering Students

The main purpose of this work is to describe the case of an online Java Programming course for engineering students to learn computer programming and to practice other non-technicalabilities: online training, self-assessment, teamwork and use of foreign languages. It is important that students develop confidence and competence in these skills, which will be required later in their professional tasks and/or in other engineering courses (life-long learning). Furthermore, this paper presents the pedagogical methodology, the results drawn from this experience and an objective performance comparison with another conventional (face-to-face) Java course.

Soft Skills: A Comparative Analysis Between Online and Classroom Teaching

Currently the Spanish universities are making a great effort to effectively incorporate the development and assessment of generic skills in their training programs. Information and communications technologies (ICT) offer a wide range of possibilities but create uncertainty among teachers about the process and results. It is considered of interest to conduct a study to analyze the extent to which social skills like commitment, communication and teamwork are acquired by students and teachers. It seeks to ascertain the influence of the learning context, online or classroom training, in the development of these personal skills among the participants in the sample. For this study two universities have been chosen, Universidad a Distancia de Madrid (UDIMA) offering online training environment, and Universidad Politécnica de Madrid (UPM) with classroom training modality. A total of 257 individuals, 230 students and 27 teachers have answered the survey called Evalsoft. This instrument was designed in the project with the same name by a research team from Universidad Complutense of Madrid (UCM). Some interesting conclusions can be highlighted: it is in the online context where there are higher levels of commitment and teamwork than in the classroom modality; teachers have higher social skills that students and these improve with age. Sex and the training program appear to influence these social skills.

A quantitative assessment of students’ experiences of studying music: a Spanish perspective on the European credit transfer system (ECTS)

The purpose of this investigation is to evaluate whether or not the allocation of time proposed in the Music Study Guide, adapted from the European Higher Education Area (EHEA) guidelines, is consistent and adequate for students with minimal musical knowledge. The report takes into account the importance of students’ previous knowledge and the relation this has to the time and effort expended by students in acquiring appropriate knowledge and skills. This is related also to the adequacy of the course specification to meet the demands of university study and the labour market. Results show that those students who enrolled at university without any previous musical knowledge are likely to experience significant difficulty in the acquisition of certain musical and professional competences. This highlights a need to reinforce the music curriculum, or establish zero-level courses, in order to enable such students to succeed in the subject.

Mentors’ implication in clinical learning and assessment of nursing students

Nursing Education in Europe is regulated by law from 2005. Clinical learning comprises at least 50% of the total degree program in nursing. It is necessary rely on professionals nurses involved in the learning process and skills development assessment. The level of implication in learning processes of these professional nurses is very important to ensure good results.

Going global with assessment: what to do when the dominant culture's literacy drives assessment

This article explores how the dominant cultural literacy in a western context relies on a western template of knowledge that can inhibit internationalisation of the curricula unless it is identified, transformed, and broadened to become interculturally responsive. As Brian Street has said "literacies may be sites of negotiation and transform ation" (1994, p. 99). Drawing on the findings of an innovative website, Worldmarks , developed at Queensland University of Technology, as well as qualitative interviews with international students and staff, this article addresses the serious implications of assessment driven by the dominant culture's literacy. We identify how and why assessment driven by responsive cultural literacy enables all students to develop comprehensive intercultural communication skills and understandings as part of their lifelong learning in Australian universities.

Long-term oral sensitivity and feeding skills of low-risk pre-term infants

This study examined the oral sensitivity and feeding skills of low-risk pre-term infants at 11-17 months corrected age. Twenty pre-term infants (PT) born between 32 and 37 weeks at birth without any medical comorbidities were assessed. All of this PT group received supplemental nasogastric (NG) tube feeds during their birth-stay in hospital. A matched control group of 10 healthy full-term infants (FT) was also assessed. Oral sensitivity and feeding skills were assessed during a typical mealtime using the Royal Children's Hospital Oral Sensitivity Checklist (OSC) and the Pre-Speech Assessment Scale (PSAS). Results demonstrated that, at 11-17 months corrected age, the PT group displayed significantly more behaviours suggestive of altered oral sensitivity and facial defensiveness, and a trend of more delayed feeding development than the FT group. Further, results demonstrated that, relative to the FT group, pre-term infants who received greater than 3 weeks of NG feeding (PT>3NG) displayed significantly more facial defensive behaviour, and displayed significant delays across more aspects of their feeding development than pre-term infants who received less than 2 weeks of NG feeding (PT

Impact of an intensive nursing education course on nurses' knowledge, confidence, attitudes, and perceived skills in the care of patients with cancer

Purpose/Objectives: To evaluate the impact of a cancer nursing education course on RNs. Design: Quasi-experimental, longitudinal, pretest/post-test design, with a follow-up assessment six weeks after the completion of the nursing education course. Setting: Urban, nongovernment, cancer control agency in Australia. Sample: 53 RNs, of whom 93% were female, with a mean age of 44.6 years and a mean of 16.8 years of experience in nursing; 86% of the nurses resided and worked in regional areas outside of the state capital. Methods: Scales included the Intervention With Psychosocial Needs: Perceived Importance and Skill Level Scale, Palliative Care Quiz for Nurses, Breast Cancer Knowledge, Preparedness for Cancer Nursing, and Satisfaction With Learning. Data were analyzed using multiple analysis of variance and paired t tests. Main Research Variables: Cancer nursing-related knowledge, preparedness for cancer nursing, and attitudes toward and perceived skills in the psychosocial care of patients with cancer and their families. Findings: Compared to nurses in the control group, nurses who attended the nursing education course improved in their cancer nursing-related knowledge, preparedness for cancer nursing, and attitudes toward and perceived skills in the psychosocial care of patients with cancer and their families. Improvements were evident at course completion and were maintained at the six-week follow-up assessment. Conclusions: The nursing education course was effective in improving nurses' scores on all outcome variables. Implications for Nursing: Continuing nursing education courses that use intensive mode timetabling, small group learning, and a mix of teaching methods, including didactic and interactive approaches and clinical placements, are effective and have the potential to improve nursing practice in oncology.

Objective and behavioural assessment of the emergence from post-traumatic amnesia (PTA)

Primary objective: To determine the profile of resolution of typical PTA behaviours and describe new learning and improvements in self-care during PTA. Research design: Prospective longitudinal study monitoring PTA status, functional learning and behaviours on a daily basis. Methods and procedures: Participants were 69 inpatients with traumatic brain injury who were in PTA. PTA was assessed using the Westmead or Oxford PTA assessments. Functional learning capability was assessed using a routine set of daily tasks and behaviour was assessed using an observational checklist. Data was analysed using descriptive statistics. Main outcomes and results: Challenging behaviours that are typically associated with PTA, such as agitation, aggression and wandering resolved in the early stages of PTA and incidence rates of these behaviours were less than 20%. Independence in self-care and bowel and bladder continence emerged later during resolution of PTA. New learning in functional situations was demonstrated by patients in PTA. Conclusions: It is feasible to begin active rehabilitation focused on functional skills-based learning with patients in the later stages of PTA. Formal assessment of typically observed behaviours during PTA may complement memory-based PTA assessments in determining emergence from PTA.

Ecological validity in neuropsychological assessment: A case for greater consideration in research with neurologically intact populations

The focus of the discipline of neuropsychology is shifting towards a greater emphasis on understanding the relationship between assessment results and performance of everyday tasks (ecological validity). To date, the literature has highlighted the importance of this concept in the assessment of patients with brain injury or disease (e.g. in rehabilitation and forensic settings). This paper presents the argument that there is another important area in which the ecological validity of neuropsychological assessments should be considered: in clinical outcomes studies using neurologically intact participants. For example, determining the extent to which a medical procedure or intervention affects performance of everyday cognitive tasks can provide useful information that can potentially guide decision-making regarding treatment options. It is argued that tests designed with ecological validity in mind (the verisimilitude approach), as opposed to traditional tests, may be most effective at predicting everyday functioning. Explanations are proposed as to why researchers may be reluctant to use tests with verisimilitude in favor of more traditional measures. (c) 2006 National Academy of Neuropsychology. Published by Elsevier Ltd. All rights reserved.

An innovative use of the web to build graduate team skills

Successful graduates in today's competitive business environments must possess sound interpersonal skills and the ability to work effectively in team situations within, and across, disciplines. However, developing these skills within the higher education curriculum is fraught with organisational and pedagogical difficulties, with many teachers not having the skills, time or resources to facilitate productive group processes. Furthermore, many students find their teamwork experiences frustrating, demanding, conflict-ridden and unproductive. This paper brings together the perspectives and experiences of an engineer and a social scientist in a cross-disciplinary examination of the characteristics of effective teamwork skills and processes. A focus is the development and operation of 'TeamWorker', an innovative online system that helps students and staff manage their team activities and assessment. TeamWorker was created to enhance team teaching and learning processes and outcomes including team creation, administration, development and evaluation. Importantly, TeamWorker can facilitate the early identification of problematic group dynamics, thereby enabling early intervention.

'Worldmarks': Web guidelines for socially and culturally responsive assessment in university classrooms

In the early 21st century, we need to prepare university students to navigate local and global cultures effectively and sensitively. These future professionals must develop comprehensive intercultural communication skills and understanding. Yet university assessment in Australia is often based on a western template of knowledge, which automatically places International, Indigenous, as well as certain groups of local students at a study disadvantage. It also ensures that Australian students from dominant groups are not given the opportunity to develop these vital intercultural skills. This paper explores the issues embedded in themes 1 and 4 of this conference and provides details of an innovative website developed at Queensland University of Technology in Brisbane, Australia, which encourages academic staff to investigate the hidden assumptions that can underpin their assessment practices. The website also suggests strategies academics can use to ensure that their assessment becomes more socially and culturally responsive.

Ability assessment and job structure measures in occupational mobility

Recent and potential changes in technology have resulted in the anticipation of increases in the frequency of job changes. This has led manpower policy makers to investigate the feasibility of incorporating the employment skills of job groups in the general prediction of future job learning and performance with a view to the establishment of "job families" within which transfer might be considered reciprocally high. A structured job analysis instrument (the Position Analysis Questionnaire) is evaluated in terms of two distinct sets of scores; job dimensions and synthetically established attribute/trait profiles. Studies demonstrate that estimates of a job's structure/dimensions and requisite human attributes can be reliably established. Three alternative techniques of statistically assembling profiles of the requisite human attributes for jobs are found to have differential levels of reliability and differential degrees of validity in their estimation of the "actual" ability requirements of jobs. The utility of these two sets of job descriptors to serve as representations of the cognitive structure similarity of job groups is investigated in a study which simulates a job transfer situation. The central role of the index of similarity used to assess the relationship between "target" and "present" job is demonstrated. The relative extents to which job structure similarity and job attribute similariity are associated with positive transfer are investigated. The studies demonstrate that the dimensions of jobs, and more fruitfully their requisite human attributes can serve as bases to predict job transfer learning and performance. The nature of the index of similarity used to optimally formulate predictions of transfer is such that networks of jobs might be establishable to which current job incumbents could be expected to transfer positively. The derivation of "job families" with anticipated reciprocal transfer consequences is considered to be less appropriate.

Substances hazardous to health:the nature of the expertise associated with competent risk assessment

This research investigated expertise in hazardous substance risk assessment (HSRA). Competent pro-active risk assessment is needed to prevent occupational ill-health caused by hazardous substance exposure occurring in the future. In recent years there has been a strong demand for HSRA expertise and a shortage of expert practitioners. The discipline of Occupational Hygiene was identified as the key repository of knowledge and skills for HSRA and one objective of this research was to develop a method to elicit this expertise from experienced occupational hygienists. In the study of generic expertise, many methods of knowledge elicitation (KE) have been investigated, since this has been relevant to the development of 'expert systems' (thinking computers). Here, knowledge needed to be elicited from human experts, and this stage was often a bottleneck in system development, since experts could not explain the basis of their expertise. At an intermediate stage, information collected was used to structure a basic model of hazardous substance risk assessment activity (HSRA Model B) and this formed the basis of tape transcript analysis in the main study with derivation of a 'classification' and a 'performance matrix'. The study aimed to elicit the expertise of occupational hygienists and compare their performance with other health and safety professionals (occupational health physicians, occupational health nurses, health and safety practitioners and trainee health and safety inspectors), as evaluated using the matrix. As a group, the hygienists performed best in the exercise, and this group were particularly good at process elicitation and at recommending specific control measures, although the other groups also performed well in selected aspects of the matrix and the work provided useful findings and insights. From the research, two models of HSRA have been derived, an HSRA aid, together with a novel videotape KE technique and interesting research findings. The implications of this are discussed with respect to future training of HS professionals and wider application of the videotape KE method.

Classroom implications of recent research into literacy development: from predictors to assessment

We outline how research into predictors of literacy underpins the development of increasingly accurate and informative assessments. We report three studies that emphasize the crucial role of speech and auditory skills on literacy development throughout primary and secondary school. Our first study addresses the effects of early childhood middle ear infections, the potential consequences for speech processing difficulties and the impact on early literacy development. Our second study outlines how speech and auditory skills are crucially related to early literacy in normally developing readers, whereas other skills such as motor, memory and IQ are only indirectly related. Our third study outlines the on-going impact of phonological awareness on reading and wider academic achievement in secondary-school pupils. Finally, we outline how teachers can use the current research to inform them about which assessments to conduct, and how to interpret the results. Copyright © 2008 John Wiley & Sons, Ltd.