Improving assessment management using tools

This paper firstly explains the importance of assessment management, then introduces two assessment tools currently used in the School of Information Technology at Deakin University. A comparison of assignment marking was conducted after collecting test data from three sets of assignments. The importance of providing detailed marking guides and personalized comments is emphasized and future possible extension to the tools is also discussed at the end of this paper.

Improving risk assessment in schizophrenia: epidemiological investigation of criminal history factors

Background : Violence risk assessment in schizophrenia relies heavily on criminal history factors.

Aims : To investigate which criminal history factors are most strongly associated with violent crime in schizophrenia.

Method : A total of 13 806 individuals (8891 men and 4915 women) with two or more hospital admissions for schizophrenia were followed up for violent convictions. Multivariate hazard ratios for 15 criminal history factors included in different risk assessment tools were calculated. The incremental predictive validity of these factors was estimated using tests of discrimination, calibration and reclassification.

Results : Over a mean follow-up of 12.0 years, 17.3% of men (n = 1535) and 5.7% of women (n = 281) were convicted of a violent offence. Criminal history factors most strongly associated with subsequent violence for both men and women were a previous conviction for a violent offence; for assault, illegal threats and/or intimidation; and imprisonment. However, only a previous conviction for a violent offence was associated with incremental predictive validity in both genders following adjustment for young age and comorbid substance use disorder.

Conclusions : Clinical and actuarial approaches to assess violence risk can be improved if included risk factors are tested using multiple measures of performance.

Sleep quality, the neglected outcome variable in clinical studies focusing on locomotor system; a construct validation study

In addition to general health and pain, sleep is highly relevant to judging the well-being of an individual. Of these three important outcome variables, however, sleep is neglected in most outcome studies.Sleep is a very important resource for recovery from daily stresses and strains, and any alteration of sleep will likely affect mental and physical health, especially during disease. Sleep assessment therefore should be standard in all population-based or clinical studies focusing on the locomotor system. Yet current sleep assessment tools are either too long or too specific for general use.

A methodologic study of pain assessment in Anglo and Hispanic children with cancer

There is growing clinical evidence that even young children experience pain and accompanying anxiety. Few instruments have been validated to assess pain characteristics in children. The study of related demographic, illness, psychologic and parental factors in children has also been limited. This study examines the reliability and validity of pain assessment tools in an outpatient pediatric cancer population. A total of 78 children from three to fifteen years of age were observed and interviewed about the pain of invasive procedures. The effect of cultural factors and the stress of acculturation were examined by comparing data from two cultural groups, Anglo and Hispanic.^ Spielberger State-Trait Anxiety Scales were administered to children and parents prior to an invasive procedure. The Procedure Behavioral Checklist (PBCL) was used for observation of the child's response during the procedure. The Children's Procedural Interview (CPI) which contains items on the PBCL and visual analogues (scales of faces indicating varying degrees of pain and anxiety) was administered following the procedure.^ Reliability coefficients for Anglos were.78 on the PBCL,.79 on the CPI and.85 on the visual analogue scales. For Hispanics, the reliability for the PBCL was.54, while the CPI had a reliability of.72 and the visual analogue scales,.87. Construct validity was demonstrated by high correlations between the PBCL and CPI scores for both ethnic groups (.66 for Anglos and.64 for Hispanics) and by the significant correlation of State anxiety scores with both PBCL and CPI scores. Age was inversely correlated with PBCL and CPI scores for both ethnic groups. Hispanic parents' anxiety scores were higher than Anglo parents, but were not highly correlated with their child's PBCL, CPI or State-Trait anxiety scores. Caregivers' ratings were correlated with the PBCL scores for Anglos but not for Hispanics.^ The findings of this study indicate that pain responses may be reliably assessed using both observational and self-report methods in children, though differences in Anglo and Hispanic cultures exist. Differences in pain symptomatology and assessment in the two cultural groups warrant further study. ^

Patient-oriented computerized clinical guidelines for mobile decision support in gestational diabetes

The risks associated with gestational diabetes (GD) can be reduced with an active treatment able to improve glycemic control. Advances in mobile health can provide new patient-centric models for GD to create personalized health care services, increase patient independence and improve patients’ self-management capabilities, and potentially improve their treatment compliance. In these models, decision-support functions play an essential role. The telemedicine system MobiGuide provides personalized medical decision support for GD patients that is based on computerized clinical guidelines and adapted to a mobile environment. The patient’s access to the system is supported by a smartphone-based application that enhances the efficiency and ease of use of the system. We formalized the GD guideline into a computer-interpretable guideline (CIG). We identified several workflows that provide decision-support functionalities to patients and 4 types of personalized advice to be delivered through a mobile application at home, which is a preliminary step to providing decision-support tools in a telemedicine system: (1) therapy, to help patients to comply with medical prescriptions; (2) monitoring, to help patients to comply with monitoring instructions; (3) clinical assessment, to inform patients about their health conditions; and (4) upcoming events, to deal with patients’ personal context or special events. The whole process to specify patient-oriented decision support functionalities ensures that it is based on the knowledge contained in the GD clinical guideline and thus follows evidence-based recommendations but at the same time is patient-oriented, which could enhance clinical outcomes and patients’ acceptance of the whole system.

Robotic Outcome Assessment in a Non-Human Primate Model of Middle Cerebral Artery Stroke

Stroke is a prevalent disorder with immense socioeconomic impact. A variety of chronic neurological deficits result from stroke. In particular, sensorimotor deficits are a significant barrier to achieving post-stroke independence. Unfortunately, the majority of pre-clinical studies that show improved outcomes in animal stroke models have failed in clinical trials. Pre-clinical studies using non-human primate (NHP) stroke models prior to initiating human trials are a potential step to improving translation from animal studies to clinical trials. Robotic assessment tools represent a quantitative, reliable, and reproducible means to assess reaching behaviour following stroke in both humans and NHPs. We investigated the use of robotic technology to assess sensorimotor impairments in NHPs following middle cerebral artery occlusion (MCAO). Two cynomolgus macaques underwent transient MCAO for 90 minutes. Approximately 1.5 years following the procedure these NHPs and two non-stroke control monkeys were trained in a reaching task with both arms in the KINARM exoskeleton. This robot permits elbow and shoulder movements in the horizontal plane. The task required NHPs to make reaching movements from a centrally positioned start target to 1 of 8 peripheral targets uniformly distributed around the first target. We analyzed four movement parameters: reaction time, movement time (MT), initial direction error (IDE), and number of speed maxima to characterize sensorimotor deficiencies. We hypothesized reduced performance in these attributes during a neurobehavioural task with the paretic limb of NHPs following MCAO compared to controls. Reaching movements in the non-affected limbs of control and experimental NHPs showed bell-shaped velocity profiles. In contrast, the reaching movements with the affected limbs were highly variable. We found distinctive patterns in MT, IDE, and number of speed peaks between control and experimental monkeys and between limbs of NHPs with MCAO. NHPs with MCAO demonstrated more speed peaks, longer MTs, and greater IDE in their paretic limb compared to controls. These initial results qualitatively match human stroke subjects’ performance, suggesting that robotic neurobehavioural assessment in NHPs with stroke is feasible and could have translational relevance in subsequent human studies. Further studies will be necessary to replicate and expand on these preliminary findings.

Robotic Outcome Assessment in a Non-Human Primate Model of Middle Cerebral Artery Stroke

Stroke is a prevalent disorder with immense socioeconomic impact. A variety of chronic neurological deficits result from stroke. In particular, sensorimotor deficits are a significant barrier to achieving post-stroke independence. Unfortunately, the majority of pre-clinical studies that show improved outcomes in animal stroke models have failed in clinical trials. Pre-clinical studies using non-human primate (NHP) stroke models prior to initiating human trials are a potential step to improving translation from animal studies to clinical trials. Robotic assessment tools represent a quantitative, reliable, and reproducible means to assess reaching behaviour following stroke in both humans and NHPs. We investigated the use of robotic technology to assess sensorimotor impairments in NHPs following middle cerebral artery occlusion (MCAO). Two cynomolgus macaques underwent transient MCAO for 90 minutes. Approximately 1.5 years following the procedure these NHPs and two non-stroke control monkeys were trained in a reaching task with both arms in the KINARM exoskeleton. This robot permits elbow and shoulder movements in the horizontal plane. The task required NHPs to make reaching movements from a centrally positioned start target to 1 of 8 peripheral targets uniformly distributed around the first target. We analyzed four movement parameters: reaction time, movement time (MT), initial direction error (IDE), and number of speed maxima to characterize sensorimotor deficiencies. We hypothesized reduced performance in these attributes during a neurobehavioural task with the paretic limb of NHPs following MCAO compared to controls. Reaching movements in the non-affected limbs of control and experimental NHPs showed bell-shaped velocity profiles. In contrast, the reaching movements with the affected limbs were highly variable. We found distinctive patterns in MT, IDE, and number of speed peaks between control and experimental monkeys and between limbs of NHPs with MCAO. NHPs with MCAO demonstrated more speed peaks, longer MTs, and greater IDE in their paretic limb compared to controls. These initial results qualitatively match human stroke subjects’ performance, suggesting that robotic neurobehavioural assessment in NHPs with stroke is feasible and could have translational relevance in subsequent human studies. Further studies will be necessary to replicate and expand on these preliminary findings.

Testing the psychometric properties of two self-report clinical competence scales for nursing students.

Background: It is important to assess the clinical competence of nursing students to gauge their educational needs. Competence can be measured by self-assessment tools; however, Anema and McCoy (2010) contend that currently available measures should be further psychometrically tested.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.
Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to investigate structural validity and scale properties; convergent and discriminant validity and reliability were also tested for each scale.
Results: MSA analysis identified that the NCQ is a unidimensional scale with strong scale scalability coefficients Hs =0.581; but limited item rankability HT =0.367. The SECP scale MSA suggested that the scale could be potentially split into two unidimensional scales (SECP28 and SECP7), each with good/reasonable scalablity psychometric properties as summed scales but negligible/very limited scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/SECP scores produced evidence of discriminant and convergent validity; good internal reliability was also found: NCQ α = 0.93, SECP28 α = 0.96 and SECP7 α=0.89.

Discussion: In line with previous research further evidence of the NCQ’s reliability and validity was demonstrated. However, as the SECP findings are new and the sample small with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.
Conclusions: Measurement of perceived self-competence could start early in a nursing programme to support students’ development of clinical competence. Further testing of the SECP scale with larger nursing student samples from different programme years is indicated.

References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

French good practice guidelines for management of the risk of low back pain among workers exposed to manual material handling: Hierarchical strategy of risk assessment of work situations

International audience

Adaptação de um instrumento de rastreio cognitivo, o MoCA (Montreal Cognitive Assessment) para população cabo-verdiana

Dissertação de Mestrado, Neurociências Cognitivas e Neuropsicologia, Faculdade de Ciências Humanas e Sociais, Universidade do Algarve, 2016

Assessment of simulated clinical skills and distance students: can we do it better?

Australian universities have traditionally been able to supplement clinical education, for undergraduate nursing courses, delivered on placement with weekly clinical teaching in the simulated environment. The Objective Structured Clinical Assessment (OSCA) tool has been used in this simulated environment to assess clinical skills. Recently, however, online delivery of undergraduate nursing courses has become more common. The move from an internal mode of teaching to an online external mode is seen worldwide and poses challenges to staff and students as well as changing the teaching and learning culture of institutions (Philip and Wozniak, 2009). This cultural shift and the resulting diminishing timeframe for students to acquire and practice simulated clinical skills imply that it may become necessary to rethink assessment forms such as the OSCA assessment. This study examines whether or not the OSCA tool developed by Bujack et al. (1991a) is the best tool to be used in this new context, where online teaching is supplemented by very short, annual, intensive periods of study. Skills acquisition theories dictate that time is required to produce an ideal skills acquisition environment (Quinn, 2000) but the time constraints placed on students in such intensive periods of study could influence skills acquisition. This cross-sectional qualitative study used semi-structured interviews and focus groups to collect data. 65% of the nursing faculty participated in the study. The teaching of the Bachelor of Nursing (BN) occurred on two campuses and staff from both areas participated. This group of nurse academics was employed across the range of academic levels (from lecturer to professor) at the University. Data analysis followed a generic thematic analysis framework. Findings in this study show that there are a variety of attitudes and underpinning beliefs amongst staff in relation to the OSCAs. Doubts were raised in regard to the suitability of the use of the OSCA tool in this setting. It also became apparent during this study that the OSCA tool possibly serves purposes other than an assessment tool.

A psychometric comparison of the Toronto Alexithymia Scale (TAS-20) and the Observer Alexithymia Scale (OAS) in an alcohol-dependent sample

Alexithymia is characterised by deficits in emotional insight and self reflection, that impact on the efficacy of psychological treatments. Given the high prevalence of alexithymia in Alcohol Use Disorders, valid assessment tools are critical. The majority of research on the relationship between alexithymia and alcohol-dependence has employed the self-administered Toronto Alexithymia Scale (TAS-20). The Observer Alexithymia Scale (OAS) has also been recommended. The aim of the present study was to assess the validity and reliability of the OAS and the TAS-20 in an alcohol-dependent sample. Two hundred and ten alcohol-dependent participants in an outpatient Cognitive Behavioral Treatment program were administered the TAS-20 at assessment and upon treatment completion at 12 weeks. Clinical psychologists provided observer assessment data for a subsample of 159 patients. The findings confirmed acceptable internal consistency, test-retest reliability and scale homogeneity for both the OAS and TAS-20, except for the low internal consistency of the TAS-20 EOT scale. The TAS-20 was more strongly associated with alcohol problems than the OAS.

Part 1. Chemical and Physical Restraints in the Management of Mechanically Ventilated Patients in the ICU: Contributing Factors

Chemical and physical restraints are frequently used in the intensive care unit (ICU) to control agitated patients and to prevent self-harm and unplanned extubations. Published work relating to the numerous issues of the care and treatment strategies for these patients remains conflicting and unclear. Literature regarding sedation and chemical restraint reveals a trend towards management with lighter sedation, use of sedation assessment tools and sedation protocols. It remains unclear which treatment is best for agitated and delirious patients, and the evidence on the effect of sedation is conflicting. A large portion of the literature on the use of physical restraint is from general hospital wards and residential homes, and not from the ICU environment. The purpose of this paper is to provide a summary of the existing literature on the use of physical and chemical restraints in the ICU setting. In Part 1 of this two-part paper, the evidence on chemical and physical restraints is explored with specific focus on definition of terms, unplanned

An environmental assessment model for knowledge-based urban development

Purpose – In recent years, knowledge-based urban development (KBUD) has introduced as a new strategic development approach for the regeneration of industrial cities. It aims to create a knowledge city consists of planning strategies, IT networks and infrastructures that achieved through supporting the continuous creation, sharing, evaluation, renewal and update of knowledge. Improving urban amenities and ecosystem services by creating sustainable urban environment is one of the fundamental components for KBUD. In this context, environmental assessment plays an important role in adjusting urban environment and economic development towards a sustainable way. The purpose of this paper is to present the role of assessment tools for environmental decision making process of knowledge cities. Design/methodology/approach – The paper proposes a new assessment tool to figure a template of a decision support system which will enable to evaluate the possible environmental impacts in an existing and future urban context. The paper presents the methodology of the proposed model named ‘ASSURE’ which consists of four main phases. Originality/value –The proposed model provides a useful guidance to evaluate the urban development and its environmental impacts to achieve sustainable knowledge-based urban futures. Practical implications – The proposed model will be an innovative approach to provide the resilience and function of urban natural systems secure against the environmental changes while maintaining the economic development of cities.

Review of refugee mental health assessment: Best practices and recommendations

This article focuses on mental health assessment of refugees in clinical, educational and administrative-legal settings in order to synthesise research and practice designed to enhance and promote further development of culturally appropriate clinical assessment services during the refugee resettlement process. It specifically surveys research published over the last 25 years into the development, reliability measurement and validity testing of assessment instruments, which have been used with children, adolescents and adults from refugee backgrounds, prior to or following their arrival in a resettlement country, to determine whether the instruments meet established crosscultural standards of conceptual, functional, linguistic, technical and normative equivalence. The findings suggest that, although attempts have been made to develop internally reliable, appropriately normed tests for use with refugees from diverse cultural and linguistic backgrounds, matters of conceptual and linguistic equivalence and test–retest reliability are often overlooked. Implications of these oversights for underreporting refugees' mental health needs are considered. Efforts should also be directed towards development of culturally comparable, valid and reliable measures of refugee children's mental health and of refugee children's and adults' psychoeducational, neuropsychological and applied memory capabilities.