Development of the student placement evaluation form: A tool for assessing student fieldwork performance

Evaluation of students undertaking fieldwork education placements is a critical process in the health professions. As training programs and practice evolve, systems for assessing students need to be reviewed and updated constantly. In 1995, staff of the occupational therapy training program at the University of Queensland, Australia decided to develop a new tool for assessing student fieldwork performance. Using an action research methodology, a team developed the Student Placement Evaluation Form, a flexible and comprehensive criterion-referenced evaluation tool. The present paper examines action research as an appropriate methodology for considering real-life organisational problems in a systematic and participatory manner. The action research cycles undertaken, including preliminary information gathering, tool development, trial stages and current use of the tool, are detailed in the report. Current and future development of the tool is also described.

The development of an observation tool for use with parents with psychiatric disability and their preschool children

Community-based treatment and care of people with psychiatric disabilities has meant that they are now more likely to engage in the parenting role. This has led to the development of programs designed to enhance the parenting skills of people with psychiatric disabilities. Evaluation of these programs has been hampered by a paucity of evaluation tools. This study's aim was to develop and trial a tool that examined the parent-child interaction within a group setting, was functional and easy to use, required minimum training and equipment, and had acceptable levels of reliability and validity. The revised tool yielded a single scale with acceptable reliability. It had discriminative validity and concurrent validity with non-independent global ratings of parenting. Sensitivity to change was not investigated. The findings suggest that this method of evaluating parenting is likely to have both clinical and research utility and further investigation of the psychometric properties of the tool is warranted.

Development and evaluation of an automated annotation pipeline and cDNA annotation system

Manual curation has long been held to be the gold standard for functional annotation of DNA sequence. Our experience with the annotation of more than 20,000 full-length cDNA sequences revealed problems with this approach, including inaccurate and inconsistent assignment of gene names, as well as many good assignments that were difficult to reproduce using only computational methods. For the FANTOM2 annotation of more than 60,000 cDNA clones, we developed a number of methods and tools to circumvent some of these problems, including an automated annotation pipeline that provides high-quality preliminary annotation for each sequence by introducing an uninformative filter that eliminates uninformative annotations, controlled vocabularies to accurately reflect both the functional assignments and the evidence supporting them, and a highly refined, Web-based manual annotation tool that allows users to view a wide array of sequence analyses and to assign gene names and putative functions using a consistent nomenclature. The ultimate utility of our approach is reflected in the low rate of reassignment of automated assignments by manual curation. Based on these results, we propose a new standard for large-scale annotation, in which the initial automated annotations are manually investigated and then computational methods are iteratively modified and improved based on the results of manual curation.

A formal object-oriented approach to defining consistency constraints for UML models

We discuss how integrity consistency constraints between different UML models can be precisely defined at a language level. In doing so, we introduce a formal object-oriented metamodeling approach. In the approach, integrity consistency constraints between UML models are defined in terms of invariants of the UML model elements used to define the models at the language-level. Adopting a formal approach, constraints are formally defined using Object-Z. We demonstrate how integrity consistency constraints for UML models can be precisely defined at the language-level and once completed, the formal description of the consistency constraints will be a precise reference of checking consistency of UML models as well as for tool development.

The role of software tools in influencing creative problem solving in engineering design and education

Creativity is increasingly recognised as an essential component of engineering design. This paper describes an exploratory study into the nature and importance of creativity in engineering design problem solving in relation to the possible impact of software design tools. The first stage of the study involved an empirical investigation in the form of a case study of the use of standard CAD tool sets and the development of a systems engineering software support tool. It was found that there were several ways in which CAD influenced the creative process, including enhancing visualisation and communication, premature fixation, circumscribed thinking and bounded ideation. The tool development experience uncovered the difficulty in supporting creative processes from the developer's perspective. The issues were the necessity of making assumptions, achieving a balance between structure and flexibility, and the pitfalls of satisfying user wants and needs. The second part of the study involved the development of a model of the creative problem solving process in engineering design. This provided a possible explanation for why purpose designed engineering software tools might encourage an analytical problem solving approach and discourage a more creative approach.

Development and standardization of the Self-regulation Skills Interview (SRSI): A new clinical assessment tool for acquired brain injury

The Self-regulation Skills Interview (SRSI) is a clinical tool designed to measure a range of metacognitive skills essential for rehabilitation planning, monitoring an individual's progress, and evaluating the outcome of treatment interventions. The results of the present study indicated that the SRSI has sound interrater reliability and test-retest reliability. A principle components analysis revealed three SRSI factors: Awareness, Readiness to Change, and Strategy Behavior. A comparison between a group of 61 participants with acquired brain injury (ABI) and a group of 43 non-brain-injured participants indicated that the participants with ABI had significantly lower levels of Awareness and Strategy Behavior, but that level of Readiness to Change was not significantly different between the two groups. The significant relationship observed between the SRSI factors and measures of neuropsychological functioning confirmed the concurrent validity of the scale and supports the value of the SRSI for post-acute assessment.