Relevation! : an open source system for information retrieval relevance assessment

Relevation! is a system for performing relevance judgements for information retrieval evaluation. Relevation! is web-based, fully configurable and expandable; it allows researchers to effectively collect assessments and additional qualitative data. The system is easily deployed allowing assessors to smoothly perform their relevance judging tasks, even remotely. Relevation! is available as an open source project at: http://ielab.github.io/relevation.

Understanding financial information used to assess small firm performance : an Australian qualitative study

Purpose The purpose of this paper is to investigate the reality of financial and management accounting in a small group of small firms. Specifically, from the owner's perspective, an exploration is undertaken to see what financial information is collected, how it is used (or not) to make business decisions and evaluate the firm's performance, and the role played by the accountant in that process. Design/methodology/approach A phenomenological paradigm underpins this exploratory study. Semi‐structured interviews were undertaken with the owners of ten small firms, where the focus was on understanding what happens in an organisational setting, as opposed to theory and textbook practice. Findings The qualitative data supported prior research in other countries. The in‐depth analysis revealed a very basic understanding of accounting information and problems with the financial literacy amongst these small firm owners. Accounting reports were not widely produced or used, so an informal assessment, such as how much cash was in the bank, was the primary means of assessing business performance. Accountants were used for taxation services, although some owners sought more general business advice. Originality/value An understanding is developed of why there might be a gap between textbook rhetoric and reality of accounting practice in small firms. The conclusion is that accounting textbooks need to include more information about the reality of financial management in small firms.

Supporting residents’ expression of sexuality : the initial construction of a sexuality assessment tool for residential aged care facilities

Background: Sexuality is a key component of quality of life and well-being and a need to express one’s sexuality continues into old age. Staff and families in residential aged care facilities often find expressions of sexuality by residents, particularly those living with dementia, challenging and facilities often struggle to address individuals’ needs in this area. This paper describes the development of an assessment tool which enables residential aged care facilities to identify how supportive their organisation is of all residents’ expression of their sexuality, and thereby improve where required. Methods: Multi-phase design using qualitative methods and a Delphi technique. Tool items were derived from the literature and verified by qualitative interviews with aged care facility staff, residents and families. The final item pool was confirmed via a reactive Delphi process. Results: A final item pool of sixty-nine items grouped into seven key areas allows facilities to score their compliance with the areas identified as being supportive of older people’s expression of their sexuality in a residential aged care environment. Conclusions: The sexuality assessment tool (SexAT) guides practice to support the normalization of sexuality in aged care homes and assists facilities to identify where enhancements to the environment, policies, procedures and practices, information and education/training are required. The tool also enables facilities to monitor initiatives in these areas over time.

Teachers using annotations to engage students in assessment conversations : recontextualising knowledge

Assessment for Learning practices with students such as feedback, and self- and peer assessment are opportunities for teachers and students to develop a shared understanding of how to create quality learning performances. Quality is often represented through achievement standards. This paper explores how primary school teachers in Australia used the process of annotating work samples to develop shared understanding of achievement standards during their curriculum planning phase, and how this understanding informed their teaching so that their students also developed this understanding. Bernstein's concept of the pedagogic device is used to identify the ways teachers recontextualised their assessment knowledge into their pedagogic practices. Two researchers worked alongside seven primary school teachers in two schools over a year, gathering qualitative data through focus groups and interviews. Three general recontextualising approaches were identified in the case studies; recontextualising standards by reinterpreting the role of rubrics, recontextualising by replicating the annotation process with the students and recontextualising by reinterpreting practices with students. While each approach had strengths and limitations, all of the teachers concluded that annotating conversations in the planning phase enhanced their understanding, and informed their practices in helping students to understand expectations for quality.

Development of an online role-play assessment initiative for nursing students in their bioscience studies

Devising assessment tasks for large units that embrace academic goals of authenticity and assessment variety can be a challenge. We developed an online Role-Play Assessment Initiative for first year nursing students in bioscience. Students responded to a case study by preparing two role-play dialogues: as a nurse with the patient, and between two nurses. The aims were to assess whether the students could: 1) understand the underlying disease process (pathophysiology) and relate it to clinical practice; 2) use language appropriate for lay and medical conversation; and 3) apply information using active learning. We conducted a student survey using quantitative questions (Likert scale: 1=strongly disagree to 5=strongly agree), and qualitative questions. 65 completed surveys were received. 80% of respondents agreed (includes agree or strongly agree) that it was a useful way to learn and understand pathophysiology of the case study. 86% agreed that it was useful to apply pathophysiology from lectures to a clinical setting. Overall, students found it enjoyable, which is beneficial for enhanced student engagement, and agreed that it allowed them to work well in a group (74% and 85%, respectively). Most qualitative suggestions for improvement related to group work, despite the encouraging response to group work in quantitative questions. Most positive comments surrounded different communication with a nurse compared with a patient. These results demonstrate that students developed deeper understanding of pathophysiology through active learning and were able to expand their nursing career skills during the role-play. Learning using role-play to simulate the workforce has fostered active learning.

A qualitative analysis of how parents assess acute pain in young children

An accurate and comprehensive pain assessment is crucial for adequate pain management in pre- and early verbal children during painful medical procedures. This study used an inductive approach to explore the processes involved in parental pain assessment and to develop a new model of Parental Assessment of Acute Child Pain. Participants were 19 parents of children aged under 3 years who had previously or were potentially about to experience an intravenous cannula or nasogastric tube insertion. Parental affect regulation, while witnessing their child in acute pain/distress, appeared to be critical to the processes involved in assessing their child’s pain.

Quality assurance of assessment and moderation discourses involving sessional staff

Quality assurance is a major agenda in tertiary education. The casualisation of academic work, especially in teaching, is also a quality assurance issue. Casual or sessional staff members teach and assess more than 50% of all university courses in Australia, and yet the research in relation to the role sessional staff play in quality assurance of student assessment outcomes is scarce. Moderation processes are a pivotal part of robust quality assurance measures. Drawing upon previous work surrounding four discourses of moderation, this pilot project reports the results of research into the role and impact of sessional staff in moderation processes at tertiary level. Qualitative data were gathered through focus interviews. Results, in the form of various moderation discourses, indicate that sessional staff impact the formal quality assurance processes in numerous ways.

Undergraduate public health students and perceptions of qualitative research: A trajectory of understanding from airy fairy to a valuable tool

Many undergraduate public health students enter introductory qualitative research units with limited or negative perceptions of qualitative research, potentially compromising learning outcomes. Unit teaching, structure and assessment provide opportunities for students to develop positive perceptions of qualitative research. Through a mixed-methods study of undergraduate public health students enrolled in a qualitative research unit, we establish students’ perceptions of qualitative research at the commencement and conclusion of the unit, and determine the critical teaching and learning events which contributed to positive changes in students’ perceptions. This study demonstrates that the structuring of an introductory qualitative research unit around varied opportunities for experiential learning provides a positive introductory learning experience and enables undergraduate public health students to recognise the real-world uses and value of qualitative research.

Serum immunoreactive pancreatic lipase and cationic trypsinogen for the assessment of exocrine pancreatic function in older patients with cystic fibrosis

Indirect and qualitative tests of pancreatic function are commonly used to screen patients with cystic fibrosis for pancreatic insufficiency. In an attempt to develop a more quantitative assessment, we compared the usefulness of measuring serum pancreatic lipase using a newly developed enzyme-linked immunosorbent immunoassay with that of cationic trypsinogen using a radioimmunoassay in the assessment of exocrine pancreatic function in patients with cystic fibrosis. Previously, we have shown neither lipase nor trypsinogen to be of use in assessing pancreatic function prior to 5 years of age because the majority of patients with cystic fibrosis in early infancy have elevated serum levels regardless of pancreatic function. Therefore, we studied 77 patients with cystic fibrosis older than 5 years of age, 41 with steatorrhea and 36 without steatorrhea. In addition, 28 of 77 patients consented to undergo a quantitative pancreatic stimulation test. There was a significant difference between the steatorrheic and nonsteatorrheic patients with the steatorrheic group having lower lipase and trypsinogen values than the nonsteatorrheic group (P < .001). Sensitivities and specificities in detecting steatorrhea were 95% and 86%, respectively, for lipase and 93% and 92%, respectively, for trypsinogen. No correlations were found between the serum levels of lipase and trypsinogen and their respective duodenal concentrations because of abnormally high serum levels of both enzymes found in some nonsteatorrheic patients. We conclude from this study that both serum lipase and trypsinogen levels accurately detect steatorrhea in patients with cystic fibrosis who are older than 5 years but are imprecise indicators of specific pancreatic exocrine function above the level needed for normal fat absorption.

An exploratory investigation of the practice of assessment for learning in Vietnamese higher education: Three case studies of lecturers' practice

In response to limited research conducted on the practice of assessment for learning (AfL) in higher education and in Asian educational settings, this qualitative study, using sociocultural theories of learning and a multiple case study approach, investigates how AfL was implemented by three lecturers in one Vietnamese university. Findings revealed that the lecturers engaged with AfL principles and practices to some extent. However, despite the lecturers' significant efforts, Vietnamese sociocultural factors such as respect for harmony, hierarchy, and examination-oriented learning, impacted on their practice of AfL. This study therefore argues that AfL requires adaptation for it to be effective in the Vietnamese tertiary context.

The Systems Theory Framework of career development: Applications to career counselling and career assessment

Since its inception, the Systems Theory Framework of career development has afforded ready translation into practice, especially into career counselling and qualitative career assessment. Through its clearly articulated constructs and the clarity of its diagrammatic representation, the Systems Theory Framework has facilitated the development of qualitative career assessment instruments as well as a quantitative measure. This article briefly overviews these practical applications of the Systems Theory Framework as well as its application in career counselling through a story telling approach. The article concludes by offering a synthesis of and considering future directions for the Systems Theory Framework’s practical applications.

Incorporating Career Assessment into Career Counselling

Career assessment has long held a central place in career counselling since the work of Parsons (1909) signalled the birth of a new field of practice, vocational guidance, and its subsequent iterations of career guidance and counselling and more recently life designing.

Diet and physical activity behaviour in nurses: A qualitative study

Issue addressed: Previous research has shown that approximately 60% of nurses in Australia are overweight or obese, insufficiently active and have an unhealthy diet. The aim of this study was to gain an understanding of nurses’ determinants contributing to these behaviours. This will inform a needs assessment for a future workplace health promotion program (WHPP) in this group. Methods: Four focus group discussions (n = 17) were conducted with a convenience sample of nurses aged 25–59 years from three hospitals in the Brisbane metropolitan area. Questions addressed barriers and motivation towards diet and physical activity (PA), and suggestions for future WHPP. Data were analysed with Nvivo10 following a thematic analysis with a realistic approach using Self-determination theory as a framework. Results: Work environment was the main barrier for healthy diet behaviours. Long working hours and lack of breaks challenged nurses’ self-control and self-regulation when making dietary choices. Fatigue was the main barrier for PA. However, relaxation, feeling energised before work and better sleep after working night shifts motivated nurses to do PA. Social environment at work seemed to be an effective external motivation to encourage healthy diet and regular PA. Goal-setting, self-monitoring and social support at work were identified as potential WHHP strategies. Conclusion: The workplace and job demands negatively impacts nurses’ lifestyle behaviours. Future interventions should include social support from colleagues, which could motivate nurses to make healthier food choices at work and be more active outside work.