Supporting user evaluation of IT security certification schemes

IT Security Certification is an increasingly important qualification for information technology (IT) professionals seeking employment in IT security. Yet currently there is a lack of rigorously developed approaches to support the evaluation and selection by key stakeholders of the most appropriate IT security certification scheme from among hundreds of vendor-neutral and vendor-specific schemes. This paper develops a framework based on categories, characteristics and criteria to support user evaluation and selection of an (IT) Security Certification scheme that satisfies user priorities and requirements. The paper illustrates the use of the framework to support an experienced IT Professional’s evaluation. Theoretical and practical implications of the framework and trial evaluation are discussed.

Objective and subjective measurements of office meeting rooms

This research is a preliminary investigation of the objective measurements ofthelmal comfort and C02 levels as well as subjective user evaluation surveys in six meeting rooms. The ongoing objective measurements were taken via thelmal comfort carts while the surveys evaluated parameters of temperature, lighting, air quality, meeting effectiveness etc. The outcomes are of particular interest since some of the objective measurements clearly to not support those of the users. In fact, the investigation has triggered off further interest in refining questionnaires to develop more precise indicators of 'discomfort'.
Furthelmore, meeting rooms present a challenge when it comes to conditioning spaces (HV AC design) which are sporadic in use and often with high occupancy for short periods. This paper investigates meeting rooms in four different buildings and their conditioning control concepts are discussed in relation to measured results.

Addressing online information needs in palliative care : an action research-inspired approach

Whereas user participation has been embraced worldwide as a means to provide better patient outcomes, the implementation of formative, action research approaches in online health information has remained under-explored. The purpose of this study is to present an action research-based methodology that allows the scoping of health information and design needs in complex, multi-user online environments. The project's four main stages were informed by an iterative, formative approach involving continuous expert and user evaluation. The study suggests that an action research-inspired formative approach can be successfully employed to generate user-participation. Moreover, sustained user-participation effectively addresses most quality issues regarding content, language, and accessibility raised in the recent literature. The paper concludes that an action research approach geared to develop online health resources deserves more attention.

Wearing your PIM : experiments with an audio enhanced PIM

PIM systems help organise people’s lives by providing address book, schedule and task management facilities. Current PIM’s manage this information by collecting and storing it as textual data. With the advent of the wearable computer, using text only is no longer an efficient and convenient mechanism for managing personal information. A wearable computer should use data from various sensors (video, audio, location, environmental, user state) to organise personal information. In this paper we examine how audio can be used to enhance the facilities provided by text-only PIM’s and present an example implementation of an audio based wearable PIM (wPIM) that has the capability of storing and retrieving PIM information as audio recordings. The results of the user evaluation we conducted, which was carried out outside of the laboratory, suggests that users strongly accept audio as a way to manage their personal information and to augment their memory, supporting our hypothesis that audio enhances wearable personal information management.

"Music therapy helped me get back doing": perspectives of music therapy participants in mental health services

BACKGROUND: Mental health service development internationally is increasingly informed by the collaborative ethos of recovery. Service user evaluation of experiences within music therapy programs allows new phenomena about participation in services to be revealed that might otherwise remain unnoticed. OBJECTIVE: The aim of this study was to demonstrate how asking service users about their experience of music therapy can generate useful information, and to reflect upon the feedback elicited from such processes in order to gain a deeper understanding of how music therapy is received among service users in mental health. METHODS: Six mental health service users described their experiences of music therapy in one or two individual interviews. Transcripts of interviews were analyzed using the procedures and techniques of Interpretative Phenomenological Analysis. RESULTS: Interviews with mental health service users provided rich, in-depth accounts reflecting the complex nature of music therapy participation. Super-ordinate themes refer to the context in which music therapy was offered, the rich sound world of music in music therapy, the humanity of music therapy, and the strengths enhancing opportunities experienced by service users. CONCLUSIONS: Participants indicated that they each experienced music therapy in unique ways. Opinions about the value of music therapy were revealed through an interview process in which the researcher holds an open attitude, welcoming all narrative contributions respectfully. These findings can remind practitioners of the importance of closely tuning into the perspectives and understandings of those who have valuable expertise to share about their experience of music therapy services in mental health.

Automatic refinement of user requirements : a case study in software tool evaluation

This paper presents an assessment of system effectiveness in automatic requirements refinement by comparing results obtained from experts and novices with those achieved by the system. As the investigated system was a combination of a tightly inter-connected methods and a tool, the evaluation framework melded together a number of distinct methodological approaches structured into three empirical studies, which aimed at the construction of a case problem domain, calibrating the system using this defined domain elements and finally using the calibrated system to assess its effectiveness. In consequence, it was concluded that the evaluated methods and tools were effective in supporting requirements refinement.

Intranet and internet uptake and usage within UK building surveying practices. A user based evaluation of advantages and disadvantages

The ‘single most important technological discovery since the birth of the p.c.’, (Gates, 1996). The swift increase in Internet utilisation within businesses and surveying has changed working methods within UK based Surveying practices. User numbers expanded rapidly since the early 1990’s and estimates place a figure of 150 million internet users globally (www.Yahoo.com, 2000). Sloan and Kee Low (2000) established that ‘e-commerce’ is a revolutionary way of trading and conducting business activities. There are opportunities for surveying practices including, reducing communication time, increasing revenues from new and existing sources, enhanced client satisfaction and competitive advantage (Cronin, 1996). Others (Dixon, 1998) perceive threats, such as ‘disintermediation’, to the traditional role of the surveyor.

This research examined the levels of internet and intranet access within the UK Building and Quantity Surveying practices and corporate firms to establish how the internet has affected working methods and client requirements. The research method comprised a qualitative approach using an email and postal questionnaire survey of a random sample of practices. The questionnaire findings formed the basis of semi structured interviews conducted with senior management of large practices to gain a deeper understanding of the issues identified within the survey.

Data analysis revealed the traditional role of the surveyor as a broker of information may be under threat in the long term. Generally levels of internet access in the sample exceed that of general business levels (Dti, 2000) with the largest growth pre 1997. The perceived advantages and barriers to Intranet and Internet usage were identified by the research.

Evaluation of user perceptions of an application of activity-based costing

This study examined the extent to which preparers and end-users of Activity-Based Costing information are satisfied with this technique and the factors forming the basis of that belief.

User-centered evaluation of a virtual environment training system : utility of user perception measures

This study assessed the utility of measures of Self-efficacy (SelfEfficacy) and Perceived VE efficacy (PVEefficacy) for quantifying how effective VEs are in procedural task training. SelfEfficacy and PVEefficacy have been identified as affective construct potentially underlying VE efficacy that is not evident from user task performance. The motivation for this study is to establish subjective measures of VE efficacy and investigate the relationship between PVEefficacy, SelfEfficacy and User task performance. Results demonstrated different levels of prior experience in manipulating 3D objects in gaming or computer environment (LOE3D) effects on task performance and user perception of VE efficacy. Regression analysis revealed LOE3D, SelfEfficacy,
PVEefficacy explain significant portions of the variance in VE efficacy. Results of the study provide further evidence that task performance may share relationships with PVEefficacy and SelfEfficacy, and that affective constructs, such as PVEefficacy, and SelfEfficacy may serve as alternative, subjective measures of task performance that account for VE efficacy.

Evaluation of thermal and visual comfort in offices considering realistic input data and user behaviour in building simulation

Thermal and visual comfort play a very important role regarding the satisfaction of occupants with their working environments. The most effective method to achieve thermal comfort in offices is to reduce cooling loads in order to avoid additional energy-consuming devices for cooling. Building simulation software can be a helpful tool for optimisation, and typically standard values for the influencing parameters are used in order to ensure compliance to norms and regulations.

In practice many of those parameters turn out to be different compared to the simulation assumptions and the reasons may be the chosen room or building related properties as well as the user behaviour influenced by the task and the corporate culture of the company.

This paper investigates exemplary for the climate of Hamburg, Germany and a naturally ventilated typical office room, the optimisation potential of the building- and user-related parameters for thermal comfort, daylighting and view when using realistic input data for building simulation. The study has been conducted with the EnergyPlus based simulation software “Primero-Komfort” [1].

User-centered design and evaluation of an interactive visual-haptic-auditory interface : a user study on assembly

Utilizing user-centred system design and evaluation method has become an increasingly important tool to foster better usability in the field of virtual environments (VEs). In recent years, although it is still the norm that designers and developers are concerning the technological advancement and striving for designing impressive multimodal multisensory interfaces, more and more awareness are aroused among the development team that in order to produce usable and useful interfaces, it is essential to have users in mind during design and validate a new design from users' perspective. In this paper, we describe a user study carried out to validate a newly developed haptically enabled virtual training system. By taking consideration of the complexity of individual differences on human performance, adoption and acceptance of haptic and audio-visual I/O devices, we address how well users learn, perform, adapt to and perceive object assembly training. We also explore user experience and interaction with the system, and discuss how multisensory feedback affects user performance, perception and acceptance. At last, we discuss how to better design VEs that enhance users perception, their interaction and motor activity.

The Health Education Impact Questionnaire (heiQ): An outcomes and evaluation measure for patient education and self-management interventions for people with chronic conditions

Objective: This paper describes the development and validation of the Health Education Impact Questionnaire (heiQ). The aim was to develop a user-friendly, relevant, and psychometrically sound instrument for the comprehensive evaluation of patient education programs, which can be applied across a broad range of chronic conditions.

Methods: Item development for the heiQ was guided by a Program Logic Model, Concept Mapping, interviews with stakeholders and psychometric analyses. Construction (N = 591) and confirmatory (N = 598) samples were drawn from consumers of patient education programs and hospital outpatients. The properties of the heiQ were investigated using item response theory and structural equation modeling.

Results: Over 90 candidate items were generated, with 42 items selected for inclusion in the final scale. Eight independent dimensions were derived: Positive and Active Engagement in Life (five items, Cronbach's alpha (α) = 0.86); Health Directed Behavior (four items, α = 0.80); Skill and Technique Acquisition (five items, α = 0.81); Constructive Attitudes and Approaches (five items, α = 0.81); Self-Monitoring and Insight (seven items, α = 0.70); Health Service Navigation (five items, α = 0.82); Social Integration and Support (five items, α = 0.86); and Emotional Wellbeing (six items, α = 0.89).

Conclusion:The heiQ has high construct validity and is a reliable measure of a broad range of patient education program benefits.

Practice Implications: The heiQ will provide valuable information to clinicians, researchers, policymakers and other stakeholders about the value of patient education programs in chronic disease management.

User participation in the performance assessment of school buildings : a study of six primary schools in the Bellarine Peninsula region

Young children spend a significant portion of their lives at primary school. This research traces the development of school facilities in Victoria and examines the performance of six primary schools from the users' perspective. Performance assessments were carried out using participatory evaluation methods that included Touring Interviews with small groups of students aged from six to twelve years. The study found that participatory evaluation methods with both student and staff users generate significant information to improve school facilities. User comments were analysed with respect to 14 aspects of building quality and serviceability including character, thermal environment, privacy and flexibility. The study concludes that school buildings do not meet a number of key user requirements. Children expressed dissatisfaction with furniture and equipment in their classrooms and the playground, and to a lesser extent with student toilets, security of their school bags and personal privacy. Staff were dissatisfied with the provision of withdrawal areas and specialist spaces. Department of School Education facilities guidelines do not address the concerns of school users or meet user needs.

Development and evaluation of a glass-box interpreter for teaching novice programmers

This study evaluates the efficacy of a low-level program visualisation tool as a learning aid for novice programmers and develops and evaluates features which might further enhance the benefit of a low-level program visualisation tool (called Bradman). Bradman is an interpreter which makes visible aspects of the programming process which are normally hidden from the user.