Statistical user simulation with a hidden agenda

Recent work in the area of probabilistic user simulation for training statistical dialogue managers has investigated a new agenda-based user model and presented preliminary experiments with a handcrafted model parameter set. Training the model on dialogue data is an important next step, but non-trivial since the user agenda states are not observable in data and the space of possible states and state transitions is intractably large. This paper presents a summary-space mapping which greatly reduces the number of state transitions and introduces a tree-based method for representing the space of possible agenda state sequences. Treating the user agenda as a hidden variable, the forward/backward algorithm can then be successfully applied to iteratively estimate the model parameters on dialogue data. © 2007 Association for Computational Linguistics.

User responses to the learning demands of consumer products

Designers are typically male, under 35 years old and unimpaired. Users can be of any age and currently over 15% will have some form of impairment. As a result a vast array of consumer products suit youthful males and in many cases exclude other demographics (e.g. Keates and Clarkson, 2004). In studying the way a range of users learn how to use new products, key cognitive difficulties are revealed and linked back to the areas of the product causing the problems. The trials were structured so each user had to complete a specific set of tasks and were consistent across the user spectrum. The tasks set aimed to represent both everyday usage and less familiar functions. Whilst the knowledge gained could provide designers with valuable guidelines for the specific products examined, a more general abstraction provides knowledge of the pitfalls to avoid in the design of other product families.

Parameter estimation for agenda-based user simulation

This paper presents an agenda-based user simulator which has been extended to be trainable on real data with the aim of more closely modelling the complex rational behaviour exhibited by real users. The train-able part is formed by a set of random decision points that may be encountered during the process of receiving a system act and responding with a user act. A sample-based method is presented for using real user data to estimate the parameters that control these decisions. Evaluation results are given both in terms of statistics of generated user behaviour and the quality of policies trained with different simulators. Compared to a handcrafted simulator, the trained system provides a much better fit to corpus data and evaluations suggest that this better fit should result in improved dialogue performance. © 2010 Association for Computational Linguistics.

Simulation in user-centred design: Helping designers to empathise with atypical users

Time and budget constraints frequently prevent designers from consulting with end-users while assessing the ease of use of the products they create. This has resulted in solutions that are difficult to use by a wide range of users, especially the growing older adult population and people with different types of impairments. To help designers with this problem, capability-loss simulators have been developed with the aim of temporarily representing users who are otherwise difficult to access. This paper questions the reliability of existing tools in providing designers with meaningful information about the users' capabilities. Consequently, a new capability-loss simulation toolkit is presented, followed by its empirical evaluation. The new toolkit proved to be significantly helpful for a group of designers identifying real usability problems with everyday devices. © 2012 Copyright Taylor and Francis Group, LLC.

Designing inclusive interfaces through user modeling and simulation

Elderly and disabled people can be hugely benefited through the advancement of modern electronic devices, as those can help them to engage more fully with the world. However, existing design practices often isolate elderly or disabled users by considering them as users with special needs. This article presents a simulator that can reflect problems faced by elderly and disabled users while they use computer, television, and similar electronic devices. The simulator embodies both the internal state of an application and the perceptual, cognitive, and motor processes of its user. It can help interface designers to understand, visualize, and measure the effect of impairment on interaction with an interface. Initially a brief survey of different user modeling techniques is presented, and then the existing models are classified into different categories. In the context of existing modeling approaches the work on user modeling is presented for people with a wide range of abilities. A few applications of the simulator, which shows the predictions are accurate enough to make design choices and point out the implication and limitations of the work, are also discussed. © 2012 Copyright Taylor and Francis Group, LLC.

Modelling information requirements in complex engineering services

Services based around complex engineering equipment and systems provide substantial challenges in both the long-term management of the equipment and the need for guaranteed delivery of the related service. One of the challenges for an organisation providing these services is the management of the information that is required to design, deliver and subsequently assess the success of the service. To assist in this process this paper develops a model for capturing, organising and assessing information requirements for these Complex Engineering Services in which information required to support key decisions in the life cycle of the service is identified. The model – referred to as The 12-Box Model for Service Information Requirements – is embedded in a three-phase procedure for providing an assessment of information requirements of a service contract which also provides insight into the capabilities of available information systems in supporting the contract. An illustrative example examining service information in an aircraft availability contract is used to demonstrate the use of the 12-Box Model and associated assessment procedure.

The Impact of Contract Type on Service Provider Information Requirements

This paper is concerned with the role of information in the servitization of manufacturing which has led to “the innovation of an organisation’s capabilities and processes as equipment manufacturers seek to offer services around their products” (Neely 2009, Baines et al 2009). This evolution has resulted in an information requirement (IR) shift as companies move from discrete provision of equipment and spare parts to long-term service contracts guaranteeing prescribed performance levels. Organisations providing such services depend on a very high level of availability and quality of information throughout the service life-cycle (Menor et al 2002). This work focuses on whether, for a proposed contract based around complex equipment, the Information System is capable of providing information at an acceptable quality and requires the IRs to be examined in a formal manner. We apply a service information framework (Cuthbert et al 2008, McFarlane & Cuthbert 2012) to methodically assess IRs for different contract types to understand the information gap between them. Results from case examples indicate that this gap includes information required for the different contract types and a set of contract-specific IRs. Furthermore, the control, ownership and use of information differs across contract types as the boundary of operation and responsibility changes.

Design for inclusivity: A practical guide to accessible, innovative and user-centred design

Design for Inclusivity is a guide to inclusive design for all types of designers, providing guidelines, real examples and information sources.

Understandable by design: How can products be designed to align with user experience?

Chapter 14 Understandable by Design: How Can Products be Designed to Align with User Experience? A. Mieczakowski, PM Langdon, RH Bracewell, JJ Patmore and PJ Clarkson 14.1 Introduction Understanding users increases the likelihood that ...

Clustering user data for user modelling in the GUIDE multi-modal set-top box

Chapter 20 Clustering User Data for User Modelling in the GUIDE Multi-modal Set- top Box PM Langdon and P. Biswas 20.1 ... It utilises advanced user modelling and simulation in conjunction with a single layer interface that permits a ...

Comparison of manual and user guided methodologies for the classification and retrieval of construction site images

The amount of original imaging information produced yearly during the last decade has experienced a tremendous growth in all industries due to the technological breakthroughs in digital imaging and electronic storage capabilities. This trend is affecting the construction industry as well, where digital cameras and image databases are gradually replacing traditional photography. Owners demand complete site photograph logs and engineers store thousands of images for each project to use in a number of construction management tasks like monitoring an activity's progress and keeping evidence of the "as built" in case any disputes arise. So far, retrieval methodologies are done manually with the user being responsible for imaging classification according to specific rules that serve a limited number of construction management tasks. New methods that, with the guidance of the user, can automatically classify and retrieve construction site images are being developed and promise to remove the heavy burden of manually indexing images. In this paper, both the existing methods and a novel image retrieval method developed by the authors for the classification and retrieval of construction site images are described and compared. Specifically a number of examples are deployed in order to present their advantages and limitations. The results from this comparison demonstrates that the content based image retrieval method developed by the authors can reduce the overall time spent for the classification and retrieval of construction images while providing the user with the flexibility to retrieve images according different classification schemes.

Real user evaluation of spoken dialogue systems using Amazon Mechanical Turk

This paper describes a framework for evaluation of spoken dialogue systems. Typically, evaluation of dialogue systems is performed in a controlled test environment with carefully selected and instructed users. However, this approach is very demanding. An alternative is to recruit a large group of users who evaluate the dialogue systems in a remote setting under virtually no supervision. Crowdsourcing technology, for example Amazon Mechanical Turk (AMT), provides an efficient way of recruiting subjects. This paper describes an evaluation framework for spoken dialogue systems using AMT users and compares the obtained results with a recent trial in which the systems were tested by locally recruited users. The results suggest that the use of crowdsourcing technology is feasible and it can provide reliable results. Copyright © 2011 ISCA.