A paradigm shift:alternative interaction techniques for use with mobile & wearable devices

Desktop user interface design originates from the fact that users are stationary and can devote all of their visual resource to the application with which they are interacting. In contrast, users of mobile and wearable devices are typically in motion whilst using their device which means that they cannot devote all or any of their visual resource to interaction with the mobile application -- it must remain with the primary task, often for safety reasons. Additionally, such devices have limited screen real estate and traditional input and output capabilities are generally restricted. Consequently, if we are to develop effective applications for use on mobile or wearable technology, we must embrace a paradigm shift with respect to the interaction techniques we employ for communication with such devices.This paper discusses why it is necessary to embrace a paradigm shift in terms of interaction techniques for mobile technology and presents two novel multimodal interaction techniques which are effective alternatives to traditional, visual-centric interface designs on mobile devices as empirical examples of the potential to achieve this shift.

Multimodal 'Eyes-Free' interaction techniques for mobile devices

Mobile and wearable computers present input/output prob-lems due to limited screen space and interaction techniques. When mobile, users typically focus their visual attention on navigating their environment - making visually demanding interface designs hard to operate. This paper presents two multimodal interaction techniques designed to overcome these problems and allow truly mobile, 'eyes-free' device use. The first is a 3D audio radial pie menu that uses head gestures for selecting items. An evaluation of a range of different audio designs showed that egocentric sounds re-duced task completion time, perceived annoyance, and al-lowed users to walk closer to their preferred walking speed. The second is a sonically enhanced 2D gesture recognition system for use on a belt-mounted PDA. An evaluation of the system with and without audio feedback showed users' ges-tures were more accurate when dynamically guided by au-dio-feedback. These novel interaction techniques demon-strate effective alternatives to visual-centric interface de-signs on mobile devices.

Comparing interaction techniques for serious games through brain-computer interfaces:a user perception evaluation study

This paper examines the application of commercial and non-invasive electroencephalography (EEG)-based brain-computer (BCIs) interfaces with serious games. Two different EEG-based BCI devices were used to fully control the same serious game. The first device (NeuroSky MindSet) uses only a single dry electrode and requires no calibration. The second device (Emotiv EPOC) uses 14 wet sensors requiring additional training of a classifier. User testing was performed on both devices with sixty-two participants measuring the player experience as well as key aspects of serious games, primarily learnability, satisfaction, performance and effort. Recorded feedback indicates that the current state of BCIs can be used in the future as alternative game interfaces after familiarisation and in some cases calibration. Comparative analysis showed significant differences between the two devices. The first device provides more satisfaction to the players whereas the second device is more effective in terms of adaptation and interaction with the serious game.

A paradigm shift for mobile interaction:a decade later

In the proceedings of CASCON'2003 we published an article entitled "A Paradigm Shift: Alternative Interaction Techniques for Use with Mobile & Wearable Devices" and were honoured to receive the Best Paper Award for that year's conference. A decade on, we are equally honoured to have the same paper recognised as the Most Influential Paper of the 2003 conference. To this end, we have been asked to provide a brief overview of our intervening research in relation to that original publication, and so that is the purpose of this extended abstract.

Mobile note taking:investigating the efficacy of mobile text entry

When designing interaction techniques for mobile devices we must ensure users are able to safely navigate through their physical environment while interacting with their mobile device. Non-speech audio has proven effective at improving interaction on mobile devices by allowing users to maintain visual focus on environmental navigation while presenting information to them via their audio channel. The research described here builds on this to create an audio-enhanced single-stroke-based text entry facility that demands as little visual resource as possible. An evaluation of the system demonstrated that users were more aware of their errors when dynamically guided by audio-feedback. The study also highlighted the effect of handwriting style and mobility on text entry; designers of handwriting recognizers and of applications involving mobile note taking can use this fundamental knowledge to further develop their systems to better support the mobility of mobile text entry.

Tear protein interaction with hydrogel contact lenses

The design and synthesis of biomaterials covers a growing number of biomedical applications. The use of biomaterials in biological environment is associated with a number of problems, the most important of which is biocompatabUity. If the implanted biomaterial is not compatible with the environment, it will be rejected by the biological site. This may be manifested in many ways depending on the environment in which it is used. Adsorption of proteins takes place almost instantaneously when a biomaterial comes into contact with most biological fluids. The eye is a unique body site for the study of protein interactions with biomaterials, because of its ease of access and deceptive complexity of the tears. The use of contact lenses for either vision correction and cosmetic reasons or as a route for the controlled drug delivery, has significantly increased in recent years. It is relatively easy to introduce a contact lens Into the tear fluid and remove after a few minutes without surgery or trauma to the patient. A range of analytical techniques were used and developed to measure the proteins absorbed to some existing commercial contact lens materials and also to novel hydrogels synthesised within the research group. Analysis of the identity and quantity of proteins absorbed to biomaterials revealed the importance of many factors on the absorption process. The effect of biomaterial structure, protein nature in terms of size. shape and charge and pH of the environment on the absorption process were examined in order to determine the relative up-take of tear proteins. This study showed that both lysozyme and lactoferrin penetrate the lens matrix of ionic materials. Measurement of the mobility and activity of the protein deposited into the surface and within the matrix of ionic lens materials demonstrated that the mobility is pH dependent and, within the experimental errors, the biological activity of lysozyme remained unchanged after adsorption and desorption. The study on the effect of different monomers copolymerised with hydroxyethyl methacrylate (HEMA) on the protein up-take showed that monomers producing a positive charge on the copolymer can reduce the spoilation with lysozyme. The studies were extended to real cases in order to compare the patient dependent factors. The in-vivo studies showed that the spoilation is patient dependent as well as other factors. Studies on the extrinsic factors such as dye used in colour lenses showed that the addition of colourant affects protein absorption and, in one case, its effect is beneficial to the wearer as it reduces the quantity of the protein absorbed.

Some aspects of the interaction of humic substances with metal ions

Humic substances are the major organic constituents of soils and sediments. They are heterogeneous, polyfunctional, polydisperse, macromolecular and have no accurately known chemical structure. Their interactions with radionuclides are particularly important since they provide leaching mechanisms from disposal sites. The central theme to this research is the interaction of heavy metal actinide analogues with humic materials. Studies described focus on selected aspects of the characteristics and properties of humic substances. Some novel approaches to experiments and data analysis are pursued. Several humic substances are studied; all but one are humic acids, and those used most extensively were obtained commercially. Some routine characterisation techniques are applied to samples in the first instance. Humic substances are coloured, but their ultra-violet and visible absorption spectra are featureless. Yet, they fluoresce over a wide range of wavelengths. Enhanced fluorescence in the presence of luminescent europium(III) ions is explained by energy transfer from irradiated humic acid to the metal ion in a photophysical model. Nuclear magnetic resonance spectroscopy is applied to the study of humic acids and their complexes with heavy metals. Proton and carbon-13 NMR provides some structural and functionality information; Paramagnetic lanthanide ions affect these spectra. Some heavy metals are studied as NMR nuclei, but measurements are restricted by their sensitivity. A humic acid is fractionated yielding a broad molecular weight distribution. Electrophoretic mobilities and particle radii determined by Laser Doppler Electrophoretic Light Scattering are sensitive to the conditions of the supporting media, and the concentration and particle size distribution of humic substances. In potentiometric titrations of humate dispersions, the organic matter responds slowly and the mineral acid addition is buffered. Proton concentration data is modelled and a mechanism is proposed involving two key stages, both resulting in proton release after some conformational changes.

Studies of molecular interactions using physical techniques

The investigations described in this thesis concern the molecular interactions between polar solute molecules and various aromatic compounds in solution. Three different physical methods were employed. Nuclear magnetic resonance (n.m.r.) spectroscopy was used to determine the nature and strength of the interactions and the geometry of the transient complexes formed. Cryoscopic studies were used to provide information on the stoichiometry of the complexes. Dielectric constant studies were conducted in an attempt to confirm and supplement the spectroscopic investigations. The systems studied were those between nitromethane, chloroform, acetonitrile (solutes) and various methyl substituted benzenes. In the n.m.r. work the dependence of the solute chemical shift upon the compositions of the solutions was determined. From this the equilibrium quotients (K) for the formation of each complex and the shift induced in the solute proton by the aromatic in the complex were evaluated. The thermodynamic parameters for the interactions were obtained from the determination of K at several temperatures. The stoichiometries of the complexes obtained from cryoscopic studies were found to agree with those deduced from spectroscopic investigations. For most systems it is suggested that only one type of complex, of 1:1 stiochiometry, predominates except that for the acetonitrile-benzene system a 1:2 complex is formed. Two sets of dielectric studies were conducted, the first to show that the nature of the interaction is dipole-induced dipole and the second to calculate K. The equilibrium quotients obtained from spectroscopic and dielectric studies are compared. Time-averaged geometries of the complexes are proposed. The orientation of solute, with respect to the aromatic for the 1:1 complexes, appears to be the one in which the solute lies symmetrically about the aromatic six-fold axis whereas for the 1:2 complex, a sandwich structure is proposed. It is suggested that the complexes are formed through a dipole-induced dipole interaction and steric factors play some part in the complex formation.

A four-factor user interaction model for content-based image retrieval

In order to bridge the “Semantic gap”, a number of relevance feedback (RF) mechanisms have been applied to content-based image retrieval (CBIR). However current RF techniques in most existing CBIR systems still lack satisfactory user interaction although some work has been done to improve the interaction as well as the search accuracy. In this paper, we propose a four-factor user interaction model and investigate its effects on CBIR by an empirical evaluation. Whilst the model was developed for our research purposes, we believe the model could be adapted to any content-based search system.

Design of experiments to study the impact of process parameters on droplet size and development of non-invasive imaging techniques in tablet coating

Atomisation of an aqueous solution for tablet film coating is a complex process with multiple factors determining droplet formation and properties. The importance of droplet size for an efficient process and a high quality final product has been noted in the literature, with smaller droplets reported to produce smoother, more homogenous coatings whilst simultaneously avoiding the risk of damage through over-wetting of the tablet core. In this work the effect of droplet size on tablet film coat characteristics was investigated using X-ray microcomputed tomography (XμCT) and confocal laser scanning microscopy (CLSM). A quality by design approach utilising design of experiments (DOE) was used to optimise the conditions necessary for production of droplets at a small (20 μm) and large (70 μm) droplet size. Droplet size distribution was measured using real-time laser diffraction and the volume median diameter taken as a response. DOE yielded information on the relationship three critical process parameters: pump rate, atomisation pressure and coating-polymer concentration, had upon droplet size. The model generated was robust, scoring highly for model fit (R2 = 0.977), predictability (Q2 = 0.837), validity and reproducibility. Modelling confirmed that all parameters had either a linear or quadratic effect on droplet size and revealed an interaction between pump rate and atomisation pressure. Fluidised bed coating of tablet cores was performed with either small or large droplets followed by CLSM and XμCT imaging. Addition of commonly used contrast materials to the coating solution improved visualisation of the coating by XμCT, showing the coat as a discrete section of the overall tablet. Imaging provided qualitative and quantitative evidence revealing that smaller droplets formed thinner, more uniform and less porous film coats.

Support vector machines to detect physiological patterns for EEG and EMG-based human-computer interaction:a review

Support Vector Machines (SVMs) are widely used classifiers for detecting physiological patterns in Human-Computer Interaction (HCI). Their success is due to their versatility, robustness and large availability of free dedicated toolboxes. Frequently in the literature, insufficient details about the SVM implementation and/or parameters selection are reported, making it impossible to reproduce study analysis and results. In order to perform an optimized classification and report a proper description of the results, it is necessary to have a comprehensive critical overview of the application of SVM. The aim of this paper is to provide a review of the usage of SVM in the determination of brain and muscle patterns for HCI, by focusing on electroencephalography (EEG) and electromyography (EMG) techniques. In particular, an overview of the basic principles of SVM theory is outlined, together with a description of several relevant literature implementations. Furthermore, details concerning reviewed papers are listed in tables, and statistics of SVM use in the literature are presented. Suitability of SVM for HCI is discussed and critical comparisons with other classifiers are reported.