Human-computer interaction and innovation in handheld, mobile and wearable technologies

Handheld and mobile technologies have witnessed significant advances in functionality, leading to their widespread use as both business and social networking tools. Human-Computer Interaction and Innovation in Handheld, Mobile and Wearable Technologies reviews concepts relating to the design, development, evaluation, and application of mobile technologies. Studies on mobile user interfaces, mobile learning, and mobile commerce contribute to the growing body of knowledge on this expanding discipline.

A paradigm shift:alternative interaction techniques for use with mobile & wearable devices

Desktop user interface design originates from the fact that users are stationary and can devote all of their visual resource to the application with which they are interacting. In contrast, users of mobile and wearable devices are typically in motion whilst using their device which means that they cannot devote all or any of their visual resource to interaction with the mobile application -- it must remain with the primary task, often for safety reasons. Additionally, such devices have limited screen real estate and traditional input and output capabilities are generally restricted. Consequently, if we are to develop effective applications for use on mobile or wearable technology, we must embrace a paradigm shift with respect to the interaction techniques we employ for communication with such devices.This paper discusses why it is necessary to embrace a paradigm shift in terms of interaction techniques for mobile technology and presents two novel multimodal interaction techniques which are effective alternatives to traditional, visual-centric interface designs on mobile devices as empirical examples of the potential to achieve this shift.

A wearable device for recording of biopotentials and body movements

Long term recording of biomedical signals such as ECG, EMG, respiration and other information (e.g. body motion) can improve diagnosis and potentially monitor the evolution of many widespread diseases. However, long term monitoring requires specific solutions, portable and wearable equipment that should be particularly comfortable for patients. The key-issues of portable biomedical instrumentation are: power consumption, long-term sensor stability, comfortable wearing and wireless connectivity. In this scenario, it would be valuable to realize prototypes using available technologies to assess long-term personal monitoring and foster new ways to provide healthcare services. The aim of this work is to discuss the advantages and the drawbacks in long term monitoring of biopotentials and body movements using textile electrodes embedded in clothes. The textile electrodes were embedded into garments; tiny shirt and short were used to acquire electrocardiographic and electromyographic signals. The garment was equipped with low power electronics for signal acquisition and data wireless transmission via Bluetooth. A small, battery powered, biopotential amplifier and three-axes acceleration body monitor was realized. Patient monitor incorporates a microcontroller, analog-to-digital signal conversion at programmable sampling frequencies. The system was able to acquire and to transmit real-time signals, within 10 m range, to any Bluetooth device (including PDA or cellular phone). The electronics were embedded in the shirt resulting comfortable to wear for patients. Small size MEMS 3-axes accelerometers were also integrated. © 2011 IEEE.

Machine learning for large-scale wearable sensor data in Parkinson disease:concepts, promises, pitfalls, and futures

For the treatment and monitoring of Parkinson's disease (PD) to be scientific, a key requirement is that measurement of disease stages and severity is quantitative, reliable, and repeatable. The last 50 years in PD research have been dominated by qualitative, subjective ratings obtained by human interpretation of the presentation of disease signs and symptoms at clinical visits. More recently, “wearable,” sensor-based, quantitative, objective, and easy-to-use systems for quantifying PD signs for large numbers of participants over extended durations have been developed. This technology has the potential to significantly improve both clinical diagnosis and management in PD and the conduct of clinical studies. However, the large-scale, high-dimensional character of the data captured by these wearable sensors requires sophisticated signal processing and machine-learning algorithms to transform it into scientifically and clinically meaningful information. Such algorithms that “learn” from data have shown remarkable success in making accurate predictions for complex problems in which human skill has been required to date, but they are challenging to evaluate and apply without a basic understanding of the underlying logic on which they are based. This article contains a nontechnical tutorial review of relevant machine-learning algorithms, also describing their limitations and how these can be overcome. It discusses implications of this technology and a practical road map for realizing the full potential of this technology in PD research and practice. © 2016 International Parkinson and Movement Disorder Society.

Wearable sensors in Huntington disease:a pilot study

Background: The Unified Huntington’s Disease Rating Scale (UHDRS) is the principal means of assessing motor impairment in Huntington disease but is subjective and generally limited to in-clinic assessments. Objective: To evaluate the feasibility and ability of wearable sensors to measure motor impairment in individuals with Huntington disease in the clinic and at home. Methods: Participants with Huntington disease and controls were asked to wear five accelerometer-based sensors attached to the chest and each limb for standardized, in-clinic assessments and for one day at home. A secondchest sensor was worn for six additional days at home. Gait measures were compared between controls, participants with Huntington disease, and participants with Huntington disease grouped by UHDRS total motor score using Cohen’s d values. Results: Fifteen individuals with Huntington disease and five controls completed the study. Sensor data were successfully captured from 18 of the 20 participants at home. In the clinic, the standard deviation of step time (timebetween consecutive steps) was increased in Huntington disease (p<0.0001; Cohen’s d=2.61) compared to controls. At home with additional observations, significant differences were observed in seven additional gait measures. The gait of individuals with higher total motor scores (50 or more) differed significantly from those with lower total motor scores (below 50) on multiple measures at home. Conclusions: In this pilot study, the use of wearable sensors in clinic and at home was feasible and demonstrated gait differences between controls, participants with Huntington disease, and participants with Huntington diseasegrouped by motor impairment.

User Effects on Wearable Conformal SCMR System

The performance of a compact, wearable Conformal Strongly Coupled Magnetic Resonance (CSCMR) system is studied when the antenna is in the air and is worn on a user’s arm. The wireless powering system consists of the receiver and load elements designed on a printed circuit board that is attached to a polyester fabric band. The wearable antenna achieves high efficiency, has a small volume, and can be easily printed on substrates. Although the user effect on mobile terminal antennas has been studied in detail, absorption losses in wearable antennas have not been widely investigated. Our results show that efficiency of the antenna in free space is 70% and on a user’s arm is 50%. Human tissue in the close proximity of our wearable Conformal SCMR caused a decrease in radiated efficiency and total efficiency. This undesired degradation in antenna efficiency might be attributed to body loss and absorption losses. Our findings can be used as a reference for future studies on wearable devices and their applications, such as health and sports monitoring.

Flexible Sensor for Wearable Vital Sign Monitoring System

In modern society, the body health is a very important issue to everyone. With the development of the science and technology, the new and developed body health monitoring device and technology will play the key role in the daily medical activities. This paper focus on making progress in the design of the wearable vital sign system. A vital sign monitoring system has been proposed and designed. The whole detection system is composed of signal collecting subsystem, signal processing subsystem, short-range wireless communication subsystem and user interface subsystem. The signal collecting subsystem is composed of light source and photo diode, after emiting light of two different wavelength, the photo diode collects the light signal reflected by human body tissue. The signal processing subsystem is based on the analog front end AFE4490 and peripheral circuits, the collected analog signal would be filtered and converted into digital signal in this stage. After a series of processing, the signal would be transmitted to the short-range wireless communication subsystem through SPI, this subsystem is mainly based on Bluetooth 4.0 protocol and ultra-low power System on Chip(SoC) nRF51822. Finally, the signal would be transmitted to the user end. After proposing and building the system, this paper focus on the research of the key component in the system, that is, the photo detector. Based on the study of the perovskite materials, a low temperature processed photo detector has been proposed, designed and researched. The device is made up of light absorbing layer, electron transporting and hole blocking layer, hole transporting and electron blocking layer, conductive substrate layer and metal electrode layer. The light absorbing layer is the important part of whole device, and it is fabricated by perovskite materials. After accepting the light, the electron-hole pair would be produced in this layer, and due to the energy level difference, the electron and hole produced would be transmitted to metal electrode and conductive substrate electrode through electron transporting layer and hole transporting layer respectively. In this way the response current would be produced. Based on this structure, the specific fabrication procedure including substrate cleaning; PEDOT:PSS layer preparation; pervoskite layer preparation; PCBM layer preparation; C60, BCP, and Ag electrode layer preparation. After the device fabrication, a series of morphological characterization and performance testing has been done. The testing procedure including film-forming quality inspection, response current and light wavelength analysis, linearity and response time and other optical and electrical properties testing. The testing result shows that the membrane has been fabricated uniformly; the device can produce obvious response current to the incident light with the wavelength from 350nm to 800nm, and the response current could be changed along with the light wavelength. When the light wavelength keeps constant, there exists a good linear relationship between the intensity of the response current and the power of the incident light, based on which the device could be used as the photo detector to collect the light information. During the changing period of the light signal, the response time of the device is several microseconds, which is acceptable working as a photo detector in our system. The testing results show that the device has good electronic and optical properties, and the fabrication procedure is also repeatable, the properties of the devices has good uniformity, which illustrates the fabrication method and procedure could be used to build the photo detector in our wearable system. Based on a series of testing results, the paper has drawn the conclusion that the photo detector fabricated could be integrated on the flexible substrate and is also suitable for the monitoring system proposed, thus made some progress on the research of the wearable monitoring system and device. Finally, some future prospect in system design aspect and device design and fabrication aspect are proposed.

Quantitative and Qualitative Trade-Off Analysis of Drowsy Driver Detection Methods: Single Electrode Wearable EEG Device, Multi-Electrode Wearable EEG Device, and Head-Mounted Gyroscope

Drowsy driving impairs motorists’ ability to operate vehicles safely, endangering both the drivers and other people on the road. The purpose of the project is to find the most effective wearable device to detect drowsiness. Existing research has demonstrated several options for drowsiness detection, such as electroencephalogram (EEG) brain wave measurement, eye tracking, head motions, and lane deviations. However, there are no detailed trade-off analyses for the cost, accuracy, detection time, and ergonomics of these methods. We chose to use two different EEG headsets: NeuroSky Mindwave Mobile (single-electrode) and Emotiv EPOC (14- electrode). We also tested a camera and gyroscope-accelerometer device. We can successfully determine drowsiness after five minutes of training using both single and multi-electrode EEGs. Devices were evaluated using the following criteria: time needed to achieve accurate reading, accuracy of prediction, rate of false positives vs. false negatives, and ergonomics and portability. This research will help improve detection devices, and reduce the number of future accidents due to drowsy driving.

”Stress Monitoring via Wearable Electrodermal Sensors”

Stress is a phenomenon that on some level affects everyone’s lives on a daily basis. The autonomic nervous system controls the varying levels of stress at any given time. The responses of the autonomic nervous system adjust the body to cope with changing external and internal conditions. During high-stress situations the body is forced into a state of heightened alertness, which passes when the stressor is removed. The stressor can be any external or internal event that causes the body to respond. Stress is a very versatile phenomenon that can be both a cause and an indicator of other medical conditions, for example cardiovascular disease. Stress detection can therefore be helpful in identifying these conditions and monitoring the overall emotional state of a person. Electrodermal activity (EDA) is one of the most easily implemented ways to monitor the activity of the autonomic nervous system. EDA describes changes occurring in the various electrical properties of the skin, including skin conductivity and resistance. Increased emotional sweating has been proven to be one possible indication of stress. On the surface of the skin, increased sweating translates to increased skin conductivity, which can be observed through EDA measurements. This makes electrodermal activity a very useful tool in a wide range of applications where it is desirable to observe changes in a person’s stress level. EDA can be recorded by using specialized body sensors placed on specific locations on the body. Most commonly used recording sites are the palms of the hands due to the high sweat gland density on those areas. Measurement is done using at least two electrodes attached to the skin, and recording the electrical conductance between them. This thesis implements a prototype of a wireless EDA measurement system. The feasibility of the prototype is also verified with a small group of test subjects. EDA was recorded from the subjects while they were playing a game of Tetris. The goal was to observe variations in the measured EDA that would indicate changes in the subjects’ stress levels during the game. The analysis of the obtained measurement results confirmed the connection between stress and recorded EDA. During the game, random occurrences of lowered skin resistance were clearly observable, which indicates points in the game where the player felt more anxious. A wireless measurement system has the potential of offering more flexible and comfortable long-term measuring of EDA, and could be utilized in a wide range of applications.

A study on situational awareness security and privacy of wearable health monitoring devices

Situational Awareness provides a user centric approach to security and privacy. The human factor is often recognised as the weakest link in security, therefore situational perception and risk awareness play a leading role in the adoption and implementation of security mechanisms. In this study we assess the understanding of security and privacy of users in possession of wearable devices. The findings demonstrate privacy complacency, as the majority of users trust the application and the wearable device manufacturer. Moreover the survey findings demonstrate a lack of understanding of security and privacy by the sample population. Finally the theoretical implications of the findings are discussed.

In step

In Step was a wearable artwork consisting of a pair of embroidered foot bandages and an actuator ‘cushion’ embedded with 15 electromechanical actuator pistons. The bandage was embedded with woven, soft and flexible fabric sensors - interconnected with metallic connecting threads, fasteners and a wireless interface (in a final form). When wrapped around a foot and lower leg the sensors sat on the ball of the toes and heel. This ‘wearable interface’ was then connected wirelessly to a soft sculptural form, which employed actuators to tap gently in response to the qualities of the walk detected by the soft sensors. In this way the ‘tread qualities’ of the walker could then be felt by someone else holding this device against their stomach – thereby allowing pairs of participants to ‘feel’ the tactile qualities of the other's walk. The work was presented both as a working object and via a short videorecorded performance.----- In Step generated innovative new approaches to interface and sensor embedded clothing/footware whilst also creating an evocative vehicle to comment upon contemporary Post Colonial theories of weight and groundedness – particularly the psycho-geographical ‘separation’ from the landscape that inspired Paul Carter’s “environmentally grounded poetics”. The work’s final form also suggested critical new directions for responsive clothing and footwear for the emerging genre of smart textiles.

Neo-Dandy

Neo-Dandy was a practice-led research project that explored histories of a quintessential men’s and womenswear garment from across the ages — the formal white dress shirt. The aim was to generate a body of radically new mens’ shirts that, whilst incorporating characteristics normally associated with womenswear, would remain acceptable to male wearers. A detailed study identified a broad spectrum of historical design approaches, ranging from the orthodox man’s shirt to the many variations of the women’s blouse. Within this spectrum a threshold was discovered where the men’s shirt morphed into the woman’s blouse — a ‘design moment’ that appeared to typify the dandy figure (a fashion character who subversively confronts dress norms of their day). The research analysed thousands of archive catwalk images from leading contemporary menswear designers, and of these, only a small number tampered appreciably with the men’s white dress shirt — suggesting a new realm of possibility for fashion design innovation. This led to the creation of a new body of work labelled ‘Neo-Dandy’. Sixty ‘concept shirts’ were produced, with differing styles and varying degrees of detailing, that fitted the brief of being acceptable to male wearers, eminently ‘wearable’ and on a threshold position between menswear and womenswear. These designs were each tested, documented, and assessed in their capacity to evolve the Neo-Dandy aesthetic. Based on these outcomes, a list of key design principles for achieving this aesthetic was identified to assist designers in further evolving this style. The creative work achieved substantial public acclaim with the ‘Neo Dandy Collection’ winning a prestigious Design Institute of Australia Award (Lifestyle category) and being one of four finalists in the prestigious overall field for design excellence. It was subsequently curated into three major Brisbane exhibitions — the ARC Biennial, at Artisan Gallery and the industry leader, the Mercedes Benz Fashion Festival. The collection was also exhibited at the Queensland Art Gallery.

Neo-Dandy

Neo-Dandy was a practice-led research project that explored histories of a quintessential men’s and womenswear garment from across the ages — the formal white dress shirt. The aim was to generate a body of radically new mens’ shirts that incorporated characteristics normally associated with womenswear, whist remaining acceptable to male wearers. A detailed study identified a broad spectrum of historical design approaches, ranging from the orthodox man’s shirt to the many variations of the women’s blouse. Within this spectrum a threshold was discovered where the men’s shirt morphed into the woman’s blouse — a ‘design moment’ that appeared to typify the dandy figure (a fashion character who subversively confronts dress norms of their day). The research analysed thousands of archive catwalk images from leading contemporary menswear designers, and of these, only a small number tampered appreciably with the men’s white dress shirt — suggesting a new realm of possibility for fashion design innovation. This led to the creation of a new body of work labelled ‘Neo-Dandy’. Sixty ‘concept shirts’ were produced, with differing styles and varying degrees of detailing, that fitted the brief of being acceptable to male wearers, eminently ‘wearable’ and on a threshold position between menswear and womenswear. These designs were each tested, documented, and assessed in their capacity to evolve the Neo-Dandy aesthetic. Based on these outcomes, a list of key design principles for achieving this aesthetic was identified to assist designers in further evolving this style. The creative work achieved substantial public acclaim with the ‘Neo Dandy Collection’ winning a prestigious Design Institute of Australia Award (Lifestyle category) and being one of four finalists in the prestigious overall field for design excellence. It was subsequently curated into three major Brisbane exhibitions — the ARC Biennial, at Artisan Gallery and the industry leader, the Mercedes Benz Fashion Festival. The collection was also exhibited at the Queensland Art Gallery.

Results from the farm

This paper reports on a large, long-term mobile wireless sensor network deployment. The trial was part of an animal study involving 45 animals. During the trial, 15 animals were equipped with wireless sensor nodes for a week. The paper discusses various issues with such a deployment including electronic design, software design, animal ethics clearance, logistics, and wearable computing equipment for animals. The paper also presents some preliminary analysis of the data obtained from the deployment, both from the perspective of network parameters and animal movement behavior.