Interaction techniques with novel multimodal feedback for addressing gesture-sensing systems

Users need to be able to address in-air gesture systems, which means finding where to perform gestures and how to direct them towards the intended system. This is necessary for input to be sensed correctly and without unintentionally affecting other systems. This thesis investigates novel interaction techniques which allow users to address gesture systems properly, helping them find where and how to gesture. It also investigates audio, tactile and interactive light displays for multimodal gesture feedback; these can be used by gesture systems with limited output capabilities (like mobile phones and small household controls), allowing the interaction techniques to be used by a variety of device types. It investigates tactile and interactive light displays in greater detail, as these are not as well understood as audio displays. Experiments 1 and 2 explored tactile feedback for gesture systems, comparing an ultrasound haptic display to wearable tactile displays at different body locations and investigating feedback designs. These experiments found that tactile feedback improves the user experience of gesturing by reassuring users that their movements are being sensed. Experiment 3 investigated interactive light displays for gesture systems, finding this novel display type effective for giving feedback and presenting information. It also found that interactive light feedback is enhanced by audio and tactile feedback. These feedback modalities were then used alongside audio feedback in two interaction techniques for addressing gesture systems: sensor strength feedback and rhythmic gestures. Sensor strength feedback is multimodal feedback that tells users how well they can be sensed, encouraging them to find where to gesture through active exploration. Experiment 4 found that they can do this with 51mm accuracy, with combinations of audio and interactive light feedback leading to the best performance. Rhythmic gestures are continuously repeated gesture movements which can be used to direct input. Experiment 5 investigated the usability of this technique, finding that users can match rhythmic gestures well and with ease. Finally, these interaction techniques were combined, resulting in a new single interaction for addressing gesture systems. Using this interaction, users could direct their input with rhythmic gestures while using the sensor strength feedback to find a good location for addressing the system. Experiment 6 studied the effectiveness and usability of this technique, as well as the design space for combining the two types of feedback. It found that this interaction was successful, with users matching 99.9% of rhythmic gestures, with 80mm accuracy from target points. The findings show that gesture systems could successfully use this interaction technique to allow users to address them. Novel design recommendations for using rhythmic gestures and sensor strength feedback were created, informed by the experiment findings.

Improving interfaces for nerve repair

Autologous nerve grafts are the current gold standard for the repair of peripheral nerve injuries. However, there is a need to develop an alternative to this technique, as donor-site morbidities such as neuroma formation and permanent loss of function are a few of the limitations concerned with this technique. Artificial nerve conduits have therefore emerged as an alternative for the repair of short peripheral nerve defects of less than 30 mm, however they do not surpass autologous nerve grafts clinically. To develop a nerve conduit that supports regeneration over long nerve gaps and in large diameter nerves, researchers have focused on functionalizing of the conduits by studying the components that enhance nerve regeneration such as micro/nano-topography, growth factor delivery systems, supportive cells and extracellular matrix (ECM) proteins as well as understanding the complex biological reactions that take place during peripheral nerve regeneration. This thesis presents strategies to improve peripheral nerve interfaces to better the regenerative potential by using dorsal root ganglions (DRGs) isolated from neonatal rats as an in vitro model of nerve regeneration. The work started off by investigating the usefulness of a frog foam protein Ranaspumin-2 (Rsn2) to coat biomaterials for compatibility, this lead to the discovery of temporary cell adhesion on polydimethylsiloxane (PDMS), which was investigated as a suitable tool to derive cell-sheets for nerve repair. The influence of Rsn2 anchored to specific adhesion peptide sequences, such as isoleucine-lysine-valine-alanine-valine (IKVAV), a sequence derived from laminin proven to promote cell adhesion and neurite outgrowth, was tested as a useful means to influence nerve regeneration. This approach improves the axonal outgrowth and maintains outgrowth long term. Based on the hypothesis that combinational modulation of substrate topography, stiffness and neurotrophic support, affects axonal outgrowth in whole DRGs, dissociated DRGs were used to assess if these factors similarly act at the single cell level. Rho associated protein kinase (ROCK) and myosin II inhibitors, which affect cytoskeletal contractility, were used to influence growth cone traction forces and have shown that these factors work in combination by interfering with growth cone dynamic creating a different response in axonal outgrowth at the single cell level.