Machine learning techniques for implicit interaction using mobile sensors

Interactions in mobile devices normally happen in an explicit manner, which means that they are initiated by the users. Yet, users are typically unaware that they also interact implicitly with their devices. For instance, our hand pose changes naturally when we type text messages. Whilst the touchscreen captures finger touches, hand movements during this interaction however are unused. If this implicit hand movement is observed, it can be used as additional information to support or to enhance the users’ text entry experience. This thesis investigates how implicit sensing can be used to improve existing, standard interaction technique qualities. In particular, this thesis looks into enhancing front-of-device interaction through back-of-device and hand movement implicit sensing. We propose the investigation through machine learning techniques. We look into problems on how sensor data via implicit sensing can be used to predict a certain aspect of an interaction. For instance, one of the questions that this thesis attempts to answer is whether hand movement during a touch targeting task correlates with the touch position. This is a complex relationship to understand but can be best explained through machine learning. Using machine learning as a tool, such correlation can be measured, quantified, understood and used to make predictions on future touch position. Furthermore, this thesis also evaluates the predictive power of the sensor data. We show this through a number of studies. In Chapter 5 we show that probabilistic modelling of sensor inputs and recorded touch locations can be used to predict the general area of future touches on touchscreen. In Chapter 7, using SVM classifiers, we show that data from implicit sensing from general mobile interactions is user-specific. This can be used to identify users implicitly. In Chapter 6, we also show that touch interaction errors can be detected from sensor data. In our experiment, we show that there are sufficient distinguishable patterns between normal interaction signals and signals that are strongly correlated with interaction error. In all studies, we show that performance gain can be achieved by combining sensor inputs.

Numerical modelling of braided fibres for reinforced concrete

Fire has been always a major concern for designers of steel and concrete structures. Designing fire-resistant structural elements is not an easy task due to several limitations such as the lack of fire-resistant construction materials. Concrete reinforcement cover and external insulation are the most commonly adopted systems to protect concrete and steel from overheating, while spalling of concrete is minimised by using HPFRC instead of standard concrete. Although these methodologies work very well for low rise concrete structures, this is not the case for high-rise and inaccessible buildings where fire loading is much longer. Fire can permanently damage structures that cost a lot of money. This is unsafe and can lead to loss of life. In this research, the author proposes a new type of main reinforcement for concrete structures which can provide better fire-resistance than steel or FRP re-bars. This consists of continuous braided fibre rope, generally made from fire-resistant materials such as carbon or glass fibre. These fibres have excellent tensile strengths, sometimes in excess of ten times greater than steel. In addition to fire-resistance, these ropes can produce lighter and corrosive resistant structures. Avoiding the use of expensive resin binders, fibres are easily bound together using braiding techniques, ensuring that tensile stress is evenly distributed throughout the reinforcement. In order to consider braided ropes as a form of reinforcement it is first necessary to establish the mechanical performance at room temperature and investigate the pull-out resistance for both unribbed and ribbed ropes. Ribbing of ropes was achieved by braiding the rope over a series of glass beads. Adhesion between the rope and concrete was drastically improved due to ribbing, and further improved by pre-stressing ropes and reducing the slacked fibres. Two types of material have been considered for the ropes: carbon and aramid. An implicit finite element approach is proposed to model braided fibres using Total Lagrangian formulation, based on the theory of small strains and large rotations. Modelling tows and strands as elastic transversely isotropic materials was a good assumption when stiff and brittle fibres such as carbon and glass fibres are considered. The rope-to-concrete and strand-to-strand bond interaction/adhesion was numerically simulated using newly proposed hierarchical higher order interface elements. Elastic and linear damage cohesive models were used effectively to simulate non-penetrative 'free' sliding interaction between strands, and the adhesion between ropes and concrete respectively. Numerical simulation showed similar de-bonding features when compared with experimental pull-out results of braided ribbed rope reinforced concrete.