User interaction monitoring and analysis framework

An overview is given of a user interaction monitoring and analysis framework called BaranC. Monitoring and analysing human-digital interaction is an essential part of developing a user model as the basis for investigating user experience. The primary human-digital interaction, such as on a laptop or smartphone, is best understood and modelled in the wider context of the user and their environment. The BaranC framework provides monitoring and analysis capabilities that not only records all user interaction with a digital device (e.g. smartphone), but also collects all available context data (such as from sensors in the digital device itself, a fitness band or a smart appliances). The data collected by BaranC is recorded as a User Digital Imprint (UDI) which is, in effect, the user model and provides the basis for data analysis. BaranC provides functionality that is useful for user experience studies, user interface design evaluation, and providing user assistance services. An important concern for personal data is privacy, and the framework gives the user full control over the monitoring, storing and sharing of their data.

Novel efficient technologies in Europe for axle bearing condition monitoring – the MAXBE project

Axle bearing damage with possible catastrophic failures can cause severe disruptions or even dangerous derailments, potentially causing loss of human life and leading to significant costs for railway infrastructure managers and rolling stock operators. Consequently the axle bearing damage process has safety and economic implications on the exploitation of railways systems. Therefore it has been the object of intense attention by railway authorities as proved by the selection of this topic by the European Commission in calls for research proposals. The MAXBE Project (http://www.maxbeproject.eu/), an EU-funded project, appears in this context and its main goal is to develop and to demonstrate innovative and efficient technologies which can be used for the onboard and wayside condition monitoring of axle bearings. The MAXBE (interoperable monitoring, diagnosis and maintenance strategies for axle bearings) project focuses on detecting axle bearing failure modes at an early stage by combining new and existing monitoring techniques and on characterizing the axle bearing degradation process. The consortium for the MAXBE project comprises 18 partners from 8 member states, representing operators, railway administrations, axle bearing manufactures, key players in the railway community and experts in the field of monitoring, maintenance and rolling stock. The University of Porto is coordinating this research project that kicked-off in November 2012 and it is completed on October 2015. Both on-board and wayside systems are explored in the project since there is a need for defining the requirement for the onboard equipment and the range of working temperatures of the axle bearing for the wayside systems. The developed monitoring systems consider strain gauges, high frequency accelerometers, temperature sensors and acoustic emission. To get a robust technology to support the decision making of the responsible stakeholders synchronized measurements from onboard and wayside monitoring systems are integrated into a platform. Also extensive laboratory tests were performed to correlate the in situ measurements to the status of the axle bearing life. With the MAXBE project concept it will be possible: to contribute to detect at an early stage axle bearing failures; to create conditions for the operational and technical integration of axle bearing monitoring and maintenance in different European railway networks; to contribute to the standardization of the requirements for the axle bearing monitoring, diagnosis and maintenance. Demonstration of the developed condition monitoring systems was performed in Portugal in the Northern Railway Line with freight and passenger traffic with a maximum speed of 220 km/h, in Belgium in a tram line and in the UK. Still within the project, a tool for optimal maintenance scheduling and a smart diagnostic tool were developed. This paper presents a synthesis of the most relevant results attained in the project. The successful of the project and the developed solutions have positive impact on the reliability, availability, maintainability and safety of rolling stock and infrastructure with main focus on the axle bearing health.

Child-centred design supported by comprehensive child application use analysis

Since children already use and explore applications on smartphones, we use this as the starting point for design. Our monitoring and analysis framework, BaranC, enables us to discover and analyse which applications children uses and precisely how they interact with them. The monitoring happens unobtrusively in the background so children interact normally in their own natural environment without artificial constraints. Thus, we can discover to what extent a child of a particular age engages with, and how they physically interact with, existing applications. This information in turn provides the basis for design of new child-centred applications which can then be subject to the same comprehensive child use analysis using our framework. The work focuses on the first aspect, namely, the monitoring and analysis of current child use of smartphones. Experiments show the value of this approach and interesting results have been obtained from this precise monitoring of child smartphone usage.

A service-oriented user interaction analysis framework supporting adaptive applications

A comprehensive user model, built by monitoring a user's current use of applications, can be an excellent starting point for building adaptive user-centred applications. The BaranC framework monitors all user interaction with a digital device (e.g. smartphone), and also collects all available context data (such as from sensors in the digital device itself, in a smart watch, or in smart appliances) in order to build a full model of user application behaviour. The model built from the collected data, called the UDI (User Digital Imprint), is further augmented by analysis services, for example, a service to produce activity profiles from smartphone sensor data. The enhanced UDI model can then be the basis for building an appropriate adaptive application that is user-centred as it is based on an individual user model. As BaranC supports continuous user monitoring, an application can be dynamically adaptive in real-time to the current context (e.g. time, location or activity). Furthermore, since BaranC is continuously augmenting the user model with more monitored data, over time the user model changes, and the adaptive application can adapt gradually over time to changing user behaviour patterns. BaranC has been implemented as a service-oriented framework where the collection of data for the UDI and all sharing of the UDI data are kept strictly under the user's control. In addition, being service-oriented allows (with the user's permission) its monitoring and analysis services to be easily used by 3rd parties in order to provide 3rd party adaptive assistant services. An example 3rd party service demonstrator, built on top of BaranC, proactively assists a user by dynamic predication, based on the current context, what apps and contacts the user is likely to need. BaranC introduces an innovative user-controlled unified service model of monitoring and use of personal digital activity data in order to provide adaptive user-centred applications. This aims to improve on the current situation where the diversity of adaptive applications results in a proliferation of applications monitoring and using personal data, resulting in a lack of clarity, a dispersal of data, and a diminution of user control.

Vibration based health monitoring of civil infrastructure using energy harvesting techniques

The use of structural health monitoring of civil structures is ever expanding and by assessing the dynamical condition of structures, informed maintenance management can be conducted at both individual and network levels. With the continued growth of information age technology, the potential arises for smart monitoring systems to be integrated with civil infrastructure to provide efficient information on the condition of a structure. The focus of this thesis is the integration of smart technology with civil infrastructure for the purposes of structural health monitoring. The technology considered in this regard are devices based on energy harvesting materials. While there has been considerable focus on the development and optimisation of such devices using steady state loading conditions, their applications for civil infrastructure are less known. Although research is still in initial stages, studies into the uses associated with such applications are very promising. Through the use of the dynamical response of structures to a variety of loading conditions, the energy harvesting outputs from such devices is established and the potential power output determined. Through a power variance output approach, damage detection of deteriorating structures using the energy harvesting devices is investigated. Further applications of the integration of energy harvesting devices with civil infrastructure investigated by this research includes the use of the power output as a indicator for control. Four approaches are undertaken to determine the potential applications arising from integrating smart technology with civil infrastructure, namely • Theoretical analysis to determine the applications of energy harvesting devices for vibration based health monitoring of civil infrastructure. • Laboratory experimentation to verify the performance of different energy harvesting configurations for civil infrastructure applications. • Scaled model testing as a method to experimentally validate the integration of the energy harvesting devices with civil infrastructure. • Full scale deployment of energy harvesting device with a bridge structure. These four approaches validate the application of energy harvesting technology with civil infrastructure from a theoretical, experimental and practical perspective.