Learning articulated motion structures with Bayesian Networks

This paper presents a general methodology for learning articulated motions that, despite having non-linear correlations, are cyclical and have a defined pattern of behavior Using conventional algorithms to extract features from images, a Bayesian classifier is applied to cluster and classify features of the moving object. Clusters are then associated in different frames and structure learning algorithms for Bayesian networks are used to recover the structure of the motion. This framework is applied to the human gait analysis and tracking but applications include any coordinated movement such as multi-robots behavior analysis.

Technology, memory and experience : virtual reality, motion capture and early modern theatre

This paper investigates virtual reality representations of performance in London’s late sixteenth-century Rose Theatre, a venue that, by means of current technology, can once again challenge perceptions of space, performance, and memory. The VR model of The Rose becomes a Camillo device in that it represents a virtual recreation of this venue in as much detail as possible and attempts to recover graphic demonstrations of the trace memories of the performance modes of the day. The VR model is based on accurate archeological and theatre historical records and is easy to navigate. The introduction of human figures onto The Rose’s stage via motion capture allows us to explore the relationships between space, actor and environment. The combination of venue and actors facilitates a new way of thinking about how the work of early modern playwrights can be stored and recalled. This virtual theatre is thus activated to intersect productively with contemporary studies in performance; as such, our paper provides a perspective on and embodiment of the relation between technology, memory and experience. It is, at its simplest, a useful archiving project for theatrical history, but it is directly relevant to contemporary performance practice as well. Further, it reflects upon how technology and ‘re-enactments’ of sorts mediate the way in which knowledge and experience are transferred, and even what may be considered ‘knowledge.’ Our work provides opportunities to begin addressing what such intermedial confrontations might produce for ‘remembering, experiencing, thinking and imagining.’ We contend that these confrontations will enhance live theatre performance rather than impeding or disrupting contemporary performance practice. This paper intersects with the CFP’s ‘Performing Memory’ and ‘Memory Lab’ themes. Our presentation (which includes a demonstration of the VR model and the motion capture it requires) takes the form of two closely linked papers that share a single abstract. The two papers will be given by two people, one of whom will be physically present in Utrecht, the other participating via Skype.

Loculus : an ontology-based information management framework for the motion picture industry

"How do you film a punch?" This question can be posed by actors, make-up artists, directors and cameramen. Though they can all ask the same question, they are not all seeking the same answer. Within a given domain, based on the roles they play, agents of the domain have different perspectives and they want the answers to their question from their perspective. In this example, an actor wants to know how to act when filming a scene involving a punch. A make-up artist is interested in how to do the make-up of the actor to show bruises that may result from the punch. Likewise, a director wants to know how to direct such a scene and a cameraman is seeking guidance on how best to film such a scene. This role-based difference in perspective is the underpinning of the Loculus framework for information management for the Motion Picture Industry. The Loculus framework exploits the perspective of agent for information extraction and classification within a given domain. The framework uses the positioning of the agent’s role within the domain ontology and its relatedness to other concepts in the ontology to determine the perspective of the agent. Domain ontology had to be developed for the motion picture industry as the domain lacked one. A rule-based relatedness score was developed to calculate the relative relatedness of concepts with the ontology, which were then used in the Loculus system for information exploitation and classification. The evaluation undertaken to date have yielded promising results and have indicated that exploiting perspective can lead to novel methods of information extraction and classifications.

Robust suspicious behaviour detection for smart surveillance systems

Video surveillance technology, based on Closed Circuit Television (CCTV) cameras, is one of the fastest growing markets in the field of security technologies. However, the existing video surveillance systems are still not at a stage where they can be used for crime prevention. The systems rely heavily on human observers and are therefore limited by factors such as fatigue and monitoring capabilities over long periods of time. To overcome this limitation, it is necessary to have “intelligent” processes which are able to highlight the salient data and filter out normal conditions that do not pose a threat to security. In order to create such intelligent systems, an understanding of human behaviour, specifically, suspicious behaviour is required. One of the challenges in achieving this is that human behaviour can only be understood correctly in the context in which it appears. Although context has been exploited in the general computer vision domain, it has not been widely used in the automatic suspicious behaviour detection domain. So, it is essential that context has to be formulated, stored and used by the system in order to understand human behaviour. Finally, since surveillance systems could be modeled as largescale data stream systems, it is difficult to have a complete knowledge base. In this case, the systems need to not only continuously update their knowledge but also be able to retrieve the extracted information which is related to the given context. To address these issues, a context-based approach for detecting suspicious behaviour is proposed. In this approach, contextual information is exploited in order to make a better detection. The proposed approach utilises a data stream clustering algorithm in order to discover the behaviour classes and their frequency of occurrences from the incoming behaviour instances. Contextual information is then used in addition to the above information to detect suspicious behaviour. The proposed approach is able to detect observed, unobserved and contextual suspicious behaviour. Two case studies using video feeds taken from CAVIAR dataset and Z-block building, Queensland University of Technology are presented in order to test the proposed approach. From these experiments, it is shown that by using information about context, the proposed system is able to make a more accurate detection, especially those behaviours which are only suspicious in some contexts while being normal in the others. Moreover, this information give critical feedback to the system designers to refine the system. Finally, the proposed modified Clustream algorithm enables the system to both continuously update the system’s knowledge and to effectively retrieve the information learned in a given context. The outcomes from this research are: (a) A context-based framework for automatic detecting suspicious behaviour which can be used by an intelligent video surveillance in making decisions; (b) A modified Clustream data stream clustering algorithm which continuously updates the system knowledge and is able to retrieve contextually related information effectively; and (c) An update-describe approach which extends the capability of the existing human local motion features called interest points based features to the data stream environment.

Automated object identification using optical video cameras on construction sites

Visual recording devices such as video cameras, CCTVs, or webcams have been broadly used to facilitate work progress or safety monitoring on construction sites. Without human intervention, however, both real-time reasoning about captured scenes and interpretation of recorded images are challenging tasks. This article presents an exploratory method for automated object identification using standard video cameras on construction sites. The proposed method supports real-time detection and classification of mobile heavy equipment and workers. The background subtraction algorithm extracts motion pixels from an image sequence, the pixels are then grouped into regions to represent moving objects, and finally the regions are identified as a certain object using classifiers. For evaluating the method, the formulated computer-aided process was implemented on actual construction sites, and promising results were obtained. This article is expected to contribute to future applications of automated monitoring systems of work zone safety or productivity.

Monitoring mesenchymal stem cell cultures using image processing and pattern recognition techniques

Stem cells have attracted tremendous interest in recent times due to their promise in providing innovative new treatments for a great range of currently debilitating diseases. This is due to their potential ability to regenerate and repair damaged tissue, and hence restore lost body function, in a manner beyond the body's usual healing process. Bone marrow-derived mesenchymal stem cells or bone marrow stromal cells are one type of adult stem cells that are of particular interest. Since they are derived from a living human adult donor, they do not have the ethical issues associated with the use of human embryonic stem cells. They are also able to be taken from a patient or other donors with relative ease and then grown readily in the laboratory for clinical application. Despite the attractive properties of bone marrow stromal cells, there is presently no quick and easy way to determine the quality of a sample of such cells. Presently, a sample must be grown for weeks and subject to various time-consuming assays, under the direction of an expert cell biologist, to determine whether it will be useful. Hence there is a great need for innovative new ways to assess the quality of cell cultures for research and potential clinical application. The research presented in this thesis investigates the use of computerised image processing and pattern recognition techniques to provide a quicker and simpler method for the quality assessment of bone marrow stromal cell cultures. In particular, aim of this work is to find out whether it is possible, through the use of image processing and pattern recognition techniques, to predict the growth potential of a culture of human bone marrow stromal cells at early stages, before it is readily apparent to a human observer. With the above aim in mind, a computerised system was developed to classify the quality of bone marrow stromal cell cultures based on phase contrast microscopy images. Our system was trained and tested on mixed images of both healthy and unhealthy bone marrow stromal cell samples taken from three different patients. This system, when presented with 44 previously unseen bone marrow stromal cell culture images, outperformed human experts in the ability to correctly classify healthy and unhealthy cultures. The system correctly classified the health status of an image 88% of the time compared to an average of 72% of the time for human experts. Extensive training and testing of the system on a set of 139 normal sized images and 567 smaller image tiles showed an average performance of 86% and 85% correct classifications, respectively. The contributions of this thesis include demonstrating the applicability and potential of computerised image processing and pattern recognition techniques to the task of quality assessment of bone marrow stromal cell cultures. As part of this system, an image normalisation method has been suggested and a new segmentation algorithm has been developed for locating cell regions of irregularly shaped cells in phase contrast images. Importantly, we have validated the efficacy of both the normalisation and segmentation method, by demonstrating that both methods quantitatively improve the classification performance of subsequent pattern recognition algorithms, in discriminating between cell cultures of differing health status. We have shown that the quality of a cell culture of bone marrow stromal cells may be assessed without the need to either segment individual cells or to use time-lapse imaging. Finally, we have proposed a set of features, that when extracted from the cell regions of segmented input images, can be used to train current state of the art pattern recognition systems to predict the quality of bone marrow stromal cell cultures earlier and more consistently than human experts.

Novel corrosion sensor based on carbon nanotube composites for structural health monitoring

Bridges are important infrastructures of all nations and are required for transportation of goods as well as human. A catastrophic failure can result in loss of lives and enormous financial hardship to the nation. Hence, there is an urgent need to monitor our infrastructures to prolong their life span, at the same time catering for heavier and faster moving traffics. Although various kinds of sensors are now available to monitor the health of the structures due to corrosion, they do not provide permanent and long term measurements. This paper investigates the fabrication of Carbon Nanotube (CNT) based composite sensors for structural health monitoring. The CNTs, a key material in nanotechnology has aroused great interest in the research community due to their remarkable mechanical, electrochemical, piezoresistive and other physical properties. Multi-wall CNT (MWCNT)/Nafion composite sensors were fabricated to evaluate their electrical properties when subjected to chemical solutions, to simulate a chemical reaction due to corrosion and real life corrosion experimental tests. The electrical resistance of the sensor electrode was dramatically changed due to corrosion. The novel sensor is expected to effectively detect corrosion in structures based on the measurement of electrical impedances of the CNT composite.

The acute adaptations of normal and pathological human Achilles tendons to eccentric and concentric exercise

Eccentric exercise is the conservative treatment of choice for mid-portion Achilles tendinopathy. While there is a growing body of evidence supporting the medium to long term efficacy of eccentric exercise in Achilles tendinopathy treatment, very few studies have investigated the short term response of the tendon to eccentric exercise. Moreover, the mechanisms through which tendinopathy symptom resolution occurs remain to be established. The primary purpose of this thesis was to investigate the acute adaptations of the Achilles tendon to, and the biomechanical characteristics of, the eccentric exercise protocol used for Achilles tendinopathy rehabilitation and a concentric equivalent. The research was conducted with an orientation towards exploring potential mechanisms through which eccentric exercise may bring about a resolution of tendinopathy symptoms. Specifically, the morphology of tendinopathic and normal Achilles tendons was monitored using high resolution sonography prior to and following eccentric and concentric exercise, to facilitate comparison between the treatment of choice and a similar alternative. To date, the only proposed mechanism through which eccentric exercise is thought to result in symptom resolution is the increased variability in motor output force observed during eccentric exercise. This thesis expanded upon prior work by investigating the variability in motor output force recorded during eccentric and concentric exercises, when performed at two different knee joint angles, by limbs with and without symptomatic tendinopathy. The methodological phase of the research focused on establishing the reliability of measures of tendon thickness, tendon echogenicity, electromyography (EMG) of the Triceps Surae and the standard deviation (SD) and power spectral density (PSD) of the vertical ground reaction force (VGRF). These analyses facilitated comparison between the error in the measurements and experimental differences identified as statistically significant, so that the importance and meaning of the experimental differences could be established. One potential limitation of monitoring the morphological response of the Achilles tendon to exercise loading is that the Achilles tendon is continually exposed to additional loading as participants complete the walking required to carry out their necessary daily tasks. The specific purpose of the last experiment in the methodological phase was to evaluate the effect of incidental walking activity on Achilles tendon morphology. The results of this study indicated that walking activity could decrease Achilles tendon thickness (negative diametral strain) and that the decrease in thickness was dependent on both the amount of walking completed and the proximity of walking activity to the sonographic examination. Thus, incidental walking activity was identified as a potentially confounding factor for future experiments which endeavoured to monitor changes in tendon thickness with exercise loading. In the experimental phase of this thesis the thickness of Achilles tendons was monitored prior to and following isolated eccentric and concentric exercise. The initial pilot study demonstrated that eccentric exercise resulted in a greater acute decrease in Achilles tendon thickness (greater diametral strain) compared to an equivalent concentric exercise, in participants with no history of Achilles tendon pain. This experiment was then expanded to incorporate participants with unilateral Achilles tendinopathy. The major finding of this experiment was that the acute decrease in Achilles tendon thickness observed following eccentric exercise was modified by the presence of tendinopathy, with a smaller decrease (less diametral strain) noted for tendinopathic compared to healthy control tendon. Based on in vitro evidence a decrease in tendon thickness is believed to reflect extrusion of fluid from the tendon with loading. This process would appear to be limited by the presence of pathology and is hypothesised to be a result of the changes in tendon structure associated with tendinopathy. Load induced fluid movement may be important to the maintenance of tendon homeostasis and structure as it has the potential to enhance molecular movement and stimulate tendon remodelling. On this basis eccentric exercise may be more beneficial to the tendon than concentric exercise. Finally, EMG and motor output force variability (SD and PSD of VGRF) were investigated while participants with and without tendinopathy performed the eccentric and concentric exercises. Although between condition differences were identified as statistically significant for a number of force variability parameters, the differences were not greater than the limits of agreement for repeated measures. Consequently the meaning and importance of these findings were questioned. Interestingly, the EMG amplitude of all three Triceps Surae muscles did not vary with knee joint angle during the performance of eccentric exercise. This raises questions pertaining to the functional importance of performing the eccentric exercise protocol at each of the two knee joint angles as it is currently prescribed. EMG amplitude was significantly greater during concentric compared to eccentric muscle actions. Differences in the muscle activation patterns may result in different stress distributions within the tendon and be related to the different diametral strain responses observed for eccentric and concentric muscle actions.

Human-specific E. coli single nucleotide polymorphism (SNP) genotypes detected in a South-East Queensland waterway, Australia

The World Health Organization recommends that the majority of water monitoring laboratories in the world should test for E. coli daily since thermotolerant coliforms and E. coli are key indicators for risk assessment of recreational waters. Recently, we developed a new SNP method for typing E. coli strains, by which human-specific genotypes were identified. Here, we report the presence of these previously described specific SNP profiles in environmental water, sourced from the Coomera River, located on South East Queensland, Australia, over a period of two years. This study tested for the presence of human-specific E. coli to ascertain whether hydrologic and anthropogenic activity plays a key role in the pollution of the investigated watershed or whether the pollution is from other sources. We found six human-specific SNP profiles and one animal-specific SNP profile consistently across sampling sites and times. We have demonstrated that our SNP genotyping method is able to rapidly identify and characterise human- and animal-specific E. coli isolates in water sources.

Adherence, adaptation and acceptance of elderly chronic heart failure patients to receiving healthcare via telephone-monitoring

Background: Although the potential to reduce hospitalisation and mortality in chronic heart failure (CHF) is well reported, the feasibility of receiving healthcare by structured telephone support or telemonitoring is not. Aims: To determine; adherence, adaptation and acceptability to a national nurse-coordinated telephone-monitoring CHF management strategy. The Chronic Heart Failure Assistance by Telephone Study (CHAT). Methods: Triangulation of descriptive statistics, feedback surveys and qualitative analysis of clinical notes. Cohort comprised of standard care plus intervention (SC + I) participants who completed the first year of the study. Results: 30 GPs (70% rural) randomised to SC + I recruited 79 eligible participants, of whom 60 (76%) completed the full 12 month follow-up period. During this time 3619 calls were made into the CHAT system (mean 45.81 SD ± 79.26, range 0-369), Overall there was an adherence to the study protocol of 65.8% (95% CI 0.54-0.75; p = 0.001) however, of the 60 participants who completed the 12 month follow-up period the adherence was significantly higher at 92.3% (95% CI 0.82-0.97, p ≤ 0.001). Only 3% of this elderly group (mean age 74.7 ±9.3 years) were unable to learn or competently use the technology. Participants rated CHAT with a total acceptability rate of 76.45%. Conclusion: This study shows that elderly CHF patients can adapt quickly, find telephone-monitoring an acceptable part of their healthcare routine, and are able to maintain good adherence for a least 12 months. © 2007.

Monitoring identity of past, current and future : a performance management system perspective

This paper seeks to explore how organisations can effectively use performance management systems (PMS) to monitor collective identities. The monitoring of relationships between identity and an influential PMS—the balanced scorecard (BSC)—are explored. Drawing from identity and management accounting literature, this paper argues that identity products, patternings and processes are commonly positioned, monitored and interpreted through the multiple perspectives and levels of the BSC. Specifically, human, technical and organisational capital under the Learning and Growth perspective of the BSC can incorporate various identity measures that sustain the relative, distinctive and fluid nature of identities. The value of this research is to strengthen the theoretical grounds which position identity as an important dimension of organisational capital in PMS.

Graph rigidity for near-coplanar structure from motion

Recent algorithms for monocular motion capture (MoCap) estimate weak-perspective camera matrices between images using a small subset of approximately-rigid points on the human body (i.e. the torso and hip). A problem with this approach, however, is that these points are often close to coplanar, causing canonical linear factorisation algorithms for rigid structure from motion (SFM) to become extremely sensitive to noise. In this paper, we propose an alternative solution to weak-perspective SFM based on a convex relaxation of graph rigidity. We demonstrate the success of our algorithm on both synthetic and real world data, allowing for much improved solutions to marker less MoCap problems on human bodies. Finally, we propose an approach to solve the two-fold ambiguity over bone direction using a k-nearest neighbour kernel density estimator.

Next generation low-cost motion capture systems can provide comparable spatial accuracy to high-end systems

The objective quantification of three-dimensional kinematics during different functional and occupational tasks is now more in demand than ever. The introduction of new generation of low-cost passive motion capture systems from a number of manufacturers has made this technology accessible for teaching, clinical practice and in small/medium industry. Despite the attractive nature of these systems, their accuracy remains unproved in independent tests. We assessed static linear accuracy, dynamic linear accuracy and compared gait kinematics from a Vicon MX20 system to a Natural Point OptiTrack system. In all experiments data were sampled simultaneously. We identified both systems perform excellently in linear accuracy tests with absolute errors not exceeding 1%. In gait data there was again strong agreement between the two systems in sagittal and coronal plane kinematics. Transverse plane kinematics differed by up to 3 at the knee and hip, which we attributed to the impact of soft tissue artifact accelerations on the data. We suggest that low-cost systems are comparably accurate to their high-end competitors and offer a platform with accuracy acceptable in research for laboratories with a limited budget.

A comprehensive literature review of the pelvis and the lower extremity digital human models under quasi-static conditions

Finite Element Modeling (FEM) has become a vital tool in the automotive design and development processes. FEM of the human body is a technique capable of estimating parameters that are difficult to measure in experimental studies with the human body segments being modeled as complex and dynamic entities. Several studies have been dedicated to attain close-to-real FEMs of the human body (Pankoke and Siefert 2007; Amann, Huschenbeth et al. 2009; ESI 2010). The aim of this paper is to identify and appraise the state of-the art models of the human body which incorporate detailed pelvis and/or lower extremity models. Six databases and search engines were used to obtain literature, and the search was limited to studies published in English since 2000. The initial search results identified 636 pelvis-related papers, 834 buttocks-related papers, 505 thigh-related papers, 927 femur-related papers, 2039 knee-related papers, 655 shank-related papers, 292 tibia-related papers, 110 fibula-related papers, 644 ankle related papers, and 5660 foot-related papers. A refined search returned 100 pelvis-related papers, 45 buttocks related papers, 65 thigh-related papers, 162 femur-related papers, 195 kneerelated papers, 37 shank-related papers, 80 tibia-related papers, 30 fibula-related papers and 102 ankle-related papers and 246 foot-related papers. The refined literature list was further restricted by appraisal against a modified LOW appraisal criteria. Studies with unclear methodologies, with a focus on populations with pathology or with sport related dynamic motion modeling were excluded. The final literature list included fifteen models and each was assessed against the percentile the model represents, the gender the model was based on, the human body segment/segments included in the model, the sample size used to develop the model, the source of geometric/anthropometric values used to develop the model, the posture the model represents and the finite element solver used for the model. The results of this literature review provide indication of bias in the available models towards 50th percentile male modeling with a notable concentration on the pelvis, femur and buttocks segments.