Non-redundant sequential association rule mining based on closed sequential patterns

In many applications, e.g., bioinformatics, web access traces, system utilisation logs, etc., the data is naturally in the form of sequences. People have taken great interest in analysing the sequential data and finding the inherent characteristics or relationships within the data. Sequential association rule mining is one of the possible methods used to analyse this data. As conventional sequential association rule mining very often generates a huge number of association rules, of which many are redundant, it is desirable to find a solution to get rid of those unnecessary association rules. Because of the complexity and temporal ordered characteristics of sequential data, current research on sequential association rule mining is limited. Although several sequential association rule prediction models using either sequence constraints or temporal constraints have been proposed, none of them considered the redundancy problem in rule mining. The main contribution of this research is to propose a non-redundant association rule mining method based on closed frequent sequences and minimal sequential generators. We also give a definition for the non-redundant sequential rules, which are sequential rules with minimal antecedents but maximal consequents. A new algorithm called CSGM (closed sequential and generator mining) for generating closed sequences and minimal sequential generators is also introduced. A further experiment has been done to compare the performance of generating non-redundant sequential rules and full sequential rules, meanwhile, performance evaluation of our CSGM and other closed sequential pattern mining or generator mining algorithms has also been conducted. We also use generated non-redundant sequential rules for query expansion in order to improve recommendations for infrequently purchased products.

A sequential Monte Carlo approach to design for population pharmacokinetics studies

Here we present a sequential Monte Carlo approach that can be used to find optimal designs. Our focus is on the design of phase III clinical trials where the derivation of sampling windows is required, along with the optimal sampling schedule. The search is conducted via a particle filter which traverses a sequence of target distributions artificially constructed via an annealed utility. The algorithm derives a catalogue of highly efficient designs which, not only contain the optimal, but can also be used to derive sampling windows. We demonstrate our approach by designing a hypothetical phase III clinical trial.

Hypoxia-mimicking mesoporous bioactive glass scaffolds with controllable cobalt ion release for bone tissue engineering

Low oxygen pressure (hypoxia) plays an important role in stimulating angiogenesis; there are, however, few studies to prepare hypoxia-mimicking tissue engineering scaffolds. Mesoporous bioactive glass (MBG) has been developed as scaffolds with excellent osteogenic properties for bone regeneration. Ionic cobalt (Co) is established as a chemical inducer of hypoxia-inducible factor (HIF)-1α, which induces hypoxia-like response. The aim of this study was to develop hypoxia-mimicking MBG scaffolds by incorporating ionic Co2+ into MBG scaffolds and investigate if the addition of Co2+ ions would induce a cellular hypoxic response in such a tissue engineering scaffold system. The composition, microstructure and mesopore properties (specific surface area, nano-pore volume and nano-pore distribution) of Co-containing MBG (Co-MBG) scaffolds were characterized and the cellular effects of Co on the proliferation, differentiation, vascular endothelial growth factor (VEGF) secretion, HIF-1α expression and bone-related gene expression of human bone marrow stromal cells (BMSCs) in MBG scaffolds were systematically investigated. The results showed that low amounts of Co (< 5%) incorporated into MBG scaffolds had no significant cytotoxicity and that their incorporation significantly enhanced VEGF protein secretion, HIF-1α expression, and bone-related gene expression in BMSCs, and also that the Co-MBG scaffolds support BMSC attachment and proliferation. The scaffolds maintain a well-ordered mesopore channel structure and high specific surface area and have the capacity to efficiently deliver antibiotics drugs; in fact, the sustained released of ampicillin by Co-MBG scaffolds gives them excellent anti-bacterial properties. Our results indicate that incorporating cobalt ions into MBG scaffolds is a viable option for preparing hypoxia-mimicking tissue engineering scaffolds and significantly enhanced hypoxia function. The hypoxia-mimicking MBG scaffolds have great potential for bone tissue engineering applications by combining enhanced angiogenesis with already existing osteogenic properties.

Towards automatic object segmentation with sequential multiple views

Object segmentation is one of the fundamental steps for a number of robotic applications such as manipulation, object detection, and obstacle avoidance. This paper proposes a visual method for incorporating colour and depth information from sequential multiview stereo images to segment objects of interest from complex and cluttered environments. Rather than segmenting objects using information from a single frame in the sequence, we incorporate information from neighbouring views to increase the reliability of the information and improve the overall segmentation result. Specifically, dense depth information of a scene is computed using multiple view stereo. Depths from neighbouring views are reprojected into the reference frame to be segmented compensating for imperfect depth computations for individual frames. The multiple depth layers are then combined with color information from the reference frame to create a Markov random field to model the segmentation problem. Finally, graphcut optimisation is employed to infer pixels belonging to the object to be segmented. The segmentation accuracy is evaluated over images from an outdoor video sequence demonstrating the viability for automatic object segmentation for mobile robots using monocular cameras as a primary sensor.

Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data

In this paper we present a sequential Monte Carlo algorithm for Bayesian sequential experimental design applied to generalised non-linear models for discrete data. The approach is computationally convenient in that the information of newly observed data can be incorporated through a simple re-weighting step. We also consider a flexible parametric model for the stimulus-response relationship together with a newly developed hybrid design utility that can produce more robust estimates of the target stimulus in the presence of substantial model and parameter uncertainty. The algorithm is applied to hypothetical clinical trial or bioassay scenarios. In the discussion, potential generalisations of the algorithm are suggested to possibly extend its applicability to a wide variety of scenarios

Cyclin-dependent kinase-mediated phosphorylation of RBP1 and pRb promotes their dissociation to mediate release of the SAP30·mSin3·HDAC transcriptional repressor complex

Eukaryotic cell cycle progression is mediated by phosphorylation of protein substrates by cyclin-dependent kinases (CDKs). A critical substrate of CDKs is the product of the retinoblastoma tumor suppressor gene, pRb, which inhibits G1-S phase cell cycle progression by binding and repressing E2F transcription factors. CDK-mediated phosphorylation of pRb alleviates this inhibitory effect to promote G1-S phase cell cycle progression. pRb represses transcription by binding to the E2F transactivation domain and recruiting the mSin3·histone deacetylase (HDAC) transcriptional repressor complex via the retinoblastoma-binding protein 1 (RBP1). RBP1 binds to the pocket region of pRb via an LXCXE motif and to the SAP30 subunit of the mSin3·HDAC complex and, thus, acts as a bridging protein in this multisubunit complex. In the present study we identified RBP1 as a novel CDK substrate. RBP1 is phosphorylated by CDK2 on serines 864 and 1007, which are N- and C-terminal to the LXCXE motif, respectively. CDK2-mediated phosphorylation of RBP1 or pRb destabilizes their interaction in vitro, with concurrent phosphorylation of both proteins leading to their dissociation. Consistent with these findings, RBP1 phosphorylation is increased during progression from G 1 into S-phase, with a concurrent decrease in its association with pRb in MCF-7 breast cancer cells. These studies provide new mechanistic insights into CDK-mediated regulation of the pRb tumor suppressor during cell cycle progression, demonstrating that CDK-mediated phosphorylation of both RBP1 and pRb induces their dissociation to mediate release of the mSin3·HDAC transcriptional repressor complex from pRb to alleviate transcriptional repression of E2F.

A longitudinal assessment of chronic wound fluid to detect biochemical indicators of healing

Chronic venous leg ulcers are a detrimental health issue plaguing our society, resulting in long term pain, immobility and decreased quality of life for a large proportion of sufferers. The frequency of these chronic wounds has led current research to focus on the wound environment to provide important information regarding the prolonged, fluctuated or static healing patterns of these wounds. Disruption to the normal wound healing process results in release of multiple factors in the wound environment that could correlate to wound chronicity. These biochemical factors can often be detected through non-invasively sampling chronic wound fluid (CWF) from the site of injury. Of note, whilst there are numerous studies comparing acute and chronic wound fluids, there have not been any reports in the literature employing a longitudinal study in order to track biochemical changes in wound fluid as patients transition from a non-healing to healed state. Initially the objective of this study was to identify biochemical changes in CWF associated with wound healing using a proteomic approach. The proteomic approach incorporated a multi-dimensional liquid chromatography fractionation technique coupled with mass spectrometry (MS) to enable identification of proteins present in lower concentrations in CWF. Not surprisingly, many of the proteins identified in wound fluid were acute phase proteins normally expressed during the inflammatory phase of healing. However, the number of proteins positively identified by MS was quite low. This was attributed to the diverse range in concentration of protein species in CWF making it challenging to detect the diagnostically relevant low molecular weight proteins. In view of this, SELDI-TOF MS was also explored as a means to target low molecular weight proteins in sequential patient CWF samples during the course of healing. Unfortunately, the results generated did not yield any peaks of interest that were altered as wounds transitioned to a healed state. During the course of proteomic assessment of CWF, it became evident that a fraction of non-proteinaceous compounds strongly absorbed at 280 nm. Subsequent analyses confirmed that most of these compounds were in fact part of the purine catabolic pathway, possessing distinctive aromatic rings and which results in high absorbance at 254 nm. The accumulation of these purinogenic compounds in CWF suggests that the wound bed is poorly oxygenated resulting in a switch to anaerobic metabolism and consequently ATP breakdown. In addition, the presence of the terminal purine catabolite, uric acid (UA), indicates that the enzyme xanthine oxidoreductase (XOR) catalyses the reaction of hypoxanthine to xanthine and finally to UA. More importantly, the studies provide evidence for the first time of the exogenous presence of XOR in CWF. XOR is the only enzyme in humans capable of catalysing the production of UA in conjunction with a burst of the highly reactive superoxide radical and other oxidants like H2O2. Excessive release of these free radicals in the wound environment can cause cellular damage disrupting the normal wound healing process. In view of this, a sensitive and specific assay was established for monitoring low concentrations of these catabolites in CWF. This procedure involved combining high performance liquid chromatography (HPLC) with tandem mass spectrometry and multiple reaction monitoring (MRM). This application was selective, using specific MRM transitions and HPLC separations for each analyte, making it ideal for the detection and quantitation of purine catabolites in CWF. The results demonstrated that elevated levels of UA were detected in wound fluid obtained from patients with clinically worse ulcers. This suggests that XOR is active in the wound site generating significant amounts of reactive oxygen species (ROS). In addition, analysis of the amount of purine precursors in wound fluid revealed elevated levels of purine precursors in wound fluid from patients with less severe ulcers. Taken together, the results generated in this thesis suggest that monitoring changes of purine catabolites in CWF is likely to provide valuable information regarding the healing patterns of chronic venous leg ulcers. XOR catalysis of purine precursors not only provides a method for monitoring the onset, prognosis and progress of chronic venous leg ulcers, but also provides a potential therapeutic target by inhibiting XOR, thus blocking UA and ROS production. Targeting a combination of these purinogenic compounds and XOR could lead to the development of novel point of care diagnostic tests. Therefore, further investigation of these processes during wound healing will be worthwhile and may assist in elucidating the pathogenesis of this disease state, which in turn may lead to the development of new diagnostics and therapies that target these processes.

A sequential Monte Carlo algorithm to incorporate model uncertainty in Bayesian sequential design

Here we present a sequential Monte Carlo (SMC) algorithm that can be used for any one-at-a-time Bayesian sequential design problem in the presence of model uncertainty where discrete data are encountered. Our focus is on adaptive design for model discrimination but the methodology is applicable if one has a different design objective such as parameter estimation or prediction. An SMC algorithm is run in parallel for each model and the algorithm relies on a convenient estimator of the evidence of each model which is essentially a function of importance sampling weights. Other methods for this task such as quadrature, often used in design, suffer from the curse of dimensionality. Approximating posterior model probabilities in this way allows us to use model discrimination utility functions derived from information theory that were previously difficult to compute except for conjugate models. A major benefit of the algorithm is that it requires very little problem specific tuning. We demonstrate the methodology on three applications, including discriminating between models for decline in motor neuron numbers in patients suffering from neurological diseases such as Motor Neuron disease.

Machine vision toolbox for MATLAB, release 3 [Software]

The Toolbox, combined with MATLAB ® and a modern workstation computer, is a useful and convenient environment for investigation of machine vision algorithms. For modest image sizes the processing rate can be sufficiently ``real-time'' to allow for closed-loop control. Focus of attention methods such as dynamic windowing (not provided) can be used to increase the processing rate. With input from a firewire or web camera (support provided) and output to a robot (not provided) it would be possible to implement a visual servo system entirely in MATLAB. Provides many functions that are useful in machine vision and vision-based control. Useful for photometry, photogrammetry, colorimetry. It includes over 100 functions spanning operations such as image file reading and writing, acquisition, display, filtering, blob, point and line feature extraction, mathematical morphology, homographies, visual Jacobians, camera calibration and color space conversion.

Robotics toolbox for MATLAB, release 9 [Software]

The ninth release of the Toolbox, represents over fifteen years of development and a substantial level of maturity. This version captures a large number of changes and extensions generated over the last two years which support my new book “Robotics, Vision & Control”. The Toolbox has always provided many functions that are useful for the study and simulation of classical arm-type robotics, for example such things as kinematics, dynamics, and trajectory generation. The Toolbox is based on a very general method of representing the kinematics and dynamics of serial-link manipulators. These parameters are encapsulated in MATLAB ® objects - robot objects can be created by the user for any serial-link manipulator and a number of examples are provided for well know robots such as the Puma 560 and the Stanford arm amongst others. The Toolbox also provides functions for manipulating and converting between datatypes such as vectors, homogeneous transformations and unit-quaternions which are necessary to represent 3-dimensional position and orientation. This ninth release of the Toolbox has been significantly extended to support mobile robots. For ground robots the Toolbox includes standard path planning algorithms (bug, distance transform, D*, PRM), kinodynamic planning (RRT), localization (EKF, particle filter), map building (EKF) and simultaneous localization and mapping (EKF), and a Simulink model a of non-holonomic vehicle. The Toolbox also including a detailed Simulink model for a quadcopter flying robot.

Sequential Fusion Using Correlated Decisions for Controlled Verification Errors

Fusion techniques have received considerable attention for achieving lower error rates with biometrics. A fused classifier architecture based on sequential integration of multi-instance and multi-sample fusion schemes allows controlled trade-off between false alarms and false rejects. Expressions for each type of error for the fused system have previously been derived for the case of statistically independent classifier decisions. It is shown in this paper that the performance of this architecture can be improved by modelling the correlation between classifier decisions. Correlation modelling also enables better tuning of fusion model parameters, ‘N’, the number of classifiers and ‘M’, the number of attempts/samples, and facilitates the determination of error bounds for false rejects and false accepts for each specific user. Error trade-off performance of the architecture is evaluated using HMM based speaker verification on utterances of individual digits. Results show that performance is improved for the case of favourable correlated decisions. The architecture investigated here is directly applicable to speaker verification from spoken digit strings such as credit card numbers in telephone or voice over internet protocol based applications. It is also applicable to other biometric modalities such as finger prints and handwriting samples.

Sequential fusion of decisions from adaptive and random samples for controlled verification of errors

Fusion techniques have received considerable attention for achieving performance improvement with biometrics. While a multi-sample fusion architecture reduces false rejects, it also increases false accepts. This impact on performance also depends on the nature of subsequent attempts, i.e., random or adaptive. Expressions for error rates are presented and experimentally evaluated in this work by considering the multi-sample fusion architecture for text-dependent speaker verification using HMM based digit dependent speaker models. Analysis incorporating correlation modeling demonstrates that the use of adaptive samples improves overall fusion performance compared to randomly repeated samples. For a text dependent speaker verification system using digit strings, sequential decision fusion of seven instances with three random samples is shown to reduce the overall error of the verification system by 26% which can be further reduced by 6% for adaptive samples. This analysis novel in its treatment of random and adaptive multiple presentations within a sequential fused decision architecture, is also applicable to other biometric modalities such as finger prints and handwriting samples.

Sequential fusion of decisions with favorable dependence for controlled verification errors

Statistical dependence between classifier decisions is often shown to improve performance over statistically independent decisions. Though the solution for favourable dependence between two classifier decisions has been derived, the theoretical analysis for the general case of 'n' client and impostor decision fusion has not been presented before. This paper presents the expressions developed for favourable dependence of multi-instance and multi-sample fusion schemes that employ 'AND' and 'OR' rules. The expressions are experimentally evaluated by considering the proposed architecture for text-dependent speaker verification using HMM based digit dependent speaker models. The improvement in fusion performance is found to be higher when digit combinations with favourable client and impostor decisions are used for speaker verification. The total error rate of 20% for fusion of independent decisions is reduced to 2.1% for fusion of decisions that are favourable for both client and impostors. The expressions developed here are also applicable to other biometric modalities, such as finger prints and handwriting samples, for reliable identity verification.

HMM triangle relative entropy concepts in sequential change detection applied to vision-based dim target manoeuvre detection

The quick detection of abrupt (unknown) parameter changes in an observed hidden Markov model (HMM) is important in several applications. Motivated by the recent application of relative entropy concepts in the robust sequential change detection problem (and the related model selection problem), this paper proposes a sequential unknown change detection algorithm based on a relative entropy based HMM parameter estimator. Our proposed approach is able to overcome the lack of knowledge of post-change parameters, and is illustrated to have similar performance to the popular cumulative sum (CUSUM) algorithm (which requires knowledge of the post-change parameter values) when examined, on both simulated and real data, in a vision-based aircraft manoeuvre detection problem.

A sequential Monte Carlo approach to the sequential design for discriminating between rival continuous data models

Here we present a sequential Monte Carlo approach to Bayesian sequential design for the incorporation of model uncertainty. The methodology is demonstrated through the development and implementation of two model discrimination utilities; mutual information and total separation, but it can also be applied more generally if one has different experimental aims. A sequential Monte Carlo algorithm is run for each rival model (in parallel), and provides a convenient estimate of the marginal likelihood (of each model) given the data, which can be used for model comparison and in the evaluation of utility functions. A major benefit of this approach is that it requires very little problem specific tuning and is also computationally efficient when compared to full Markov chain Monte Carlo approaches. This research is motivated by applications in drug development and chemical engineering.