Person tracking using motion detection and optical flow

Person tracking systems to date have either relied on motion detection or optical flow as a basis for person detection and tracking. As yet, systems have not been developed that utilise both these techniques. We propose a person tracking system that uses both, made possible by a novel hybrid optical flow-motion detection technique that we have developed. This provides the system with two methods of person detection, helping to avoid missed detections and the need to predict position, which can lead to errors in tracking and mistakes when handling occlusion situations. Our results show that our system is able to track people accurately, with an average error less than four pixels, and that our system outperforms the current CAVIAR benchmark system.

Adaptive optical flow for person tracking

Person tracking systems are dependent on being able to locate a person accurately across a series of frames. Optical flow can be used to segment a moving object from a scene, provided the expected velocity of the moving object is known; but successful detection also relies on being able segment the background. A problem with existing optical flow techniques is that they don’t discriminate the foreground from the background, and so often detect motion (and thus the object) in the background. To overcome this problem, we propose a new optical flow technique, that is based upon an adaptive background segmentation technique, which only determines optical flow in regions of motion. This technique has been developed with a view to being used in surveillance systems, and our testing shows that for this application it is more effective than other standard optical flow techniques.

Downtime reduction analysis of the Australia Post flat mail optical character reader

Machine downtime, whether planned or unplanned, is intuitively costly to manufacturing organisations, but is often very difficult to quantify. The available literature showed that costing processes are rarely undertaken within manufacturing organisations. Where cost analyses have been undertaken, they generally have only valued a small proportion of the affected costs, leading to an overly conservative estimate. This thesis aimed to develop a cost of downtime model, with particular emphasis on the application of the model to Australia Post’s Flat Mail Optical Character Reader (FMOCR). The costing analysis determined a cost of downtime of $5,700,000 per annum, or an average cost of $138 per operational hour. The second section of this work focused on the use of the cost of downtime to objectively determine areas of opportunity for cost reduction on the FMOCR. This was the first time within Post that maintenance costs were considered along side of downtime for determining machine performance. Because of this, the results of the analysis revealed areas which have historically not been targeted for cost reduction. Further exploratory work was undertaken on the Flats Lift Module (FLM) and Auto Induction Station (AIS) Deceleration Belts through the comparison of the results against two additional FMOCR analysis programs. This research has demonstrated the development of a methodical and quantifiable cost of downtime for the FMOCR. This has been the first time that Post has endeavoured to examine the cost of downtime. It is also one of the very few methodologies for valuing downtime costs that has been proposed in literature. The work undertaken has also demonstrated how the cost of downtime can be incorporated into machine performance analysis with specific application to identifying high costs modules. The outcome of this report has both been the methodology for costing downtime, as well as a list of areas for cost reduction. In doing so, this thesis has outlined the two key deliverables presented at the outset of the research.

Modulation of the SHBG signalling axis

Sex hormone-binding globulin (SHBG) is a homodimeric plasma glycoprotein that is the major sex steroid carrier-protein in the bloodstream and functions also as a key regulator of steroid bioavailability within target tissues, such as the prostate. Additionally, SHBG binds to prostatic cell membranes via the putative and unidentified SHBG receptor (RSHBG), activating a signal transduction pathway implicated in stimulating both proliferation and expression of prostate specific antigen (PSA) in prostate cell lines in vitro. A yeast-two hybrid assay suggested an interaction between SHBG and kallikrein-related protease (KLK) 4, which is a serine protease implicated in the progression of prostate cancer. The potential interaction between these two proteins was investigated in this PhD thesis to determine whether SHBG is a proteolytic substrate of KLK4 and other members of the KLK family including KLK3/PSA, KLK7 and KLK14. Furthermore, the effects from SHBG proteolytic degradation on SHBG-regulated steroid bioavailability and the activation of the putative RSHBG signal transduction pathway were examined in the LNCaP prostate cancer cell line. SHBG was found to be a proteolytic substrate of the trypsin-like KLK4 and KLK14 in vitro, yielding several proteolysis fragments. Both chymotrypsin-like PSA and KLK7 displayed insignificant proteolytic activity against SHBG. The kinetic parameters of SHBG proteolysis by KLK4 and KLK14 demonstrate a strong enzyme-substrate binding capacity, possessing a Km of 1.2 ± 0.7 µM and 2.1 ± 0.6 µM respectively. The catalytic efficiencies (kcat/Km) of KLK4 and KLK14 proteolysis of SHBG were 1.6 x 104 M-1s-1 and 3.8 x 104 M-1s-1 respectively, which were comparable to parameters previously reported for peptide substrates. N-terminal sequencing of the fragments revealed cleavage near the junction of the N- and C-terminal laminin globulin-like (G-like) domains of SHBG, resulting in the division of the two globulins and ultimately the full degradation of these fragments by KLK4 and KLK14 over time. Proteolytic fragments that may retain steroid binding were rapidly degraded by both proteases, while fragments containing residues beyond the steroid binding pocket were less degraded over the same period of time. Degradation of SHBG was inhibited by the divalent metal cations calcium and zinc for KLK4, and calcium, zinc and magnesium for KLK14. The human secreted serine protease inhibitors (serpins), α1-antitrypsin and α2-antiplasmin, inhibited KLK4 and KLK14 proteolysis of SHBG; α1-antichymotrypsin inhibited KLK4 but not KLK14 activity. The inhibition by these serpins was comparable and in some cases more effective than general trypsin protease inhibitors such as aprotinin and phenylmethanesulfonyl fluoride (PMSF). The binding of 5α-dihydrotestosterone (DHT) to SHBG modulated interactions with KLK4 and KLK14. Steroid-free SHBG was more readily digested by both enzymes than DHT-bound SHBG. Moreover, a binding interaction exists between SHBG and pro-KLK4 and pro-KLK14, with DHT strengthening the binding to pro-KLK4 only. The inhibition of androgen uptake by cultured prostate cancer cells, mediated by SHBG steroid-binding, was examined to assess whether SHBG proteolysis by KLK4 and KLK14 modulated this process. Proteolytic digestion eliminated the ability of SHBG to inhibit the uptake of DHT from conditioned media into LNCaP cells. Therefore, the proteolysis of SHBG by KLK4 and KLK14 increased steroid bioavailability in vitro, leading to an increased uptake of androgens by prostate cancer cells. Interestingly, different transcriptional responses of PSA and KLK2, which are androgen-regulated genes, to DHT-bounsd SHBG treatment were observed between low and high passage number LNCaP cells (lpLNCaP and hpLNCaP respectively). HpLNCaP cells treated with DHT-bound SHBG demonstrated a significant synergistic upregulation of PSA and KLK2 above DHT or SHBG treatment alone, which is similar to previously reported downstream responses from RSHBG-mediated signaling activation. As this result was not seen in lpLNCaP cells, only hpLNCaP cells were further investigated to examine the modulation of potential RSHBG activity by KLK4 and KLK14 proteolysis of SHBG. Contrary to reported results, no increase in intracellular cAMP was observed in hpLNCaP cells when treated with SHBG in the presence and absence of either DHT or estradiol. As a result, the modulation of RSHBG-mediated signaling activation could not be determined. Finally, the identification of the RSHBG from both breast (MCF-7) and prostate cancer (LNCaP) cell lines was attempted. Fluorescently labeled peptides corresponding to the putative receptor binding domain (RBD) of SHBG were shown to be internalized by MCF-7 cells. Crosslinking of the RBD peptide to the cell surfaces of both MCF-7 and LNCaP cells, demonstrated the interaction of the peptide with several targets. These targets were then captured using RBD peptides synthesized onto a hydrophilic scaffold and analysed by mass spectrometry. The samples captured by the RBD peptide returned statistically significantly matches for cytokeratin 8, 18 and 19 as well as microtubule-actin crosslinking factor 1, which may indicate a novel interaction between SHBG and these proteins, but ultimately failed to detect a membrane receptor potentially responsible for the putative RSHBG-mediated signaling. This PhD project has reported the proteolytic processing of SHBG by two members of the kallikrein family, KLK4 and KLK14. The effect of SHBG proteolysis by KLK4 and KLK14 on RSHBG-mediated signaling activation was unable to be determined as the reported signal transduction pathway was not activated after treatment with SHBG, in combination with either DHT or estradiol. However, the digestion of SHBG by these two proteases positively regulated androgen bioavailability to prostate cancer cells in vitro. The increased uptake of androgens is deleterious in prostate cancer due to the promotion of proliferation, metastasis, invasion and the inhibition of apoptosis. The increased bioavailability of androgens, from SHBG proteolysis by KLK4 and KLK14, may therefore promote both carcinogenesis and progression of prostate cancer. Finally, this information may contribute to the development of therapeutic treatment strategies for prostate cancer by inhibiting the proteolysis of SHBG, by KLK4 and KLK14, to prevent the increased uptake of androgens by hormone-dependent cancerous tissues.

Optical absorption and EPR studies on tenorite mineral

Optical absorption and EPR studies of the mineral tenorite, a cupric oxide, which originated from Mexico and contains 54.40 wt% of CuO. EPR spectral results indicate two Cu(II) closely interacting ions to give a d2 type structure. The calculated spin Hamiltonian at Rt and LNT are g = 2.160 and D = 125 G . The intensity of resonance line is not the same in low and high field regions. The optical absorption spectrum is due to Cu(II) which three sets of energies indicating Cu(II) in two independent tetragonal C4v symmetry, in addition to d2 structure of octahedral coordination. The octahedral and tetragonal field parameters are compared with those reported for several other copper containing minerals.

Robust video stabilisation algorithm using feature point selection and delta optical flow

In this study, the authors propose a novel video stabilisation algorithm for mobile platforms with moving objects in the scene. The quality of videos obtained from mobile platforms, such as unmanned airborne vehicles, suffers from jitter caused by several factors. In order to remove this undesired jitter, the accurate estimation of global motion is essential. However it is difficult to estimate global motions accurately from mobile platforms due to increased estimation errors and noises. Additionally, large moving objects in the video scenes contribute to the estimation errors. Currently, only very few motion estimation algorithms have been developed for video scenes collected from mobile platforms, and this paper shows that these algorithms fail when there are large moving objects in the scene. In this study, a theoretical proof is provided which demonstrates that the use of delta optical flow can improve the robustness of video stabilisation in the presence of large moving objects in the scene. The authors also propose to use sorted arrays of local motions and the selection of feature points to separate outliers from inliers. The proposed algorithm is tested over six video sequences, collected from one fixed platform, four mobile platforms and one synthetic video, of which three contain large moving objects. Experiments show our proposed algorithm performs well to all these video sequences.

Improved simultaneous computation of motion detection and optical flow for object tracking

Object tracking systems require accurate segmentation of the objects from the background for effective tracking. Motion segmentation or optical flow can be used to segment incoming images. Whilst optical flow allows multiple moving targets to be separated based on their individual velocities, optical flow techniques are prone to errors caused by changing lighting and occlusions, both common in a surveillance environment. Motion segmentation techniques are more robust to fluctuating lighting and occlusions, but don't provide information on the direction of the motion. In this paper we propose a combined motion segmentation/optical flow algorithm for use in object tracking. The proposed algorithm uses the motion segmentation results to inform the optical flow calculations and ensure that optical flow is only calculated in regions of motion, and improve the performance of the optical flow around the edge of moving objects. Optical flow is calculated at pixel resolution and tracking of flow vectors is employed to improve performance and detect discontinuities, which can indicate the location of overlaps between objects. The algorithm is evaluated by attempting to extract a moving target within the flow images, given expected horizontal and vertical movement (i.e. the algorithms intended use for object tracking). Results show that the proposed algorithm outperforms other widely used optical flow techniques for this surveillance application.

Effect of optical aberrations on the colour appearance of small lights

Purpose: Small red lights (one minute of arc or less) change colour appearance with positive defocus. We investigated the influence of longitudinal chromatic aberration and monochromatic aberrations on the colour appearance of small narrow band lights. Methods: Seven cyclopleged, trichromatic observers viewed a small light (one minute of arc, λmax = 510, 532, 550, 589, 620, 628 nm, approximately 19 per cent Weber contrast) centred within a black annulus (4.5 minutes of arc) and surrounded by a uniform white field (2,170 cd/m2). Pupil size was four millimetres. An optical trombone varied focus. Longitudinal chromatic aberration was controlled with a two component Powell achromatising lens that neutralises the eye’s chromatic aberration; a doublet that doubles and a triplet that reverses the eye’s chromatic aberration. Astigmatism and higher order monochromatic aberrations were corrected using adaptive optics. Results: Observers reported a change in appearance of the small red light (628 nm) without the Powell lens at +0.49 ± 0.21 D defocus and with the doublet at +0.62 ± 0.16 D. Appearance did not alter with the Powell lens, and five of seven observers reported the phenomenon with the triplet for negative defocus (-0.80 ± 0.47 D). Correction of aberrations did not significantly affect the magnitude at which the appearance of the red light changed (+0.44 ± 0.18 D without correction; +0.46 ± 0.16 D with correction). The change in colour appearance with defocus extended to other wavelengths (λmax = 510 to 620 nm), with directions of effects being reversed for short wavelengths relative to long wavelengths. Conclusions: Longitudinal chromatic aberrations but not monochromatic aberrations are involved in changing the appearance of small lights with defocus.

Optical absorption, infrared, Raman and EPR spectral studies on natural Iowaite mineral

Natural iowaite, magnesium–ferric oxychloride mineral having light green color originating from Australia has been characterized by EPR, optical, IR, and Raman spectroscopy. The optical spectrum exhibits a number of electronic bands due to both Fe(III) and Mn(II) ions in iowaite. From EPR studies, the g values are calculated for Fe(III) and g and A values for Mn(II). EPR and optical absorption studies confirm that Fe(III) and Mn(II) are in distorted octahedral geometry. The bands that appear both in NIR and Raman spectra are due to the overtones and combinations of water and carbonate molecules. Thus EPR, optical, and Raman spectroscopy have proven most useful for the study of the chemistry of natural iowaite and chemical changes in the mineral.

Effects of age on peripheral ocular aberrations

On-axis monochromatic higher-order aberrations increase with age. Few studies have been made of peripheral refraction along the horizontal meridian of older eyes, and none of their off-axis higher-order aberrations. We measured wave aberrations over the central 42°x32° visual field for a 5mm pupil in 10 young and 7 older emmetropes. Patterns of peripheral refraction were similar in the two groups. Coma increased linearly with field angle at a significantly higher rate in older than in young emmetropes (−0.018±0.007 versus −0.006±0.002 µm/deg). Spherical aberration was almost constant over the measured field in both age groups and mean values across the field were significantly higher in older than in young emmetropes (+0.08±0.05 versus +0.02±0.04 µm). Total root-mean-square and higher-order aberrations increased more rapidly with field angle in the older emmetropes. However, the limits to monochromatic peripheral retinal image quality are largely determined by the second-order aberrations, which do not change markedly with age, and under normal conditions the relative importance of the increased higher-order aberrations in older eyes is lessened by the reduction in pupil diameter with age. Therefore it is unlikely that peripheral visual performance deficits observed in normal older individuals are primarily attributable to the increased impact of higher-order aberration.

Peripheral higher order aberrations in emmetropes and myopes

Purpose: Poor image quality in the peripheral field may lead to myopia. Most studies measuring the higher order aberrations in the periphery have been restricted to the horizontal visual field. The purpose of this study was to measure higher order monochromatic aberrations across the central 42º horizontal x 32º vertical visual fields in myopes and emmetropes. ---------- Methods: We recruited 5 young emmetropes with spherical equivalent refractions +0.17 ± 0.45D and 5 young myopes with spherical equivalent refractions -3.9 ± 2.09D. Measurements were taken with a modified COAS-HD Hartmann-Shack aberrometer (Wavefront Sciences Inc). Measurements were taken while the subjects looked at 38 points arranged in a 7 x 6 matrix (excluding four corner points) through a beam splitter held between the instrument and the eye. A combination of the instrument’s software and our own software was used to estimate OSA Zernike coefficients for 5mm pupil diameter at 555nm for each point. The software took into account the elliptical shape of the off-axis pupil. Nasal and superior fields were taken to have positive x and y signs, respectively. ---------- Results: The total higher order RMS (HORMS) was similar on-axis for emmetropes (0.16 ± 0.02 μm) and myopes (0.17 ± 0.02 μm). There was no common pattern for HORMS for emmetropes across the visual field where as 4 out of 5 myopes showed a linear increase in HORMS in all directions away from the minimum. For all subjects, vertical and horizontal comas showed linear changes across the visual field. The mean rate of change of vertical coma across the vertical meridian was significantly lower (p = 0.008) for emmetropes (-0.005 ± 0.002 μm/deg) than for myopes (-0.013 ± 0.004 μm/deg). The mean rate of change of horizontal coma across the horizontal meridian was lower (p = 0.07) for emmetropes (-0.006 ± 0.003 μm/deg) than myopes (-0.011 ± 0.004 μm/deg). ---------- Conclusion: We have found differences in patterns of higher order aberrations across the visual fields of emmetropes and myopes, with myopes showing the greater rates of change of horizontal and vertical coma.

Choice of image features for depth-axis control in image based visual servo control

This paper is concerned with choosing image features for image based visual servo control and how this choice influences the closed-loop dynamics of the system. In prior work, image features tend to be chosen on the basis of image processing simplicity and noise sensitivity. In this paper we show that the choice of feature directly influences the closed-loop dynamics in task-space. We focus on the depth axis control of a visual servo system and compare analytically various approaches that have been reported recently in the literature. The theoretical predictions are verified by experiment.