Visual code annotations for cyberphysical programming

User interfaces for source code editing are a crucial component in any software development environment, and in many editors visual annotations (overlaid on the textual source code) are used to provide important contextual information to the programmer. This paper focuses on the real-time programming activity of ‘cyberphysical’ programming, and considers the type of visual annotations which may be helpful in this programming context.

Aircraft collision avoidance using spherical visual predictive control and single point features

This paper presents practical vision-based collision avoidance for objects approximating a single point feature. Using a spherical camera model, a visual predictive control scheme guides the aircraft around the object along a conical spiral trajectory. Visibility, state and control constraints are considered explicitly in the controller design by combining image and vehicle dynamics in the process model, and solving the nonlinear optimization problem over the resulting state space. Importantly, range is not required. Instead, the principles of conical spiral motion are used to design an objective function that simultaneously guides the aircraft along the avoidance trajectory, whilst providing an indication of the appropriate point to stop the spiral behaviour. Our approach is aimed at providing a potential solution to the See and Avoid problem for unmanned aircraft and is demonstrated through a series.

High altitude stereo visual odometry

Stereo visual odometry has received little investigation in high altitude applications due to the generally poor performance of rigid stereo rigs at extremely small baseline-to-depth ratios. Without additional sensing, metric scale is considered lost and odometry is seen as effective only for monocular perspectives. This paper presents a novel modification to stereo based visual odometry that allows accurate, metric pose estimation from high altitudes, even in the presence of poor calibration and without additional sensor inputs. By relaxing the (typically fixed) stereo transform during bundle adjustment and reducing the dependence on the fixed geometry for triangulation, metrically scaled visual odometry can be obtained in situations where high altitude and structural deformation from vibration would cause traditional algorithms to fail. This is achieved through the use of a novel constrained bundle adjustment routine and accurately scaled pose initializer. We present visual odometry results demonstrating the technique on a short-baseline stereo pair inside a fixed-wing UAV flying at significant height (~30-100m).

Robust scale initialization for long-range stereo visual odometry

Achieving a robust, accurately scaled pose estimate in long-range stereo presents significant challenges. For large scene depths, triangulation from a single stereo pair is inadequate and noisy. Additionally, vibration and flexible rigs in airborne applications mean accurate calibrations are often compromised. This paper presents a technique for accurately initializing a long-range stereo VO algorithm at large scene depth, with accurate scale, without explicitly computing structure from rigidly fixed camera pairs. By performing a monocular pose estimate over a window of frames from a single camera, followed by adding the secondary camera frames in a modified bundle adjustment, an accurate, metrically scaled pose estimate can be found. To achieve this the scale of the stereo pair is included in the optimization as an additional parameter. Results are presented both on simulated and field gathered data from a fixed-wing UAV flying at significant altitude, where the epipolar geometry is inaccurate due to structural deformation and triangulation from a single pair is insufficient. Comparisons are made with more conventional VO techniques where the scale is not explicitly optimized, and demonstrated over repeated trials to indicate robustness.

Visual guidance for fixed-wing unmanned aerial vehicles using feature tracking : application to power line inspection

This thesis presents novel vision based control solutions that enable fixed-wing Unmanned Aerial Vehicles to perform tasks of inspection over infrastructure including power lines, pipe lines and roads. This is achieved through the development of techniques that combine visual servoing with alternate manoeuvres that assist the UAV in both following and observing the feature from a downward facing camera. Control designs are developed through techniques of Image Based Visual Servoing to utilise sideslip through Skid-to-Turn and Forward-Slip manoeuvres. This allows the UAV to simultaneously track and collect data over the length of infrastructure, including straight segments and the transition where these meet.

Agreement to and compliance with advice on removing mats or rugs by older people with visual impairments

The article presents a study which investigated the reasons why advice related to the removal of mats or rags by older people with visual impairments had a low rate of acceptance. The researchers speculated that it may have been due to older people's need to maintain a sense of control and autonomy and to arrange their environments in a way that they decided or a belief that the recommended modification would not reduce the risk of falling. A telephone survey of subsample of the participants was conducted in the Visually Impaired Persons (VIP) Trial. All 30 interviewees had rugs or mats in their homes. Of the 30 participants, 20 had moved the rugs or mats as a result of recommendations, and 10 had not.

Visual front-end wars : Viola-Jones face detector vs Fourier Lucas-Kanade

The performance of visual speech recognition (VSR) systems are significantly influenced by the accuracy of the visual front-end. The current state-of-the-art VSR systems use off-the-shelf face detectors such as Viola- Jones (VJ) which has limited reliability for changes in illumination and head poses. For a VSR system to perform well under these conditions, an accurate visual front end is required. This is an important problem to be solved in many practical implementations of audio visual speech recognition systems, for example in automotive environments for an efficient human-vehicle computer interface. In this paper, we re-examine the current state-of-the-art VSR by comparing off-the-shelf face detectors with the recently developed Fourier Lucas-Kanade (FLK) image alignment technique. A variety of image alignment and visual speech recognition experiments are performed on a clean dataset as well as with a challenging automotive audio-visual speech dataset. Our results indicate that the FLK image alignment technique can significantly outperform off-the shelf face detectors, but requires frequent fine-tuning.

The impact of interface modality on police officers' visual behaviour when using an in-vehicle system

Background Standard operating procedures state that police officers should not drive while interacting with their mobile data terminal (MDT) which provides in-vehicle information essential to police work. Such interactions do however occur in practice and represent a potential source of driver distraction. The MDT comprises visual output with manual input via touch screen and keyboard. This study investigated the potential for alternative input and output methods to mitigate driver distraction with specific focus on eye movements. Method Nineteen experienced drivers of police vehicles (one female) from the NSW Police Force completed four simulated urban drives. Three drives included a concurrent secondary task: imitation licence plate search using an emulated MDT. Three different interface methods were examined: Visual-Manual, Visual-Voice, and Audio-Voice (“Visual” and “Audio” = output modality; “Manual” and “Voice” = input modality). During each drive, eye movements were recorded using FaceLAB™ (Seeing Machines Ltd, Canberra, ACT). Gaze direction and glances on the MDT were assessed. Results The Visual-Voice and Visual-Manual interfaces resulted in a significantly greater number of glances towards the MDT than Audio-Voice or Baseline. The Visual-Manual and Visual-Voice interfaces resulted in significantly more glances to the display than Audio-Voice or Baseline. For longer duration glances (>2s and 1-2s) the Visual-Manual interface resulted in significantly more fixations than Baseline or Audio-Voice. The short duration glances (<1s) were significantly greater for both Visual-Voice and Visual-Manual compared with Baseline and Audio-Voice. There were no significant differences between Baseline and Audio-Voice. Conclusion An Audio-Voice interface has the greatest potential to decrease visual distraction to police drivers. However, it is acknowledged that an audio output may have limitations for information presentation compared with visual output. The Visual-Voice interface offers an environment where the capacity to present information is sustained, whilst distraction to the driver is reduced (compared to Visual-Manual) by enabling adaptation of fixation behaviour.

Relationship of moderate and low isometric lumbar extension through architectural and muscular activity variables: a cross sectional study

Background No study relating the changes obtained in the architecture of erector spinae (ES) muscle were registered with ultrasound and different intensities of muscle contraction recorded by surface EMG (electromyography) on the ES muscle was found. The aim of this study was analyse the relationship in the response of the ES muscle during isometric moderate and light lumbar isometric extension considering architecture and functional muscle variables. Methods Cross-sectional study. 46 subjects (52% men) with a group mean age of 30.4 (±7.78). The participants developed isometric lumbar extension while performing moderate and low isometric trunk and hip extension in a sitting position with hips flexed 90 degrees and the lumbar spine in neutral position. During these measurements, electromyography recordings and ultrasound images were taken bilaterally. Bilaterally pennation angle, muscle thickness, torque and muscle activation were measured. This study was developed at the human movement analysis laboratory of the Health Science Faculty of the University of Malaga (Spain). Results Strong and moderate correlations were found at moderate and low intensities contraction between the variable of the same intensity, with correlation values ranging from 0.726 (Torque Moderate – EMG Left Moderate) to 0.923 (Angle Left Light – Angle Right Light) (p < 0.001). This correlation is observed between the variables that describe the same intensity of contraction, showing a poor correlation between variables of different intensities. Conclusion There is a strong relationship between architecture and function variables of ES muscle when describe an isometric lumbar extension at light or moderate intensity. Keywords: Ultrasonography; Surface electromyography; Thickness; Pennation angle; Erector spinae

Performance of a cognitive, but not visual, secondary task interacts with alcohol-induced balance impairment in novice and experienced motorcycle riders

The appropriateness of applying drink driving legislation to motorcycle riding has been questioned as there may be fundamental differences in the effects of alcohol on driving and motorcycling. It has been suggested that alcohol may redirect riders’ focus from higher-order cognitive skills such as cornering, judgement and hazard perception, to more physical skills such as maintaining balance. To test this hypothesis, the effects of low doses of alcohol on balance ability were investigated in a laboratory setting. The static balance of twenty experienced and twenty novice riders was measured while they performed either no secondary task, a visual (search) task, or a cognitive (arithmetic) task following the administration of alcohol (0%, 0.02%, and 0.05% BAC). Subjective ratings of intoxication and balance impairment increased in a dose-dependent manner in both novice and experienced motorcycle riders, while a BAC of 0.05%, but not 0.02%, was associated with impairments in static balance ability. This balance impairment was exacerbated when riders performed a cognitive, but not a visual, secondary task. Likewise, 0.05% BAC was associated with impairments in novice and experienced riders’ performance of a cognitive, but not a visual, secondary task, suggesting that interactive processes underlie balance and cognitive task performance. There were no observed differences between novice vs. experienced riders on static balance and secondary task performance, either alone or in combination. Implications for road safety and future ‘drink riding’ policy considerations are discussed.

Effect of recovery modality on 4-hour repeated treadmill running performance and changes in physiological variables

The purpose of this study was to compare the effectiveness of three different recovery modalities - active (ACT), passive (PAS) and contrast temperature water immersion (CTW) - on the performance of repeated treadmill running, lactate concentration and pH. Fourteen males performed two pairs of treadmill runs to exhaustion at 120% and 90% of peak running speed (PRS) over a 4-hour period. ACT, PAS or CTW was performed for 15-min after the first pair of treadmill runs. ACT consisted of running at 40% PRS, PAS consisted of standing stationary and CTW consisted of alternating between 60-s cold (10°C) and 120-s hot (42°C) water immersion. Run times were converted to time to cover set distance using critical power. Type of recovery modality did not have a significant effect on change in time to cover 400 m (Mean±SD; ACT 2.7±3.6 s, PAS 2.9±4.2 s, CTW 4.2±6.9 s), 1000 m (ACT 2.2±4.0 s, PAS 4.8±8.6 s, CTW 2.1±7.2 s) or 5000 m (ACT 1.4±29.0 s, PAS 16.7±58.5 s, CTW 11.7±33.0 s). Post exercise blood lactate concentration was lower in ACT and CTW compared with PAS. Participants reported an increased perception of recovery in the CTW compared with ACT and PAS. Blood pH was not significantly influenced by recovery modality. Data suggest both ACT and CTW reduce lactate accumulation after high intensity running, but high intensity treadmill running performance is returned to baseline 4-hours after the initial exercise bout regardless of the recovery strategy employed.

Visual function and CFH/ARMS2 risk genotypes in macular dystrophy due to maternally inherited diabetes and deafness

Maternally inherited diabetes and deafness (MIDD) is an autosomal dominant inherited syndrome caused by the mitochondrial DNA (mtDNA) nucleotide mutation A3243G. It affects various organs including the eye with external ophthalmoparesis, ptosis, and bilateral macular pattern dystrophy.1, 2 The prevalence of retinal involvement in MIDD is high, with 50% to 85% of patients exhibiting some macular changes.1 Those changes, however, can vary between patients and within families dramatically based on the percentage of retinal mtDNA mutations, making it difficult to give predictions on an individual’s visual prognosis...

Visual performance with lenses correcting peripheral refractive errors

Purpose To design and manufacture lenses to correct peripheral refraction along the horizontal meridian and to determine whether these resulted in noticeable improvements in visual performance. Method Subjective refraction of a low myope was determined on the basis of best peripheral detection acuity along the horizontal visual field out to ±30° for both horizontal and vertical gratings. Subjective refraction was compared to objective refractions using a COAS-HD aberrometer. Special lenses were made to correct peripheral refraction, based on designs optimized with and without smoothing across a 3 mm diameter square aperture. Grating detection was retested with these lenses. Contrast thresholds of 1.25’ spots were determined across the field for the conditions of best correction, on-axis correction, and the special lenses. Results The participant had high relative peripheral hyperopia, particularly in the temporal visual field (maximum 2.9 D). There were differences > 0.5D between subjective and objective refractions at a few field angles. On-axis correction reduced peripheral detection acuity and increased peripheral contrast threshold in the peripheral visual field, relative to the best correction, by up to 0.4 and 0.5 log units, respectively. The special lenses restored most of the peripheral vision, although not all at angles to ±10°, and with the lens optimized with aperture-smoothing possibly giving better vision than the lens optimized without aperture-smoothing at some angles. Conclusion It is possible to design and manufacture lenses to give near optimum peripheral visual performance to at least ±30° along one visual field meridian. The benefit of such lenses is likely to be manifest only if a subject has a considerable relative peripheral refraction, for example of the order of 2 D.

EGFR expression : associations with outcome and clinicopathological variables in malignant pleural mesothelioma

Malignant mesothelioma (MM) is a fatal tumour of increasing incidence which is related to asbestos exposure. This work evaluated expression in MM of Epidermal Growth Factor Receptor (EGFR) by immunohistochemistry in 168 tumour sections and its correlations with clinicopathological and biological factors. The microvessel density (MVD) was derived from CD34 immunostained sections. Hematoxylin and eosin stained sections were examined for intratumoural necrosis. COX-2 protein expression was evaluated with semi-quantitative Western blotting of homogenised tumour supernatants (n = 45). EGFR expression was correlated with survival by Kaplan-Meier and log rank analysis. Univariate and multivariate Cox proportional hazards models were used to compare the effects of EGFR with clinicopathological and biological prognostic factors and prognostic scoring systems. EGFR expression was identified in 74 cases (44%) and correlated with epithelioid cell type (p < 0.0001), good performance status (p < 0.0001), the absence of chest pain (p < 0.0001) and the presence of TN (p = 0.004), but not MVD or COX-2. EGFR expression was a good prognostic factor in univariate analysis (p = 0.01). Independent indicators of poor prognosis in multivariate analysis were non-epithelioid cell type (p = 0.0001), weight loss, performance status and WBC > 8.3 × 10 9 L -1. EGFR status was not an independent prognostic factor. EGFR expression in MM correlates with epithelioid histology and TN. EGFR may be a target for selective therapies in MM. © 2006 Elsevier Ireland Ltd. All rights reserved.

Differential pathologic variables and outcomes across the spectrum of adenocarcinoma of the esophagogastric junction

Background Adenocarcinoma of the esophagogastric junction (AEG) as described by Siewert et al. is classified as one entity in the latest (7th Edition) American Joint Cancer Committee/International Union Against Cancer (AJCC/UICC) manual, compared with the previous mix of esophageal and gastric staging systems. The origin of AEG tumors, esophageal or gastric, and their biology remain controversial, particularly for AEG type II (cardia) tumors. Methods We adapted a large prospective database (n = 520: 180 type I, 182 type II, 158 type III) to compare AEG tumors under the new TNM system Pathological variables associated with prognosis were compared (pT, pN, stage, differentiation, R status, lymphovascular invasion, perineural involvement, number of positive nodes, percent of positive nodes, and tumor length), as well as overall survival. Results Compared with AEG type I tumors, type II and type III tumors had significantly (p\0.05) more advanced pN stages, greater number and percentage of positive nodes, poorer differentiation, more radial margin involvement, and more perineural invasion. In AEG type I, 14/180 patients (8%) had[6 involved nodes (pN3), compared with 16 and 30% of patients classified type II and III, respectively. Median survival was significantly (p = 0.03) improved for type I patients (38 months) compared with those with tumors classified as type II (28 months) and type III (24 months). In multivariate analysis node positivity and pN staging but not AEG site had an impact on survival. Conclusions In this series AEG type I is associated with more favorable pathologic features and improved outcomes compared with AEG type II and III. This may reflect earlier diagnosis, but an alternative possibility, that type I may be a unique paradigm with more favorable biology, requires further study. © Société Internationale de Chirurgie 2010.