Vision-based classification of solder joint defects

Inspection of solder joints has been a critical process in the electronic manufacturing industry to reduce manufacturing cost, improve yield, and ensure product quality and reliability. The solder joint inspection problem is more challenging than many other visual inspections because of the variability in the appearance of solder joints. Although many research works and various techniques have been developed to classify defect in solder joints, these methods have complex systems of illumination for image acquisition and complicated classification algorithms. An important stage of the analysis is to select the right method for the classification. Better inspection technologies are needed to fill the gap between available inspection capabilities and industry systems. This dissertation aims to provide a solution that can overcome some of the limitations of current inspection techniques. This research proposes two inspection steps for automatic solder joint classification system. The “front-end” inspection system includes illumination normalisation, localization and segmentation. The illumination normalisation approach can effectively and efficiently eliminate the effect of uneven illumination while keeping the properties of the processed image. The “back-end” inspection involves the classification of solder joints by using Log Gabor filter and classifier fusion. Five different levels of solder quality with respect to the amount of solder paste have been defined. Log Gabor filter has been demonstrated to achieve high recognition rates and is resistant to misalignment. Further testing demonstrates the advantage of Log Gabor filter over both Discrete Wavelet Transform and Discrete Cosine Transform. Classifier score fusion is analysed for improving recognition rate. Experimental results demonstrate that the proposed system improves performance and robustness in terms of classification rates. This proposed system does not need any special illumination system, and the images are acquired by an ordinary digital camera. In fact, the choice of suitable features allows one to overcome the problem given by the use of non complex illumination systems. The new system proposed in this research can be incorporated in the development of an automated non-contact, non-destructive and low cost solder joint quality inspection system.

Wide-baseline keypoint detection and matching with wide-angle images for vision based localisation

This thesis addresses the problem of detecting and describing the same scene points in different wide-angle images taken by the same camera at different viewpoints. This is a core competency of many vision-based localisation tasks including visual odometry and visual place recognition. Wide-angle cameras have a large field of view that can exceed a full hemisphere, and the images they produce contain severe radial distortion. When compared to traditional narrow field of view perspective cameras, more accurate estimates of camera egomotion can be found using the images obtained with wide-angle cameras. The ability to accurately estimate camera egomotion is a fundamental primitive of visual odometry, and this is one of the reasons for the increased popularity in the use of wide-angle cameras for this task. Their large field of view also enables them to capture images of the same regions in a scene taken at very different viewpoints, and this makes them suited for visual place recognition. However, the ability to estimate the camera egomotion and recognise the same scene in two different images is dependent on the ability to reliably detect and describe the same scene points, or ‘keypoints’, in the images. Most algorithms used for this purpose are designed almost exclusively for perspective images. Applying algorithms designed for perspective images directly to wide-angle images is problematic as no account is made for the image distortion. The primary contribution of this thesis is the development of two novel keypoint detectors, and a method of keypoint description, designed for wide-angle images. Both reformulate the Scale- Invariant Feature Transform (SIFT) as an image processing operation on the sphere. As the image captured by any central projection wide-angle camera can be mapped to the sphere, applying these variants to an image on the sphere enables keypoints to be detected in a manner that is invariant to image distortion. Each of the variants is required to find the scale-space representation of an image on the sphere, and they differ in the approaches they used to do this. Extensive experiments using real and synthetically generated wide-angle images are used to validate the two new keypoint detectors and the method of keypoint description. The best of these two new keypoint detectors is applied to vision based localisation tasks including visual odometry and visual place recognition using outdoor wide-angle image sequences. As part of this work, the effect of keypoint coordinate selection on the accuracy of egomotion estimates using the Direct Linear Transform (DLT) is investigated, and a simple weighting scheme is proposed which attempts to account for the uncertainty of keypoint positions during detection. A word reliability metric is also developed for use within a visual ‘bag of words’ approach to place recognition.

Vision based control for fixed wing UAVs inspecting locally linear infrastructure using skid-to-turn maneuvers

The following paper proposes a novel application of Skid-to-Turn maneuvers for fixed wing Unmanned Aerial Vehicles (UAVs) inspecting locally linear infrastructure. Fixed wing UAVs, following the design of manned aircraft, commonly employ Bank-to-Turn ma- neuvers to change heading and thus direction of travel. Whilst effective, banking an aircraft during the inspection of ground based features hinders data collection, with body fixed sen- sors angled away from the direction of turn and a panning motion induced through roll rate that can reduce data quality. By adopting Skid-to-Turn maneuvers, the aircraft can change heading whilst maintaining wings level flight, thus allowing body fixed sensors to main- tain a downward facing orientation. An Image-Based Visual Servo controller is developed to directly control the position of features as captured by onboard inspection sensors. This improves on the indirect approach taken by other tracking controllers where a course over ground directly above the feature is assumed to capture it centered in the field of view. Performance of the proposed controller is compared against that of a Bank-to-Turn tracking controller driven by GPS derived cross track error in a simulation environment developed to replicate the field of view of a body fixed camera.

Towards the implementation of vision-based UAS sense-and-avoid

Machine vision represents a particularly attractive solution for sensing and detecting potential collision-course targets due to the relatively low cost, size, weight, and power requirements of the sensors involved. This paper describes the development of detection algorithms and the evaluation of a real-time flight ready hardware implementation of a vision-based collision detection system suitable for fixed-wing small/medium size UAS. In particular, this paper demonstrates the use of Hidden Markov filter to track and estimate the elevation (β) and bearing (α) of the target, compares several candidate graphic processing hardware choices, and proposes an image based visual servoing approach to achieve collision avoidance

A vision of the past : The Mill Albion

This paper examines The Mill Albion community history project, a diverse, multi-layered public history/art program that captures the social heritage of The Albion Flour Mill, as told through images produced as part of a research consultancy undertaken by QUT for FKP Property Group. The Albion Flour Mill was built in 1930 and continued operations for more than 72 years. After ceasing operation in 2005 the site was left to deteriorate. The FKP Property Group purchased the land to undertake a new urban redevelopment project. This paper reflects on the project and showcases some of the culturally creative ways this community’s history was told, using images.

Persons with age-related maculopathy risk genotypes and clinically normal eyes have reduced mesopic vision

PURPOSE: To determine if participants with normal visual acuity, no ophthalmoscopically signs of age-related maculopathy (ARM) in both eyes and who are carriers of the CFH, LOC387715 and HRTA1 high-risk genotypes (“gene-positive”) have impaired rod- and cone-mediated mesopic visual function compared to persons who do not carry the risk genotypes (“gene-negative”).---------- METHODS: Fifty-three Caucasian study participants (mean 55.8 ± 6.1) were genotyped for CFH, LOC387715/ARMS2 and HRTA1 polymorphisms. We genotyped single nucleotide polymorphisms (SNPs) in the CFH (rs380390), LOC387715/ARMS2 (rs10490924) and HTRA1 (rs11200638) genes using Applied Biosystems optimised TaqMan assays. We determined the critical fusion frequency (CFF) mediated by cones alone (Long, Middle and Short wavelength sensitive cones; LMS) and by the combined activities of cones and rods (LMSR). The stimuli were generated using a 4-primary photostimulator that provides independent control of the photoreceptor excitation under mesopic light levels. Visual function was further assessed using standard clinical tests, flicker perimetry and microperimetry.---------- RESULTS: The mesopic CFF mediated by rods and cones (LMSR) was significantly reduced in gene-positive compared to gene-negative participants after correction for age (p=0.03). Cone-mediated CFF (LMS) was not significantly different between gene-positive and -negative participants. There were no significant associations between flicker perimetry and microperimetry and genotype.---------- CONCLUSIONS: This is the first study to relate ARM risk genotypes with mesopic visual function in clinically normal persons. These preliminary results could become of clinical importance as mesopic vision may be used to document sub-clinical retinal changes in persons with risk genotypes and to determine whether those persons progress into manifest disease.

The effect of presbyiopic vision corrections on nighttime driving performance

Purpose. To investigate the effect of various presbyopic vision corrections on nighttime driving performance on a closed-road driving circuit. Methods. Participants were 11 presbyopes (mean age, 57.3 ± 5.8 years), with a mean best sphere distance refractive error of R+0.23±1.53 DS and L+0.20±1.50 DS, whose only experience of wearing presbyopic vision correction was reading spectacles. The study involved a repeated-measures design by which a participant's nighttime driving performance was assessed on a closed-road circuit while wearing each of four power-matched vision corrections. These included single-vision distance lenses (SV), progressive-addition spectacle lenses (PAL), monovision contact lenses (MV), and multifocal contact lenses (MTF CL) worn in a randomized order. Measures included low-contrast road hazard detection and avoidance, road sign and near target recognition, lane-keeping, driving time, and legibility distance for street signs. Eye movement data (fixation duration and number of fixations) were also recorded. Results. Street sign legibility distances were shorter when wearing MV and MTF CL than SV and PAL (P < 0.001), and participants drove more slowly with MTF CL than with PALs (P = 0.048). Wearing SV resulted in more errors (P < 0.001) and in more (P = 0.002) and longer (P < 0.001) fixations when responding to near targets. Fixation duration was also longer when viewing distant signs with MTF CL than with PAL (P = 0.031). Conclusions. Presbyopic vision corrections worn by naive, unadapted wearers affected nighttime driving. Overall, spectacle corrections (PAL and SV) performed well for distance driving tasks, but SV negatively affected viewing near dashboard targets. MTF CL resulted in the shortest legibility distance for street signs and longer fixation times.

Functional status, postural stability and falls among older adults with glaucoma

Visual impairment is an important contributing factor in falls among older adults, which is one of the leading causes of injury and injury-related death in this population. Visual impairment is also associated with greater disability among older adults, including poorer health-related quality of life, increased frailty and reduced postural stability. The majority of this evidence, however, is based on measures of central visual function, rather than peripheral visual function. As such, there is comparatively limited research on the associations between peripheral visual function, disability and falls, and even fewer studies involving older adults with specific diseases which affect peripheral visual function, the most common of which is glaucoma. Glaucoma is one of the leading causes of irreversible vision loss among older adults, affecting around 3 per cent of adults aged over 60 years. The condition is characterised by retinal nerve fibre loss, primarily affecting peripheral visual function. Importantly, the number of older adults with glaucomatous visual impairment is projected to increase as the ageing population grows. The first component of the thesis examined the cross-sectional association between glaucomatous visual impairment and health-related quality of life (Study 1a), functional status (Study 1b) and postural stability (Study 1c) among older adults. A cohort of 74 community-dwelling adults with glaucoma (mean age 74.2 ± 5.9 years) was recruited and completed a baseline assessment. A number of visual function measures was assessed, including central visual function (visual acuity and contrast sensitivity), motion sensitivity, retinal nerve fibre analysis and monocular and binocular visual field measures (monocular 24-2 and binocular integrated visual fields (IVF): IVF-60 and IVF-120). The analyses focused on the associations between the outcomes measures and severity and location of visual field loss, as this is the primary visual function affected by glaucoma. In Study 1a, we examined the association between visual field loss and health-related quality of life, measured by the Short Form 36-item Health Survey (SF-36). Greater binocular visual field loss, on both IVF measures, was associated with lower SF-36 physical component scores, adjusted for age and gender (Pearson's r =|0.32| to |0.36|, p<0.001). Furthermore, inferior visual field loss was more strongly associated with the SF-36 physical component than superior field loss. No association was found between visual field loss and SF-36 mental component scores. The association between visual field loss and functional status was examined in Study 1b. Functional status outcomes measures included a physical activity questionnaire (Physical Activity Scale for the Elderly, PASE), performance tests (six-minute walk test, timed up and go test and lower leg strength) and an overall functional status score. Significant, but weak, correlations were found between binocular visual field loss and PASE and overall functional status scores, adjusted for age and gender (Pearson's r =|0.24| to |0.33|, p<0.05). Greater inferior visual field loss, independent of superior visual field loss, was significantly associated with poorer physical performance results and lower overall functional status scores. In Study 1c, we examined the association between visual field loss and postural stability, using a swaymeter device which recorded body movement during four conditions: eyes open and closed, on a firm and foam surface. Greater binocular visual field loss was associated with increased postural sway, both on firm and foam surfaces, independent of age and gender (Pearson’s r =|0.44| to |0.46|, p <0.001). Furthermore, inferior visual field was a stronger contributor to postural stability, more so than the superior visual field, particularly on the foam condition with the eyes open. Greater visual field loss was associated with a reduction in the visual contribution to postural sway, which underlies the observed association with postural sway. The second component of the thesis examined the association between severity and location of visual field loss and falls during a 12-month longitudinal follow-up. The number of falls was assessed prospectively using monthly fall calendars. Of the 71 participants who successfully completed the follow up (mean age 73.9 ± 5.7 years), 44% reported one or more falls, and around 20% reported two or more falls. After adjusting for age and gender, every 10 points missed on the IVF-120 increased the rate of falls by 25% (rate ratio 1.25, 95% confidence interval 1.08 - 1.44) or every 5dB reduction in IVF-60 increased the rate of falls by 47% (rate ratio 1.47, 95% confidence interval 1.16 - 1.87). Inferior visual field loss was a significant predictor of falls, more so than superior field loss, highlighting the importance of the inferior visual field area in safe and efficient navigation. Further analyses indicated that postural stability, more so than functional status, may be a potential mediating factor in the relationship between visual field loss and falls. Future research is required to confirm this causal pathway. In addition, the use of topical beta-blocker medications was not associated with an increased rate of falls in this cohort, compared with the use of other topical anti-glaucoma medications. In summary, greater binocular visual field loss among older adults with glaucoma was associated with poorer health-related quality of life in the physical domain, reduced functional status, greater postural instability and higher rates of falling. When the location of visual field loss was examined, inferior visual field loss was consistently more strongly associated with these outcomes than superior visual field loss. Insights gained from this research improve our understanding of the association between glaucomatous visual field loss and disability, and its link with falls among older adults. The clinical implications of this research include the need to include visual field screening in falls risk assessments among older adults and to raise awareness of these findings to eye care practitioners and adults with glaucoma. The findings also assist in developing further research to examine strategies to reduce disability and prevent falls among older adults with glaucoma to promote healthy ageing and independence for these individuals.

Visual field size criteria for mobility rehabilitation referral

Purpose. To investigate evidence-based visual field size criteria for referral of low-vision (LV) patients for mobility rehabilitation. Methods. One hundred and nine participants with LV and 41 age-matched participants with normal sight (NS) were recruited. The LV group was heterogeneous with diverse causes of visual impairment. We measured binocular kinetic visual fields with the Humphrey Field Analyzer and mobility performance on an obstacle-rich, indoor course. Mobility was assessed as percent preferred walking speed (PPWS) and number of obstacle-contact errors. The weighted kappa coefficient of association (κr) was used to discriminate LV participants with both unsafe and inefficient mobility from those with adequate mobility on the basis of their visual field size for the full sample and for subgroups according to type of visual field loss and whether or not the participants had previously received orientation and mobility training. Results. LV participants with both PPWS <38% and errors >6 on our course were classified as having inadequate (inefficient and unsafe) mobility compared with NS participants. Mobility appeared to be first compromised when the visual field was less than about 1.2 steradians (sr; solid angle of a circular visual field of about 70° diameter). Visual fields <0.23 and 0.63 sr (31 to 52° diameter) discriminated patients with at-risk mobility for the full sample and across the two subgroups. A visual field of 0.05 sr (15° diameter) discriminated those with critical mobility. Conclusions. Our study suggests that: practitioners should be alert to potential mobility difficulties when the visual field is less than about 1.2 sr (70° diameter); assessment for mobility rehabilitation may be warranted when the visual field is constricted to about 0.23 to 0.63 sr (31 to 52° diameter) depending on the nature of their visual field loss and previous history (at risk); and mobility rehabilitation should be conducted before the visual field is constricted to 0.05 sr (15° diameter; critical).

'Radiant with possibility': involving young people in creating a vision for the future of their community

This paper argues that young people need to be given the opportunity to recognise the interaction between their own understandings of the world as it is now and the vision of what it might become. To support this argument, we discuss an urban planning project, known as the Lower Mill Site Project, which involved active participation of high school students from the local community. The outcomes of this project demonstrate the positive contributions young people can make to the process of urban redevelopment, the advantages of using a participatory design approach, and the utopian possibilities that can emerge when young people are invited to be part of an intergenerational community project.