Vision-based classification of solder joint defects

Inspection of solder joints has been a critical process in the electronic manufacturing industry to reduce manufacturing cost, improve yield, and ensure product quality and reliability. The solder joint inspection problem is more challenging than many other visual inspections because of the variability in the appearance of solder joints. Although many research works and various techniques have been developed to classify defect in solder joints, these methods have complex systems of illumination for image acquisition and complicated classification algorithms. An important stage of the analysis is to select the right method for the classification. Better inspection technologies are needed to fill the gap between available inspection capabilities and industry systems. This dissertation aims to provide a solution that can overcome some of the limitations of current inspection techniques. This research proposes two inspection steps for automatic solder joint classification system. The “front-end” inspection system includes illumination normalisation, localization and segmentation. The illumination normalisation approach can effectively and efficiently eliminate the effect of uneven illumination while keeping the properties of the processed image. The “back-end” inspection involves the classification of solder joints by using Log Gabor filter and classifier fusion. Five different levels of solder quality with respect to the amount of solder paste have been defined. Log Gabor filter has been demonstrated to achieve high recognition rates and is resistant to misalignment. Further testing demonstrates the advantage of Log Gabor filter over both Discrete Wavelet Transform and Discrete Cosine Transform. Classifier score fusion is analysed for improving recognition rate. Experimental results demonstrate that the proposed system improves performance and robustness in terms of classification rates. This proposed system does not need any special illumination system, and the images are acquired by an ordinary digital camera. In fact, the choice of suitable features allows one to overcome the problem given by the use of non complex illumination systems. The new system proposed in this research can be incorporated in the development of an automated non-contact, non-destructive and low cost solder joint quality inspection system.

Experiments in visual localisation around underwater structures

Localisation of an AUV is challenging and a range of inspection applications require relatively accurate positioning information with respect to submerged structures. We have developed a vision based localisation method that uses a 3D model of the structure to be inspected. The system comprises a monocular vision system, a spotlight and a low-cost IMU. Previous methods that attempt to solve the problem in a similar way try and factor out the effects of lighting. Effects, such as shading on curved surfaces or specular reflections, are heavily dependent on the light direction and are difficult to deal with when using existing techniques. The novelty of our method is that we explicitly model the light source. Results are shown of an implementation on a small AUV in clear water at night.

Scaffold development using 3D printing with a starch-based polymer

Rapid prototyping (RP) techniques have been utilised by tissue engineers to produce three-dimensional (3D) porous scaffolds. RP technologies allow the design and fabrication of complex scaffold geometries with a fully interconnected pore network. Three-dimensional printing (3DP) technique was used to fabricate scaffolds with a novel micro- and macro-architecture. In this study, a unique blend of starch-based polymer powders (cornstarch, dextran and gelatin) was developed for the 3DP process. Cylindrical scaffolds of five different designs were fabricated and post-processed to enhance the mechanical and chemical properties. The scaffold properties were characterised by scanning electron microscopy (SEM), differential scanning calorimetry (DSC), porosity analysis and compression tests

Interactions between human osteoblasts and prostate cancer cells in a novel 3D in vitro model

Cell-cell and cell-matrix interactions play a major role in tumor morphogenesis and cancer metastasis. Therefore, it is crucial to create a model with a biomimetic microenvironment that allows such interactions to fully represent the pathophysiology of a disease for an in vitro study. This is achievable by using three-dimensional (3D) models instead of conventional two-dimensional (2D) cultures with the aid of tissue engineering technology. We are now able to better address the complex intercellular interactions underlying prostate cancer (CaP) bone metastasis through such models. In this study, we assessed the interaction of CaP cells and human osteoblasts (hOBs) within a tissue engineered bone (TEB) construct. Consistent with other in vivo studies, our findings show that intercellular and CaP cell-bone matrix interactions lead to elevated levels of matrix metalloproteinases, steroidogenic enzymes and the CaP biomarker, prostate specific antigen (PSA); all associated with CaP metastasis. Hence, it highlights the physiological relevance of this model. We believe that this model will provide new insights for understanding of the previously poorly understood molecular mechanisms of bone metastasis, which will foster further translational studies, and ultimately offer a potential tool for drug screening. © 2010 Landes Bioscience.

Wide-baseline keypoint detection and matching with wide-angle images for vision based localisation

This thesis addresses the problem of detecting and describing the same scene points in different wide-angle images taken by the same camera at different viewpoints. This is a core competency of many vision-based localisation tasks including visual odometry and visual place recognition. Wide-angle cameras have a large field of view that can exceed a full hemisphere, and the images they produce contain severe radial distortion. When compared to traditional narrow field of view perspective cameras, more accurate estimates of camera egomotion can be found using the images obtained with wide-angle cameras. The ability to accurately estimate camera egomotion is a fundamental primitive of visual odometry, and this is one of the reasons for the increased popularity in the use of wide-angle cameras for this task. Their large field of view also enables them to capture images of the same regions in a scene taken at very different viewpoints, and this makes them suited for visual place recognition. However, the ability to estimate the camera egomotion and recognise the same scene in two different images is dependent on the ability to reliably detect and describe the same scene points, or ‘keypoints’, in the images. Most algorithms used for this purpose are designed almost exclusively for perspective images. Applying algorithms designed for perspective images directly to wide-angle images is problematic as no account is made for the image distortion. The primary contribution of this thesis is the development of two novel keypoint detectors, and a method of keypoint description, designed for wide-angle images. Both reformulate the Scale- Invariant Feature Transform (SIFT) as an image processing operation on the sphere. As the image captured by any central projection wide-angle camera can be mapped to the sphere, applying these variants to an image on the sphere enables keypoints to be detected in a manner that is invariant to image distortion. Each of the variants is required to find the scale-space representation of an image on the sphere, and they differ in the approaches they used to do this. Extensive experiments using real and synthetically generated wide-angle images are used to validate the two new keypoint detectors and the method of keypoint description. The best of these two new keypoint detectors is applied to vision based localisation tasks including visual odometry and visual place recognition using outdoor wide-angle image sequences. As part of this work, the effect of keypoint coordinate selection on the accuracy of egomotion estimates using the Direct Linear Transform (DLT) is investigated, and a simple weighting scheme is proposed which attempts to account for the uncertainty of keypoint positions during detection. A word reliability metric is also developed for use within a visual ‘bag of words’ approach to place recognition.