Exterior orientation of CBERS-2B imagery using multi-feature control and orbital data

The major contribution of this paper relates to the practical advantages of combining Ground Control Points (GCPs), Ground Control Lines (GCLs) and orbital data to estimate the exterior orientation parameters of images collected by CBERS-2B (China-Brazil Earth Resources Satellite) HRC (High-resolution Camera) and CCD (High-resolution CCD Camera) sensors. Although the CBERS-2B is no longer operational, its images are still being used in Brazil, and the next generations of the CBERS satellite will have sensors with similar technical features, which motivates the study presented in this paper. The mathematical models that relate the object and image spaces are based on collinearity (for points) and coplanarity (for lines) conditions. These models were created in an in-house developed software package called TMS (Triangulation with Multiple Sensors) with multi-feature control (GCPs and GCLs). Experiments on a block of four CBERS-2B HRC images and on one CBERS-2B CCD image were performed using both models. It was observed that the combination of GCPs and GCLs provided better bundle block adjustment results than conventional bundle adjustment using only GCPs. The results also demonstrate the advantages of using primarily orbital data when the number of control entities is reduced. © 2013 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS).

DETERMINATION of THE INDIRECT ORIENTATION of ORBITAL PUSHBROOM IMAGES USING CONTROL STRAIGHT LINES

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

A semi-automatic method for indirect orientation of aerial images using ground control lines extracted from airborne laser scanner data

This paper presents a method for indirect orientation of aerial images using ground control lines extracted from airborne Laser system (ALS) data. This data integration strategy has shown good potential in the automation of photogrammetric tasks, including the indirect orientation of images. The most important characteristic of the proposed approach is that the exterior orientation parameters (EOP) of a single or multiple images can be automatically computed with a space resection procedure from data derived from different sensors. The suggested method works as follows. Firstly, the straight lines are automatically extracted in the digital aerial image (s) and in the intensity image derived from an ALS data-set (S). Then, correspondence between s and S is automatically determined. A line-based coplanarity model that establishes the relationship between straight lines in the object and in the image space is used to estimate the EOP with the iterated extended Kalman filtering (IEKF). Implementation and testing of the method have employed data from different sensors. Experiments were conducted to assess the proposed method and the results obtained showed that the estimation of the EOP is function of ALS positional accuracy.

Orientação exterior de imagens orbitais usando modelos rigorosos com feições retas

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Automatic Orientation of Multi-Scale Terrestrial Images for 3D Reconstruction

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Orientação indireta de imagens digitais usando telhados de duas águas como apoio de campo

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Extração de feições retas com precisão subpixel: estudo comparativo entre três métodos

In the fields of Machine Vision and Photogrammetry, extracted straight lines from digital images can be used either as vector elements of a digital representation or as control entities that allow the determination of the camera interior and exterior orientation parameters. Applications related with image orientation require feature extraction with subpixel precision, to guarantee the reliability of the estimated parameters. This paper presents three approaches for straight line extraction with subpixel precision. The first approach considers the subpixel refinement based on the weighted average of subpixel positions calculated on the direction perpendicular to the segmented straight line. In the second approach, a parabolic function is adjusted to the grey level profile of neighboring pixels in a perpendicular direction to the segmented line, followed by an interpolation of this model to estimate subpixel coordinates of the line center. In the third approach, the subpixel refinement is performed with a parabolic surface adjustment to the grey level values of neighboring pixels around the segmented line. The intersection of this surface with a normal plane to the line direction generates a parabolic equation that allows estimating the subpixel coordinates of the point in the straight line, assuming that this is the critical point of this function. Three experiments with real images were made and the approach based on parabolic surface adjustment has presented better results.

A influência das injunções de orientação relativa na calibração de um sistema dual de câmeras digitais

Image acquisition systems based on multi-head arrangement of digital frame cameras, such as the commercial systems DMC, UltraCam, besides others, are attractive alternatives enabling larger imaging area when compared to a single frame camera. Considering that in these systems, cameras are tightly attached to an external mount, it is assumed that relative position and orientation between cameras are stable during image acquisition and, consequently, these constraint can be included in the calibration step. This constraint is acceptable because estimates of the relative orientation (RO) parameters between cameras, from previously estimated exterior orientation parameters, present higher and significant deviations than the expected physical variations, due to error propagation. In order to solve this problem, this work presents an approach based on simultaneous calibration of two or more cameras using constraints that state that the relative rotation matrix and the distance between the cameras head are stable. Experiments with images acquired by an arrangement of two Hasselblad H2D cameras were accomplished, without and with the mentioned constraints. The experiments showed that the calibration process with RO constraints allows better results than the approach based on single camera calibration, provided that the estimation has included only images with good target distribution.

Um modelo para orientação de imagens orbitais baseado em feições retas

The aim of this paper is to present a model for orientation of pushbroom sensors that allows estimating the polynomial coefficients describing the trajectory of the platform, using linear features as ground control. Considering that pushbroom image acquisition is not instantaneous, six EOP (Exterior Orientation Parameters) for each scanned line must be estimated. The sensor position and attitude parameters are modeled with a time dependent polynomial. The relationship between object and image space is established through a mathematical model based on the equivalence between the vector normal to the projection plane in the image space and to the vector normal to the rotated projection plane in the object space. The equivalence property between planes was adapted to consider the pushbroom geometry. Some experiments with simulated data corresponding to CBERS scene (China-Brazil Earth Resource Satellite) were accomplished in order to test the developed model using straight lines. Moreover, experiments with points ground with the model based on collinearity equations adapted to the pushbroom geometry were also accomplished. The obtained results showed that the proposed model can be used to estimate the EOP of pushbroom images with suitable accuracy.

Formação de imagens multiespectrais por meio de fusão de imagens adquiridas por múltiplas câmaras

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Locating control points in aerial images with a multi-scale approach based on terrestrial image patches

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Efeitos da injunção da base nas orientações interior e exterior e nas coordenadas do espaço objeto em imagens obtidas com a estéreo vídeo-câmara de um sistema móvel de mapeamento

In general, a land-based mobile mapping system is featured by a vehicle with a pair of video cameras mounted on the top and positioning and navigation sensors loaded in the vehicle. Considering the pair of video cameras mounted on the roof of the vehicle as a stereo camera pointing forward with both optical axes parallel to each other and orthogonal to the stereo base, whose length is 0.94 m, this paper aims at analyzing the interior and exterior camera orientation and the object point coordinates estimated by phototriangulation when the length constraint related to the stereo base is considered or not. The results show that the stereo base constraint has effect ouver the convergence estimation, but does it neither improves the object point coordinate estimation at significance level of 5% and nor it influences the interior orientation parameters. Finally, it has been noticed that the optical axes are not truly parallel to each other and orthogonal to the stereo base. Additionally, it has been observed that there is a convergence of approximately 0.5 degrees in the optical axes and they are not in the same plane (approximately 0.8 degrees deviation).

Análise comparativa dos resultados obtidos pelos métodos de calibração de campo tridimensional e bidimensional

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Concept of Matching Parallelepiped and its use in the correspondence problem

In this paper, the concept of Matching Parallelepiped (MP) is presented. It is shown that the volume of the MP can be used as an additional measure of `distance' between a pair of candidate points in a matching algorithm by Relaxation Labeling (RL). The volume of the MP is related with the Epipolar Geometry and the use of this measure works as an epipolar constraint in a RL process, decreasing the efforts in the matching algorithm since it is not necessary to explicitly determine the equations of the epipolar lines and to compute the distance of a candidate point to each epipolar line. As at the beginning of the process the Relative Orientation (RO) parameters are unknown, a initial matching based on gradient, intensities and correlation is obtained. Based on this set of labeled points the RO is determined and the epipolar constraint included in the algorithm. The obtained results shown that the proposed approach is suitable to determine feature-point matching with simultaneous estimation of camera orientation parameters even for the cases where the pair of optical axes are not parallel.

Line based camera calibration in machine vision dynamic applications

The problem of dynamic camera calibration considering moving objects in close range environments using straight lines as references is addressed. A mathematical model for the correspondence of a straight line in the object and image spaces is discussed. This model is based on the equivalence between the vector normal to the interpretation plane in the image space and the vector normal to the rotated interpretation plane in the object space. In order to solve the dynamic camera calibration, Kalman Filtering is applied; an iterative process based on the recursive property of the Kalman Filter is defined, using the sequentially estimated camera orientation parameters to feedback the feature extraction process in the image. For the dynamic case, e.g. an image sequence of a moving object, a state prediction and a covariance matrix for the next instant is obtained using the available estimates and the system model. Filtered state estimates can be computed from these predicted estimates using the Kalman Filtering approach and based on the system model parameters with good quality, for each instant of an image sequence. The proposed approach was tested with simulated and real data. Experiments with real data were carried out in a controlled environment, considering a sequence of images of a moving cube in a linear trajectory over a flat surface.