JP2009271895A - Image set and method for independent rectification - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve problems wherein a device for utilizing information to the maximum has been strongly desired because much information can be acquired from duplicate photographed aerial photographs (digital photographs) and there is a demand for meeting new needs corresponding to recent rapid environmental changes such as shortening of time for acquiring target information, simplification of processes, cost reduction and diversification of kinds of information. <P>SOLUTION: An image set for independent rectification includes a plurality of images for independent rectification including the same observation point, which are images for independent rectification obtained on a parallel face of a reference face by carrying out projective transformation of duplicate-photographed aerial photographic images in a perpendicular direction to the reference face. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

    The present invention relates to a deviation corrected image relating to geospatial information and a method for utilizing the same. In particular, the new displacement corrected image has a wide range of use and can be expected to be applied in various ways.

    Recently, digitalization has progressed. For example, aerial photographs are also taken with a digital camera, and new uses that were impossible with analog photographs have been proposed, and rapid development has begun. First, scanning and the like after development processing that was necessary in analog is unnecessary in digital, and the time required for development processing after photographing has been greatly reduced, and processing can be performed quickly.

    Furthermore, overlapping shooting (overlap shooting) is performed in the shooting movement direction, and overlapping shooting (side-wrap shooting) is also performed in a direction perpendicular to the shooting movement direction in the horizontal plane, so that many images can be obtained. It came to be able to. At first, it was intended to take multiple shots for safe shooting, but now it is being devised to make use of images that have been shot multiple times.

In addition, for example, since the image can be corrected at the pixel level, various applications can be made. For example, as described in Japanese Patent Application Laid-Open No. 2003-323603 (Patent Document 1), Japanese Patent Application Laid-Open No. 2003-316256, (Patent Document 2), Japanese Patent Application Laid-Open No. 2002-092658 (Patent Document 3), etc. Although it has come to be used for generation methods, 3D digital map creation, etc., the information obtained by shooting has not been fully utilized yet, and the information obtained by duplicate shooting is more effective. Utilization is desired.
JP 2003-323603 A JP2003-316256 JP 2002-092658 A

    Conventionally, duplicated aerial photographs (digital photographs) acquire a lot of information when the degree of overlap increases. Therefore, a device for making maximum use of the information of the overlapping photographed aerial photograph is desired. A method for that purpose and the proposal of the above-mentioned device are strongly desired. Furthermore, there is a need to answer new needs in response to recent rapid changes in the environment, such as shortening the time to obtain target information, simplifying processes, reducing costs, and diversifying the types of information. Yes.

    The present invention is an independent deviation correction image obtained on the parallel plane of the reference plane by performing projective transformation in the vertical direction with respect to the reference plane, aerial photograph images taken in an overlapping manner, An independent displacement correction image set including a plurality of independent displacement correction images including the same gazing point is useful and is proposed as claim 1. The reference plane is generally a horizontal plane, but for the purpose of investigation or the like, for example, a slope may be the reference plane, and in that case, the slope is the reference plane.

    An aerial photograph image captured in an overlapping manner is an independent displacement correction image obtained by performing projective transformation in the vertical direction in the absolute coordinate system and obtained on a horizontal plane, and the depth of the independent displacement correction image An independent displacement correction image set including a plurality of the independent displacement correction images including the same gazing point by performing magnification conversion according to the distance is defined as claim 2.

    In the present invention, the independent displacement corrected image refers to an image obtained by performing projective transformation of a certain orientation image (aerial photograph image) on a horizontal virtual imaging plane in the vertical direction in the absolute coordinate system. . In addition, a combination of a plurality of the independent displacement correction images including the same gazing point is set. This set may exist at the same time, but may be used with a time difference, and both are intended. In addition, the set may be stored and used, or may temporarily exist during use.

    Further, the present invention is an independent displacement correction image obtained by performing projective transformation on an aerial photograph image taken in an overlapping manner in a direction perpendicular to a reference plane and obtained on a parallel plane of the reference plane. Multi-matching characterized by performing a magnification conversion according to a depth distance of the independent displacement corrected image and performing multi-matching on a feature point with respect to the plurality of independent displacement corrected images including the same gazing point A method is proposed as claim 3.

    Further, the magnification conversion image group of the independent displacement corrected image is regarded as a voxel image in a three-dimensional space, is created as a three-dimensional mapping space array, and the mapping space array in which the pixel values of the aerial photo image are recorded is used. The multi-matching method according to claim 3 is defined as claim 4.

    Further, the mapping space in which the pixel value can store gradation information of a monochrome image of a single layer, a color image of a three-layer layer, or a multi-spectrum image and a hyperspace spectrum image of a plurality of layers. The multi-matching method according to claim 4, which is an array, is defined as claim 5.

    6. The reference plane according to claim 4 or 5, wherein the reference plane is a horizontal plane, the vertical direction is a direction in an absolute coordinate system, and the mapping space arrangement is a lattice shape parallel to the east, west, north, and south directions of the aerial image. Claim 6 is proposed as the multi-matching method described. In any case, claims 3 to 6 basically use the independent displacement corrected image set for multi-matching. 7. The multi-matching method according to claim 3, wherein pixel matching is performed on the feature points when performing the multi-matching.

    The present invention is an independent deviation correction image obtained on the parallel plane of the reference plane by performing projective transformation in the vertical direction with respect to the reference plane, aerial photograph images taken in an overlapping manner, The magnification conversion is performed according to the depth distance of the independent deviation corrected image, and polygon matching is performed on a three-dimensional polygon in a three-dimensional mapping space array with respect to the plurality of independent deviation corrected images including the same gazing point. A polygon matching method characterized by the above is defined as claim 8. Then, the magnification conversion image group of the independent displacement correction image is regarded as a voxel image in a three-dimensional space, is created as a three-dimensional mapping space array, and the mapping space array in which the pixel values of the aerial photo image are recorded is used. The polygon matching method according to claim 8 is defined as claim 9.

    Further, in the mapping space arrangement, the pixel values can store gradation information of a single layer monochrome image, a three layer color image, or a multi-layer image and a hyperspace spectrum image of a plurality of layers. A polygon matching method according to claim 9 is proposed as claim 10.

    The reference plane is a horizontal plane, the vertical direction is a direction in an absolute coordinate system, and the mapping space arrangement is a lattice shape parallel to the east, west, north, and south directions of the aerial photo image. The polygon matching method according to claim 11 is defined as claim 11. Accordingly, the eighth to eleventh aspects are very useful since the independent displacement corrected image set can be used for polygon matching, and the polygon matching method used in this way has an effect that is very easy to use.

    The present invention is further an independent deviation correction image obtained by performing projective transformation on an aerial photograph image taken in an overlapping manner in a direction perpendicular to the reference plane and obtained on a parallel plane of the reference plane. And creating a true ortho image by converting the magnification according to the depth distance of the independent displacement corrected image and obtaining a true ortho image by multiplying the specific region with respect to the plurality of independent displacement corrected images including the same gazing point. The method according to claim 12, wherein the magnification-converted image group of the independent displacement correction image is regarded as a voxel image in a three-dimensional space, is created as a three-dimensional mapping space array, and the mapping in which pixel values of the aerial photo image are recorded The true ortho image creation method according to claim 12 using a spatial arrangement is defined as claim 13.

    In the mapping space array, the pixel values can store gradation information of a single layer monochrome image, a three layer color image, or a multi-layer image and a hyperspace spectrum image of a plurality of layers. A true ortho image creation method according to claim 13 is proposed as claim 14, wherein the reference plane is a horizontal plane, the vertical direction is a direction in an absolute coordinate system, and the mapping space arrangement is east-west of the aerial image. The true ortho image creation method according to claim 13 or 14, which has a lattice shape parallel to the north-south direction. Accordingly, claims 12 to 15 include, for example, an example in which the independent displacement correction image set is used in a true ortho image generation method.

    According to the present invention, as described above, various applications are possible with a simple projection, and it is possible to use all the images that have been captured twice without fail, and the captured information can be effectively used without waste. In addition, application can be performed by a simple method, and desired devices and effects can be obtained. In addition, there is an advantage that all the horizontal line segments have the same directionality in the independent displacement corrected image, and various applications are possible based on this. The horizontal line segment is a line segment composed of vertices having the same elevation value, and is composed of points in a horizontal reference plane. In the case of a horizontal outline polygon composed only of horizontal line segments, a similar relationship is always established.

    Furthermore, the independent displacement corrected image has an effect of avoiding occlusion by simultaneous reference of all images. Since it is possible to superimpose feature points by magnification conversion of independent displacement corrected images in the object space, it is possible to simultaneously refer to all images corresponding to arbitrary search positions. Therefore, there is an advantage that a correct corresponding point can be determined.

    Further, according to the present invention, the calculation cost can be reduced along with the occlusion avoidance. According to the present invention, a single gaze point measurement method is used, equidistant measurement points are arranged in a grid shape in the horizontal direction, and a search in the vertical direction is performed. Density is obtained, and at each measurement point, it is possible to avoid occlusion by simultaneous reference of all images, and it is not necessary to repeatedly perform corresponding point search. The present invention has many other effects.

Hereinafter, the present invention will be described in more detail with reference to examples and drawings. First, the independent displacement correction method according to the present invention and the independent correction image obtained by the method will be described. FIG. 1 is a conceptual diagram of the independent displacement correction method. 1 is an object to be photographed, and 2 is a gaze point. Two images of the orientation image 3 and the orientation image 4 are selected from the multiple captured images obtained by capturing the imaging object 1, and the respective imaging centers are set to 5 and 6, respectively. The orientation images 3 and 4 are converted from the photographic coordinate system to the absolute coordinate system using the following formula (1), and are each projected and converted to the horizontal virtual imaging plane based on the collinear condition, independently. Displacement corrected images 7 and 8 are obtained.

Here, C _k (X _k , Y _k , Z _k ) is the projection center position of the camera in the absolute coordinate system from the orientation elements of each orientation image, and the rotation angle of the posture is (Ω _k , Φ _k , K _k). ), The coordinate value (x, y, −c) of an arbitrary point in the photographic coordinate system of the orientation image can be converted into an absolute coordinate value (X, Y, Z). Here, κ = 1, 2,..., N (n: the number of images used for matching), and c means the focal length of the camera.

An absolute coordinate value (X, Y, Z) of an arbitrary point on the orientation image is a horizontal where the rotation angle of the posture is all 0 based on the collinear condition without changing the projection center point C _k and the focal length c. In addition, by defining a virtual imaging plane in the same direction and performing projective transformation, coordinate values (x ′, y ′, −c) in the photographic coordinate system after transformation are obtained. By re-sampling this as a projective transformation image, an independent displacement corrected image can be obtained.

In addition, since all of the independent deviation corrected images are projective transformed with respect to the horizontal and same virtual imaging plane, the corresponding points can be superimposed by converting the magnification of the image according to the height of the reference plane. is there. FIG. 2 is an example of overlapping of corresponding points. The four independent independent corrected images 11 to 14 are obtained by superimposing corresponding points P _{1 to} P ₄ of the gazing point P on the gazing point P. C _{1 to} C ₄ are the respective photographing centers. When the coordinate value in the independent displacement correction image of the gazing point P is (x, y) and the reference plane is set to the altitude value (Z _p ) of the point P, the magnification conversion equation shown in the following equation (2) is used. The horizontal position (X _p , Y _p ) of the point P can be calculated.

    When this magnification conversion is applied to all independent displacement corrected images, corresponding points overlap on a common reference plane. By matching the image data superimposed in the object space on a hierarchy and searching the image data stored in this layer shape in the vertical direction, matching between multiple captured images becomes possible.

    A multiple photographic image selected from aerial photographs of the entire Shibuya Ward was used in the examples. (The present invention can be applied to any shooting method in this way. Select 7 images, one image on the left and right adjacent to each other in the center, A total of seven adjacent images, one adjacent image and one adjacent image on the right front side, and one adjacent image on the lower left and lower right side of the center, and six adjacent images surrounding the center are hexagonal From the shooting record, the equipment used for shooting, as the DMC, the origin of Intergraph, etc. has a pixel number of 13824 × 780 pixels, a CCD size of 165.9 mm × 92, 2 mm, a pixel size of 12 0.0 μm (square lattice), focal length 120 mm, and the origin of shooting was an altitude of 600 m, a lap ratio (OL / SL) of 66.7% × 66.7%, and the number of projects was 2.

    A schematic flow of the embodiment is shown in a flowchart in FIG. First, an independent displacement correction image 32 was obtained from the selected multiple photographed image 31 (a method of obtaining it is called an independent displacement correction method). First, the original multiple captured image (orientation image 31) and its independent displacement corrected image 32 were compared, and the direction identity of the horizontal line segment was evaluated at 33.

    Secondly, the reduction rate of the occlusion area 36 with respect to the simultaneous reference 34 of all images was evaluated based on the visible / invisible determination 35 using the building model obtained by plotting. Third, the calculation costs 37 of both were compared and evaluated under such conditions that the occlusion areas were equivalent.

    In order to evaluate the degree of coincidence of the coordinate values by the conversion of the corresponding points, acquisition of the area centroid points of the contour vertices by plotting using the independent deviation corrected image was performed. FIG. 4 exemplifies a part thereof, and shows contour vertices by plotting. When this was performed for each image, it was confirmed that the positions of the building outlines were consistent (displayed with solid lines) in all the images. The dotted lines in the figure indicate building outlines having different heights. However, when the corresponding height was used as a reference plane and the magnification was converted, the contour line matched in all images.

    About the contour points of the building obtained by plotting and the feature points obtained by the area centroid method, the degree of coincidence of the horizontal coordinate values by magnification conversion with respect to each reference plane is displayed as an average point, X is 6.45 cm, Y is 4.74 cm, the area centroid is X is 3.12 cm, Y is 3.02 cm, about one pixel at the plotted contour vertex, and 0.5 pixels at the area centroid This shows a degree of coincidence. In addition, the consistency of the direction was matched to the horizontal building outline at the top, but inconsistency was seen in the multi-ray method, but in the independent displacement correction image method, it was seen that it was in agreement. .

    Although it is a subject of the 2nd occlusion reduction | decrease, the visible / invisible determination simulation was performed using the building model by the independent displacement correction image method concerning this invention. In the case of the multi-ray method, it was 10.08%, and in the case of the independent displacement correction image method, it was 2.42%. According to the present invention, all images can be referred to at the same time. Therefore, matching is possible if there are two or more visible images in any combination. This contributes to the reduction of occlusion.

    As a result of calculation for the third reduction cost, multi-matching processing by the multi-ray method is performed on the combination of the image at the center of the seven positions and the one at the right side, the upper left side, and the lower left side. The calculation time for 4 times was added and compared. As a result, in the multi-ray method (A), image reading 0 minutes 12 seconds, image extraction 6 minutes 00 seconds, corresponding point search 30 minutes 24 seconds, whereas, in the method according to the present invention, image reading 0 minutes 5 seconds. Image extraction 16 minutes 8 seconds, corresponding point search 8 minutes 12 seconds, and the multi-lay method required 3.75 times the time required for the method according to the present invention. Therefore, it can be seen that the present invention greatly reduces the cost.

It is a conceptual diagram of the independent deviation correction method concerning this invention. It is a conceptual diagram concerning the present invention, the state of superimposition of corresponding points by a magnification conversion image. It is a flowchart of the Example of this invention. It is a figure concerning this invention and showing the contour vertex by plotting.

Explanation of symbols

1 Subject (object to be photographed)
2 Gaze point 3 Multiple shot image 4 Multiple shot image 5 Shooting center 6 Shooting center 7 Independent displacement corrected image 8 Independent displacement corrected image

Claims (15)

      An independent deviation correction image obtained by performing projective transformation on an aerial photograph image taken in the vertical direction with respect to a reference plane in a direction perpendicular to the reference plane and obtained on the parallel plane of the reference plane, and having the same gaze point A plurality of independent displacement corrected images including the independent displacement corrected image set.       An aerial photograph image captured in an overlapping manner is subjected to projective transformation in the vertical direction in the absolute coordinate system, and is an independent deviation corrected image obtained on a horizontal plane, and the depth distance of the independent deviation corrected image is obtained. An independent displacement correction image set comprising a plurality of the independent displacement correction images including the same gazing point after performing a corresponding magnification conversion.       An independent deviation correction image obtained by performing projective transformation on an aerial photograph image taken in an overlapping manner in a direction perpendicular to a reference plane, and obtained on a parallel plane of the reference plane, the independent deviation A multi-matching method characterized by performing magnification conversion according to a depth distance of a corrected image and performing multi-matching on a feature point with respect to the plurality of independent displacement corrected images including the same gazing point.       Taking the magnification conversion image group of the independent displacement corrected image as a voxel image in a three-dimensional space, creating a three-dimensional mapping space array, and using the mapping space array in which pixel values of the aerial photo image are recorded. 4. The multi-matching method according to claim 3, wherein       The mapping value array is capable of storing gradation information of a monochrome image of a single layer, a color image of a three-layer layer, or a multi-spectrum image and a hyperspace spectrum image of a plurality of layers. The multi-matching method according to claim 4.       5. The reference plane according to claim 4, wherein the reference plane is a horizontal plane, the vertical direction is a direction in an absolute coordinate system, and the mapping space arrangement is a grid shape parallel to the east, west, north, and south directions of the aerial image. The multi-matching method according to any one of 5.       The multi-matching method according to claim 3, wherein pixel matching is performed on the feature points when performing the multi-matching.       An independent deviation correction image obtained by performing projective transformation on an aerial photograph image taken in an overlapping manner in a vertical direction with respect to a reference plane and obtained on a parallel plane of the reference plane, the independent deviation A magnification conversion is performed according to a depth distance of the corrected image, and polygon matching is performed on a three-dimensional polygon in a three-dimensional mapping space array with respect to the plurality of independent displacement corrected images including the same gazing point. Polygon matching method.       Taking the magnification conversion image group of the independent displacement corrected image as a voxel image in a three-dimensional space, creating a three-dimensional mapping space array, and using the mapping space array in which pixel values of the aerial photo image are recorded. The polygon matching method according to claim 8, wherein the method is a polygon matching method.       The mapping value array is capable of storing gradation information of a monochrome image of a single layer, a color image of a three-layer layer, or a multi-spectrum image and a hyperspace spectrum image of a plurality of layers. The polygon matching method according to claim 9.       The reference plane is a horizontal plane, the vertical direction is a direction in an absolute coordinate system, and the mapping space arrangement is a lattice shape parallel to the east, west, north, and south directions of the aerial photo image. The polygon matching method according to any one of 10.       An independent deviation correction image obtained by performing projective transformation on an aerial photograph image taken in an overlapping manner in a vertical direction with respect to a reference plane and obtained on a parallel plane of the reference plane, the independent deviation A true ortho image creation method characterized by performing a magnification conversion according to a depth distance of a corrected image and obtaining a true ortho image by a magnification conversion of a specific region for the plurality of independent displacement corrected images including the same gazing point .       Taking the magnification conversion image group of the independent displacement corrected image as a voxel image in a three-dimensional space, creating a three-dimensional mapping space array, and using the mapping space array in which pixel values of the aerial photo image are recorded. The true ortho-image creating method according to claim 12, wherein the true ortho-image is created.       The pixel value is the mapping space array capable of storing gradation information of a single layer monochrome image, a three layer color image, or a multi-layer image and a hyperspace spectrum image of a plurality of layers. The true ortho image creating method according to claim 13.       The reference plane is a horizontal plane, the vertical direction is a direction in an absolute coordinate system, and the mapping space arrangement is a lattice shape parallel to the east, west, north, and south directions of the aerial photograph image. 14. The true ortho image creation method according to any one of claims 14 to 14.

Images