KR20170108552A - Information system for analysis of waterfront structure damage - Google Patents

Abstract

The present invention relates to a method for constructing an information system for analyzing damage information on a waterfront structure. The information system for analyzing damage information on the waterfront structure according to the present invention includes a storage unit for storing the unmanned aerial photographs taken at the time of the damage and the reference data of the same area constructed in the past, A verification unit for confirming individual photographing positions in a footprint form through an external facial expression element from the input unmanned airplane image, and an image matching unit for performing image matching from the input unmanned airplane image Dimensional point cloud data, and a detection unit for detecting the damaged region by comparing the reference point cloud data with the reference data.

Description

TECHNICAL FIELD [0001] The present invention relates to an information system for analyzing damage information on a waterside structure,

The present invention is based on a spatial information-based system for quickly analyzing damages information on a waterside structure such as a dam, a beam, a bridge, a dam, a retaining wall, and a cut slope when a natural disaster such as a typhoon or a heavy rain occurs, And how to build an information system.

Recently, as climate change due to global warming accelerates, localized heavy rain and typhoon damage are frequent. These damages cause many human and material damages, especially when the damage of the national infrastructure is delayed, the additional loss of lives and social inconvenience are increased.

Ultimately, the development of technology to support rapid analysis of damage information and timely recovery activities is a very important step for us. In the past, the investigation and restoration of these damages have been carried out by the local autonomous entities. In some cases, it is sometimes difficult to investigate the objective damage according to the investigation method of individual civil servants.

In order to improve the disadvantages of damage investigation based on such manpower, many studies have been carried out using technology of science and space (GIS) in many fields.

Currently, many technology developments and studies use aerial images or satellite images to analyze the damage location and the whole area. This focuses on a rough analysis that takes some loss of accuracy rather than an accurate analysis of damage information.

Also, it mainly focuses on the calculation of two - dimensional area information, and there is a limitation in transmitting accurate information for restoration.

The emphasis of the present invention is to accurately extract the location of the damaged area and the amount of damage information, and to extract the volume information by analyzing the three-dimensional information.

Disclosure of Invention Technical Problem [8] Accordingly, the present invention has been made in order to solve the above-mentioned problems, and it is an object of the present invention to quickly identify damages of dam structures such as dams, boats, bridges, banks, retaining walls, and slope slopes when a natural disaster such as a typhoon, And to provide analysis information necessary for recovery decision making.

The information system for analyzing damage information of the waterfront structure for achieving the above object includes a storage unit for storing the unmanned aerial photographs taken at the time of the damage and the reference data of the same area constructed in the past, An identifying unit for identifying an individual photographing position in a footprint form through an external facial expression element from the input unmanned airplane image, and an image matching unit for obtaining image matching from the input unmanned airplane image, And generating a three-dimensional point cloud data, and comparing the detected point cloud data with the reference data to detect a damaged region.

According to an embodiment of the present invention, three-dimensional information of a damaged area is generated and analyzed through image information captured by an unmanned aerial vehicle and various spatial information databases, and compared with reference data to automatically calculate an area determined to be damaged By providing the system construction method and the initial modules, it is possible to analyze the damage information in the remote area at a distance using the image of the unmanned aerial vehicle without directly going to the scene in case of a disaster, have.

1 is a block diagram illustrating an information system for analyzing damage information on a waterfront structure according to an embodiment of the present invention.
2 is a view for explaining an example of an image of an unmanned aerial vehicle according to an embodiment of the present invention.
FIG. 3 is a view for explaining an external facial expression element according to an embodiment of the present invention.
4 is a diagram for explaining a damage information analysis process according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating an image matching result according to an exemplary embodiment of the present invention. Referring to FIG.
6 is a flowchart illustrating an operation of the damage analysis system according to an embodiment of the present invention.
7 is a diagram illustrating an example of an architecture of a damage information analysis system according to an embodiment of the present invention.
8 is a view for explaining a module type and a process of the damage analysis system according to an embodiment of the present invention.
FIG. 9 is a view for explaining definitions of damage information management and visualization module requesting functions according to an embodiment of the present invention.
FIG. 10 is a view for explaining an illustration and a control request function definition of a damage information management and visualization module according to an embodiment of the present invention.
11 is a view for explaining a UAV management module according to an embodiment of the present invention.
12 and 13 are views for explaining a UAV image and a background map according to an embodiment of the present invention.
14 is a diagram for explaining the definition of a required function of the damage information extraction and analysis module according to an embodiment of the present invention.
15 is a diagram for explaining a damage information extracting and analyzing module according to an embodiment of the present invention.
FIG. 16 is a diagram illustrating a height criterion of a matching result according to an embodiment of the present invention.
17 is a diagram illustrating a shading criterion of a matching result according to an embodiment of the present invention.
18 is a diagram showing a point shape of a damaged area according to an embodiment of the present invention.
FIG. 19 is a diagram showing a line shape of a damaged area according to an embodiment of the present invention.
20 is a view showing a surface shape of a damaged area according to an embodiment of the present invention.
FIG. 21 is a view for explaining quantitative information disclosure of a damaged area according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to or limited by the embodiments. Like reference symbols in the drawings denote like elements.

The present invention is not limited to a waterside structure area where damage is frequently caused by typhoons or floods during heavy rainfall.

1 is a block diagram illustrating an information system for analyzing damage information on a waterfront structure according to an embodiment of the present invention.

An information system 100 for analyzing damage information on the waterfront structure of the present invention (hereinafter abbreviated as 'damage analysis system') 100 includes a storage unit 110, an input unit 120, an identification unit 130, 140). In addition, according to the embodiment, the damage analysis system 100 can be configured by adding the display unit 150. [

The storage unit 110 can store the unmanned aerial photographs taken at the time of the damage and the reference data of the same area constructed in the past.

The input unit 120 may input external facial expression element information of each of the images, which can identify the position and attitude information at the time of photographing.

The confirmation unit 130 can confirm the individual photographing position in the footprint form through the external facial expression element from the inputted image of the unmanned aerial vehicle.

The detection unit 140 may perform image matching from the input unmanned airplane image to generate three-dimensional point cloud data, and may compare the reference point cloud data with the reference data to detect the damaged region.

In addition, the detection unit 140 extracts the point cloud data, which are three-dimensional shapes, from the two-dimensional unmanned airplane images, and compares the point cloud data with the reference data constructed in three dimensions, It can be judged as the lost area due to the damage.

The display unit 150 may display the damage information result related to the damage area when the damage area is detected. In addition, the display unit 150 may display the damage information result so as to include at least the damage position and damage amount for the damage area.

The present invention can extract the quantitative value of damage information on the assumption of damages and loss of facilities frequently occurring in bridges, banks, and the like. The data required for this can be divided into two types: the unmanned aerial photographs and the spatial information database.

2 is a view for explaining an example of an image of an unmanned aerial vehicle according to an embodiment of the present invention.

The unmanned aerial vehicle image can be used as a source of the image matching technology for generating 3D information, and the spatial information DB can be used as reference data for performing change detection compared with the 3D information generated through image matching have.

FIG. 3 is a view for explaining an external facial expression element according to an embodiment of the present invention.

In order to perform the image matching, the image of the UAV is composed of the image itself and the exterior orientation parameters (EOPs) of the individual image, and the external facial expression represents the position of the sensor at the time of shooting acquired by the GPS / INS sensor It may be necessary information for accurate measurement.

The outer facial element consists of position coordinates and attitude information at the shooting time of the UAV, and all the images can be information that they have individually because they are different in the shooting position and posture.

In addition, the calibration file information corrected for the error of the camera mounted on the unmanned aerial vehicle is also included, so that any errors that may occur during the shooting process can be prevented in advance.

The reference data that performs the image matching result and the comparison detection may refer to the spatial information constructed before the damage occurrence to compare with the point cloud data extracted from the image matching result.

The spatial information used as the reference may be an unmanned aerial vehicle image, an orthoimage image, an aerial image not generally corrected, an aerial image data, a digital surface model (DSM), and a 3D watershed structure object model.

This reference can be used to perform change detection by automatically comparing with the unmanned aerial vehicle image matching result, or as a grounding data to visually and manually identify the damaged area when image matching is not performed.

In the end, the main point of the damage analysis in the present invention may be a method of calculating the damage area by comparing the result of the image matching technique of the unmanned aerial vehicle with the reference.

In the image matching technique, it is essential to extract point cloud data, which is a three-dimensional shape, from two-dimensional unmanned airplane images. Comparing this with reference data constructed in three dimensions, the height difference between two data is discriminated as a lost area due to damage can do.

4 is a diagram for explaining a damage information analysis process according to an embodiment of the present invention.

In order to analyze the damage of the waterfront structure, the present invention basically utilizes the unmanned aerial photographs taken at the time of the damage and the reference data of the same area constructed in the past, but is not limited thereto.

The photographed unmanned aerial vehicle image can be input in the form of a DB including both the corrected information of the used camera and the external facial expression information of the respective images, which can know the position and attitude information at the time of photographing.

The input image of the unmanned aerial vehicle can be confirmed by footprint using the external facial expression element and the user can confirm the damage area by the image before the image matching is performed.

The input unmanned airplane image performs image matching to generate three-dimensional point cloud data, and this result can be compared with the reference to detect the damaged area.

FIG. 5 is a diagram illustrating an image matching result according to an exemplary embodiment of the present invention. Referring to FIG.

As shown in FIG. 5, the image matching of the unmanned aerial vehicle applied in the process may be a technique of generating a three-dimensional shape using an image processing algorithm for images of a plurality of identical areas.

The generated 3D point cloud data can reproduce the shape in the relative model space and it should include a procedure to convert it to have the same scale and coordinate information as the absolute space real world, It can be said that it is a singing operation.

Georeferencing is a technology in the space information field that uses aerial photographs taken using a large frame camera to create a map. It can be a technology that makes the actual world in which we live in the virtual world in the computer the same.

6 is a flowchart illustrating an operation of the damage analysis system according to an embodiment of the present invention.

The damage analysis system 100 may be a program that is implemented by software in image matching technology and change detection technology, and analyzes damage information of the unmanned airplane image and the spatial information DB as input data. The result of this program can be the quantitative volume value of the damaged area extracted by comparing the matching result with the height (Z) value of the reference data.

The process is designed based on the system by setting the damage detection scenario in advance and the scenario is as shown in Fig.

After the 2D-based visualization module receives the unmanned aerial image as an input, the 3D-based analysis module is executed with the image matching result, and the damage detection and analysis processes described above can be performed.

The final damage information may include polygon information of the damage area range for visualization and information such as position coordinates, length, width, and volume of the corresponding area.

As a result, for the above-mentioned operation process, a module composed of a software part must be developed for each step, and each module can be composed of an unmanned aerial vehicle image management and visualization module, a multiple image matching module, and a damage information analysis module.

7 is a diagram illustrating an example of an architecture of a damage information analysis system according to an embodiment of the present invention.

The system architecture can be designed as shown in FIG. 7 with respect to the construction of the system 100 suggested by the present invention. The architecture may include a server system in which spatial information DBs are stored.

8 is a view for explaining a module type and a process of the damage analysis system according to an embodiment of the present invention.

Each module may be implemented as a separate program, but may be implemented to be executed in a single UI (User Interface) in the end and integrated into one system.

First, 2D - based image input and visualization module that reads unmanned aircraft images and related DBs is required, and data control can be freely performed by the user.

By analyzing the demand of such functions, the 2D-based damage information management and the required functions of the visualization module can be defined as shown in FIG. FIG. 9 is a view for explaining definitions of damage information management and visualization module requesting functions according to an embodiment of the present invention.

In addition, the damage information management and visualization module can display a large amount of data on a screen and provide a function for the user to handle it.

These requirements can also be reflected to define the required functions for data city and control as shown in FIG. FIG. 10 is a view for explaining an illustration and a control request function definition of a damage information management and visualization module according to an embodiment of the present invention.

It is assumed that 2D and 3D data shown or controlled by the module are all photographed and constructed in advance, and the constructed data can be stored in a database (DB) in a server system that is reflected in the design in the system 100.

The database is designed as Oracle, and can be designed to enable long distance communication between the operating system and the database, depending on the situation.

The data to be stored may be classified according to the data acquisition date, the spatial coordinates of the data containing area, and the data format.

11 is a view for explaining a UAV management module according to an embodiment of the present invention.

The module enables the input of the image list of the damaged area photographed by the unmanned aerial vehicle, and can provide a footprint function expressing the position of the individual images.

The inputted set of the unmanned aerial vehicle image can be composed of a list view screen in which both the individual image list and the external appearance element values of each image are displayed, and the individual image enlarging function.

The user can search the list of inputted images and use the basic viewing function such as moving, reducing, enlarging and rotating selected images.

Also, the UAV image and position in the entire UI and frame of the video management module may be displayed on the background map, and the approximate position can be confirmed while the image is input.

12 and 13 are views for explaining a UAV image and a background map according to an embodiment of the present invention.

The image matching step of the unmanned aerial vehicle image DB suspected to be the damage region shown in the figure is performed to generate three-dimensional information, and the corresponding data can be extracted as point data or model data.

The extracted data can detect change of damage area and analyze and extract damage information from the damage information extracting and analyzing module capable of displaying and managing three-dimensional data.

The required function definition of the damage information extraction and analysis module and the implementation UI can be designed as shown in FIG.

14 is a diagram for explaining the definition of a required function of the damage information extraction and analysis module according to an embodiment of the present invention.

The functions of the required function definition described above are classified according to two methods of automatic damage detection and manual damage detection, and may not be duplicated.

The UI can be designed as shown in FIG. 15 according to the function definition of the damage information extraction and analysis module. Representative functions may be a city of multiple image matching results, detection and visualization of a damaged area, generation of damage information results, etc., as shown in FIG.

15 is a diagram for explaining a damage information extracting and analyzing module according to an embodiment of the present invention.

The result of the multiple image matching can be easily confirmed by the user's eyes, and the extracted damage information can be displayed separately from the polygon, as shown in FIG.

When the result is first loaded, the data is shown on the basis of the height, and the level of the data used can be clearly seen. The height reference data table uses the color table method, and the color range is calculated by setting the data of the highest value Z in the range of the full height value of the data to red, and the data having the lowest Z value to blue .

FIG. 16 is a diagram illustrating a height criterion of a matching result according to an embodiment of the present invention.

This matching result, which is displayed on a height basis, can also be viewed as a shaded display for users intuitively looking.

In particular, in the process of detecting and extracting the damaged area and showing the corresponding area, the result file can be expressed as data having the same color in the model form by constituting the TIN as shown in the following figure.

17 is a diagram illustrating a shading criterion of a matching result according to an embodiment of the present invention.

The area determined to be damaged is a part that detects a difference in shape change between the matching result and the reference, which is regarded as a damage, and can be shown as a damaged area in the system 100 of the present invention.

First, the area identified as the damage is implemented in various shapes (points, lines, and faces) so that the user can easily see the area of the damage, and the damage can be observed on the screen in a form desired by the user.

The method of dividing a damaged area by a point may be a method of setting a change area of a point group data originally generated internally as a range. This has the advantage of expressing accurate data, but it may not be easy to read in terms of visualization.

18 is a diagram showing a point shape of a damaged area according to an embodiment of the present invention.

In order to compensate for this, a line is selected as a visualization method to supplement the function. This line can express the damage by selecting a triangular irregular network (TIN) method internally. The TIN method can represent data by connecting irregular point cloud data to adjacent data and connecting triangular triangular networks continuously.

FIG. 19 is a diagram showing a line shape of a damaged area according to an embodiment of the present invention.

Although the line shape is more effective than the point visualization, it is possible to add the function of displaying the damage area in the form of a face and color in order to find a more effective solution.

20 is a view showing a surface shape of a damaged area according to an embodiment of the present invention.

In addition to the visualization method, damage information analysis represented by the method proposed by the present invention can adopt a method of calculating quantitative information of damage information separately and transmitting it to a user.

Quantitative information can be information about the location (coordinates) of the damage in a particular area, the extent and the volume.

This information is displayed when selecting the damaged area polygon visualized above, and the displayed information may be the analysis date, time, coordinates (xyz) of the damage center position, the longest length, area and volume.

The information is represented in a pop-up form, and can be calculated and information can be checked even when there are damage to various areas at the same time.

FIG. 21 is a view for explaining quantitative information disclosure of a damaged area according to an embodiment of the present invention.

The calculated information can be finally extracted as final damage information by manually selecting the damage type by the user.

The damage type is judged by the user's eyes based on the data displayed on the screen, and the selected facility can be stored in advance in the system 100 so that both the detailed facilities and the damage type can be selected.

The present invention relates to a system (100) for generating and analyzing three-dimensional information of a damaged area through image information photographed by an unmanned aerial vehicle and various spatial information databases, and automatically calculating an area discriminated as a damage by comparing with reference data I have devised a plan and an initial module.

The present invention can provide data for rapidly analyzing damage information of a local area and making accurate decision-making by using only images of an unmanned aerial vehicle without directly going to the scene in case of a disaster disaster.

The method according to an embodiment of the present invention may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

100: Information system for damage information analysis of waterside structures
110:
120: Input unit
130:
140:
150:

Claims (4)

A storage unit for storing the unmanned aerial photographs taken at the time of the damage and the reference data of the same area constructed in the past;
An input unit for inputting external facial expression element information of each of images in which position and posture information at the time of photographing can be known;
A confirmation unit for confirming an individual photographing position in the form of a footprint through an external facial expression element from the inputted image of the unmanned aerial vehicle; And
A detection unit for detecting three-dimensional point cloud data by performing image matching from the input unmanned airplane image and comparing the reference point cloud data with the reference data,
Information System for Analysis of Damage Information on Watershed Structures. The method according to claim 1,
The detection unit detects,
The point cloud data, which are three-dimensional shapes, are extracted from the two-dimensional unmanned airplane images and compared with the reference data constructed in three dimensions,
The height difference between the point cloud data and the reference data is determined as a lost area due to the damage
Information System for Damage Information Analysis of Watershed Structures. The method according to claim 1,
When the damage area is detected, a display unit for displaying a damage information result related to the damage area
And an information system for analyzing the damage information of the waterfront structure. The method of claim 3,
The display unit includes:
The damage information result is displayed so as to include at least the damage position and damage amount for the damage area
Information System for Damage Information Analysis of Watershed Structures.

Images