KR101879855B1 - Digital map generating system for performing spatial modelling through a distortion correction of image - Google Patents

Abstract

(여기서, a_m 은 영상 중심점에서 곡선의 현에 내린 수선의 길이를 나타내고, R은 영상 대각선의 길이를 나타내고, m = 1~M , M은 선의 개수를 나타내며, ψ는 사용자 파라미터를 나타냄)에 의해 획득되는 필터링 모듈; 상기 제 1 보정 그룹과 상기 제 2 보정 그룹이 제거된 영상 정보에 기초하여, 영상의 휘어짐 정도를 나타내는 매개변수를 추출하는 매개변수 추출 모듈; 상기 매개변수를 이용하여 상기 영상 정보의 보정을 수행하는 영상보정 모듈을 포함하되, 상기 제 1 보정 그룹으로 설정된 커브는, 영상 내에 존재하는 세그먼트를 서치하고, 상기 세그먼트 내의 각 픽셀의 변화율과 각도를 산출하고, 기설정된 임계값보다 높은 변화율을 갖는 픽셀을 시작점으로 하여 기설정된 크기의 윈도우 내에서 가장 큰 변화율을 갖는 픽셀을 하나의 그룹으로 설정하여 그 픽셀을 시작점으로 하여 다시 윈도우를 통해 다음 픽셀을 서치하며, 상기 과정을 통해 검출된 픽셀들로 구성된 세그먼트들을 연결하여 형성되는 것을 특징으로 하는 수치지도제작 시스템을 제공한다.The present invention relates to a three-dimensional space modeling system using aerial photographs and a mobile mapping system, the system comprising: a captured image acquisition module for acquiring image information from a plurality of cameras; A GPS receiving module for receiving GPS information from a satellite and obtaining current position information of the camera; An inertia measurement module for obtaining horizontal information of the camera using a plurality of sensors; An image processing module for correcting the image information based on the image information, the current position information, and the horizontal information; A control module for controlling the image information, current position information and horizontal information to be transmitted to the image processing module; And a buffer for storing the image information; An aerial photograph database for receiving and storing the image information from the mobile mapping device or receiving and storing aerial photograph data from an external database; A data processing module for determining a target object by comparing the image information obtained from the mobile mapping device with the aerial photograph data obtained from the aerial photograph database, and performing three-dimensional space modeling using the determined target object information; And a communication module for receiving request information for a spatial modeling service from a user, transmitting the request information to the mobile mapping device, the aerial photograph database, and the data processing module, and transmitting the three-dimensional spatial data obtained from the data processing module to a user; Wherein the image processing module detects a curve from the image information received from the captured image acquisition module to set a first correction group, removes the first correction group from the image information, The second correction group is set as a second correction group on the three-dimensional coordinates from the center of the image information from which the correction group has been removed, and the second correction group is removed from the image information from which the first correction group is removed, The value is calculated by the following equation

(Where a _m Wherein R is the length of the diagonal line of the image, m = 1 to M, M is the number of lines, and? Is a user parameter), the filtering module ; A parameter extracting module for extracting a parameter indicating a degree of warping of the image based on the image information from which the first correction group and the second correction group have been removed; Wherein the curve set to the first correction group is used to search for a segment existing in an image and to calculate a change rate and an angle of each pixel in the segment A pixel having the highest rate of change in a window of a predetermined size is set as a group with a pixel having a rate of change higher than a predetermined threshold value as a starting point and the next pixel is set again as a starting point using the pixel as a starting point And connecting segments constituted by the pixels detected through the above process to each other.

Description

[0001] DIGITAL MAP GENERATING SYSTEM FOR PERFORMING SPATIAL MODELING THROUGH DISTORTION CORRECTION OF IMAGE [0002]

The present invention relates to a digital map production system for performing spatial modeling through image distortion correction.

The 3D space modeling method using existing aerial surveying is available only to the photographed part of the acquired building, and it has been forcibly extended to the end of the building. Since the image has been forcibly expanded, not only the visibility is significantly lowered but also the accurate coordinate information about the object can not be obtained, and it is difficult to provide more realistic image data to the user even after completing the modeling work.

In addition, in the conventional space modeling method, an excessive labor cost is generated by using data constructed manually by field survey, and errors of geographical information are frequently generated due to such manual operation, and it is difficult to correct and update In order to overcome these drawbacks, geographic information data on buildings and road facilities are being constructed using the latest surveying equipment such as mobile mapping system (MMS). However, it is difficult to acquire precise coordinate information due to distortion of the measured image, and the like. In addition, since the accuracy of the information is lacking in the urban area, there are many problems in constructing the geographic information database .

The present invention intends to acquire more accurate three-dimensional space coordinate information by correcting a warping phenomenon of an image through a filtering process after acquiring an image obtained through a mobile measurement equipment (MMS).

In addition, the present invention intends to perform finer image correction by performing filtering using a weighted threshold value when extracting parameters for image correction.

In addition, the present invention intends to perform more precise image correction by redundantly eliminating error elements when extracting parameters for image correction.

Also, the present invention compares the image information of the target object with the common point vector information generated from the aerial photograph, and obtains the coordinate information of the target object to thereby calculate the more accurate three-dimensional space coordinate information.

(여기서, a_m 은 영상 중심점에서 곡선의 현에 내린 수선의 길이를 나타내고, R은 영상 대각선의 길이를 나타내고, m = 1~M , M은 선의 개수를 나타내며, ψ는 사용자 파라미터를 나타냄)에 의해 획득되는 필터링 모듈; 상기 제 1 보정 그룹과 상기 제 2 보정 그룹이 제거된 영상 정보에 기초하여, 영상의 휘어짐 정도를 나타내는 매개변수를 추출하는 매개변수 추출 모듈; 상기 매개변수를 이용하여 상기 영상 정보의 보정을 수행하는 영상보정 모듈을 포함하는 것을 특징으로 하는 3차원 공간 모델링 시스템을 제공한다.The present invention relates to a three-dimensional space modeling system using aerial photographs and a mobile mapping system, the system comprising: a captured image acquisition module for acquiring image information from a plurality of cameras; A GPS receiving module for receiving GPS information from a satellite and obtaining current position information of the camera; An inertia measurement module for obtaining horizontal information of the camera using a plurality of sensors; An image processing module for correcting the image information based on the image information, the current position information, and the horizontal information; A control module for controlling the image information, current position information and horizontal information to be transmitted to the image processing module; And a buffer for storing the image information; An aerial photograph database for receiving and storing the image information from the mobile mapping device or receiving and storing aerial photograph data from an external database; A data processing module for determining a target object by comparing the image information obtained from the mobile mapping device with the aerial photograph data obtained from the aerial photograph database, and performing three-dimensional space modeling using the determined target object information; And a communication module for receiving request information for a spatial modeling service from a user, transmitting the request information to the mobile mapping device, the aerial photograph database, and the data processing module, and transmitting the three-dimensional spatial data obtained from the data processing module to a user; Wherein the image processing module detects a curve from the image information received from the captured image acquisition module to set a first correction group, removes the first correction group from the image information, The second correction group is set as a second correction group on the three-dimensional coordinates from the center of the image information from which the correction group has been removed, and the second correction group is removed from the image information from which the first correction group is removed, The value is calculated by the following equation

(Where a _m Wherein R is the length of the diagonal line of the image, m = 1 to M, M is the number of lines, and? Is a user parameter), the filtering module ; A parameter extracting module for extracting a parameter indicating a degree of warping of the image based on the image information from which the first correction group and the second correction group have been removed; And an image correction module that performs correction of the image information using the parameters.

According to the present invention, the curve set as the first correction group is obtained by searching a segment existing in an image, calculating a rate of change and an angle of each pixel in the segment, and calculating a pixel having a rate of change higher than a predetermined threshold, Sets pixels having the greatest change rate in a window of a predetermined size as a group and searches for the next pixel through the window with the pixel as a starting point, And is formed by connecting.

을 이용하여 획득되는 것을 특징으로 한다.In the present invention, the data processing module acquires the three-dimensional coordinates of the target object, wherein the Z coordinate value is a Y coordinate (Y_l) of the image obtained from the left camera and a Y coordinate Based on the average value of the Y coordinate (Y_r), the focal length (f) and the Y-axis distance (Yo) to the target object,

Is obtained.

The present invention can acquire more accurate three-dimensional space coordinate information by correcting the warping phenomenon of an image through filtering after acquiring an image acquired through a mobile measurement equipment (MMS).

Further, in the present invention, more detailed image correction can be performed by performing filtering using a weighted threshold value when extracting parameters for image correction.

In addition, the present invention can perform more precise image correction by redundantly eliminating error elements when extracting parameters for image correction.

Also, the present invention compares the image information of the target object with the common point vector information generated from the aerial photograph, and obtains the coordinate information of the target object, so that more accurate three-dimensional space coordinate information can be calculated.

Fig. 1 shows a schematic block diagram of an automatic three-dimensional space modeling system to which the present invention is applied.
2 is a schematic block diagram of an image processing module 120 according to an embodiment of the present invention.
FIG. 3 shows a coordinate system for explaining a method of performing image correction by defining a first correction group and a second correction group according to an embodiment of the present invention.
FIG. 4 shows a coordinate system for explaining a weighted threshold calculation process for image correction according to an embodiment of the present invention. Referring to FIG.
5 is a schematic block diagram of the data processing module 500 according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating a method of modeling three-dimensional coordinate information using coordinate information of a target object according to an embodiment of the present invention. Referring to FIG.
FIG. 7 is a flowchart for explaining a three-dimensional space modeling method according to an embodiment to which the present invention is applied.
8 is a flowchart for explaining a method of correcting an image obtained from a camera for three-dimensional space modeling according to an embodiment of the present invention.
9 is a flowchart for explaining a method for acquiring coordinate information of a target object from a corrected image for three-dimensional space modeling according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects,

And the structure and operation of the present invention described with reference to the drawings are described as an embodiment, and the technical idea and the core structure and operation of the present invention are not limited thereby.

In addition, the term used in the present invention is intended to include,

, But the specific case is explained by using the terminology arbitrarily selected by the applicant. In such a case, the meaning is clearly stated in the detailed description of the relevant part, so it should be understood that the name of the term used in the description of the present invention should not be simply interpreted and that the meaning of the corresponding term should be understood and interpreted .

Space Modeling System is an information system that integrates geographical data occupying spatial position and related property data. It collects, stores, updates, processes, analyzes and outputs various types of geographical information efficiently. It can be defined as the total organization of hardware, software, geographical data, and human resources used for. Various applications of spatial information have become easier according to the use of the geographic information system. Therefore, it is necessary to use the mobile survey data efficiently in order to provide clear and realistic geographical information in a rapidly changing city center. Hereinafter, embodiments in which more accurate spatial modeling information is generated by using the mobile surveying data efficiently will be described.

Fig. 1 shows a schematic block diagram of an automatic three-dimensional space modeling system to which the present invention is applied.

1, the automatic three-dimensional space modeling system 10 to which the present invention is applied includes a mobile mapping apparatus 100, a communication module 200, an update module 300, an aerial photograph database 400, And a processing module 500. The mobile mapping device 100 includes an imaging image acquisition module 110, an image processing module 120, an inertia measurement module 130, a GPS reception module 140, a control module 150 And a buffer 160. [0033] FIG.

Here, the spatial model may mean an object occupying a space in a three-dimensional image, for example, a road facility, a building, a road facility, and an auxiliary facility. The spatial model information may refer to the location, distance, area, and property information of the object, i.e., a road facility, a building, a road facility, and an auxiliary facility.

The mobile mapping apparatus 100 can measure a road facility, a building, a road-use facility, and an auxiliary facility in a target area while moving the route in the target area. The mobile mapping device 100 refers to a moving and measurable device, for example, a car or a plane equipped with a measurable camera.

The photographed image acquisition module 110 may include a left-eye image camera and a right-eye image camera. The photographed image acquisition module 110 may acquire stereo images by photographing the road facilities, buildings, road facilities, and auxiliary facilities using a left- can do. In this case, the captured image acquisition module 110 needs to correct the acquired image due to the camera shake at the time of shooting due to the shake of the mobile mapping device 100, or a bending problem of the camera lens itself. Therefore, in the embodiment to which the present invention is applied, a method of estimating a correction parameter for correcting such an image and a new threshold value calculating method using weighting are proposed. This will be described in more detail in Fig. 3 and Fig.

The captured image acquisition module 110 acquires the left eye image and the right eye image acquired from the camera mounted in the mobile mapping device 100 and acquires the left eye image and the right eye image from the GPS receiving module 140, The current position information of the left eye image and the right eye image can be obtained using the position information. The moving path of the mobile mapping apparatus 100 can be generated from the current position information of the left eye image and the right eye image. That is, the movement path may be determined from the position information of the mobile mapping apparatus 100, and the left eye image and the right eye image acquired from the camera may be matched for each movement path.

The inertia measurement module 130 can acquire the horizontal information of the mobile mapping apparatus 100 by receiving sensing information using multiple sensors, and can perform more detailed image correction using the horizontal information. In an embodiment to which the present invention is applied, the inertia measurement module 130 logs data at intervals of 100 Hz.

The GPS receiving module 140 may receive the GPS information from the satellites and obtain the current position information of the mobile mapping device 100. [ The mobile mapping device 100 acquires location information of a vehicle in a city center through the GPS receiving module 140 and transmits the location information of the vehicle through an IMU (Inertial Measurement Unit) By obtaining horizontal information, more accurate 3D space modeling can be performed. In an embodiment to which the present invention is applied, the GPS receiving module 140 logs data at intervals of 1 Hz.

The image processing module 120 calculates parameters by using the horizontal information obtained from the inertia measurement module 130 and the position information obtained from the GPS receiving module 140 for correction of the acquired image. The parameter calculation method to which the present invention is applied is that a straight line in a 3D image is a straight line even if it is converted into a 2D image. That is, more accurate 3D space modeling can be performed by detecting lines that are not straight lines of the 3D image, excluding them, and then performing image correction. In addition, in the process of calculating the parameters, faster 3D space modeling can be performed by excluding lines out of the threshold. A detailed description of these embodiments is given in Figs. 3 and 4. Fig.

The control module 150 outputs the left eye image and the right eye image obtained from the captured image acquisition module 110, the horizontal information obtained from the inertia measurement module 130, and the position information obtained from the GPS reception module 140, respectively To the image processing module 120, and controls the image processing module 120 to calculate parameters using the image information, the horizontal information, the position information, and the like. The control module 150 controls the synchronization between the sensed image acquisition module 110, the inertia measurement module 130 and the GPS reception module 140. In an embodiment to which the present invention is applied, The inertial measurement module 130, and the GPS reception module 140, respectively, based on the GPS time obtained from the GPS receiver 140, have.

The buffer 160 stores the image information of the left eye image and the right eye image obtained from the sensed image acquisition module 110 in a buffer and provides the requested image information when the image information is requested from the outside. The buffer 160 may be composed of a memory and a memory control module. The memory 160 may be rearranged through a log analysis or the like to provide a faster spatial data service. For example, it is possible to determine the received request information through the log analysis, that is, frequently requested video information, and process the video information in a different manner accordingly. If the received request information is frequently requested video information, the video information may be cached in a memory in units of layers and updated automatically. On the other hand, if the image information is not frequently requested, the corresponding image information is deleted from the memory, or if the image information is not previously requested, the corresponding image information is updated to the table information and a corresponding code is generated and stored have.

The communication module 200 transmits the request information to the mobile mapping apparatus 100, the update module 300, the aerial photograph database 400, and the data processing module 500 when receiving the request information for the spatial modeling service from the user. If the received request information requires video information of the mobile mapping apparatus 100, the mobile mapping apparatus 100 transmits the request information to the mobile mapping apparatus 100, and transmits the request information from the mobile mapping apparatus 100 It is possible to receive corresponding spatial data. The communication module 200 manages communication between a user terminal (not shown) and an external terminal (not shown) and between the mobile mapping apparatus 100 and the data processing module 500, May support a variety of communication standards such as local area network (LAN), wireless LAN (WLAN), wireless broadband (WIBRO), world interoperability for microwave access (WIMAX), high speed downlink packet access (HSDPA)

The update module 300 may update the data stored in the buffer 160 in the mobile mapping apparatus 100 with the modified data through the image processing module 120 or the data processing module 500 or the like. Also, the data stored in the aerial photograph database 400 can be updated with the modified data through the image processing module 120 or the data processing module 500. [

The aerial photograph database 400 includes information on the area, length, and location of the road facilities, buildings, road facilities, and other facilities. The aerial photograph database 400 receives data from the mobile mapping device 100, And can receive the aerial photograph data from the database.

The aerial photograph database 400 may include a memory and a memory control module. The aerial photograph database 400 may provide spatial data service more rapidly by rearranging memories through log analysis and the like. For example, it is possible to determine through the log analysis whether the received request information is frequently requested aerial photograph data, and to process the aerial photograph data accordingly. If the received request information is frequently requested aerial photograph data, the aerial photograph data may be cached in a memory in units of layers and automatically updated. On the other hand, if the data is not the frequently requested aerial photograph data, the corresponding aerial photograph data is deleted from the memory, or if the aerial photograph data is not previously requested, the corresponding aerial photograph data is updated to the table information, Can be created and stored.

The data processing module 500 generates 3D space modeling information using the data obtained from the mobile mapping apparatus 100 and the aerial photographing database 400. The data processing module 500 may include an object extraction module 501, an aerial photograph extraction module 502, an object positioning module 503, a coordinate comparison module 504, and a three-dimensional modeling module 505 . This will be described in more detail in FIG.

2 is a schematic block diagram of an image processing module 120 according to an embodiment of the present invention.

The image processing module 120 may include a parameter extraction module 121, a filtering module 123, and an image correction module 125.

Most cameras using a lens have a problem that a straight line is bent into a curved line, and a phenomenon occurs in which the image is expanded or contracted radially from the bent center. If the deflection phenomenon is not properly corrected, serious problems may occur in viewing 3D images or in digital image analysis.

In order to solve this problem, it is possible to perform mathematical modeling of the bending phenomenon and to perform compensation by estimating parameters for determining the degree of bending and inversely converting the parameters. Then, curves in the image are detected, and non-straight lines on the 3D coordinates are defined as a first correction group, and correction is performed. Furthermore, in one embodiment of the present invention, lines that are not a curve on the 3D coordinates and that interfere with parameter estimation can be defined and removed as a second correction group.

3 and 4 show one embodiment to which the present invention is applied. FIG. 3 shows a coordinate system for explaining a method of performing image correction by defining the first correction group and the second correction group, And a coordinate system for explaining a weighted threshold calculation process for image correction.

3, when the basic image is R, the convex warped image is V, and the concave warped image is C, the coordinates of a point that is not bent with respect to the center point A is O = (X, Y) If the coordinates of the bent point are Oc = (Xc, Yc), the relationship between the two coordinates can be expressed by the following equations (1) and (2). Gi denotes a parameter reflecting the degree of warping of the image, and when Gi > 0, it indicates convex warpage, and Gi < 0 indicates concave warpage.

Here, a represents the distance from the center point A of the image to the coordinate Oc of the convex curved image, and a is represented by the following equation (3).

As an embodiment to which the present invention is applied, a method of calculating the parameter will be described.

The parameter extraction module 121 first searches for a segment existing in the image, and calculates the rate of change and angle of each pixel in the segment. The segment can be detected by grouping the pixels of the same straight line into one group. A pixel having a rate of change higher than a given threshold value is set as a starting point and a pixel having the largest rate of change in a predetermined window is set as a group and the next pixel is searched again through the window using the pixel as a starting point. At this time, the window of the predetermined size may use 3x3, 4x4 or 5x5 window.

The curve may be formed by connecting the segments from the group consisting of the detected pixels through the above process. At this time, the distance between the end points of the two segments, the angle between the two segments, and the vertical distance of the two segments are calculated. If the calculated values are smaller than the preset threshold value, the segments are regarded as one line have.

A line that is connected to the segments and is regarded as a curve on a 3D coordinate may be set as a first correction group, and the first correction group may be removed in an image.

For example, if one target line of the F curves is referred to as Lm (m = 1 to M) and Nm pixels constituting Lm are denoted by Pn = (Xn, Yn) (n = 1 to Nm) The parameter Gi when the Nm number of pixels are maximally straight can be obtained. The calculated Gi can also be applied to other curves to obtain Pn. Pn is defined as an error En of each pixel, and when the pixels whose absolute magnitudes exceed the preset threshold value? _M exceed a preset percentage in one curve, they are set as the first correction group, The first correction group may be removed from the image.

Through this process, it is possible to calculate the parameter Gi which causes the first correction group to be the maximum straight line among the removed lines.

The filtering module 123 can define and filter the lines serving as the error element in the parameter calculation as the second correction group even though the curve is not a curve on the 3D coordinates. For lines located near the center point, you can narrow the range to which the parameter is applied by setting more precise thresholds. For example, referring to FIG. 4, when it is determined that the error of each pixel exceeds a preset threshold value, a weight is applied to the threshold value according to the distance from the image center to the curve Lm to correspond to the second correction group Can be determined.

The distance from the image center point A to the curve Lm can be defined as the length a _m of the perpendicular line drawn on the straight line F and the weight can be normalized to a range between 0 and 1. At this time, a _m Can be defined as Equation (4) below.

If the weight for normalization is 0, a _m Is 0 when the line passes the center of the image, and when the weight is 1, a _m This is the distance from the center of the image to the diagonal vertex. Below represents a new threshold value δ _{m_ new} applying a weight to the equation shown in equation (5).

Here, R denotes the length of the image diagonal, m = 1 to M, M denotes the number of lines, and? Is a user parameter.

It is possible to calculate the new threshold value δ _{m_ new} by weighting the critical values depending on the distance of the line from the center of the image as described above, a more precise image correction them by obtaining more accurate parameter Gi through is possible.

The image correction module 125 may correct the image warping phenomenon using parameters obtained through the above process.

The mobile mapping apparatus 100 corrects the image through the process described above, and the corrected image is transmitted to the data processing module 500.

5 is a schematic block diagram of the data processing module 500 according to an embodiment of the present invention.

The data processing module 500 may include an object extraction module 501, an aerial photograph extraction module 502, an object positioning module 503, a coordinate comparison module 504, and a three-dimensional modeling module 505 .

The object extraction module 501 may extract a desired object from the corrected image obtained from the mobile mapping apparatus 100 and obtain coordinate information of the object. A search area may be set to extract the target object, and a target object may be extracted from the corrected image according to the search area. At this time, the target object can use each pixel RGB value of the corrected image. For example, a pixel having the same characteristic can be detected by checking eight integer pixel values adjacent to the target pixel. If there are a plurality of target objects extracted through the above process, an object having the closest distance from the previous position of the target object can be selected. If no target object is extracted, the object can be selected by the user's input .

The object position determination module 503 can obtain the coordinate information of the target object by determining the center point of the target object extracted from the object extraction module 501. [ The center point may be determined by Equation (6) below.

Here, x and y represent the coordinates of the center point, n is the number of pixels in the x-axis direction, and N is the number of pixels in the y-axis direction.

The aerial photograph extraction module 502 can extract the aerial photograph coordinate information corresponding to the corresponding image from the aerial photograph database 400. [ At this time, the aerial photograph extracting module 502 may extract the corresponding image corresponding to the position information from the aerial photograph database 400 according to the position information obtained from the GPS receiving module 140. [

The coordinate comparison module 504 can check whether the objects are matched by comparing the coordinate information of the object obtained from the object positioning module 503 with the aerial photograph coordinate information obtained from the aerial photograph extraction module 502 have. For example, matching points can be identified by extracting common points unchanged in size and rotation from images having different directions and sizes. An aerial photograph image extracted from the aerial photograph database 400 may be passed through a Gaussian filter having various dispersion values and an error image may be generated by sequentially subtracting the passed images according to a scale. This can be performed by Equation (7) below.

Where D (x, y, σ) represents the function of the image passed through the Gaussian filter and G (x, y, σ) represents the Gaussian filter. Respectively. The position of the pixel corresponding to the extreme value (maximum and minimum values) can be extracted from the generated error image. Here, the pixel position corresponding to the extreme value (maximum and minimum values) is a case where the selected pixel value is larger or smaller than a total of 26 pixel values, that is, eight pixels adjacent to the selected pixel value and nine pixels of the scaled upper and lower images . That is, pixels corresponding to the extreme values (maximum and minimum values) can be extracted as a common point. Noise removal and strong edge components are removed from the extracted common points, and direction information and size are set for the remaining common points. The direction information and the size are determined by the following equations (8) and (9), respectively.

A 16x16 block is set around the common point, and the direction of change is measured for each pixel in the block. The change direction is set to be proportional to the change slope, and the larger the change slope, the larger the probability distribution in the change direction. The probability distribution for the change direction is divided into eight directions and stored, which is expressed in a 128-dimensional vector form with respect to a 16x16 block. The common point vector information of the aerial photographic images thus obtained and the common point vector information of the corrected image are compared to check whether the objects are matched. The coordinate information of the target object can be extracted based on the matching check result.

As another embodiment to which the present invention is applied, filtering may be used for the object identification. First, a boundary region of an object in an image is identified, and a target object can be identified using the geometric characteristics of the boundary region. For example, since a building, a signboard, a roadside tree, and the like have respective geometric characteristics, a target object can be identified by extracting and comparing only the points of the corner of the building, the signboard, .

The three-dimensional modeling module 505 can model the three-dimensional coordinate information using the coordinate information of the target object. FIG. 6 is a diagram illustrating a method of modeling three-dimensional coordinate information using coordinate information of a target object according to an embodiment of the present invention. Referring to FIG.

Referring to FIG. 6, assuming that two left and right cameras photograph an object in order to model three-dimensional coordinate information, the distances from the inner angle of the triangle and the left and right cameras to the object are calculated using Equations 10 to 17 below. .

The three-dimensional coordinates (X_o, Y_o, Z_o) of the target object O can be obtained by the following equations (15) to (17), where Z_o coordinate is obtained by multiplying the Y_l coordinate of the image obtained from the left camera and the Y_l coordinate The average value of the coordinates, the focal length information, and the Y-axis distance to the object.

Dimensional space modeling can be performed using the three-dimensional coordinates (X_o, Y_o, Z_o) of the object O obtained by the equations (15) to (17).

FIG. 7 is a flowchart for explaining a three-dimensional space modeling method according to an embodiment to which the present invention is applied.

First, the captured image acquisition module 110 in the mobile mapping apparatus 100 includes a left eye image camera and a right eye image camera, and a left eye image and a right eye image can be obtained from the cameras, respectively (S710). The current position information of the cameras in the mobile mapping apparatus 100, that is, the obtained left and right eye images, is acquired from the GPS receiving module 140, and the horizontal information of the camera is acquired from the inertia measurement module 130 (S720).

The parameter extraction module 121 in the image processing module 120 may extract parameters for image correction using the horizontal information and the current position information of the camera in operation S730. At this time, the filtering module 123 may perform filtering using the weighted threshold value at the time of extracting the parameters (S740). The image correction module 125 may perform image correction using parameters that have been performed until filtering (S750).

The object extraction module 501 in the data processing module 500 receives the corrected image from the mobile mapping device 100 and extracts the target object in operation S760. Then, the object position determination module 503 can obtain the coordinate information of the target object by determining the center point of the extracted target object (S770).

The coordinate comparison module 504 can check whether the matching is performed by comparing the coordinate information of the obtained object and the coordinate information of the corresponding aerial photograph (S780).

The three-dimensional modeling module 505 can perform three-dimensional space modeling using the coordinate information of the target object (S790).

8 is a flowchart for explaining a method of correcting an image obtained from a camera for three-dimensional space modeling according to an embodiment of the present invention.

First, a curve may be detected from the image information obtained from the captured image acquisition module 110 (S810). The first correction group may be set to non-straight lines on the three-dimensional coordinates of the detected curves (S820). The lines corresponding to the set first correction group may be removed from the image information (S830).

In step S840, the first correction group may be detected from the center of the three-dimensional coordinate image, and the second correction group may be set to a second correction group. At this time, in order to reset a more precise threshold value, a new threshold value can be reset by applying a weight according to the distance from the image center point to the curve. And the second correction group can be set based on the reset threshold value. The lines corresponding to the set second correction group may be removed from the image information (S850).

The parameter may be extracted from the image from which the second correction group is removed (S860). The image correction may be performed by performing inverse transformation using the extracted parameters (S870).

9 is a flowchart for explaining a method for acquiring coordinate information of a target object from a corrected image for three-dimensional space modeling according to an embodiment of the present invention.

The image information of the target object obtained from the object position determination module 503 can be extracted (S910). Then, the coordinate information of the aerial photograph corresponding to the corrected image can be obtained from the aerial photograph database 400 (S920). remind

It is possible to confirm whether the objects are matched by comparing the image information of the target object with the aerial photograph coordinate information. For example, matching points can be identified by extracting common points unchanged in size and rotation from images having different directions and sizes. The aerial photographic image is passed through a Gaussian filter, and an error image is generated by sequentially subtracting the passed images according to a scale (S930).

The positions of pixels corresponding to extreme values (maximum and minimum values) from the generated error images can be extracted and set as common points (S940). Common point vector information can be generated by removing noise and strong edge components from the extracted common points and setting direction information and size for the remaining common points (S950).

By comparing the common point vector information of the aerial photographic images thus obtained and the common point vector information of the corrected image, it is possible to confirm whether or not the objects are matched. The coordinate information of the target object may be obtained based on the matching result (S960).

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined by the appended claims. , Substitution or addition, or the like.

Claims (1)

A three-dimensional space modeling system using an aerial photograph and a mobile mapping system,
A captured image acquisition module for acquiring image information from a plurality of cameras; A GPS receiving module for receiving GPS information from a satellite and obtaining current position information of the camera; An inertia measurement module for obtaining horizontal information of the camera using a plurality of sensors; An image processing module for correcting the image information based on the image information, the current position information, and the horizontal information; A control module for controlling the image information, current position information and horizontal information to be transmitted to the image processing module; And a buffer for storing image information;
An aerial photograph database for receiving and storing the image information from the mobile mapping device or receiving and storing aerial photograph data from an external database;
A data processing module for determining a target object by comparing the image information obtained from the mobile mapping device with the aerial photograph data obtained from the aerial photograph database, and performing three-dimensional space modeling using the determined target object information; And
A communication module for receiving request information for a spatial modeling service from a user, transmitting the request information to the mobile mapping device, the aerial photograph database, and the data processing module, and transmitting the three-dimensional spatial data obtained from the data processing module to a user;
&Lt; / RTI &gt;
The image processing module includes:
A first correction group is detected by detecting a curve from the image information received from the captured image acquisition module, the first correction group is removed from the image information, Sets lines having vertical distances from the center point of the pixels of the lines on the coordinates to the respective lines to a second correction group, removing the second correction group from the image information from which the first correction group is removed, The threshold is calculated by the following equation

(Where a _m denotes the length of the waterline on the curve at the center of the image, R denotes the length of the image diagonal, m = 1 to M, M denotes the number of lines, and ψ denotes the user parameter) A filtering module obtained by the filtering module;
A parameter extracting module for extracting a parameter indicating a degree of warping of the image based on the image information from which the first correction group and the second correction group have been removed;
An image correction module for performing correction of the image information using the parameter,
&Lt; / RTI &gt;
Wherein the curve set to the first correction group is a curve having a predetermined magnitude and having a predetermined magnitude, with a pixel having a rate of change higher than a predetermined threshold as a starting point, searching for a segment existing in the image, calculating a rate of change and angle of each pixel in the segment, The pixel having the greatest change rate in the window is set as a group, and the next pixel is searched again through the window with the pixel as a start point, and the segments are formed by connecting the segments composed of the pixels detected through the search process A digital map production system.

Images