KR101345554B1 - Method of resampling high resolution digital multi band imagery from line senser into frame type imagery to construct gis(uis), digital map and 3d spatial information using ground control point and gps/ins data - Google Patents

Abstract

The present invention relates to a method for constructing spatial image information by creating a unit image separated from image data which is photographed by an aerial digital camera having a line sensor, which constitutes one strip, and of which the capacity is about 20 GB. The method comprising: acquiring an original image and imaging information from aerial digital camera equipment having a line sensor (S10); performing coordinate system conversion and time synchronization using ground control point data and the imaging information according to a post-processing DGPS principle to obtain external orientation parameters for each line of the original image not acquired in step S10 (S20); acquiring a geometric correction image in which the geometric distortion of the original image is corrected by a collinearity equation using the external orientation parameters for each line acquired in step S20 and internal orientation parameters of the imaging information acquired in step S10 (S30); giving the external orientation parameters to principal point coordinates of the center of the geometric correction image to acquire external orientation parameters for each line of the geometric correction image in a manner of converting each of the image coordinates of the original image and the geometric correction image into ground coordinates, extracting the pixels of the original image having ground coordinates adjacent to the ground coordinates converted for each pixel of the geometric correction image, and regarding the external orientation parameters which the extracted pixels of the original image have as the external orientation parameters which the corresponding pixels of the geometric correction image have (S40); and generating a geometric correction strip image of which the external orientation parameters for each line are acquired into an image of a predetermined size and constructing a property DB of each generated image (S50). [Reference numerals] (AA) Line sensor aerial digital camera equipment MMS; (BB) Acquire an original image; (CC) Acquire imaging information; (DD) Create a unit image; (EE) Construct a property DB; (FF) Generate an XML file; (GG) Standard compression format(NIX) conversion; (HH) DB loading; (S20) Acquire external orientation parameters for each line of the original image; (S30) Acquire a geometric correction image; (S40) Correct imaging information of the geometric correction image(External orientation parameters for each line)

Description

Method of resampling high resolution digital multi band imagery in which high resolution linear digital multiband image linking ground control point and GPS / INS is constructed as planar image for constructing GPS, digital map and 3D national spatial information from line senser into frame type imagery to construct GIS (UIS), digital map and 3D spatial information using ground control point and GPS / INS data}

The present invention relates to a method of rearranging a high resolution linear digital multiband image in which a ground control point survey and a GPS / INS are linked to a planar image to construct a GPS, a digital map, and three-dimensional land-spatial information. Line sensor aerial digital camera captures GPS ground-based point survey (intellectual and geodetic) performance and GPS / INS on video image data of approximately 20 GB capacity, taken from a single strip with a constant width of 40 km above ground. Gives absolute coordinates of the associated air triangulation method, generates unit images separated from high-resolution line-type digital multi-band images including near infrared bands, and automatically generates attribute DBs containing metadata for digital maps. We are planning to provide a high resolution linear digital multi-band image linking ground control point surveying and GPS / INS to construct 3D national spatial information. S and the method of rearranging by planar image for constructing digital map and 3D national spatial information.

The conventional method of constructing a database (DB) with video images of aerial photographs taken by the National Geographic Information Institute (that is, acquiring (generating) images and constructing an attribute DB) and using them as national spatial spatial image information is largely analog type aerial camera. After the shooting, it consists of automatic reading of aerial photographs, construction of attribute DB, conversion of standard compression format (NIX), and loading of DB. In addition, images taken with analog aviation cameras are of lower quality than those taken with line sensor aviation digital cameras.

It is necessary to build a database of aerial photographs for use as national spatial image information by using images taken with high-quality line digital aerial cameras and photographing information, and to automate the image DB construction step.

However, digital images (images) taken by line sensor aviation digital cameras consist of one strip, shoot with a constant width, shoot up to 40km in length, and have a data capacity of about 20GB. In this case, the filmed image is composed of one strip and is called linear type photographing. Therefore, it is not possible to construct a DB with the whole image as one data, but to cut the image in certain standard units and to build the attribute DB for each cut-out unit image.

In addition, the image photographed by the line sensor aerial digital camera does not have the photographing information for each line, but has the photographing information in a specific line designated at regular intervals. Therefore, by taking advantage of the photographing information of the specified specific line, it is necessary to obtain the photographing information of each adjacent line approximately, and to generate the unit image to construct the attribute DB.

Republic of Korea Patent Registration No. 10-0930643 (December 01, 2009) “High resolution linear digital multi-band (including near infrared band) image linking ground control point and GPS / INS, GPS, digital map, 3D Rearrangement of Planar Image to Construct Spatial Information ”

In order to solve the problems and necessity of the prior art as described above, the present invention obtains the image (image) and shooting information taken from the line sensor aviation digital camera equipment and the surface type so that it can be used as the national geospatial image information of the National Geographic Institute The high resolution linear digital multi-band image linking the ground control point survey and GPS / INS to construct the aerial image database by dividing the method image and calculating the respective property DB for each planar type image. The purpose is to provide a method of rearranging the planar image to construct the spatial information.

In addition, the present invention transmits the signals of the raw image information and the corresponding photographing information taken by the line sensor aviation digital camera equipment installed on the plane in real time and can transmit a signal without errors even if some failure occurs by having a plurality of paths. The purpose of the present invention is to provide a method of rearranging high resolution linear digital multiband images linked with ground control point surveying and GPS / INS to planar images for constructing GPS, digital maps, and 3D national spatial information.

In order to achieve the above object, a high-resolution linear digital multiband image, which is connected with ground control point surveying and GPS / INS of the present invention, is cultivated as a planar type image to construct a GPS, a digital map, and 3D national spatial information. The method may include (S10) obtaining a raw image and photographing information (including metadata and position data) of the raw image from the line sensor aerial digital camera equipment; (S20) acquiring an external expression element for each line of the raw image not obtained in the step S10 through coordinate system transformation and time synchronization using the ground reference point data and the photographing information according to the post-processing DGPS principle ; (S30) Acquiring a geometrically corrected image correcting the geometric distortion of the raw image through a collinear condition equation by using the external expression element for each line obtained in the step S20 and the internal expression element of the photographing information obtained in the step S10. step; (S40) convert each of the image coordinates of the raw image and the geometrically corrected image to ground coordinates, extract pixels of the raw image having ground coordinates close to the converted ground coordinates for each pixel of the geometrically corrected image, and extract The external expression for each line of the geometrically corrected image is assigned by assigning the external expression element to the main coordinates of the center of the geometrically corrected image. Obtaining an element; (S50) generating the geometrically corrected strip image obtained by obtaining the external expression elements for each line as an image of a predetermined size, and constructing an attribute DB of each generated image (ie, planar image); In the step S40, the pixel extraction of the raw image having the ground coordinates close to the ground coordinates converted for each pixel of the geometrically corrected image is performed using an Affine transform, and the step S50 is obtained by cutting the geometrically corrected strip image. The high resolution linear digital multiband image, which is connected to ground control point surveying and GPS / INS, includes a step of cutting the upper and lower ends of each of the cut images generated by the geometric correction to form a rectangular cut image. In the method of rearranging the planar image to build a three-dimensional land and spatial information, the step S10 is the line sensor aviation digital The terrestrial processing system acquires the raw image and the photographing information from the Mera equipment in real time by mobile communication method, laser optical communication method and FM wireless communication method, and removes radio transmission error by performing arithmetic average operation on the data of the obtained signal. The line sensor aviation digital camera equipment includes a camera unit installed at a lower side of the plane and outputting a signal of a raw image photographed by visible light and near infrared rays, respectively, and a photographing information signal of the raw image as digital signals; An MS unit which accesses the camera unit and stores an output signal in a designated area; An air control unit connected to the camera unit and an MS unit and outputting control signals for operating and monitoring each function unit of the line sensor aviation digital camera equipment; And an aviation communication unit connected to the aviation control unit and the MMS unit and bidirectionally communicating by the control signal in an optical communication method using a mobile communication method and a laser light signal and an FM communication method using an FM signal. The air communication unit wirelessly connects to the ground processing system in a mobile communication manner, and transmits a signal stored in the MS unit by a control signal of the air control unit, and a control command and operational data transmitted by the ground processing system. A first air radio unit for receiving a signal; A second air radio unit wirelessly connecting the terrestrial processing system in an optical communication manner and transmitting a signal stored in the MMS unit by a control signal of the air control unit; A third aviation radio unit wirelessly connecting the terrestrial processing system through an FM communication scheme and transmitting a signal stored in the MS unit by a control signal of the air controller; And a wired communication unit for wired connection with the ground processing system, transmitting a signal stored in the MS unit according to a control signal of the air control unit, and receiving a control command and an operation data signal transmitted by the ground processing system. The ground processing system includes a terrestrial communication unit connected to the line sensor aviation digital camera device and bidirectionally communicating with an optical communication method using a mobile communication method and a laser light signal and an FM communication method using an FM signal; Connecting to the terrestrial communication unit, detecting and correcting transmission errors of signals transmitted and received in the mobile communication method, the optical communication method, and the FM communication method, respectively, by using a parity check bit method, and calculating and outputting the modified signals in an arithmetic average method. Average calculation unit; A ground control unit connected to the average computing unit and the ground communication unit and outputting control signals for operating and monitoring each function unit of the ground processing system; And a terrestrial processing server connected to the average computing unit and inputting the raw image signal and the photographing information according to a control signal of the ground control unit and storing the raw image signal in the allocated area. . ≪ / RTI >

According to the present invention having the above-described configuration, it is possible to obtain a high quality aerial image DB by providing a plane type unit image and a property DB for each unit image using the image captured by the line sensor aerial digital camera and image photographing information. It is useful for information and construction of aerial image DB is quick and convenient.

In addition, the present invention having the above configuration has the advantage of real-time transmission of the raw image information and the signal of the corresponding shooting information taken by the line sensor aerial digital camera equipment installed in the plane.

In addition, the present invention having the configuration as described above has the advantage that the signal can be transmitted in both directions even when a failure occurs in some communication paths having a plurality of communication paths.

On the other hand, the present invention of the above configuration has the advantage of eliminating the transmission error of data because the same data signal is transmitted over a plurality of communication paths and averaged at the receiving side.

1 is a flow chart of a method for generating a unit image for utilizing a line sensor aerial digital camera image in the national spatial spatial image information according to the present invention;
2 is a schematic diagram of a method for acquiring an external expression element for each line of a raw image;
3A and 3B illustrate an example of converting a raw image into a geometrically corrected image.
4A to 4D are diagrams for explaining a method of acquiring an external expression element for each line of a geometrically corrected image;
5 is a functional configuration diagram of a line sensor aviation digital camera equipment according to an embodiment of the present invention,
And
6 is a functional configuration diagram of a ground treatment system according to an embodiment of the present invention.

As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all transformations, equivalents, and substitutes included in the spirit and scope of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. In addition, it is to be understood that all modifications, equivalents, and substitutes included in the spirit and scope of the present invention are included.

The present invention uses the prior patent No. 10-0930643 as it is. Therefore, the features of the apparatus and method configuration described below are all those described in the prior patent No. 10-0930643.

However, the present invention transmits the raw image signal and the corresponding photographing information signal in real time among the components disclosed in the above-mentioned Patent Registration No. 10-0930643, and configures a preliminary communication path, even in the case of failure of some functional units. In this process, a plurality of communication paths transmit the same data signal at the same time, and the part configured to remove transmission errors by averaging at the receiving end forms the most essential structural feature.

Therefore, the features of the configuration described below will be referred to the contents of the Patent No. 10-0930643 as it is, and will be described in detail with respect to the configuration associated with the main features of the present invention at the rear end.

1 is a flowchart illustrating a method for generating a unit image for utilizing a line sensor aerial digital camera image according to the present invention in the national spatial spatial image information, as shown in the drawing, acquiring a raw image and photographing information (S10); Acquiring an external expression element for each line of the original image (S20), acquiring a geometric correction image (S30), acquiring an external expression element for each line of the geometrically corrected image (S40), A geometrically corrected strip image is cut out in standard units to generate a planar image (that is, a unit image), and a property DB for each planar image is constructed (S50).

Acquisition of the raw image and the photographing information (S10) is obtained by downloading the ground processing system from the mass memory system (MMS) mounted on the plane.

The MMS stores an image photographed by a line sensor aviation digital camera device mounted on an aircraft, and photographing information about the photographed image. For reference, a representative of the digital sensor as a line sensor aviation digital camera equipment is a device of model name ADS40.

When the terrestrial processing system downloads data from the MMS, the ADS40 obtains the raw image photographed by the ADS40 and metadata and position data as photographing information about the raw image.

Metadata includes photographing project information (e.g. photographing altitude, coordinate system, photographing plan map), photographing strip information (e.g. photographing angle by band of photographed strip image, photographing time (Start, End), capacity), photographing image information ( Eg Tiff image, GPS / IMU data).

The position data is GPS / INS data processed in a POS system mounted on an airplane (one of the line sensor aviation digital camera equipment).

At this time, the photographing information of the raw image does not contain all of the external expression elements of each line, but includes only the posture and position information of a specific line designated at a predetermined interval (recorded).

Therefore, after obtaining the external expression elements for each line of the raw image through the ground processing in step S20, and generates a geometric correction image in step S30.

Acquiring an external expression element for each line of the raw image (S20) is performed through coordinate system transformation and time synchronization using the raw image obtained in step S10, photographing information, and ground reference point data.

On the other hand, the external expression element is composed of the position data of the video camera and the rotation data when shooting.

To explain this briefly, with the concept of post-processing DGPS, a reference receiver (ground GPS) is installed at the ground reference point, a remote receiver (aircraft GPS) is installed at an unknown point (aircraft), and then the reference receiver and the remote receiver are simultaneously minimized. Observe the GPS signals of four or more GPS satellites. Since the vector displacement of the unknown point is calculated from the known point using the observation data obtained by the above observation or the coordinate information or the position information, the coordinates of all the unknown points can be calculated based on the known point, and this method is called relative positioning method.

FIG. 2 is a diagram schematically illustrating a method of obtaining an external expression element (position data; GPS / photography rotation data; IMU or INS) for each line of a raw image.

In the ADS40, neither the position of the photographing point nor the posture information of each line is acquired by the GPS and the IMU.

As shown in FIG. 2, the GPS / IMU acquires location information and posture (rotation when photographing) at predetermined intervals, and this information may be referred to as an expression element.

That is, the information thus obtained is called an orientation fix of the facial expression element, and the external expression element can be obtained only in a line having a predetermined unit interval.

This is quite different from the actual external expression of the strip image (image) of each line taken by the plane.

Therefore, the external expression elements for each line are obtained by using the external expression elements obtained at predetermined intervals.

As shown in FIG. 2, a red line (thin solid line) is photographing information of a raw image, which is a line connecting an external expression element (orientation fixes) to a line of a predetermined interval, and a green line ( The dashed line) shows the external expression factor calculated using the concept of post-processing DGPS using the ground control point data and the GPS / IMU data on the aircraft. 2 is a diagram illustrating correction (interpolation) of the external expression elements of the raw image by line using the external expression elements acquired through the concept of post-processing DGPS.

In the step S30, the external expression elements for each line acquired in the step S20, the internal expression elements (camera focal length, the CCD's X and Y direction correction values) and the metadata among the photographing information acquired in the step S10 are generally known. The geometric distortion of the raw image is corrected by substituting the collinear condition equation.

Here, the collinearity conditional expression is a mathematical expression representing the relationship between the pixel of the image and the actual ground coordinates, and thus, further description thereof will be omitted.

The attached FIG. 3A shows an example of a geometric image (Level 1) converted to a raw image (Level 0) and a correction to remove geometric distortion. The graph between the two images shows the rotation factor for each line.

The roll direction shows the rotation about the X axis, the pitch direction the rotation about the Y axis, and the Yaw direction shows the rotation about the Z axis.

The Level 1 image (geometrically corrected image) is an image that removes all geometric distortions from the original image by considering both the rotational and posture elements.

Therefore, the level 1 image is not arranged in a line-by-line image as it is captured, but is analyzed and rearranged by compensating the distortion of the line-by-line image due to the analyzed movement.

3B is an enlarged image of a specific portion of a raw image (Level 0 image) and a geometric correction image (Level 1 image), respectively.

In the step S40, as the raw image is converted into the geometrically corrected image, the photographing information (especially, external expression elements and metadata) of the image is corrected.

The external expression elements for each line of the raw image were obtained through the step S20, but the geometrically corrected image obtained through the geometric distortion correction is an image that is interpolated by geometric displacement by rearranging pixels of the raw image. External expression elements per line cannot be obtained directly.

Therefore, when the geometrically corrected image is cut out, information about the center of the image (periodic coordinate information) is obtained and the corresponding orientation information (external expression element) is approximately calculated.

The coordinates of the center of the ADS40 image are provided as the relative coordinate values for the anchor point.The ADS40 image is basically provided with the parameters used for the geometric coordinates of the principal and geometrically corrected images. have.

In order to correct shooting information by converting the raw image into the geometrically corrected image (S40), first, the coordinates of the raw image and the geometrically corrected image, that is, the ground coordinates are calculated (the actual ground coordinates of each pixel constituting the image), Through the Affine transformation, which will be described in detail below, pixels of the raw image having the ground coordinates closest to the ground coordinates of each pixel of the geometrically corrected image are searched to obtain external coordinate elements of each line of the geometrically corrected image.

(1) Calculation of Ground Space coordinates from the raw image (Level0) coordinates.

Ground Space is a coordinate system centered on one surface of the earth. It is also commonly referred to as Topocentric Coordinate System (VUW) or NEU (NED) Coordinate System, which stands for North, East, Up (Down).

4A shows the relationship between the Ground Space coordinates and the Geocentric coordinates, and their conversion formulas are as follows.

The raw image (Level0) and geometrically corrected image (Level1) of the ADS40 system are provided with a support file along with the image file. This file contains two values representing the coordinates of the earth's surface center used in Ground Space. have.

LOCAL_ORIGN values representing geocentric coordinates (earth center coordinates, XYZ) and ANCHOR_ LATITUDE and ANCHOR_LONGITUDE values (f and in FIG. 4A) representing latitude and longitude, which are geodetic coordinates. Ground space coordinates can be converted to geocentric coordinates using this value.

The correction values for the coordinates of the raw image are taken from the camera calibration file (including the internal expression element) for the X and Y axes, and the external expression file (including the external expression element) with the camera position, angle and time at the time of shooting. Can be obtained by The X value of an image can be used as an array index of a camera calibration file and the Y value of an image can be directly used as an array index of an external expression file. To convert the coordinates of the raw image into the Ground Space coordinates, perform the following process.

The camera calibration file contains information about the physical bias of the camera's line sensor values. In order to calculate the value, this physical error must be corrected.

First, the image coordinate value is converted to the coordinate of the focal plane of the camera sensor.

Fx: X coordinate on the focal plane of the camera sensor

Fy: Y coordinate on the focal plane of the camera sensor

xcal []: X value of array of camera calibration file of original image

ycal []: Y value of array of camera calibration file of original image

pos: The X value of the image coordinates (corresponds to the index number of the camera calibration), and has 12000 sensor pixels, so it has a value between 0 and 11999.

d: represents the distance between the actual position and the pixel position. This value is used to interpolate the floating point (float or double) values that occur during coordinate calculation. (I.e. if the pixel value is 1.5, the 0.5 value is calculated by linear interpolation between the 1 and 2 array values.)

Second, using the coordinates on the focal plane and the Orientation Data (external expression file), the Ground Space coordinates can be calculated as follows.

R represents the rotation matrix created by R () R (f) R (), which is the camera pose information at the time of image acquisition, and the value is obtained from the Orientation Data file using the Y value (Scan Line) of the raw image. Where C is the focal length (constant) value of the ADS40 camera.

The rotation matrix looks like this:

(2) Calculation of Ground Space coordinates from geometrically corrected image (Level1) coordinates.

m = Scale value used for geometry correction xoffset = Offset value of x used for geometry correction

yoffset = Offset value of y used for geometry correction a = Rotation value used for geometry correction

Height = Height used for geometric correction LS = Total line value of geometrically corrected image

Using the above equation, the coordinates of the geometrically corrected image can be calculated as the coordinates on the ground space. However, it is not possible to know the external facial expression elements (other information such as camera posture information and time at the time of shooting) corresponding to the pixels of the geometrically corrected image. To obtain this value, the Orientation data of the raw image (original image) (Level0) must be accessed. In this case, a method of approaching an external facial expression element is performed through the Ground Space coordinates, which are common elements between the original image and the geometrically corrected image.

That is, after calculating the ground space of the geometrically corrected image, the outer expression element corresponding to the arbitrary pixel position of the geometrically corrected image is pointed to by the value closest to the ground space value of the geometrically corrected image among the pixels of the raw image. Can be considered as an external expression element.

The Y value (Line) of the raw image (Level0) is exactly the same as the number of camera scan lines when acquiring a photo (image) .After converting the image coordinate of the geometrically corrected image (Level1) to Ground Space coordinates, the raw image ( If the image coordinate close to the Ground Space coordinate of Level 0) can be obtained, external orientation information can be obtained.

In this case, the raw image Level0 and the geometrically corrected image Level1 are calculated using points having similar properties to those of the Affine transformed image.

(3) Affine conversion

The Affine transformation refers to an image transformation in which coordinates are moved after being enlarged and reduced about the X and Y axes, and an example thereof is illustrated in FIG. 4B.

This property of the Affine transform can be expressed by the linear equation

A, B, and D, E are constants having properties for magnification ratios for X and Y, and C and F are constants having properties for movement.

X '= AX + BY + C

Y '= DX + EY + F

That is, if the coefficients A, B, C, D, E, and F of the Affine transform can be found, then the image coordinates X 'with respect to arbitrary points X, Y (here, these points are regarded as the coordinates of the principal point in Ground space). , Y 'can be approximated. Using three Ground Space coordinates to find six unknown values, we can find the Affine Parameters in the original image (Level0).

You can easily get it by using matrix operations like this:

P represents the image coordinate value of the raw image (Level0), G represents the ground coordinate value of the original image.

The approximate calculation of the ground coordinates of the raw image is performed in the following order.

First, the ground space coordinates are calculated from the coordinates of the geometrical correction image Level1 to be obtained.

Using the calculated Ground Space coordinates, calculate the Window to search in the raw image (Level0). Here, Window means a range of a search target.

First, since the Ground Space coordinates are not known in the raw image (Level0), first, image coordinates of three vertices as shown in FIG. 4C are selected from the entire image range. Since three linear equations are needed to calculate the six Affine parameter values, three points are selected.

For the triangular window, calculate the Ground Space coordinates corresponding to the image coordinates of the three vertices. (E.g. when the original image is 12,000 x 5000, Z1 = Z2 = Z3)

L0_1 (0, 0)-> G0_1 (X1, Y1, Z1)

L0_2 (12,000, 0)-> G0_2 (X2, Y2, Z2)

L0_3 (6,000, 5,000)-> G0_3 (X3, Y3, Z3)

Next, the Affine coefficient is obtained using the values calculated in the raw image (Level0).

Next, the pixel coordinate of the raw image (Level0) is calculated using the ground space value of the pixel coordinate of the geometrically corrected image (Level1) to be obtained using the Affine coefficient.

(If the Ground Space coordinate of the raw image is -100, 50, 20,)

X '= A * (-100) + B * 50 + C

Y '= D * (-100) + E * 50 + F

The coordinates of the original image calculated above are X '= 100, Y' = 200, and the size of the search minimum window is 250 x 500. This value can be set to a larger or smaller value depending on the speed of the Search search. Since the Y value is long, set the size of the rectangle as above.

Then repeat the process below to find the minimum window area.

X coordinate of new L0_1 = X '(100)-250/4

Y coordinate of new L0_1 = Y '(200)-250/4

X coordinate of new L0_2 = X '(100)-250/4

Y coordinate of new L0_2 = Y '(200) + 250/4

X coordinate of new L0_3 = X '(100) + 250/4

Y coordinate of new L0_3 = Y '(200)

Here, the reason for decreasing and increasing the range by 1/4 is to set the detailed search range to twice that.

The new search window has a triangular shape around the calculated coordinates. Calculate the Ground Space coordinates again for these points, and repeat the above procedure when the spacing between the points L0_1 and L0_2 is less than 250 in the search window, or the spacing between the points L0_1 and L0_3 is less than 500 in the search window. Repeat until.

The closest image coordinates are calculated (red, circular display in FIG. 4D, where the coordinates to be obtained are described).

If you find the search window (blue area in the drawing) as above, set the detail search range to that value (green range in the drawing).

The Ground Space coordinates are calculated by increasing the Y value by 1 from the starting point of the detailed comparison (Ps (x0, y0)) of the original image.

The distance between the calculated Ground Space and the Ground Space coordinates of the geometrically corrected image to be calculated is calculated by the least square method.

The detailed comparison end point is then calculated to find the nearest approximation point.

Orientation information is obtained from the calculated coordinates of the raw image and given to the corresponding pixel of the geometrically corrected image.

Through the above process, the raw image is converted into the geometrically corrected image, and after correcting the photographing information according to the geometrical correction, the geometrically corrected strip image is cut into a certain sized image to generate the unit image, and the property of each unit image Build a DB (S50)

When you want to cut the geometrically corrected image, you need to cut the same position for the various bands taken, and the position difference occurs due to the characteristics of the angle and position of the camera sensor. That is, in order to acquire images of several bands, the position error occurs between images acquired simultaneously by changing the positions and observation angles of the CCD sensors.

In this case, the position and angle of the camera CCD sensor are used to find the same or close position with respect to the image photographed by the different sensors.

The method of cutting out an image includes a method of cutting according to the same number of images, the same image length, and a predetermined file size for one strip image. You can choose the way to cut the image to suit your needs.

When the strip image is cut to the same unit length (width) or the file size, the last part of a strip image may not have the same unit length. In this case, the size of the same unit length from the end of the remaining area is provided so that the image can maintain the same unit length (width) or the size of the file.

When cutting according to the size of a predetermined file, it is necessary to analyze a range of regions in a reference image to cut out images captured by different sensor images or different bands for the same region.

In order to cut out the same position or area as the image data of other sensor images, the reference image is defined with the starting position of each image, and then the offset from the reference image of each CCD sensor image is calculated and the starting point is skipped. When calculating the offset, convert a point of the reference image coordinate to a local coordinate and calculate the distance of the x coordinate by calculating the image coordinate on the other image of the coordinate. Although there is a slight difference in y coordinate, it is ignored because it calculates the offset in the cutting direction (x-axis direction).

The raw image is an image having the same width (that is, a rectangular image) but is geometrically distorted. The geometrically corrected image correcting the geometric distortion of the raw image is not a rectangular image, but an image in which bending occurs at both ends (upper, lower, left and right) of the image.

This image is not a problem to use in the photogrammetry, but may cause inconvenience in grasping the shape of the entire image. In order to solve this problem, a rectangular image is generated so that there is no difficulty in grasping the overall shape of the image by removing 5 to 10% of the excess at both ends where the image is bent.

After generating the unit image (ie, planar image) by cutting the geometric correction strip image, the attribute DB for each unit image is automatically constructed. In addition to the photographing information for the unit image, the attribute DB includes the image orientation, business year, region name, GSD, photographing date, course photo number, photograph number, data organization, responsible department, characteristics of camera equipment, film type, etc. The business year and shooting area name are taken from the business district code and the shooting area entered at the time of cut-off, and the GSD and shooting date are taken from the cut-out information generated at the time of cutting in the original SUP file.

After this process, the property DB information is converted into an XML file, converted into standard compression format (NIX), and loaded into a separate DB to complete the work. A detailed description thereof will be omitted.

The method for rearranging a high resolution linear digital multi-band image in which a ground control point survey and a GPS / INS is linked to a planar image to construct a GPS, a digital map, and three-dimensional land-spatial information is a ground processing system (200). The ground processing system 200 is connected to the line sensor aviation digital camera equipment 1000 installed in an airplane by wire or wirelessly to receive the raw image and the shooting information, respectively.

The line sensor aviation digital camera equipment 1000 includes a camera unit 1100, an MS unit 1200, an aviation control unit 1300, and an aviation communication unit 1400.

The camera unit 1100 includes a camera sensor photographed with visible light and a camera sensor photographed with near-infrared light, respectively, and is installed on one side of the lower part of the plane.

In another embodiment, the camera unit 1100 may further include a corresponding sensor or a photographing function for photographing with ultraviolet light or laser or a specific monochromatic wavelength, and in another embodiment, visible light, near-infrared light, ultraviolet light, laser, The apparatus for photographing with the monochromatic wavelength may be classified into each, and in this case, each camera apparatus may output corresponding photographing information.

The camera unit 1100 generates a signal of the raw image photographed with visible light and near-infrared light and a photographing information signal for the raw image signal, respectively, and outputs the digital signal in the interconnected state. The camera unit 1100 may be a device having the same or similar function as the model name ADS40.

The MMS unit 1200 connects to the camera unit 1100 and stores the output signal in a designated area. The signal output from the camera unit 1100 to the MS unit 1200 includes a raw video signal photographed with visible light, a raw video signal photographed with near-infrared light, and respective photographing information signals. And a raw image signal photographed at a monochromatic wavelength and the corresponding photographing information signal.

The air control unit 1300 is connected to the camera unit 1100 and the MS unit 1200, and at the same time connected to each functional unit of the line sensor aerial digital camera equipment 1000, the control signal for operating and monitoring each connected functional unit Output each of them.

The aviation control unit 1300 is operated by a command or a stored program input through an input unit not shown in the drawing, and controls to capture a raw image signal by connecting to the camera unit 1100 and measures the corresponding shooting information signal while shooting. Alternatively, the control is monitored to output a state linked to the raw video signal.

The air controller 1300 controls the MMS unit 1200 to control the raw image signal output from the camera unit 1100 and the corresponding photographing information signal to be stored in the assigned or designated area, respectively, and the MMS unit 1200. Control and monitor all signals stored in the aviation communication unit 1400 to be output.

Meanwhile, the aviation control unit 1300 controls the aviation communication unit 1400 to connect with the ground processing system 2000 and transmit raw image signals and corresponding photographing information signals, or control commands, various operational data signals, programs, and updated information. Control and monitor to send and receive.

The aviation communication unit 1400 is connected to the aviation control unit 1300 and the MMS unit 1200, and the optical communication method and the FM using the mobile communication method and the laser light signal by the control signal applied from the aviation control unit 1300 ) It performs bidirectional communication by FM communication method using modulation method signal.

That is, the aviation communication unit 1400 outputs the raw image signal and the corresponding photographing information signal stored in the MS unit 1200 by wireless or wired, under the control and monitoring of the aviation control unit 1300, and is inputted wirelessly or wired. Receives signals, various operational data, programs, and the like, and transmits them to the aviation controller 1300.

The aviation communication unit 1400 includes a first air radio unit 1410, a second air radio unit 1420, a third air radio unit 1430, and an air wire communication unit 1440.

The first air radio unit 1410 wirelessly connects to the ground processing system 2000 through a mobile communication method, and wirelessly transmits various signals stored in the MS unit 1200 according to a control signal of the air control unit 1300. do.

The first aviation radio unit 1410 is a bidirectional communication device that wirelessly receives a control command and operation data and various programs, data for update, and the like, which are wirelessly transmitted by the ground processing system 2000 in a mobile communication method. Mobile communication methods are known, and include digital modulation methods such as CDMA, W-CDMA, TDMA, analog modulation methods, and the like, and modulation methods to be developed for mobile communication in the future.

The second aeronautical radio unit 1420 wirelessly connects the ground processing system 2000 in an optical communication manner, and wirelessly transmits a signal stored in the MMS unit 1200 in an optical communication manner by a corresponding control signal of the aeronautical control unit 1300. The terrestrial processing system 2000 is configured to receive a signal for wireless transmission in the same optical communication method.

The second aviation radio unit 1420 has the same bidirectional communication function as the first aviation radio unit 1410 and may transmit and receive the same signal, but the aviation control unit 1300 primarily operates the first aviation radio. When the bidirectional communication function of the unit 1410 is controlled to be in an active state, and the second aviation radio unit 1420 is set to allow only one-way communication by transmission, and a failure occurs in the bidirectional communication function of the first aviation radio unit 1410. Set up and control to operate.

The optical signal used in the optical communication method in the second aeronautical radio unit 1420 may use a laser optical signal, but may use any one or more selected from among infrared, ultraviolet, and optical signals having a specific monochromatic wavelength. Modulation and demodulation techniques are well known and will not be described in detail.

The third aviation radio part 1430 wirelessly connects to the terrestrial processing system through the FM communication method and wirelessly transmits the signal stored in the MMS part 1200 by the corresponding control signal of the aviation controller 1300 through the FM modulation method.

In the case of the third aeronautical radio unit 1430, the two aeronautical radio units 1420 and the second aeronautical radio unit 1420 have the same bidirectional communication functions and transmit and receive signals having the same contents. 1300 primarily controls the bidirectional communication function of the first air radio unit 1410 and second air radio unit 1420 in an activated state, and the third air radio unit 1430 is the first air radio. The bidirectional communication function of the unit 1410 and the second aviation radio unit 1420 is set and controlled to prepare for a case where a failure occurs, and operates in a bidirectional communication state.

That is, the radio communication function of the aviation communication unit 1400 is controlled, monitored and operated to safely communicate in two steps.

In this case, the first aviation radio unit 1410, the second aviation radio unit 1420, and the third aviation radio unit 1430 constituting the aviation communication unit 1400 always operate the transmitting function in an activated state and thus provide a raw image signal. And various data signals including the photographing information signal are always simultaneously and identically transmitted through three paths.

In this case, the failure of the wireless communication function includes a case in which normal communication cannot be performed due to an obstacle or a signal to noise ratio is poor in a signal transmitted and received, thereby preventing normal communication.

The aviation wire communication unit 1440 makes a wired connection with the ground processing system 2000 and wires a signal stored in the MS unit 1200 according to a control signal of the aviation control unit 1300, and the ground processing system 2000 transmits or transmits the signal. It is a bi-directional communication device that receives wired control commands and operational data signals.

The aviation wire communication unit 1440 connects various signals stored in the MS unit 1200 in a wired connection in case the first aviation unit, the second aviation unit, or the third aviation unit does not operate normally or a serious failure occurs. Output by download or input various control commands, operating data, programs, etc. from the outside can be transmitted to the aviation control unit.

That is, the line sensor aviation digital camera device 1000 may store the raw image signal, corresponding photographing information signal, and various data signals in real time through three communication paths by the first to third air radio units 1410, 1420, and 1430. Output and real-time wireless transmission in one direction, and further comprises a wired communication path by configuring the aviation wire communication unit 1440.

In addition, since the line sensor aviation digital camera equipment 1000 includes a wireless three-step path and a wired one-step path in two-way communication, the stability of the signal transmission path delivered in real time by configuring a two-way communication path by a total of four steps is achieved. There is a very high advantage.

The terrestrial processing system 2000 is connected to the line sensor aviation digital camera equipment 1000 by wireless or wired to receive the raw image signal and the corresponding shooting information signal and store them in the allocated area, and at the same time, various command signals, operation parameters, operation data. Output and send signals, programs, update information, and so on.

The ground treatment system 2000 includes a ground communication unit 2100, an average computing unit 2200, a ground control unit 2300, and a ground treatment server 2400.

The ground communication unit 2100 is connected to the line sensor aviation digital camera equipment 1000 under the control and monitoring of the ground control unit, and performs bidirectional communication using an optical communication method using a mobile communication method and a laser light signal and an FM communication method using an FM signal. The first ground radio part 2110, the second ground radio part 2120, the third ground radio part 2130, and the ground wired communication part 2140 are included.

The first terrestrial wireless unit 2110 wirelessly connects the line sensor aerial digital camera equipment 1000 in a mobile communication manner, receives a raw image signal and a corresponding photographing information signal, and simultaneously receives various command signals, operation parameters, operation data signals, and programs. And wirelessly transmit a signal such as update information to the activated first air radio unit 1410 in a mobile communication method.

The second terrestrial wireless unit 2120 wirelessly connects the line sensor aviation digital camera equipment 1000 with a laser optical signal, receives a raw image signal and a corresponding photographing information signal, and simultaneously receives various command signals, operation parameters, and operations. Signals such as data signals, programs, and update information are wirelessly transmitted to the activated second air radio unit 1420 in an optical communication manner.

The third terrestrial wireless unit 2130 wirelessly connects with the line sensor aviation digital camera equipment 1000 by using an FM modulation signal and receives raw image signals and corresponding photographing information signals. Signals such as command signals, operational parameters, operational data signals, programs, and update information are wirelessly transmitted to the activated third aviation radio unit 1430 in an FM communication scheme.

The first terrestrial wireless unit 2110, the second terrestrial wireless unit 2120, and the third terrestrial wireless unit 2130 always set and maintain a reception state for receiving a signal, and a transmission state for transmitting a signal is shown in the embodiment. Is selectively activated and operated.

In one embodiment, the first terrestrial wireless unit 2110, the second terrestrial wireless unit 2120, and the third terrestrial wireless unit 2130 may always operate in an active state in a bidirectional communication state.

Meanwhile, in another embodiment, the first ground radio part 2110, the second ground radio part 2120, and the third ground radio part 2130 may include a first air radio part 1410 and a second air radio part 1420. In response to the two-way communication activation state of the third aviation radio unit 1430, it may be selectively activated and operated in a two-way communication state.

When operated in another embodiment of the above, the line sensor aviation digital camera equipment 1000 may include any one of the first aviation radio unit 1410, the second aviation radio unit 1420, and the third aviation radio unit 1430. It has a function of notifying the ground treatment system 2000 whether it is operating in an activated state, and the ground treatment system 2000 is configured to recognize the signal.

The ground wire communication unit 2140 is connected to the aviation wire communication unit 1440 by wire and transmits and receives a raw image signal, corresponding photographing information, and various command signals, operation parameters, operation data signals, programs, and update information.

When the ground wire communication unit 2140 and the aviation wire communication unit 1440 are connected by wire, it is very natural that the plane on which the line sensor aviation digital camera equipment 1000 is installed should remain in the ground. It is also possible to use a separate mobile memory device such as a USB), a mobile hard disk, an optical disk, or the like.

The average operation unit 2200 is connected to the terrestrial communication unit 2100 under the control and monitoring of the ground control unit, and detects transmission errors of signals transmitted or received in the mobile communication method, the optical communication method, and the FM communication method, respectively, using a parity check bit method. If an error is detected, correct the error.

On the other hand, the average calculating unit 2200 is applied to the mobile communication method, the optical communication method and the FM communication method, respectively, and received the received signal simultaneously in the arithmetic average method to eliminate the transmission error generated in each communication path . Since the arithmetic mean method of the digital signal received in each of the plurality of paths is well known and can be easily confirmed, the detailed description will not be given.

The ground control unit 2300 is connected to the average computing unit 2200 and the ground communication unit 2100 and outputs control signals for operating and monitoring each function unit constituting the ground treatment system 2000. In addition, the ground control unit 2300 controls and monitors each functional unit to operate the method according to the present invention.

The ground control unit 2300 may be operated by inputting various command signals, operation parameters, operation data signals, programs, update information, and the like through an input device not shown in the drawing, or may be operated by a specific program stored in advance.

The ground processing server 2400 is connected to the average computing unit 2200, and inputs the raw image signal and the shooting information signal by the corresponding control signal of the ground control unit 2300 and stores them in the allocated area, and at the same time various command signals, operating parameters, Signals such as operational data signals, programs and update information are stored in the allocated areas, respectively.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art.

1000: Line Sensor Aviation Digital Camera Equipment
1100: camera unit 1200: MMS unit
1300: aviation control unit 1400: aviation communication unit
1410: first radio part 1420: second radio part
1430: third aeronautical wireless unit 1440: aeronautical wired and communication department
2000: Ground treatment system 2100: Ground communication department
2110: first ground radio part 2120: second ground radio part
2130: third terrestrial wireless unit 2140: terrestrial wired communication unit
2200: average computing unit 2300: ground control unit
2400: ground treatment server

Claims (1)

(S10) obtaining a raw image and photographing information (including metadata and position data) of the raw image from the line sensor aerial digital camera equipment;
(S20) acquiring an external expression element for each line of the raw image not obtained in the step S10 through coordinate system transformation and time synchronization using the ground reference point data and the photographing information according to the post-processing DGPS principle ;
(S30) Acquiring a geometrically corrected image correcting the geometric distortion of the raw image through a collinear condition equation by using the external expression element for each line obtained in the step S20 and the internal expression element of the photographing information obtained in the step S10. step;
(S40) convert each of the image coordinates of the raw image and the geometrically corrected image to ground coordinates, extract pixels of the raw image having ground coordinates close to the converted ground coordinates for each pixel of the geometrically corrected image, and extract The external expression for each line of the geometrically corrected image is assigned by assigning the external expression element to the main coordinates of the center of the geometrically corrected image. Obtaining an element;
(S50) generating the geometrically corrected strip image obtained by obtaining the external expression elements for each line as an image of a predetermined size, and constructing an attribute DB of each generated image (ie, planar image); By the way,
The pixel extraction of the raw image having the ground coordinates close to the ground coordinates converted for each pixel of the geometrically corrected image in step S40 uses an Affine transform,
The step S50 is to cut the geometric correction strip image, and then cut the upper and lower ends of each cut image in which the bending is generated by geometric correction to form a rectangular cut image. In a method of rearranging linear digital multi-band images into planar images to construct a GPS, digital maps and 3D national spatial information,
In step S10, the terrestrial processing system acquires the raw image and the photographing information from the line sensor aviation digital camera device in real time using a mobile communication method, a laser optical communication method, and an FM wireless communication method, respectively, and performs an arithmetic mean of the obtained data. Operation to remove the wireless transmission error,
The line sensor aviation digital camera equipment
A camera unit installed at a lower side of the plane and outputting a signal of a raw image photographed by visible light and near-infrared light and a photographing information signal of the raw image as digital signals, respectively;
An MS unit which accesses the camera unit and stores an output signal in a designated area;
An air control unit connected to the camera unit and an MS unit and outputting control signals for operating and monitoring each function unit of the line sensor aviation digital camera equipment; And
An air communication unit connected to the air control unit and the MS unit and performing bidirectional communication using an optical communication method using a mobile communication method and a laser light signal and an FM communication method using an FM signal according to the control signal; Lt; / RTI >
The aviation communication unit
A first air radio wirelessly connected to the ground processing system in a mobile communication manner, transmitting a signal stored in the MS unit by a control signal of the air control unit, and receiving a control command and an operation data signal transmitted by the ground processing system. part;
A second air radio unit wirelessly connecting the terrestrial processing system in an optical communication manner and transmitting a signal stored in the MMS unit by a control signal of the air control unit;
A third aviation radio unit wirelessly connecting the terrestrial processing system through an FM communication scheme and transmitting a signal stored in the MS unit by a control signal of the air controller; And
An airline communication unit for wired connection with the ground processing system, transmitting a signal stored in the MS unit according to a control signal of the air traffic controller, and receiving a control command and an operation data signal transmitted by the ground processing system; , ≪ / RTI >
The above ground treatment system
A ground communication unit connected to the line sensor aviation digital camera device and bidirectionally communicating with an optical communication method using a mobile communication method and a laser optical signal and an FM communication method using an FM signal;
Connecting to the terrestrial communication unit, detecting and correcting transmission errors of signals transmitted and received in the mobile communication method, the optical communication method, and the FM communication method, respectively, by using a parity check bit method, and calculating and outputting the modified signals in an arithmetic average method. Average calculation unit;
A ground control unit connected to the average computing unit and the ground communication unit and outputting control signals for operating and monitoring each function unit of the ground processing system; And
A ground processing server connected to the average computing unit and inputting the raw image signal and the photographing information according to a control signal of the ground control unit and storing the raw image signal in the allocated area; A method of rearranging a high-resolution linear digital multi-band image in which a ground control point survey and a GPS / INS connected to a planar image to construct a GPS, a digital map, and three-dimensional land-spatial information.

Images