WO2012057392A1

WO2012057392A1 - System for measuring distance using a plurality of cameras, and method for same

Info

Publication number: WO2012057392A1
Application number: PCT/KR2010/008083
Authority: WO
Inventors: 김두현; 전동운; 조기호
Original assignee: 건국대학교 산학협력단
Priority date: 2010-10-27
Filing date: 2010-11-16
Publication date: 2012-05-03
Also published as: KR20120044052A

Abstract

The present invention relates to a system for measuring distance using a plurality of cameras, and to a method for same. The aim of the invention is to provide a system and method for measuring distance using a plurality of cameras, which involves measuring the distance from an unmanned flying object to a target by matching images acquired through the plurality of cameras. To achieve said aim, the system of the present invention includes: a plurality of camera devices installed at specific positions on an unmanned flying object, each acquiring an image of a target; and an image-processing device for measuring the distance from the unmanned flying object to the target by matching the images acquired through the camera device.

Description

Distance measuring system and method using a plurality of cameras

The present invention relates to a distance measuring system and a method using a plurality of cameras, and more particularly, to a user who needs to pay attention to a plurality of targets at the same time using two different cameras, that is, a part of different images acquired from a plurality of cameras. The present invention relates to a system and a method for measuring a distance between an unmanned aerial vehicle and a target installed with a camera.

Recently, unmanned aerial vehicles are equipped with various kinds of cameras to perform missions. Most drones are usually equipped with one camera. In this case, it is difficult to detect and track a plurality of targets or targets, and there is a difficulty in taking off and landing using an image acquired from a camera.

On the other hand, GPS, ultrasonic waves, infrared sensors (IR), etc. are used as equipment for measuring position and altitude in an unmanned aerial vehicle, but types of sensors that can be used for each height are determined. It takes That is, the prior art as described above requires a costly budget for accurate measurement, and has a disadvantage in that it is difficult to use at a wide range of heights. In addition, there is a problem in that it is difficult to acquire a plurality of ROIs with one camera, so that image-based location is difficult.

The present invention has been made in view of the above problems, and provides a distance measuring system and method using a plurality of cameras that can measure the distance between the unmanned aerial vehicle and the target by matching images acquired through a plurality of cameras. There is a purpose.

The present invention for achieving the technical problem relates to a distance measuring system using a plurality of cameras, a plurality of camera devices installed at a specific position of the unmanned aerial vehicle, each camera device for obtaining an image for the target; And an image processing apparatus for matching the images acquired through the camera apparatus and measuring a distance between the unmanned aerial vehicle and a target. Characterized in that it comprises a.

On the other hand, the present invention relates to a distance measuring method using a plurality of cameras, (a) a plurality of camera devices installed at a specific position of the unmanned aerial vehicle to obtain an image for a specific target at the same angle of view, respectively; And (b) extracting a region of interest in each image acquired by the image processing apparatus through a plurality of camera apparatuses, and comparing the positions of the target and the plurality of regions of interest to measure a distance between the unmanned aerial vehicle and the target. ; Characterized in that it comprises a.

According to the present invention as described above, it is possible to automatically take off and land of the unmanned aerial vehicle by providing the relative height information to the user using a plurality of, preferably two cameras. That is, the present invention can effectively monitor and process the two camera images as described above, has the following specific effects.

1) It can detect minute change in height.

2) GPS information can be supplemented.

3) It is possible to monitor the landing point by using two camera devices, so it is easy to identify the landing point.

4) By installing two camera devices, the user can easily operate equipment such as driverless cars or unmanned aerial vehicles, and can quickly understand the surroundings.

5) It is easy to use at the height of wide area, and it is easy to acquire a plurality of regions of interest such as a plurality of target sites or targets, so that image-based positioning is easy and low cost budget is required.

1 is an overall configuration diagram conceptually showing a distance measuring system using a plurality of cameras according to an embodiment of the present invention.

FIG. 2 is an exemplary diagram illustrating a region of interest in each image acquired through two camera apparatuses according to an embodiment of the present invention, and showing an interval from each region of interest to a target. FIG.

3 is an exemplary view showing a state in which each image obtained through two camera apparatuses is divided into block areas according to an embodiment of the present invention.

4 is an exemplary view illustrating a region in which each of the first image and the second image and the first image and the second image overlap each other according to an embodiment of the present invention.

5 is an exemplary view illustrating a distance from a target for each number of overlapping blocks after dividing each image into a block area using two images acquired through two camera apparatuses according to an embodiment of the present invention.

6 is a flowchart illustrating a distance measuring method using a plurality of cameras according to an embodiment of the present invention.

[Description of the code]

S: Distance measuring system using multiple cameras

100: camera device 200: image processing device

210: first distance measuring unit 220: second distance measuring unit

300: monitoring device

Specific features and advantages of the present invention will become more apparent from the following detailed description based on the accompanying drawings. In the meantime, when it is determined that the detailed description of the known functions and configurations related to the present invention may unnecessarily obscure the subject matter of the present invention, it should be noted that the detailed description is omitted.

Hereinafter, with reference to the accompanying drawings will be described in detail the present invention.

A distance measuring system using a plurality of cameras according to an embodiment of the present invention will be described with reference to FIGS. 1 to 5.

1 is an overall configuration diagram conceptually showing a distance measuring system S using a plurality of cameras according to an embodiment of the present invention, as shown in the camera device 100, the image processing device 200 and monitoring Device 300.

The camera apparatus 100 is a plurality of camera apparatuses installed at a predetermined distance on the same horizontal line of the unmanned aerial vehicle, and acquires images of targets (landing destinations) at the same angle of view, respectively.

In the present embodiment, the number of the camera device 100 is set to two, but the present invention is not limited thereto.

In addition, the image processing apparatus 200 performs a function of measuring a distance between the unmanned aerial vehicle and a target by matching images acquired through the plurality of camera apparatuses 100, as shown in FIG. 1. , A first distance measuring unit 210 and a second distance measuring unit 220.

FIG. 2 extracts regions of interest a and A from each image (first image and second image) acquired through two camera apparatuses 100 according to an embodiment of the present invention, respectively. One example showing the interval from the area to the target.

In detail, the first distance measuring unit 210 extracts the ROIs A and A in each image acquired through the plurality of camera apparatuses 100, and extracts the target region and the plurality of target objects. The distance between the unmanned aerial vehicle and the target is measured by comparing the positions of the ROIs.

In this case, the interval of the ROI may vary depending on the distance between the unmanned aerial vehicle and the target (landing destination). Therefore, the first distance measuring unit 210 measures the distance (altitude) to the target based on the distance from each region of interest to the target.

Here, the ROI is an area existing in the image acquired through the camera apparatus 100 and may exist at a distance adjacent to the target.

The second distance measuring unit 220 divides the plurality of (two) images acquired through the plurality of (two) camera apparatus 100 into the block area, and then determines the similarity of the blocks between the images divided into the blocks. , Measure the distance to the target (altitude).

FIG. 3 is an exemplary view illustrating the division of each image (first image and second image) acquired through two camera apparatuses 100 according to an embodiment of the present invention into block regions. FIG. 1 is a view illustrating each of the first image and the second image and a region where the first image and the second image overlap each other according to an exemplary embodiment of the present invention.

Specifically, as shown in FIG. 3 to FIG. 4, the second distance measuring unit 220 divides a plurality of (two) images acquired through the plurality of camera apparatuses 100 into block regions, respectively. The number of overlapping blocks between the plurality of divided images (two) is determined, and a distance (altitude) from a preset target is set according to the number of overlapping blocks.

5 is a distance (altitude) from the target for each number of overlapping blocks after dividing each image into block regions using two images acquired through two camera apparatuses 100 according to an embodiment of the present invention. As an example showing the number of overlapping blocks as shown in the figure 7 is 100m, 6 is 75m, 5 is 50m, 4 is 4m, 2 is set to 15m.

In this embodiment, although a specific height is set for each number of overlapping blocks, the present invention is not limited to the height.

In addition, the image processing apparatus 200 may encode various processing information for calculation for distance measurement or transmission to an external device.

Meanwhile, in the present invention, one of the first distance measuring unit 210 or the second distance measuring unit 220 may be selectively used, and the first distance measuring unit 210 and the second distance measuring unit ( 220 may be used at the same time, and then optionally referred to the measured information.

In addition, the monitoring apparatus 300 controls the image processing apparatus 200 according to the user's input information, and thus, various status information regarding the unmanned aerial vehicle including various control information of the user for distance measurement and distance information to a target. Monitor

In this case, the monitoring device 300 is connected to the image processing apparatus 200 by wire or wireless so as to be connected in a near or remote position.

Hereinafter, a distance measuring method using a plurality of cameras using the above-described system will be described with reference to FIG. 6.

FIG. 6 is a flowchart illustrating a distance measuring method using a plurality of cameras according to an embodiment of the present invention. As shown in FIG. 6, a plurality of camera apparatuses 100 installed on an unmanned aerial vehicle at a predetermined distance on the same horizontal line are provided. Each image of the target is acquired at the same angle of view (S10).

Thereafter, the image processing apparatus 200 matches the images acquired through the plurality of camera apparatuses 100, and measures a distance between the unmanned aerial vehicle and the target object (S20).

Specifically, the first distance measuring unit 210 of the image processing apparatus 200 extracts the regions of interest a and A in each image acquired through the plurality of camera apparatuses 100 (S22). ), The distance between the target and the plurality of (two) areas of interest (a, A) is compared (S24), and the distance between the unmanned aerial vehicle and the target is measured (S26).

Subsequently, the image processing apparatus 200 encodes various types of processing information for transmission to an external device (S30).

In addition, the monitoring apparatus 300 controls the image processing apparatus 200 according to the user's input information, and thus, various status information regarding the unmanned aerial vehicle including various control information of the user for distance measurement and distance information to a target. Monitor (S40).

Meanwhile, the process S20 as described above may be replaced with the process S20 ', as shown in FIG. 6. In step S20 ', the second distance measuring unit 220 divides a plurality of images obtained through the plurality of camera apparatuses 100 into block regions (S22'), and then divides the plurality of divided images. The number of overlapping blocks between the two images is determined (S24 ′), and a distance (altitude) from a predetermined target is set according to the number of overlapping blocks (S26 ′).

In other words, at least one of the above-described process S20 and process S20 'may be set to be executed.

As described above and described with reference to a preferred embodiment for illustrating the technical idea of the present invention, the present invention is not limited to the configuration and operation as shown and described as described above, it is a deviation from the scope of the technical idea It will be understood by those skilled in the art that many modifications and variations can be made to the invention without departing from the scope of the invention. Accordingly, all such suitable changes and modifications and equivalents should be considered to be within the scope of the present invention.

Claims

In the distance measuring system using a plurality of cameras,

A plurality of camera devices installed at a specific position of the unmanned aerial vehicle, comprising: a camera device 100 for acquiring an image of a target, respectively; And

An image processing apparatus 200 for matching the images acquired through the camera apparatus 100 and measuring a distance between the unmanned aerial vehicle and a target; Distance measuring system using a plurality of cameras comprising a.
The method of claim 1,

The camera device 100,

At least two or more camera devices installed at a constant distance on the same horizontal line of the unmanned aerial vehicle, the distance measuring system using a plurality of cameras, characterized in that obtained at the same angle of view.
The method of claim 1,

The image processing apparatus 200,

The first distance measuring unit 210 extracts a region of interest within each image acquired through the plurality of camera apparatuses 100, and compares a position of a target with a plurality of regions of interest to measure a distance between the unmanned aerial vehicle and the target. ); Distance measuring system using a plurality of cameras comprising a.
The method of claim 3, wherein

The first distance measuring unit 210,

A distance measuring system using a plurality of cameras, characterized in that for measuring the distance to the target based on the distance from each region of interest to the target.
The method of claim 1,

The image processing apparatus 200,

A second distance measuring unit 220 dividing a plurality of images acquired through the plurality of camera apparatuses 100 into a block area, determining a similarity of blocks among the images divided into blocks, and measuring a distance to a target; Distance measuring system using a plurality of cameras comprising a.
The method of claim 5,

The second distance measuring unit 220,

After dividing the plurality of images acquired through the plurality of camera apparatuses 100 into block regions, the number of overlapping blocks between the plurality of divided images is determined, and the number of overlapping blocks is determined according to the number of overlapping blocks. Distance measuring system using a plurality of cameras, characterized in that for setting the distance.
The method of claim 1,

The image processing apparatus 200,

A distance measuring system using a plurality of cameras, characterized by encoding a variety of processing information for calculation for distance measurement or transmission to an external device.
The method of claim 1,

By controlling the image processing apparatus 200 according to the user's input information, the monitoring device 300 for monitoring the various state information about the unmanned aerial vehicle including the user's various control information for the distance measurement and the distance information to the target object ; Distance measuring system using a plurality of cameras, characterized in that it further comprises.
The method of claim 1,

The monitoring device 300,

Distance measuring system using a plurality of cameras, characterized in that connected to the wired or wireless so as to be connected to the image processing apparatus 200 in a near or remote position.
In the distance measuring method using a plurality of cameras through a system including a camera device 100, an image processing device 200 and a monitoring device 300,

(a) a process in which a plurality of camera apparatuses 100 installed at a specific position of the unmanned aerial vehicle respectively acquire images of a target at the same angle of view; And

(b) The image processing apparatus 200 extracts a region of interest in each image acquired through the plurality of camera apparatuses 100, compares a position of a target with a plurality of regions of interest, and compares it to the unmanned aerial vehicle and the target. Measuring the distance; Distance measuring method using a plurality of cameras comprising a.
The method of claim 10,

After the above (b) process,

(c) the monitoring apparatus 300 controls the image processing apparatus 200 according to the user's input information, whereby various control information about the unmanned aerial vehicle including various control information of the user for distance measurement and distance information to a target object are included. Monitoring status information; Distance measuring method using a plurality of cameras, characterized in that it further comprises.
In the distance measuring method using a plurality of cameras through a system including a camera device 100, an image processing device 200 and a monitoring device 300,

(a) a process in which a plurality of camera apparatuses 100 installed at a specific position of the unmanned aerial vehicle respectively acquire images of a specific target at the same angle of view; And

(b) After the image processing apparatus 200 divides the plurality of images acquired through the plurality of camera apparatuses 100 into block regions, the number of overlapping blocks between the plurality of divided images is determined, and the overlapping is performed. Setting a distance to a predetermined target according to the number of blocks that have been set; Distance measuring method using a plurality of cameras comprising a.
The method of claim 12,

After the process (b) above,

(c) the monitoring apparatus 300 controls the image processing apparatus 200 according to the user's input information, whereby various control information about the unmanned aerial vehicle including various control information of the user for distance measurement and distance information to a target object are included. Monitoring status information; Distance measuring method using a plurality of cameras, characterized in that it further comprises.