KR20160064891A - Spatial Infomation Acquisition Device and Method - Google Patents

Abstract

The present invention relates to a device for combining image information with spatial information. More specifically, actual measurement information of a distance and an object is mapped on 2D or 3D information obtained from an image device and related information is shown or notified to an arbitrary target person.

Description

[0001] Spatial Infomation Acquisition Device and Method [

The present invention is a technique for acquiring 2D (planar) or 3D (three-dimensional) spatial information.

Conventional techniques have acquired 2D or 3D spatial information using one or more cameras. In addition, GPS technology is applied to provide distance information and location information of spatial information.

Korea Electronics and Telecommunications Research Institute KR102007000110921 Korea Research Institute of Standards and Science KR102010000121164

The conventional invention acquires 2D or 3D spatial information using one or more cameras. And navigation service technology applying GPS technology mapping distance and location information to acquired spatial information is commercialized. However, there is a need for a way to apply distance and location information to spatial information where GPS technology is not applied or GPS signals are not received.

The present invention relates to a technique for providing distance information and location information to a device obtained from a receiving device capable of acquiring one or more cameras or spatial information.

At this time, the provided distance information and position information can be acquired using an ultrasonic sensor. In addition, current orientation information can be acquired by utilizing a bearing sensor with a magnet attached thereto.

The present invention applies a distance and position information obtained by using an ultrasonic sensor to spatial information obtained from at least one camera or a spatial information acquiring receiver and further adds the orientation information obtained from the orientation sensor attached with magnets, It is possible to provide the surrounding spatial information and its own location information.

Further, when the tilt sensor is further added to the above-described invention, it is possible to further provide status information on the object to the object.

In the conventional technology, spatial information is secured by applying GPS information to the image information. In this case, the applied GPS signal is applied to the error information due to limited distance information to the user and spatial information is applied to the image information in the shadow area of the GPS signal I can not.

Therefore, when the distance, azimuth, and tilt information acquired in real time to 2D or 3D image information is mapped to 2D or 3D image information as in the present invention, space information can be effectively reflected.

When the real time image and the spatial information are independently mapped without an external signal such as GPS, the present invention can detect the walking and object recognition, the vehicle driving, the unmanned airplane, and the location of the object.

1 is a block diagram of a video information and spatial information obtaining unit according to an embodiment of the present invention;
2 is a block diagram of a method of acquiring image information and spatial information according to an embodiment of the present invention
FIG. 3 is a configuration diagram further comprising an information management DB, an informing step, and an image information displaying unit after acquiring image information and spatial information according to an embodiment of the present invention
4 is a block diagram of a method of utilizing a spatial information obtaining apparatus according to an embodiment of the present invention

And an apparatus for combining image information and spatial information. More specifically, it maps actual information of distance and object to 2D or 3D information obtained from a video device, and then displays or informs relevant information to an arbitrary object.

Reference numeral 110 in FIG. 1 is a video image capturing device capable of acquiring image information, and includes video devices using an optical device using light or a source using infrared, near-infrared, ultrasound, millimeter wave, high frequency, radiation, magnetic field,

In FIG. 1, reference numeral 120 denotes an ultrasonic sensor unit for grasping distance information of a space, and it is possible to grasp the position of an object in an arbitrary space.

In FIG. 1, reference numeral 130 denotes an orientation sensor unit which provides information on a current position or a moving direction of an arbitrary object, and allows a current direction of an arbitrary object to be grasped from the surrounding objects. This is applied to setting the orientation of each object based on the distance information of an object in a certain space from the 120 ultrasonic sensor.

In FIG. 1, reference numeral 140 denotes a tilt sensor unit which obtains tilt information in a state where an arbitrary object is located, and information on the inclination of the road surface or floor. It also provides status information for arbitrary objects in free space by providing information about the rise and fall or the slope of the left and right sides in the dynamic state.

Reference numeral 210 in FIG. 1 is a functional unit for performing a process of extracting image information from information obtained from the image information obtaining apparatus.

In FIG. 1, 220 performs signal processing, beam focusing, apodization, scan conversion, and the like required to acquire at least one of distance, position, and image from information obtained from the ultrasonic sensor unit.

Reference numeral 230 in FIG. 1 is a functional unit for extracting the information of the defense agency using the information obtained by the orientation sensor unit. At this time, the azimuth information may secure the direction in which an arbitrary object moves and the amount of displacement of the vertical and horizontal directions. Also, displacement or direction information can be obtained by using the distance, position information, and the like obtained from the ultrasonic sensor unit.

Reference numeral 240 in FIG. 1 is a functional unit for receiving the information obtained by the tilt sensor unit and obtaining tilt information. At this time, the obtained information may be combined with the distance or position information and used for extracting the bearing information required by 230.

1 includes an image information acquiring apparatus 100 and an apparatus for acquiring spatial information.

Reference numeral 200 in FIG. 1 includes an image information acquisition function unit and a spatial information acquisition function unit.

310 is an image signal transmission unit, 320 is an ultrasonic signal transmission unit, 330 is a direction signal transmission unit, and 340 is a tilt signal transmission unit, and each transmission unit can transmit and receive signals by wire or wireless. Accordingly, the present invention utilizes a general communication method for wired / wireless transmission signals, and does not limit the specific transmission method in the practice of the present invention.

Reference numeral 710 in FIG. 2 is a step of initializing the system in the apparatus for acquiring spatial information of the present invention.

In FIG. 2, reference numeral 7200 denotes a system synchronization step. In order to map spatial information (distance, position, orientation, and slope) to image information by using information obtained from real-time image and spatial information stroke devices, do. Accordingly, the 7200 performs system synchronization of the devices and the functional units included in 100 and 200 of FIG.

In FIG. 2, reference numeral 7300 denotes an information obtaining step, which is a process of extracting information from the signals received from the sensors 100 of FIG. 1 at 200.

In FIG. 2, step 7400 is a step of synthesizing the information obtained in step 7300, and mapping spatial information (distance, position, orientation, and slope) to the image information.

In FIG. 2, reference numeral 7500 denotes a step of acquiring spatial position information of an arbitrary object in the spatial information synthesized in 7400.

The step 7600 of FIG. 3 performs a step of displaying image information on the display unit using at least one of information synthesized at 7400 or arbitrary object synthesis spatial information at 7500, and information received at the information management gateway.

In FIG. 3, 7700 performs an alert step of informing an arbitrary object of spatial information using one or more of the information acquired from 7400, 7500, and 7800.

In FIG. 3, reference numeral 7800 denotes a step of reflecting information updated in an image or spatial information acquired in an arbitrary 7300 and storing the updated information in the information management DB.

Reference numeral 7900 in Fig. 3 is a step of performing the process termination when the operation of the spatial information obtaining apparatus is completed or when the system is terminated by the user.

Reference numeral 400 in FIG. 4 is a video information / spatial information synthesizing apparatus, which is an apparatus or functional unit for synthesizing spatial information in image information using information obtained from the spatial information obtaining unit of the 210 and the spatial information obtaining unit of the 210.

4, an information management DB 500 is a functional unit for managing video information and spatial information. 500 can update the existing DB information in which the real time image, distance, position, bearing, and tilt information is updated, transmits updated information to the user or an arbitrary object, or transmits updated information to the display device .

It also manages the warning or risk information set by the user and the notification message setting reference information. A warning, a danger, and a notification message setting criterion are, for example, a puddle, a curtain, a corner, an obstacle, a sudden change in the medium (ex, cement to water), a sudden movement of the moving object, It can be a standard.

Reference numeral 600 in FIG. 4 is a function of notifying a message to a user or an arbitrary object according to the image, distance, position, bearing, and tilt information changed in real time based on the message set information in 500.

Reference numeral 700 in FIG. 4 denotes a video information display unit, which provides 2D, 3D, and 4D information obtained from a video apparatus. Also, it is a function to display the synthesized spatial information composites at 400.

The present invention can be applied to low vision or visually impaired persons, military, robot, and unmanned devices to recognize the location of space and objects, and can be utilized for walking, running, flying, and locating objects.

100:
110: Image information acquiring unit
120: ultrasonic sensor part
130:
140: tilt sensor unit
210: Image information acquisition (processing) function unit
220: Distance / position information acquisition (processing) function part
230: Orientation information acquisition (processing) function part
240: Tilt information acquisition (processing) function part
310: Video signal transmission unit
320: ultrasonic signal transmission unit
330: azimuth signal transmission unit
340: tilt signal transmission unit
400: image information / spatial information synthesizer
500: Information management DB
600: Message notification part
7100: Spatial information acquisition device initial stage
7200: System Synchronization Phase
7300: Information acquisition phase
7400: information synthesis step
7500: Acquisition of arbitrary object synthesis space information
7600: Image information display section
7700: Any object information notification step
7800: Information management DB update step
7900: Shutdown phase

Claims (1)

An image information acquiring unit capable of acquiring 2D or 3D image information; And
A spatial information acquiring unit that acquires spatial information;
Wherein the spatial information obtaining unit includes one of distance, azimuth or tilt information;

Images