KR20180044500A - Overlapping image information providing system and method implemented using a portable visual display device. - Google Patents

Abstract

The present invention relates to a system for improving real time observation and detection performance in accordance with a user gaze. The present invention discloses a method for processing an overlapping image signal and a device thereof. The method for processing an overlapping image signal comprises the following steps of: obtaining image information in a first direction in a system composed to obtain the image information in at least two directions; obtaining the image information in a second direction different from the first direction; transmitting the obtained image information; setting the image information to be selectively displayed through a step of receiving the transmitted image information and selecting the image information to be displayed in the image information of the second direction and a step of comparing a similarity degree between the selected image information of the second direction and the image information of the first direction; and displaying the set image information in at least one region.

Description

TECHNICAL FIELD [0001] The present invention relates to an overlapping image information providing system and a method for implementing the overlapping image information using a moving time display device. }

The present invention provides another image information to one image information when the observation and detection image information is transmitted in real time using two cameras, an image processing system, a movable time display device, and the like, And a system and method for efficiently observing and detecting by increasing the recognition rate of the information when it is desired to detect and providing various views.

Generally, a small dome-type camera installed in a high-sensitivity surveillance camera installed inside a corporation, a public or public institution, an airport, a fire-fighting and disaster prevention center, or a public facility for observation and detection, or inside a building, a hallway, It is installed in a specific place and provides video information. The image information is transmitted to a monitor or an image storage device using wired or wireless lines according to the performance of the image input device.

Typical observation and detection cameras only provide images in a specific angle range in the direction the camera lens is pointing. And provides image information observed at different angles through 360 degree rotation of the camera lens unit as needed. In addition, since these images provide the user with the image information through the monitor, information necessary for the user or the observer's view is difficult to be transmitted in real time, and when detailed image information is required for a specific part, The effect is not high enough to confirm. In order to solve this problem, several cameras are installed facing each other in different directions, but the realistic feeling is not high from the viewpoint of users who see limited visual information with increased installation and operation costs. In addition, although a panoramic image is provided in which images input from different cameras are connected and displayed on a plurality of screens for a long time, even if a wide range of camera images are displayed on the screen, In an environment requiring surveillance, the effect of unilaterally provided panorama images is low. In order to solve this problem, a camera using a 360 ° observation fisheye lens or a special lens, which is another type of CCTV camera used, can observe various directions with a single lens, but the image is distorted and the zoom in / It is difficult to improve the performance of the detection function of the surveillance camera due to the necessity of separate image processing for correcting the distortion phenomenon, and there is a technical limitation, and additional image processing A module for the < / RTI >

The present invention provides a method and system for enabling users to perform more effective observation and detection by enhancing real-time observation and detection functions in response to the above-mentioned problem, thereby improving a blind spot and a presence feeling with a minimum system configuration, To solve the existing problems.

The present invention provides a panoramic image or a 360-degree image and a general monitor which are difficult to enlarge or reduce only the images observed from a specific angle of the existing surveillance camera system, To a system for improving real-time observation and detection performance. However, these problems are illustrative and do not limit the scope of the present invention.

In order to accomplish at least one of the above-described aspects of the present invention, the present invention provides an image display apparatus including a first image information input unit 100 configured by a first camera and a second image information input unit 100 having a wider viewing angle than the first camera, And a second image information input unit 200 composed of a second camera capable of inputting a wide panorama image. The first image information input unit 100 and the second image information input unit 200 are disposed in at least one rotation unit 300 installed at a specific location. 2 image information input unit 200, and an image processing system 400 for processing the received image information. The image signal transfer unit 500 connects the first and second image information input units 100 and 200 and the image processing system 400 to each image information transmitted through the signal transfer unit 500, (400) to provide one image information to the time display device (600). The apparatus may further include a device for receiving a direction to be monitored or observed by the user with respect to the direction of the first image information input unit 100. At least a part of the image information of the second image information input unit 200 including the area linked with the direction of the user is displayed on the time display device 600. [ In addition, the first camera or the second camera may include a driving unit for moving the first camera or the second camera in synchronization with the movement of the user or a desired direction, To display an image in a direction in which the image is displayed.

Other aspects, features and advantages of the present invention will become apparent from the following detailed description of the invention, claims and drawings.

In order to prevent the observation effect from being degraded due to the provision of only the image observed at a specific angle, which is installed at a specific position in the related art, A problem that the installation cost and the operation maintenance cost are increased and the problem that the camera which can be additionally installed in the direction of 360 degrees to observe can not have the enlargement and reduction function is replaced by at least one first main camera And at least one second camera having a wider viewing angle than the main monitoring camera to display the image of the main monitoring camera in the time display device, When superimposed on the image and displayed on the time display device Time observation and detection performance can be enhanced and real time monitoring or observer's intention detection / observation function can be implemented in one visual display device, so that it is not displayed on a separate screen, and at least observation or monitoring So that more effective observation and detection is possible.

In addition, when the distance between the user and the system equipped with the cameras is remote and the camera is connected wirelessly, the camera is composed of a camera arranged in the forward direction or a front direction of the system and another camera having a larger viewing angle than the camera, The real time image information can be effectively viewed even in a state where the user and the system are separated from each other by allowing the user to observe the image in the overlapping direction or the direction in real time through one time display device.

1 is a block diagram of a superimposed image information providing system using a time display device according to an embodiment of the present invention.
2 is a block diagram of a superimposed image information providing system using a time display device according to an embodiment of the present invention.
3 is a flow chart illustrating a procedure of a method of a superimposed image information providing system using a time display device according to an embodiment of the present invention
4 is a flowchart illustrating a method of a method of providing a superimposed image information using a time display device according to an embodiment of the present invention.
5 is a flowchart illustrating a method of a method of providing a superimposed image information using a time display device according to an embodiment of the present invention

BRIEF DESCRIPTION OF THE DRAWINGS The present invention is capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or corresponding components throughout the drawings, and a duplicate description thereof will be omitted . The terms used in the following examples are used only to illustrate specific embodiments and are not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the following description, the terms "comprises" or "having ", and the like, specify that the presence of stated features, integers, steps, operations, elements, But do not preclude the presence or addition of other features, numbers, steps, operations, components, parts, or combinations thereof.

In the drawings, components may be exaggerated or reduced in size for convenience of explanation. For example, the size and thickness of each component shown in the drawings are arbitrarily shown for convenience of explanation, and thus the present invention is not necessarily limited to those shown in the drawings.

In the following embodiments, the concept of the present invention can be more easily understood.

The superimposed video signal processing system according to the present invention may include at least one first camera capable of obtaining image information in a first direction and at least one second camera capable of obtaining image information in a second direction and having a viewing angle larger than that of the first camera, A first transmitter for externally transmitting image information acquired by the first camera; a second transmitter for externally transmitting image information acquired by the second camera; a second transmitter for transmitting image information obtained from the transmitter, And a time display device for selectively displaying the time display area in at least one time display area.

The superimposed video signal processing system according to the present invention may further include at least one first camera capable of obtaining image information in a first direction and at least one first camera capable of obtaining image information in a second direction and having a viewing angle larger than that of the first camera, 2 is a block diagram illustrating a configuration of an image processing apparatus according to an exemplary embodiment of the present invention. Referring to FIG. 2, there is provided an image processing apparatus including a housing in which a camera is installed, a video signal transfer unit for transferring image information acquired by the first camera and image information acquired by the second camera, An image processing system for generating one superimposed video signal so as to be able to be displayed in one time display area, and a time display device for displaying superimposed video signals of the image processing system.

The overlapping image information providing system using the time display device according to the present invention may include a first image input unit configured by at least one first camera that inputs near and far image information, a second image input unit configured to output a range of image information larger than a viewing angle of the first camera There is provided a second image input unit including at least one second camera having a wider viewing angle, a first image input unit and a second image input unit, at least one drive motor capable of turning at least a first image input unit, An operation control unit coupled to the rotation unit, the rotation unit, and the first image information input unit to control the operation of the rotation unit and the first image information input unit, the first image information input unit and the second image input unit, A signal transmission unit connected to the first and second image input units and configured to transmit the image signals from the first and second image input units, An image processing system for combining two image signals into one image, and a time display device for visually providing a combined image to a user.

The time display device is characterized in that a time display device of HMD (Head Mounted Display) type is used in one embodiment of the present invention. Various virtual reality-based visual apparatuses applicable to the concept of the present invention other than the above-described examples can be applied. Also, the second camera may be a camera capable of simultaneously inputting image information in a 360-degree direction.

The overlapping image information providing system using the time display device according to an embodiment of the present invention includes a first image input unit configured by one first camera, at least one image input unit having a wider viewing angle than the first camera of the first image input unit, A second image input unit including two cameras, a video signal transmitting unit of a wired or wireless type, a mount for fixing the image input unit, and a control unit for controlling operations of the rotation unit, the rotation unit, and the image input unit. An image processing system for receiving the observed and detected images and processing them as one superposed image, and at least one time display device.

The second camera has an input unit for generating an input signal with respect to a sound that can be input with respect to at least one or more of the second cameras so that the direction information corresponding to the user's relative position and direction can be determined in the image information And a speaker system that can include sound information by the corresponding input unit and outputs the audio information interlocked with the direction of the user's monitoring or observation.

In addition, the above-described speaker system and the above-described time display device can be implemented in one integrated device. The integrated equipment described above may be in the form of a helmet.

According to another aspect of the present invention, there is provided a method of processing a superimposed image signal by acquiring image information of at least two directions, the method comprising: acquiring image information in a first direction; Receiving the transmitted image information, setting image information to be selectively displayed, and displaying the set image information in at least one area, the method comprising the steps of: A signal processing method is provided. In addition, the step of receiving the transmitted image information and selectively setting image information to be displayed may include selecting image information to be displayed in the image information in the second direction, selecting the image information in the selected second direction, And comparing the degree of similarity with the information.

Example

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

In the following description of the embodiments of the present invention, descriptions of techniques which are well known in the technical field of the present invention and are not directly related to the present invention will be omitted. This is for the sake of clarity of the present invention without omitting the unnecessary explanation.

1 is a block diagram for explaining an overlapping image information providing system using a time display device according to an embodiment of the present invention.

Referring to FIG. 1, the overlapped image information providing system using the time display device of the present embodiment includes a first image information input unit 100 configured by a CCTV camera having one PTZ function, one camera having a 360 degree observation function A second image information input unit 200 configured by a first image information input unit 200 and a rotation unit 300 installed and fixed at a specific place, And an image processing system 400 for processing the received image information. The signal transfer unit 500 connects the first and second image information input units 100 and 200 to the image processing system 400 and transmits the image information transmitted through the signal transfer unit 500 to the image processing system 400. [ And provides it to the time display device 600. The time display device 600 displays the image information.

Detailed operation of the superimposed image information providing system using the time display device according to the present invention will now be described in detail with reference to FIG.

Referring to FIG. 2, an overlapping image information providing system using the time display device 600 of the present embodiment includes a first image information input unit 100 and a second image information input unit 100 in a rotation unit 300, A video information input unit 200 is provided. The first image information input unit 100 faces the specific direction and observes and detects a specific region or space, and sends the image signal S110, which is observed and detected, to the image signal transmission unit 500. [ The second image information input unit 200 sends a video signal S210 for spatial information in the 360-degree direction, which is centered on the second image information input unit 200, to the image signal transfer unit 500. The video signal transmitting unit 500 transmits the video signals S110 and S210 sent from the first and second video information input units 100 and 200 to the video receiving unit 410 of the video processing system 400. [

The image receiving unit 410 of the image processing system sends the received two image signals S110 and S210 to the image processing unit 420 and the image processing unit 420 receiving the two image signals S110 and S210 receives the superimposed image Signal (S410). When the superimposed video signal S410 is generated in the video processing unit 420, the video transmitting unit 430 transmits the superimposed video signal S410 to the time display unit 600. [ The time display device 600 converts the superposed video signal S410 into image information, and provides the user with a 360-degree observation image and an observation image of a specific region or space at the same time.

The operation control unit 700 includes a driving unit and a control unit for controlling at least the vertical and horizontal directions of the viewing angle of the camera of the first image input unit and has a control function for changing the camera focal length of the first image information input unit . ≪ / RTI > The rotary motion unit 300 can be swiveled by operating the operation control unit 700 and the first image information input unit is driven at a high level. At this time, the second image information input unit 200 is fixed and does not move in any direction. If necessary, the area of the input image can be changed by being moved in the vertical direction with respect to the fixed mounting surface. In the present embodiment, it is assumed that it is fixed. The operation control unit may further include a signal generating unit for generating a motion control signal, and the signal generating unit may be installed at a position substantially spaced apart from the rotatable unit 300 or a housing that may be otherwise represented. The operation control unit may change the direction of the first camera by transmitting an operation signal to the driving unit by the signal of the signal generating unit.

The first image information input unit 100 converts the observation and detection image information changed due to the turning motion of the rotation unit 300 and the high and low driving of the first image information input unit 100 into the image signal S110, The image processing unit 420 processes the changed image signal S110 in real time and generates the superposed image signal S410 so that the user can receive the image information according to the position or direction conversion in real time.

In addition, the second image input unit may include a plurality of audio signal input units for determining the directionality of the video information around the camera, and may include audio information by the audio signal input units, And a speaker system for outputting the speaker signal.

In addition, the above-described speaker system and the above-described time display device may be constituted by a headset having a sound generating device and a time display device. The sound generating device and the time display device may be integrated into one integrated device. For example, the time display device may be a virtual reality and an augmented reality device. The integrated device described above may also be in the form of a helmet.

3 is a schematic view of a superimposed image provided by the superimposed image information providing system using the time display device of the present embodiment. The video signal S210 of the second video information input unit is set as the background video and the video signal S110 of the first video information input unit is projected in a square shape before the video signal S210 as the background video in the superposed video signal display area S420 And simultaneously displaying two video signals S110 and S210. The superimposed video signal S410 generated by the video processing system 400 may be displayed on the superimposed video signal display area S420, Area, space, and subject. The image signal S110 of the first image information input unit having a rectangular shape can be adjusted in size. Also, the brightness of each relative image can be set differently or additional signals can be displayed.

FIG. 4 is a schematic diagram showing that a process of transmitting different image information inputted as the second embodiment to the time display device 600 is transmitted by radio. It is preferable that the position where the image is input is implemented in the external environment where the distance to the position to be detected or monitored is long or the relative distance and position is changed or the transmission method of the image signal by wireless when using environment. As an example, when a rescue or fire-fighting surveillance system deviates from the user's visual range, such as a dangerous area or a fire-exposed building, it is preferable that real-time image information is transmitted by radio.

5 is a block diagram illustrating a third embodiment of the present invention in which the process of transmitting different image information to the time display device 600 is transmitted by radio, The image generated in the display devices 100 and 200 is transmitted to the virtual reality device as the time display device 600 and each image information can be displayed in the time display device 600. [ That is, the generated image information can be displayed on the display device without generating the superimposed image signal in advance.

1 to 5, an image displayed in the superimposed image signal display area S420 may include a video signal S110 generated by the first video information input unit and a video signal S210 generated by the second video information input unit May be selectively displayed on the superimposed video signal display unit S420. The first image information and the second image information may be selectively displayed in one image display device or a predetermined area in the same direction according to the direction of the user's time and direction. That is, the first image signal and the second image signal, which are selectively displayed on the time display device, further include a user motion recognition unit that recognizes a change in the user's gaze direction corresponding to the first direction of the first camera, And can be selectively displayed in the time display area by a negative signal. For example, when the user is looking forward, if the first camera direction of the first image matches the direction of the second camera or the similar direction, the image information of the wide view angle of the second camera is not selectively displayed, It is possible to set the display in the time display area so that only the image of the first camera can be viewed by the user. When the user's gaze is different from the first direction of the first camera or is out of the area, the user can display the video information in the time display area in association with the time of the user in the video information of the second camera have. The motion recognizing unit recognizes the angle of the face rotated relative to the front of the user by an external camera, and measures the gaze of the user changed in the first direction. Further, in a device worn on the user's body in the form of glasses, a headset, etc. on the user's head or ear, a relative change relative to the first direction can be measured and the direction of the user's relative gaze can be measured. Also, in the case of a virtual reality apparatus, the direction of a line of sight can be recognized by measuring a movement of a three-dimensional user by means of a sensor installed inside or attached to an additional apparatus.

4 to 5 may be implemented in a small unmanned aerial vehicle such as a drone, and may include at least one camera having a wide view angle with respect to a first camera facing forward or forward, It is possible to observe a superimposed image or an image of a corresponding area in a single time display device with respect to the images of a plurality of cameras in the air vehicle on the ground or at a third place, It is possible to make the work more effective in the work such as observation. Also, in the unmanned vehicle or the remote control vehicle, the image of the first camera in the direction of the user's gaze and the direction of the user's gaze is selected using the image of the second camera such as the camera in the traveling direction of the vehicle and the wide viewing angle, panorama, So that it becomes easy to recognize real-time situations and real-time situations. In addition, the present invention can provide a more realistic environment in real time in a process of performing a robot operation through remote control, a special operation separated from an operator, or a remote control operation of a special purpose apparatus.

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

100: first image information input section
200: second image information input unit
300:
400: Image processing system
500:
600: time display device
700:
800:
S110: First video signal
S210: a second video signal
S410: superimposed video signal
S420: overlapped video display area

Claims (14)

At least one first camera capable of obtaining image information in a first direction
A housing for receiving image information in a second direction and having at least one second camera having a viewing angle larger than that of the first camera;
A first transmitter for externally transmitting image information acquired by the first camera;
A second transmitter for externally transmitting image information acquired by the second camera;
And a time display device for selectively displaying the video signal transmitted from the transmitter in at least one time display area,
The method of claim 1, wherein
The housing may further include a driving unit for changing a direction of at least a first camera installed in the housing and an operation control unit for changing a first direction with respect to the housing, wherein the operation control unit is substantially apart from the housing Superimposed video signal processing system
The method of claim 1, wherein
Wherein the system further comprises at least one wireless signal transmitter and the first transmitter and the second transmitter are transmitted to the time display device.
The method of claim 1, wherein
Wherein the first image signal and the second image signal, which are selectively displayed on the time display device, further include a user action recognition unit for recognizing a change in the gaze direction of the user corresponding to the first direction of the first camera, Is displayed on the time display area
The method of claim 1, wherein
Characterized in that the time display area is displayed in a virtual reality apparatus
The method of claim 1, wherein
Wherein the housing is installed in any one of a remote control vehicle, an unmanned vehicle, a unmanned aerial vehicle, and a robot for remote control work,
At least one first camera capable of obtaining image information in a first direction
A housing for receiving image information in a second direction and having at least one second camera having a viewing angle larger than that of the first camera;
An image signal transmitter for transmitting image information acquired by the first camera and image information acquired by the second camera to the outside;
An image processing system for generating one superimposed video signal so that the video signal transmitted from the video signal transmitting unit can be displayed in at least one time display area;
And a time display device for displaying the superimposed video signal of the image processing system The method of claim 7, wherein
Wherein the housing includes an operation driving unit for changing at least a first direction of the first camera and an operation control signal generating unit for the operation driving unit is installed to be substantially spaced apart from the housing.
The method of claim 7, wherein
Wherein the first image signal and the second image signal displayed on the time display device further include a user action recognition unit for recognizing a change in the gaze direction of the user corresponding to the first direction of the first camera, And the time information is displayed on the time display area.
The method of claim 7, wherein
Wherein the image signal transfer unit transfers the image signals to the image processing system by wireless.
The method of claim 7, wherein
Characterized in that the time display device is a virtual reality device
The method of claim 7, wherein
Wherein the housing is installed in any one of a remote control vehicle, an unmanned vehicle, a unmanned aerial vehicle, and a robot for remote control work,
Acquiring image information in a first direction;
Acquiring image information in a second direction different from the first direction;
Transmitting the acquired image information;
Receiving the transmitted image information and selectively setting image information to be displayed;
And displaying the set video information in at least one area.
The method of claim 13, wherein
The step of receiving the transmitted image information and selectively setting image information to be displayed may include selecting image information to be displayed in the image information in the second direction, selecting the image information in the selected second direction, And comparing the degree of similarity between the superimposed video signal processing method

Images