KR100581533B1 - Image composition apparatus of stereo camera - Google Patents

Abstract

According to the present invention, stereoscopic images can be watched in an auto glasses-free manner, and stereoscopic images are synthesized in various units on a pixel-by-pixel basis to realize stereoscopic images directly on a display device. An image synthesizing apparatus is provided.

In the image synthesizing apparatus of the stereo camera of the present invention, an image synthesizing apparatus for synthesizing the images photographed through the first and second cameras, the first camera signal processing unit converting the image output from the first camera into a digital image ; A second camera signal processor configured to convert an image output from the second camera into a digital image; Stereoscopic image synthesizing means for synthesizing the images by receiving the processed images from the first and second signal processors; And a stereoscopic display device for displaying stereoscopic image data transmitted from the stereoscopic image synthesizing means.

The present invention has the effect of displaying a three-dimensional effect on the real-time three-dimensional image display device without cumbersome synthesis process in a computer.

Stereoscopic Video, Stereo Camera, Video Synthesis

Description

Image synthesizing apparatus of stereo camera {IMAGE COMPOSITION APPARATUS OF STEREO CAMERA}

1 is a schematic system configuration diagram of a stereo camera system according to the prior art.

2 is a schematic block diagram of a stereoscopic image synthesizing apparatus of a stereo camera system according to the present invention.

FIG. 3 is a detailed block diagram of the stereoscopic image synthesizing means shown in FIG. 2.

4 is a timing diagram illustrating in detail a data processing flow in a stereoscopic image synthesis process.

Explanation of symbols on the main parts of the drawings

100,110: first and second camera

120,130: first and second camera signal processing unit

140,150: left and right video

200: stereoscopic image synthesis means

300: stereoscopic display device

400: stereoscopic image synthesis processing unit

500: stereo camera system

The present invention relates to an apparatus for synthesizing two images of a stereo camera, and in particular, to view a stereoscopic image in an autostereoscopic manner, and to synthesize a stereoscopic image in various ways by pixel unit to implement a stereoscopic image directly on a display device as a whole. The present invention relates to an image synthesizing apparatus of a stereo camera for simplifying equipment for implementing stereoscopic images.

Various methods for implementing stereoscopic images have been proposed. 1 is a schematic system configuration diagram of a stereo camera system according to the prior art. As shown therein, the stereo camera system 50 uses the first and second cameras (not shown), respectively, to capture an image of an object and deliver the captured image, respectively. And a server computer device which receives the processed image from the image processing unit 10 through a connecting means (cable, etc.), and processes the image into a stereoscopic image for display on a display device (monitor, etc.). And a shutter glass 30 for viewing a stereoscopic image displayed on the display device.

Meanwhile, in FIG. 1, the stereo camera system 50 for forming a stereoscopic image is specifically mechanically installed between the first and second cameras, the first and second camera modules, and the devices in the other system 50. Methods and the like are also important because the details are not essential to the present invention and thus detailed descriptions will be omitted.

In the conventional stereo camera system 50 as shown in FIG. 1, each camera or camera module has functions such as focus and angle control, zoom in, and zoom out of the lens, which are limited to optical functions, but are compatible with a stereoscopic display device. Since there is no function such as stereoscopic image processing to implement an image to solve the problem, there is a cumbersome problem that must be processed after software processing on other parts of the system, that is, a server computer driving a stereoscopic display. In addition, there was an inconvenience of using a shutter glass separately to watch a stereoscopic image.

In other words, according to the related art, in order to watch a stereoscopic image, the first and second cameras and a camera module (which may be mounted in the camera), a cable, a server computer, a shutter glass, etc. must be provided. there was.

The present invention is to solve the problems in the prior art as described above, by synthesizing the stereo image output in real time in real time compatible with the stereoscopic display device and outputting a stereoscopic image that can be viewed without having a separate viewing device The purpose is to provide an image synthesizing apparatus of a stereo camera.

According to a preferred embodiment of the present invention for achieving the above object, in the image synthesizing apparatus for synthesizing the images taken by the first and second camera, the image output from the first camera is a digital image A first camera signal processor converting the signal to the camera; A second camera signal processor configured to convert an image output from the second camera into a digital image; Stereoscopic image synthesizing means for synthesizing the images by receiving the processed images from the first and second signal processors; Provided is an image synthesizing apparatus for a stereo camera, comprising: a stereoscopic display apparatus for displaying stereoscopic image data transmitted from the stereoscopic image synthesizing means.

Preferably, the stereoscopic image synthesizing means comprises: an odd / even pixel selector for selecting odd or even pixels from the continuous digital image data output from the first camera signal processor; An odd / even pixel selector configured to select odd or even pixels from the continuous digital image data output from the second camera signal processor; A stereoscopic image synthesizing unit for synthesizing 1/2 left image pixel data and 1/2 right image pixel data output from each odd / even pixel selection unit in synchronization with a horizontal or vertical synchronization signal; And a video encoder for converting the digital stereoscopic image synthesized by the image synthesizing apparatus into various analog signals for transmission to the stereoscopic image display apparatus.

Preferably, the stereoscopic image synthesizing unit forms a stereoscopic image by selecting pixels having a delay of 1/2 left image_even pixels and 1/2 right image_odd pixels by two pixel times.

Also, preferably, the stereoscopic image synthesis unit forms a stereoscopic image by selecting 1/2 left image_odd pixel and 1/2 right image_even pixel.

Preferably, the stereoscopic image synthesizing unit forms a stereoscopic image by selecting a pixel in which the 1/2 left image_odd pixel and 1/2 right image_odd pixel are delayed by one pixel time.

Preferably, the stereoscopic image synthesizing unit forms a stereoscopic image by selecting a pixel having a delay of 1/2 left image_even pixels and 1/2 right image_even pixels by one pixel time.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is a schematic block diagram of a stereoscopic image synthesizing apparatus of a stereo camera system according to the present invention, FIG. 3 is a detailed block diagram of a stereoscopic image synthesizing means shown in FIG. 2, and FIG. Is a timing diagram showing the data processing flow in detail.

As shown in the drawing, the stereo camera system 500 according to an embodiment of the present invention outputs from the first and second cameras 100 and 110 and the first and second cameras 100 and 110 which respectively capture an image of an object. The stereoscopic image synthesizing unit 400 for processing an image, and the stereoscopic display device 300 is displayed is transmitted to the stereoscopic image synthesized from the stereoscopic image synthesizing unit 400 via a cable.

The stereoscopic image synthesis processing unit 400 may include first and second camera signal processing units 120 and 130 for converting images output from the first and second cameras 100 and 110 into digital images, respectively, and the first and second signals. It is composed of a three-dimensional image synthesizing means 200 for receiving the processed images from the processing unit (120,130) together to synthesize the image and output to the stereoscopic display device. In this case, the images output from the first and second camera signal processors 120 and 130 are left and right images 140 and 150, respectively.

In addition, the stereoscopic image synthesizing unit 200 has a function of converting and aligning the images output from the first camera signal processor 120 and the second camera signal processor 130 into an image format suitable for the stereoscopic display apparatus 300. Have.

The stereoscopic image synthesizing means 200 will be described with reference to FIG. 3 as follows.

Reference numeral 210 denotes an odd / even pixel selector. When a continuous image from the left image 140 output from the first camera signal processor 120 is applied in synchronization with a horizontal synchronization signal, an odd pixel and an even pixel are selected. Alternately, the even / odd pixel selector 220 is similar to the odd-numbered pixel when an image consecutive from the right image 150 output from the second camera signal processor 130 is applied in synchronization with a horizontal synchronization signal. Alternately selects even-numbered pixels. In this case, the right image 150 is delayed by one pixel time and output. The reason for this is to align the left image 140 and the right image 150 to have an image data structure equivalent to that of the stereoscopic display device 300.

As described above, the half-left image 230 and the half-right image 240 are made by the odd / even pixel selectors 210 and 220, respectively. In this case, the 1/2 left image 230 has an image generated in an odd unit and an even unit, and the 1/2 right image 240 is generated in an odd unit, and delayed by one pixel time therefrom. One, one delayed by two pixel times, one generated in even units, and one delayed by one pixel time are selected and output.

The six types of images generated as described above are appropriately combined by the stereoscopic image synthesizer 250 to create four kinds of stereoscopic images. That is, in the case of combining the image generated in the even unit among the 1/2 left image 230 and the image generated in the odd unit among the 1/2 right image 240, the odd unit among the 1, 1/2 left image 230. In the case of synthesizing an image generated by an even unit among an image generated by an image and a 1/2 right image 240, an image generated by an odd unit and a 1/2 right image 240 among 2 and 1/2 left images 230 In the case of synthesizing the image generated in the odd unit among the 3, 1/2 left image 230 to 4 in the case of combining the image generated in the even unit from the half-right image (240) Can be configured.

The generated stereoscopic image is output and displayed on the stereoscopic image display apparatus 300 through a video cable.

The stereoscopic display apparatus 300 is a display apparatus having a stereoscopic effect by displaying a left / right image in a stripe form in which an image pattern has a vertical pixel structure.

The pixel data timing diagram of the stereoscopic image synthesizing method through the stereoscopic image synthesizing apparatus in FIG. 3 will be described with reference to FIG. 4.

The sync signal a generally means a horizontal sync signal and is formed in line units to form one frame. At this time, the signal composed of one frame unit is a vertical synchronization signal.

In this way, the image pixels are sequentially arranged in the horizontal synchronization signal a. As shown in the left image c and the right image d, 1,2,3,4,5,6,7,... odd / even pixels, such as .n-1, n (where n stands for horizontal resolution) and a, b, c, d, e, f, g, m-1, m (where m stands for horizontal resolution) When applied to the selectors 210 and 220, the odd / even pixel selector 210 generates a half-left image 230 for the left image c. In this case, the odd pixels are selected and the even pixels are discarded. For example, if 1,3,5,7, n-1 is selected, 1/2 left image_odd (e) is selected. On the contrary, when even pixels are selected and odd pixels are discarded, 1 is displayed as 2,4,6, n. / 2 left image_even number (f) is selected and output, the odd / even pixel selector 220 generates a 1/2 right image 240 for the right image (d), where the odd pixel is selected If the even pixels are discarded, select the 1/2 right image odd g as a, c, e, g, m-1, and conversely, select the even pixels and discard the odd pixels b, d, f, Like m, the right half of the video is selected and output. And delays 1/2 right image_odd (g,) by one pixel time 1/2 right image_odd_delay1 (i) and 1/2 right image_even (h) by one pixel time 1/2 right image_odd_delay1 (j) is selected and 1/2 right image_odd_delay1 (j) is delayed by one pixel time. Select and print k). The reason for this is to facilitate the left / right arrangement of images in stereoscopic image synthesis.

Thus, the 1/2 left image_odd (e) and 1/2 left image_even (f) selected for the left image (c) and 1/2 right image_even (h) selected for the right image (d) ), 1/2 right image_odd_delay 1 (i), 1/2 right image_odd_delay (j), 1/2 right image_odd_delay 2 (k) 250), four kinds of stereoscopic image synthesis results are obtained as follows.

First 1/2 stereo image 1 (l) from 1/2 left image_even (f) and 1/2 right image_odd_delay 2 (k), second half image / odd (e) and 1 / 2 Stereoscopic image 2 (m) from right image_even (h), third stereoscopic image 3 (n) from 1/2 left image_odd (e) and 1/2 right image_odd_delay 1 (i) Finally, stereoscopic image 4 (o) is obtained from 1/2 left image_even (f) and 1/2 right image_even_delay 1 (j), respectively.

The stereoscopic images synthesized in the above four ways are, for example, when left and right images are alternately arranged in the horizontal scan line direction when displayed on a 15 "stereoscopic display device of 1024 * 768 pixels. The screen is configured in a form in which the left image and the right image are arranged in a line.

In addition, as described above, the embodiment of the present invention is characterized in that a three-dimensional screen is formed by using a screen configuration in pixel units and at the same time using a combination method (four in the embodiment).

According to the image synthesizing apparatus of the stereo camera according to the present invention as described above, by synthesizing the real-time stereoscopic image from the stereo camera, the stereoscopic image can be displayed on the real-time stereoscopic image display apparatus without cumbersome compositing process in a computer, and the image is synthesized by pixel unit. Therefore, it is a useful invention with high efficiency in implementing stereoscopic images.

Claims (6)

delete In the image synthesizing apparatus for synthesizing the images taken by the first and second camera, A first camera signal processor configured to convert the image output from the first camera into a digital image; A second camera signal processor configured to convert an image output from the second camera into a digital image; Stereoscopic image synthesizing means for synthesizing the images by receiving the processed images from the first and second signal processors; And a stereoscopic display device for displaying stereoscopic image data transmitted from the stereoscopic image synthesizing means. The stereoscopic image synthesizing means An odd / even pixel selector for selecting odd or even pixels from the continuous digital image data output from the first camera signal processor; And An odd / even pixel selector configured to select odd or even pixels from the continuous digital image data output from the second camera signal processor; A stereoscopic image synthesizing unit for synthesizing 1/2 left image pixel data and 1/2 right image pixel data output from each odd / even pixel selection unit in synchronization with a horizontal or vertical synchronization signal; And a video encoder for converting the digital stereoscopic image synthesized by the image synthesizing apparatus into various analog signals for transmission to a stereoscopic image display apparatus. The stereoscopic image synthesizer of claim 2, wherein the stereoscopic image synthesizer forms a stereoscopic image by selecting a pixel having a delay of 1/2 left image_even pixels and 1/2 right image_odd pixels by two pixel times. Camera's video synthesis device. The image synthesizing apparatus of claim 2, wherein the stereoscopic image synthesizer forms a stereoscopic image by selecting 1/2 left image_odd pixel and 1/2 right image_even pixel. 3. The stereoscopic image synthesizer of claim 2, wherein the stereoscopic image synthesizer forms a stereoscopic image by selecting a pixel having a delay of 1/2 left image_odd pixel and 1/2 right image_odd pixel by one pixel time. Camera's video synthesis device. The stereoscopic image synthesizing unit forms a stereoscopic image by selecting a pixel having a delay of 1/2 left image_even pixels and 1/2 right image_even pixels by one pixel time. Video synthesis device of stereo camera.

Images