KR20050078737A - Apparatus for converting 2d image signal into 3d image signal - Google Patents

Abstract

A two-dimensional video signal photographed by a recording device such as a video camera or a camcorder is converted into a three-dimensional video signal.

The frame storage means divides and stores the photographed 2D video signal in units of frames. The pixel value extracting unit extracts values of each pixel of the 2D video signal stored in units of frames. Comparing the reference value and generating a plurality of windows according to the comparison result, merging windows having a pixel number equal to or smaller than the reference pixel number determined by the window converter by determining the number of pixels of each generated window to an adjacent window, and constructing a merged window. The reference point setting unit sets one pixel having the vertically lowest position coordinate among the pixels to be a reference point, and the depth map generator generates each window using the horizontal width of the window output from the window converter and the reference point set by the reference point setting unit. Creates a depth map of the, and the depth generated by the depth map generator In accordance with the present invention, the parallax processing unit converts the frame video signal output from the frame storage unit into a 3D video signal by parallax processing, compresses the frame video signal into an MPEG signal, and stores it in the storage medium.

Description

Apparatus for converting 2D image signal into 3D image signal}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus for converting a 2D video signal into a 3D video signal, and in particular, converts a 2D video signal photographed by a photographing device such as a video camera and a camcorder into a 3D video signal, and then, The present invention relates to an apparatus for converting a 2D video signal, which is compressed into a 3D video signal and stored in a predetermined storage medium, into a 3D video signal.

3D image technology is one of the next generation information and communication services, one of the high-tech advanced technologies with high demand and fierce competition in technology development. In addition, 3D imaging technology can be used in various fields such as information communication, broadcasting, medical care, education and training, military, games, animation, virtual reality, CAD, and industrial technology. It is the core base technology of 3D stereoscopic multimedia information communication that provides the next-generation presence that is commonly required in the world.

In general, the information that people actually see a certain object through their eyes is a three-dimensional image, so in the video system, much effort is made to make it look more natural and closer to the scene of the natural world that people see everyday. Currently, many countries in the world are developing realistic 3D stereoscopic multimedia services that can be viewed and enjoyed more naturally and realistically from 3D information-oriented multimedia services.

Three-dimensional information technology is the next generation of high value-added core technology. Many countries are competing for the practical use of three-dimensional information technology in terms of technology preoccupation in the future information and communication market. In addition, since 3D information technology is in the early stages of technology development worldwide, it is still less dependent on foreign technology and is expected to be a promising technology that can possess Korea's own technology.

Therefore, one of the three-dimensional information technology to preoccupy the front in the Republic of Korea is a technology that automatically converts a two-dimensional video signal to a three-dimensional video signal in real time.

People can see a given object in three dimensions by binocular disparity, which is when a human sees the same object and sees different images through his right and left eyes. These two different images are made into one stereoscopic image in the brain.

However, since video display devices such as a television receiver or a monitor display a two-dimensional image on a plane, both the left and right eyes see the same image, and thus the user cannot feel the stereoscopic effect when viewing an object on a daily basis.

Therefore, in order to allow a user to feel a stereoscopic effect when viewing a predetermined image on a television receiver or a monitor, conventionally, a stereoscopic camera is used to make a three-dimensional image or to manually generate a two-dimensional image signal by using a three-dimensional image signal. Converted to.

However, the above-described conventional technology consumes a lot of cost and time, and thus, it is impossible to convert a vast amount of existing two-dimensional image signals into three-dimensional image signals. Above all, the converted 3D video signal is very expensive, and thus, the general user may not be effective because a predetermined medium storing the 3D video signal is considerably more expensive than the 2D video signal.

In addition, the conventional 3D image is separated into a left eye image and a right eye image in consideration of the convergence of both eyes and the parallax of both eyes in a planar image of 2D in advance, or after taking images according to the binocular disparity with a left eye and right eye camera, There is a need for converting a 3D image having a parallax.

Therefore, in order to watch 3D still images and moving pictures, not only a 3D image reproducing apparatus but also a 3D image source must be prepared in advance.

An object of the present invention is to provide an apparatus for converting a 2D video signal into a 3D video signal, which simply converts the 2D video signal into a 3D video signal.

Another object of the present invention is to provide an apparatus for converting a 2D video signal photographed by applying to a recording means such as a video camera and a camcorder into a 3D video signal.

The apparatus for converting a 2D video signal of the present invention having the above object into a 3D video signal includes frame storage means for dividing and storing an input 2D video signal in units of frames, and stored in units of frames in the frame storage means. A pixel value extractor for extracting values of pixels of the 2D video signal, a window generator for comparing the pixel values extracted by the pixel value extractor with a preset reference value and generating a plurality of windows according to a comparison result; A window converter which determines the number of pixels of each of the windows generated by the generator and merges windows having the determined number of pixels or less to a reference number of pixels into an adjacent window; and among the pixels constituting the window output from the window converter. Reference point setting unit that sets one pixel having the lowest position coordinate as a reference point A depth map generator for generating a depth map of each window by using a horizontal width of the window output from the window converter and a reference point set by the reference point setting unit, and a depth map of the frame image signal output from the frame storage unit; Characterized in that it comprises a parallax processing unit for converting the parallax processing according to the depth generated by the generation unit into a three-dimensional image signal.

The frame storage means may include a demultiplexer for switching a 2D video signal in units of frames, first and second memories alternately storing a 2D video signal switched in units of frames in the demultiplexer, and the first and second memories. A multiplexer that alternately selects two-dimensional image signals in frame units stored in a memory and outputs them to the color comparator, and a third memory that stores two-dimensional image signals in frame units output from the multiplexer and outputs them to the parallax processor Characterized in that configured.

The pixel value extracting unit includes a plurality of buffers for storing values of each pixel output from the frame storing unit, and an adder for extracting pixel values by adding values of pixels stored in the plurality of buffers. And adding the value of the upper 4 bits of the pixel.

The window generating unit may include: a comparator comparing the values of the pixels extracted by the pixel value extracting unit with a preset reference value; a memory storing a comparison result value of the comparator; and a consecutive value having the same value among the values stored in the memory. It is characterized by consisting of a window output unit for extracting the extracted area and output to the window.

The window converter may include a pixel number calculator that calculates the number of pixels constituting each window generated by the window generator, and a comparator that compares the number of pixels calculated by the pixel number calculator with a preset number of reference pixels. And a window merging unit for merging windows having a reference number of pixels less than or equal to the comparison result with adjacent windows.

The depth map generator may include: a maximum horizontal width determiner configured to determine a maximum horizontal width of each window output from the window converter; a reference point determiner configured to determine reference points of respective windows set by the reference point setter; The depth map determiner determines the depth of each window according to the horizontal width of each window determined by the maximum horizontal width determiner and the position of the reference point determined by the reference point determiner and outputs the depth map to the parallax processor. If the object is located on the bottom of the screen with reference to the reference point, set it to near, and if the object is located on the screen, set the distance to a long distance.If the horizontal diameter is narrow while including both the top and bottom of the screen, If set to near and wide horizontal diameter including both the top and bottom of the screen To it characterized in that it is set to a distance.

In another aspect, the present invention further comprises a photographing means for photographing a predetermined subject and outputting a 2D image signal, and an analog / digital converter for converting the 2D image signal output by the photographing means into a digital signal and outputting the digital signal to the frame storage means. And an MPEG encoder for encoding the 3D video signal output from the parallax processor as an MPEG signal, and a storage medium for storing the 3D video signal encoded as the MPEG signal in the MPEG encoder. Is an R, G, B signal or a Y, Cr, Cb signal.

Hereinafter, an apparatus for converting a 2D video signal to a 3D video signal of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing the configuration of an apparatus for converting a 2D video signal to a 3D video signal of the present invention. As shown in the drawing, the photographing means 100 generates a 2D video signal by photographing a predetermined subject, and an analog / digital converter converting the 2D video signal output from the photographing means 100 into a digital video signal. And a frame storage unit 130 for storing and outputting the two-dimensional image signal output from the analog / digital converter 110 in units of frames under the control of the controller 120 and outputting the frame. And a pixel value extractor 140 for extracting the values of the pixels of the 2D video signal output from the means 130 in units of frames, and a pixel value extracted by the pixel value extractor 140 with a preset reference value. According to the comparison result, the window generator 150 generating a plurality of windows and the number of pixels of each window generated by the window generator 150 are determined and the number of determined pixels is equal to or less than a reference pixel number. A reference point for setting a reference point as a reference point for the window converter 160 merging the windows into adjacent windows and one pixel having a vertically lowest position coordinate among pixels constituting the window output from the window converter 160 A depth map generator 180 for generating a depth map of each window using a setting unit 170, a horizontal width of the window output from the window converter 160, and a reference point set by the reference point setting unit 170, A parallax processor 190 for parallaxing a frame image signal output from the frame storage unit 130 to a 3D image signal according to a depth map generated by the depth map generator 180 and the parallax; An MPEG encoder 200 for encoding a 3D video signal output from the lex processor 190 into an MPEG signal, and a 3D video signal encoded with an MPEG signal from the MPEG encoder 200. It was composed of a sheet storage medium (210).

The frame storage unit 130, the demultiplexer 131 for switching the image signal output from the analog / digital converter 110 in units of frames under the control of the control unit 120, and the frame in the demultiplexer 131 First and second memory 133 and 135 for alternately storing the video signal output in the unit and the video signal of the frame unit stored in the first and second memory 133, 135 are alternately selected The multiplexer 137 outputs to the color pixel generator 140 and a third memory 139 for storing image signals in units of frames output from the multiplexer 137 and outputting the image signals to the parallax processor 190. Configured.

As illustrated in FIG. 2, the pixel value extractor 140 stores a plurality of buffers for storing digital image signals output from the frame storage unit 130, that is, R, G, and B signals or Y, Cr, and Cb signals. 141, 143, and 145, and an adder 147 for extracting pixel values by adding video signals of higher four bits among the video signals stored in the buffers 141, 143, and 145.

The window generator 150 may include a comparator 151 for comparing the value of each pixel extracted by the pixel value extractor 140 with a preset reference value, and a memory for storing a comparison result value of the comparator 151. 153 and a window output unit 155 which extracts a continuous area having the same value among the values stored in the memory 153 and outputs it to the window.

As illustrated in FIG. 4, the window converter 160 includes a pixel number calculator 161 for calculating the number of pixels constituting each window generated by the window generator 150, and the pixel number calculator. A comparator 163 for comparing the number of pixels calculated in the unit 161 with a preset number of reference pixels, and a window merging unit for merging windows having a reference number of pixels less than or equal to the comparison result of the comparator 163 into adjacent windows ( 165).

As illustrated in FIG. 5, the depth map generator 180 may determine a maximum horizontal width determiner 181 for determining a maximum horizontal width of each window output from the window converter 160, and set the reference point. The reference point determination unit 183 determines the reference points of the respective windows set by the unit 170, the horizontal width of each window determined by the maximum horizontal width determination unit 181, and the reference point determined by the reference point determination unit 183. The depth map determiner 185 determines the depth of each window according to the position and outputs the depth to the parallax processor 190.

In the apparatus for converting a 2D video signal of the present invention configured as described above into a 3D video signal, the photographing means 100 photographs a predetermined subject to output a 2D video signal, and the photographing means 100 outputs 2D. The 3D video signal is converted into a digital signal by the analog / digital converter 110 and output.

The two-dimensional image signal output from the analog / digital converter 110 is switched in units of frames in the demultiplexer 131 of the frame storage unit 130 under the control of the controller 120, and thus, the first memory 133 and the first memory 133 are controlled. The two-dimensional image signal that is alternately stored in the second memory 135 and output, and alternately output to the first memory 133 and the second memory 135 is selected by the multiplexer 137 to be the third memory 139. It is stored in, and input to the pixel value extraction unit 140. That is, when the two-dimensional image signal of one frame output from the demultiplexer 131 is stored in the first memory 133, the two-dimensional image signal of the previous frame stored in the second memory 135 is multiplexer 137. ) Is input to the third memory 139 and the pixel value extractor 140, and then a two-dimensional image signal of one frame, which is output from the demultiplexer 131, is stored in the second memory 135. The 2D image signal of the immediately preceding frame stored in the memory 133 is input to the third memory 139 and the pixel value extractor 140 through the multiplexer 137.

In this state, the pixel value extractor 140 buffers an input two-dimensional image signal, that is, an 8-bit R, G, B signal or an 8-bit Y, Cr, and Cb signal as shown in FIG. 2. 141, 143, and 145, and the upper four bits of the video signals stored in the buffers 141, 143, and 145 are added to the adder 147 to extract values of respective pixels.

The pixel value extracted by the pixel value extractor 140 is input to the window generator 150. The window generator 150 includes a comparator 151 as shown in FIG. 3 and a pixel value extractor 140. The value of each pixel input from the device is compared with a preset reference value, and the comparison result value is stored in the memory 153. When the comparison result value of one frame is stored in the memory 153, the window output unit 155 distinguishes an area where a pixel value is larger than a reference value and an area smaller than the reference value, and divides the respective areas into respective windows. Will output That is, the window generator 150 sets and outputs each of the background screen and the plurality of objects displayed on the screen of the video signal as the respective windows.

Each window generated by the window generator 150 is input to the pixel number calculator 161 of the window converter 161 to calculate the number of pixels forming each window, and the calculated number of pixels of the window. And the reference pixel number are compared with the comparator 163, and the window merging unit 165 merges the windows according to the comparison result of the comparator 163. That is, among the plurality of windows generated by the window generator 150, windows having small sizes are merged into adjacent windows.

The windows converted by the window converter 160 are input to the reference point setter 170 and the depth map generator 180, and the reference point setter 170 selects one pixel from the pixels constituting each window. In other words, when a window is displayed on the screen, one pixel located at the lowest point in the vertical direction from the screen coordinates is set as the reference point and is output to the depth map generator 180.

Then, the depth map generator 180 determines the maximum horizontal width of each window input from the window converter 160 by the maximum horizontal width determiner 181, and sets the reference point setting unit 170. The reference point determiner 183 determines the reference points of the windows, and the depth map determiner 185 determines the depth map of each window according to the determined horizontal width and the reference point. That is, the depth map determiner 185 sets the objects located below to the near point based on the reference point, and sets the objects located above to the far distance, and the extracted objects both above and below the screen. If the horizontal diameter is narrow while it is included, set it to near, and set it as the distance when the horizontal diameter is wide to distinguish the background from the object.

When the depth map is determined in this way, the parallax processing unit 190 converts the 2D video signal of the frame unit stored in the third memory 139 into a 3D video signal by parallaxing it according to the determined depth map. In the 2D video signal, the background is processed with a positive parallax, the objects are processed with a negative parallax, converted into a 3D video signal, and the converted 3D video signal is encoded as an MPEG signal by the MPEG encoder 200. It is stored in the storage medium 210.

As described above, the present invention distinguishes objects and sets windows using pixel values of a 2D video signal, generates a depth map with reference points and horizontal widths of each window, and generates a 2D image according to the generated depth map. Parallaxing the signal and converting the signal into a 3D image signal may be applied to a 2D image photographing device to convert the captured 2D image signal into a 3D image signal.

1 is a block diagram showing the configuration of a device for converting a two-dimensional video signal of the present invention to a three-dimensional video signal.

FIG. 2 is a detailed block diagram of a pixel value extractor of FIG. 1. FIG.

3 is a detailed block diagram of the window generating unit of FIG. 1;

FIG. 4 is a detailed block diagram of the window converter of FIG. 1. FIG.

FIG. 5 is a detailed block diagram of the depth map generator of FIG. 1. FIG.

Explanation of symbols on the main parts of the drawings

100: recording means 110: analog / digital conversion unit

120: control unit 130: frame storage means

131: demultiplexer 133, 135, 139: first to third memories

137: multiplexer 140: pixel value extraction unit

141, 143, 145: buffer 147: adder

150: window generator 151, 163: comparator

153: pixel value memory 155: window output unit

160: window converting unit 161: pixel number calculating unit

165: window merge unit 170: reference point setting unit

180: depth map generator 181: maximum horizontal width determination unit

183: reference point determination unit 185: depth map determination unit

190: Parallax processing unit 200: MPEG encoder

210: storage medium

Claims (11)

Frame storage means for dividing and storing the input 2D video signal in units of frames; A pixel value extracting unit extracting values of respective pixels of the 2D video signal stored in the frame unit in the frame storage unit; A window generator for comparing the pixel value extracted by the pixel value extractor with a preset reference value and generating a plurality of windows according to a comparison result; A window converter for determining the number of pixels of each of the windows generated by the window generator and merging windows having the determined number of pixels or less to a reference pixel to an adjacent window; A reference point setting unit that sets one pixel having a vertically lowest position coordinate among pixels constituting the window output from the window converter as a reference point; A depth map generator configured to generate a depth map of each window using a horizontal width of the window output from the window converter and a reference point set by the reference point setter; And Converting a 2D video signal composed of a parallax processor to parallax the 3D video signal according to the depth generated by the depth map generator and converting the frame video signal output from the frame storage unit into a 3D video signal Device. The method of claim 1, wherein the frame storage means; A demultiplexer for switching two-dimensional image signals in units of frames; First and second memories configured to alternately store a 2D video signal switched in units of frames in the demultiplexer; A multiplexer which alternately selects two-dimensional image signals of frame units stored in the first and second memories and outputs the two-dimensional image signals to the color comparator; And And a third memory for storing the 2D video signal in the unit of frame output from the multiplexer and outputting the 2D video signal to the parallax processing unit. The display apparatus of claim 1, wherein the pixel value extractor; A plurality of buffers for storing the value of each pixel output from the frame storage means; And And an adder for extracting pixel values by adding pixel values stored in each of the plurality of buffers. The method of claim 3, wherein the adder; An apparatus for converting a two-dimensional video signal into a three-dimensional video signal, characterized in that the value of the upper four bits of the pixel is added. The method of claim 1, wherein the window generating unit; A comparator for comparing the value of each pixel extracted by the pixel value extractor with a preset reference value; A memory for storing a comparison result value of the comparator; And And a window output unit for extracting a continuous area having the same value among the values stored in the memory and outputting the same to a window. The method of claim 1, wherein the window converter; A pixel number calculator configured to calculate the number of pixels constituting each window generated by the window generator; A comparator for comparing the number of pixels calculated by the pixel number calculator with a preset number of reference pixels; And And a window merging unit for merging a window having a reference pixel count or less into an adjacent window as a result of the comparison of the comparator. The apparatus of claim 1, wherein the depth map generator; A maximum horizontal width determining unit determining a maximum horizontal width of each window output from the window converting unit; A reference point determination unit which determines reference points of respective windows set by the reference point setting unit; And a depth map determiner for determining the depth of each window according to the horizontal width of each window determined by the maximum horizontal width determiner and the position of the reference point determined by the reference point determiner and outputting the depth to the parallax processor. Apparatus for converting a video signal into a three-dimensional video signal. 8. The apparatus of claim 7, wherein the depth map determiner; Set to near if the object is located on the bottom of the screen based on the reference point, set to far if the object is located on the screen, and close if the horizontal diameter is narrow while including both the top and bottom of the screen. The apparatus for converting a two-dimensional video signal into a three-dimensional video signal, characterized in that it is set to, and set to a long distance when the horizontal diameter is wide, including both the top and bottom of the screen. The method of claim 1, Photographing means for photographing a predetermined subject and outputting a two-dimensional image signal; And And an analog / digital converter for converting the 2D video signal output by the photographing means into a digital signal and outputting the digital signal to the frame storage means. The method of claim 1, An MPEG encoder for encoding the 3D video signal output from the parallax processor into an MPEG signal; And And a storage medium for storing the 3D video signal encoded by the MPEG signal in the MPEG encoder. The apparatus of claim 1, wherein the video signal comprises: a video signal; An apparatus for converting a 2D video signal into a 3D video signal, wherein the 2D video signal is an R, G, B signal or a Y, Cr, Cb signal.