KR20100130723A - Apparatus and methof for processing a stereoscopy - Google Patents

Abstract

PURPOSE: A three-dimensional image processing device and a method are provided to provide various three-dimensional image output according to new three-dimensional image format. CONSTITUTION: A three-dimensional image processing apparatus is inputted a left-eyed image and a right-eyed image(S110). The three-dimensional image processing apparatus generates a first three-dimensional image signal by left/right eyed signals of odd numbered line in the left/right eyed video(S120). The three-dimensional image processing apparatus generates the second three-dimensional image signal by the left/right eyed signals of even numbered line in the left/right eyed video(S130). The three-dimensional image processing apparatus successively processes the first and the second 3D video signal(S140).

Description

Apparatus and Methof for processing a stereoscopy

The present invention relates to an image, and more particularly, to an apparatus and method for processing a stereoscopic image.

In general, stereoscopy is performed based on the principle of stereo vision through two eyes of a person. The binocular parallax that appears because the eyes are about 65 mm apart is the most important factor of the stereoscopic effect. .

The stereoscopic image display includes a display using glasses and a non-glasses type display, and a display without glasses is used to obtain a stereoscopic image by separating left and right images without using glasses.

In the spectacle method, the polarization directions of the left and right parallax images are displayed on the direct view display or the projector in a time-division manner, and the stereoscopic images are viewed using polarized glasses or liquid crystal shutter glasses.

For example, there are parallax barriers, lenticular, and polarization multiplexing methods.

1 illustrates various conventional stereoscopic image formats.

As shown in FIG. 1, a stereoscopic image has various formats according to a single stream or a multistream, and a stereoscopic image generated for a specific system cannot be used in another system.

For example, a display device that outputs a top / down stereoscopic image may not output a side by side format stereoscopic image.

It is an object of the present invention to provide a stereoscopic image processing apparatus and method for providing a new stereoscopic image format and providing various stereoscopic image outputs using the stereoscopic image format.

According to an aspect of the present invention, there is provided a stereoscopic image processing apparatus comprising: an input unit to which left and right eye images are input; A first generator configured to generate a first stereoscopic image signal using the left and right eye signals of an odd-numbered line in the input left and right eye images; A second generator configured to generate a second stereoscopic image signal by using left and right eye signals of an even-numbered line in the input left and right eye images; And a stereoscopic image processor sequentially processing the first and second stereoscopic image signals generated by the first and second generators.

In this case, the first generator generates a first stereoscopic image signal by alternately synthesizing the left and right eye signals of the odd-numbered line by line, and the second generator generates the left and right eye signals of the even-numbered line. By synthesizing alternately in units to generate a second stereoscopic image signal.

The stereoscopic image processing unit may further include: a separator configured to sequentially separate left and right eye signals from first and second stereoscopic image signals; A de-interlacer for de-interlacing the separated left and right eye signals; A first scaler configured to scale the deinterlaced left eye signals; And a second scaler configured to scale the deinterlaced right eye signals.

In addition, the stereoscopic image processing method according to the present invention comprises the steps of receiving a left eye image and a right eye image; Generating a first stereoscopic image signal using left and right eye signals of an odd-numbered line in the left and right eye images; Generating a second stereoscopic image signal using left and right eye signals of an even line in the left eye and right eye images; And sequentially processing the generated first and second stereoscopic image signals.

The stereoscopic image processing apparatus and method according to the present invention have the effect of providing a new stereoscopic image format and providing various stereoscopic image outputs according to the stereoscopic image format.

Hereinafter, the stereoscopic image processing apparatus 100 according to the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "unit" for components used in the following description are given or mixed in consideration of ease of specification, and do not have distinct meanings or roles from each other.

Prior to describing the present invention, the stereoscopic image processing apparatus 100 according to the present invention includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a liquid crystal display (LCD), and a plasma (PDP). It will be readily apparent to those skilled in the art that the display panel, projector, personal digital assistants (PDA), portable multimedia player (PMP), navigation, or the like may be built in or external to the terminal.

Hereinafter, a stereoscopic image processing apparatus and method according to the present invention will be described in detail with reference to the drawings.

2 is a block diagram of an embodiment of a stereoscopic image processing apparatus according to the present invention.

3 is a block diagram illustrating an embodiment of the first and second generators according to the present invention.

4 is a flowchart illustrating a stereoscopic image processing method according to the present invention.

2 to 4, the stereoscopic image processing apparatus 100 according to the present invention includes a communication unit 110, a memory 120, an input unit 130, and a first and second generation unit 140. 150 and the stereoscopic image processor 160.

Of course, the stereoscopic image processing apparatus 100 according to the present invention may be configured to include other than the above-described components as necessary, but other than the above-described components are not directly related to the present invention. For the sake of simplicity, a detailed description thereof will be omitted below.

On the other hand, it should be noted that the components may be configured by combining two or more components into one component, or one component may be subdivided into two or more components as necessary when implemented in actual applications.

Hereinafter, components of the stereoscopic image processing apparatus 100 according to the present invention will be described in sequence.

The communication unit 110 receives left and right eye images for generating stereoscopic images from an external communication server or receives left and right eye images for generating stereoscopic images from an external broadcasting center.

The memory 120 includes left and right eye image sources for generating stereoscopic images, and also stores left and right eye sources received by the communication unit 110.

The input unit 130 receives and outputs left and right eye image sources stored in the communication unit 110 or the memory 120 [S110].

The first generator 140 generates a first stereoscopic image signal using left and right eye signals of odd-numbered lines from the left and right eye images input through the input unit 130 [S120].

The second generator 150 generates a second stereoscopic image signal using left and right eye signals of even-numbered lines from the left and right eye images inputted through the input unit 130 [S130].

Referring to FIG. 3, the first generator 140 includes a first extractor 141 and a first synthesizer 142, and the second generator 150 includes a second extractor 151 and a second extractor 151. And a synthesizer 152.

In this case, the first extractor 141 extracts the left eye signals and the right eye signals of an odd-numbered line from the input left eye and right eye images, and outputs the same to the first synthesizer 142. The extracted left eye signals and the right eye signals are multiplexed to generate a first stereoscopic image signal. That is, the first synthesizer 142 alternately synthesizes the left eye and right eye signals of the odd-numbered lines in line units to generate a first stereoscopic image signal.

In addition, the second extractor 151 extracts the left eye signals and the right eye signals of the even-numbered line from the input left eye and right eye images, and outputs them to the second synthesizer 152, and the second synthesizer 152 extracts the extracted eye. The left eye signals and the right eye signals of the even-numbered line are alternately synthesized in line units to generate a second stereoscopic image signal.

The stereoscopic image processor 160 performs the following image processing operations on the first and second stereoscopic image signals generated by the first and second generators 140 and 150.

That is, the stereoscopic image processor 160 may use the separator 161, the de-interlacing 162, the first and second scalers 163 and 164, and the output controller 165. It is configured to include.

Hereinafter, the components of the stereoscopic image processor 160 will be described in detail.

The separator 161 sequentially separates left and right eye signals from the first and second stereoscopic image signals generated by the first and second generators [S140].

The deinterlacer 162 de-interlaces the left and right eye signals separated by the separator 151 [S150].

The first scaler 163 scales the left eye signals deinterlaced by the deinterlacer 162, and the second scaler 164 processes the right eye signals deinterlaced by the deinterlacer 162 [S160]. .

The output controller 165 reconstructs the left and right eye signals scaled by the first and second scalers 163 into a stereoscopic image format reproducible in an output device connected to the stereoscopic image processing apparatus 100 according to the present invention. [S170].

Hereinafter, the stereoscopic image processing process according to the present invention will be described in detail with reference to FIG. 5.

5 is a view for explaining a process of processing left and right eye signals according to the present invention.

First, reference numeral '10' of FIG. 5A illustrates first left eye images and first right eye images 11 and 12 for generating a stereoscopic image signal according to the present invention.

In addition, reference numeral '20' of FIG. 5B illustrates second left eye images and second right eye images 21 and 22 for generating a stereoscopic image signal according to the present invention.

Referring to FIG. 5C, the first generation unit 140 may be left eye signals of odd-numbered lines in the first left eye image and the first right eye image 11 and 12 illustrated in FIG. 5A. "L ₁ _odd_1" and "L ₁ _odd_3" and odd-numbered lines of right eye signals "R ₁ _odd_1" and "R ₁ _odd_3" are extracted, and the extracted left and right eye signals "L ₁ _odd_1" and " L ₁ _odd_3 ”,“ R ₁ _odd_1 ”, and“ R ₁ _odd_3 ”are alternately synthesized in line units to generate the first stereoscopic image signal 30 as shown in FIG.

Also, referring to FIG. 5D, the second generation unit 140 may include the left eye of the even-numbered line in the second left eye image and the second right eye image 21 and 22 illustrated in FIG. 5B. The signals "L ₂ _odd_2" and "L ₂ _odd_4" and the even-numbered right eye signals "R ₂ _odd_2" and "R ₂ _odd_4" are extracted, and the extracted left and right eye signals "L ₂ _odd_2". and generates the second three-dimensional image signal 40 as shown in the _{"L 2 _odd_4", "R} 2 _odd_2", "R 2 _odd_4" to be alternatively synthesized by a line unit 5 (d).

In this case, the first and second stereoscopic image signals 30 and 40 are sequentially input to the separator 161.

That is, referring to (e) of FIG. 5, the image processor 160 may extract the left eye signals 51 and the right eye signals 52 from the first stereoscopic image signal 30 generated in FIG. 5 (c). The left and right eye signals 51 and 52 separated from the first stereoscopic image signal 30 are deinterlaced and scaled.

In addition, referring to FIG. 5F, the image processor 160 may extract the left eye signals 61 and the right eye signals 62 from the second stereoscopic image signal 40 generated in FIG. 5D. The left eye and right eye signals 61 and 62 separated from the second stereoscopic image signal 40 are deinterlaced and scaled.

Left and right eye signals scaled in FIGS. 5E and 5F are reconstructed in a stereoscopic image format reproducible in an output device (not shown) connected to the stereoscopic image processing apparatus 100 according to the present invention.

In this case, when the output device supports a stereoscopic image in a single stream format, only one of the outputs ⑥ and ⑦ shown in FIG. 1 may be used or the same signal may be used as two outputs.

In addition, when the output device supports a stereoscopic image in a multi-stream format, the outputs 6 and 7 shown in FIG. 1 may be used as different signals.

For example, assuming that 1 of FIG. 1 is a first stereoscopic image signal 30 and a resolution of 1080i, and a signal desired to output 6 and 7 of FIG. 1 is 1080p.

That is, the signal ② is a left eye 1080i signal, the signal ③ is a right eye 1080i signal, the signal ② is deinterlaced and scaled ④ becomes a left eye 1080p signal, and the signal ③ is deinterlaced and scaled is a right eye 1080p signal.

That is, since the left and right eye images of (2) and (3) are respectively scaled, desired output signals having a resolution of 1080P are output as the output signals 6 and 7.

Hereinafter, the stereoscopic image reconstruction process of the output controller 165 will be described in detail with reference to FIGS. 6 to 10.

6 to 10 are diagrams for describing a process of reconfiguring various stereoscopic image formats by using left and right eye signals output from the first and second scalers.

First, FIG. 6 illustrates reconstructing left and right eye signals output from the first and second scalers 163 and 164 into a side by side stereoscopic image format of a single stream in the output controller 165. have.

That is, the odd-numbered columns “L ₁ ” and “L ₃ ” among the scaled ④ left eye signals of FIG. 6 and the even-numbered columns “R ₂ ” and “R ₄ ” among ⑤ right eye signals By combining, the side-by-side stereoscopic video format of a single stream, which is a 6) output format, can be configured.

Next, FIG. 7 shows the left and right eye signals output from the first and second scalers 163 and 164 in the output controller 165 in a single stream of Top / Down stereoscopic image format. The configuration is shown.

That is, by combining the odd-numbered lines “L ₁ ” and “L ₃ ” of the scaled ④ left eye signal of FIG. 7 and the “R ₂ ” and “R ₄ ”, even-numbered lines of the right eye signal, A single stream top / down stereoscopic video format may be configured.

Next, FIG. 8 illustrates reconstruction of the left eye and right eye signals output from the first and second scalers 163 and 164 into the single stream interlaced stereoscopic image format at the output controller 165. have.

That is, by combining the odd-numbered lines “L ₁ ” and “L ₃ ” of the scaled ④ left eye signal of FIG. 8 with the even-numbered lines “R ₂ ” and “R ₄ ” of the right ④ signal, A single stream interlace stereoscopic video format may be configured.

Next, FIG. 9 illustrates reconstruction of ④ left eye and ⑤ right eye signals output from the first and second scalers 163 and 164 into a multi-stream full left eye / right eye stereoscopic image format by the output controller 165. have.

That is, by bypassing the scaled ④ left eye signal and ⑤ right eye signal of FIG. 9, the full left eye / right eye stereoscopic image format of the multi stream ⑥ ⑦ output format can be configured.

Next, FIG. 10 illustrates reconstruction of ④ left eye and ⑤ right eye signals output from the first and second scalers 163 and 164 into a multi-stream full left eye / half right eye stereoscopic image format by the output controller 165. Doing.

That is, the scaled ④ left eye signal of FIG. 10 bypasses and ⑤ the right eye signal extracts only half of the input signal, thereby forming a multi-stream full left eye / half right eye stereoscopic image format ⑥ ⑦ output format. Can be.

It will be apparent to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit and essential features of the present invention.

Accordingly, the above detailed description should not be construed as limiting in all aspects and should be considered as illustrative.

The scope of the invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

1 illustrates various conventional stereoscopic image formats.

2 is a block diagram of an embodiment of a stereoscopic image processing apparatus according to the present invention.

3 is a block diagram illustrating an embodiment of the first and second generators according to the present invention.

4 is a flowchart illustrating a stereoscopic image processing method according to the present invention.

5 is a view for explaining a process of processing left and right eye signals according to the present invention.

6 to 10 are diagrams for describing a process of reconfiguring various stereoscopic image formats by using left and right eye signals output from the first and second scalers.

Claims (10)

Receiving a left eye image and a right eye image; Generating a first stereoscopic image signal using left and right eye signals of an odd-numbered line in the left and right eye images; Generating a second stereoscopic image signal using left and right eye signals of an even line in the left and right eye images; And And sequentially processing the generated first and second stereoscopic image signals. The method of claim 1, wherein the generating of the first stereoscopic image signal comprises: Extracting left eye signals and right eye signals of an odd-numbered line from the left eye and right eye images; And multiplexing the extracted left eye signals and right eye signals. The method of claim 2, In the multiplexing step, the extracted left eye signals and the right eye signals are alternately synthesized in units of lines. The method of claim 1, wherein the generating of the second stereoscopic image signal comprises: Extracting left eye signals and right eye signals of an even-numbered line from the left eye and right eye images; And multiplexing the extracted left eye signals and right eye signals. The method of claim 2, In the multiplexing step, the extracted left eye signals and the right eye signals are alternately synthesized in units of lines. The image processing method of claim 1, wherein the image processing step comprises: Separating left and right eye signals sequentially from the first and second stereoscopic image signals; De-interlacing the separated left and right eye signals; And And scaling the deinterlaced left and right eye signals. An input unit for inputting left and right eye images; A first generator configured to generate a first stereoscopic image signal using the left and right eye signals of an odd-numbered line in the input left and right eye images; A second generator configured to generate a second stereoscopic image signal using the left and right eye signals of an even-numbered line in the input left eye and right eye images; And And a stereoscopic image processor sequentially processing the first and second stereoscopic image signals generated by the first and second generators. 8. The method of claim 7, And the first generating unit generates a first stereoscopic image signal by alternately synthesizing the left and right eye signals of the odd-numbered line in line units. 8. The method of claim 7, And the second generating unit generates a second stereoscopic image signal by alternately synthesizing the left and right eye signals of the even-numbered line in line units. The method of claim 7, wherein the stereoscopic image processing unit, A separator that sequentially separates left and right eye signals from the first and second stereoscopic image signals; A deinterlacer for de-interlacing the separated left and right eye signals; A first scaler configured to scale the deinterlaced left eye signals; And And a second scaler configured to scale the deinterlaced right eye signals.

Images