CN102404583A - Depth reinforcing system and method for three dimensional images - Google Patents

Depth reinforcing system and method for three dimensional images Download PDF

Info

Publication number
CN102404583A
CN102404583A CN201010281097XA CN201010281097A CN102404583A CN 102404583 A CN102404583 A CN 102404583A CN 201010281097X A CN201010281097X A CN 201010281097XA CN 201010281097 A CN201010281097 A CN 201010281097A CN 102404583 A CN102404583 A CN 102404583A
Authority
CN
China
Prior art keywords
depth
degree
image
map
dimensional image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201010281097XA
Other languages
Chinese (zh)
Inventor
钮圣君
黄铃琇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Himax Technologies Ltd
Himax Media Solutions Inc
Original Assignee
Himax Media Solutions Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Himax Media Solutions Inc filed Critical Himax Media Solutions Inc
Priority to CN201010281097XA priority Critical patent/CN102404583A/en
Publication of CN102404583A publication Critical patent/CN102404583A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Image Processing (AREA)

Abstract

The invention discloses a depth reinforcing system and a method for three dimensional images. The depth reinforcing system for three dimensional images comprises a depth generator and a depth reinforcer. The depth generator generates at least one depth map related to an image; and the depth reinforcer reinforces the depth map through a depth histogram related to a stretching depth map, wherein the depth histogram shows the distribution of depth levels of the image pixel.

Description

The degree of depth strengthening system and the method for 3-dimensional image
Technical field
The present invention relates to digitized video and handle, particularly relate to the degree of depth strengthening system and the method for a kind of three-dimensional (3D) image.
Background technology
When three-dimensional body by camera or video camera and during projection mapping to bidimensional image plane, can lose many information, particularly three-dimensional depth information.3-D imaging system can pass on three-dimensional information to give the onlooker by recording 3D vision information or creation depth illusion.Though the technological above history of a century that has of three-dimensional imaging, yet, make three dimensional display become more actual and reach generally owing to the development of high-res and low price display (for example LCD) recently.
Figure 1A shows the calcspar of conventional three-dimensional imaging system, and wherein, degree of depth generator 10 produces depth information according to two dimension input image.(it lets the onlooker watch through demonstration to this depth information for depth-image-based rendering, DIBR) 12 processing and produce a left side (L) image 14A and the right side (R) image 14B via degree of depth video imaging device.Figure 1B shows the calcspar of another kind of conventional three-dimensional imaging system; Wherein, Three-dimensional record device (for example blue light digital image and sound optical disk) 16 or television broadcasting signal write down left image 18A and right image 18B; It can use Fig. 1 D institute example methodology to encode, for example coding (side-by-side), coding (top-bottom, over-under or above-below), line interleaved code (line-by-line or line interlace) or checkerboard type coding (checkerboard) up and down shoulder to shoulder.Fig. 1 C shows the calcspar of another conventional three-dimensional imaging system, wherein, three-dimensional record device 16 or television broadcasting signal registered depth figure (depth map) 20 and left image 18A and right image 18B one of them, this is commonly referred to as two dimension+degree of depth kenel.To produce right image 18B, it lets the onlooker watch through demonstration to degree of depth video imaging device (DIBR) 12 according to degree of depth Figure 20 and left image 18A.
The conventional three-dimensional imaging system has some shortcomings, for example limited depth bounds.Therefore, often make the onlooker can't differentiate the former different objects that should have different depth.
In view of the conventional three-dimensional imaging system can't effectively show 3-dimensional image or video signal, therefore need 3-D imaging system and the method that proposes a kind of novelty badly, it has the depth characteristic of improvement.
Summary of the invention
In view of the defective of above-mentioned prior art, one of purpose of the embodiment of the invention is to propose a kind of degree of depth strengthening system and method for 3-dimensional image, in order to improve the quality of 3-dimensional image or video signal, makes the onlooker be able to the more degree of depth level of perception.
According to the embodiment of the invention, degree of depth generator produces at least one depth map that is relevant to an image.Degree of depth intensive is by stretching the degree of depth histogram that this depth map be correlated with, with the reinforcement depth map, and the wherein distribution of this degree of depth histogram degree of depth level that is image pixel.
According to another embodiment of the present invention, receive and to be relevant at least one depth map of an image, and cut apart depth map and make and become a plurality of depth maps of cutting apart.Then, cut apart depth map, to produce a plurality of regional depth histograms according to these.At last, change the depth characteristic of image, to strengthen the depth map that those are cut apart respectively.
Description of drawings
Figure 1A shows the calcspar of conventional three-dimensional imaging system.
Figure 1B shows the calcspar of another kind of conventional three-dimensional imaging system.
Fig. 1 C shows the calcspar of another conventional three-dimensional imaging system.
Fig. 1 D shows the 3 dimensional format of three-dimensional record device or broadcast singal.
Fig. 2 shows the calcspar of degree of depth strengthening system of the 3-dimensional image of the embodiment of the invention.
Fig. 3 shows that the degree of depth of the 3-dimensional image of the embodiment of the invention adds the flow chart of strong method.
The degree of depth histogram of Fig. 4 A illustration original depth-map.
Fig. 4 B shows the reinforcement degree of depth histogram that carries out after degree of depth histogram stretches.
Fig. 5 demonstration imposes the conversion of S curve to the histogrammic degree of depth level of the degree of depth.
Fig. 6 shows that the degree of depth of the 3-dimensional image of another embodiment of the present invention adds the flow chart of strong method.
The depth map that Fig. 7 illustration basis is cut apart is to produce a plurality of corresponding regional depth histograms.
The reference numeral explanation
10 degree of depth generators
12 degree of depth video imaging devices (DIBR)
14A left side image
The right image of 14B
16 three-dimensional record devices (television broadcasting signal)
18A left side image
The right image of 18B
The left image of 18A '
The right image of 18B '
21A left side image
The right image of 21B
22 degree of depth generators
23 degree of depth intensives
24 degree of depth video imaging (DIBR) unit
25A strengthens left image
25B strengthens right image
The 31-34 step
The 61-64B step
Embodiment
Fig. 2 shows the calcspar of degree of depth strengthening system of the 3-dimensional image of the embodiment of the invention.Fig. 3 shows that the degree of depth of the 3-dimensional image of the embodiment of the invention adds the flow chart of strong method.3-dimensional image is called solid (stereoscopic) image again.
In step 31, reception can be shown in a left side (L) the image 21A and the right side (R) the image 21B of 3-D imaging system.Then, produce at least one depth map (step 32) with degree of depth generator 22.For example, degree of depth generator 22 produces left depth map and right depth map, and it corresponds to original left image and right image respectively.In another example, degree of depth generator 22 produces single depth map.In depth map, each pixel or block have corresponding depth value.For example, the depth value near onlooker's object is greater than the depth value away from onlooker's object.Therefore, in the depth map image, the brightness of comparing away from onlooker's object near the brightness meeting of onlooker's object is greater.In another embodiment, can provide, perhaps provide by the three-dimensional record device of 3-D imaging system (for example 16 of Fig. 1 C) by degree of depth generator (for example 10 of Figure 1A).
Next,, strengthen, with the depth characteristic of change or improvement image with one or more depth maps that 23 pairs of degree of depth generators 22 of degree of depth intensive are produced in step 33.In the present embodiment, the depth map that degree of depth generator 22 is produced carries out the stretching, extension (stretching) of degree of depth histogram (histogram).Degree of depth histogram is the distribution (it is plotted as chart usually) of the degree of depth level of pixel, and wherein, each degree of depth level has corresponding pixel counts value.When histogram is plotted as chart, trunnion axis representing depth level then, vertical axis is then represented corresponding number of pixels.The degree of depth histogram of Fig. 4 A illustration original depth-map, and Fig. 4 B shows the reinforcement degree of depth histogram that carries out after degree of depth histogram stretches.In this example, the pairing image of original depth-map, the degree of depth level of its pixel is all less than 100; Yet, strengthen the pairing reinforcement image of depth map, the degree of depth level of its pixel is stretched in entire depth level scope.
In one embodiment, the execution of aforementioned degree of depth histogram stretching, extension (depth histogram stretching) is that each degree of depth level is imposed a gain.In another embodiment, the execution of degree of depth histogram stretching, extension is conversion or the mapping that the histogrammic degree of depth level of the degree of depth is imposed indicatrix (for example gamma (Gamma) curve).Fig. 5 demonstration imposes the conversion of S curve to the histogrammic degree of depth level of the degree of depth.As shown in the figure, the greatest gradient of S curve is through the degree of depth level of maximum pixel number.In general, the execution that degree of depth histogram stretches can impose histogrammic each degree of depth level of the degree of depth and add, subtracts, takes advantage of or remove a numerical value, in order to balanced (equalize) each degree of depth level.
Then; In step 34; Reinforcement depth map from degree of depth intensive 23 is fed into degree of depth video imaging (DIBR) unit 24, and it is according to strengthening depth map and original left image and right image, strengthens a left side (L ') image 25A and strengthens right (R ') image 25B in order to produce (or synthetic).The reinforcement that produced left side image and strengthen right image and then can show by 3-D imaging system.The enforcement of degree of depth video imaging (DIBR) unit 24 can be used conventional art, and for example Christoph Fehn is disclosed " A 3D-TVApproach Using Depth-Image-Based Rendering (DIBR) ".
Fig. 6 shows that the degree of depth of the 3-dimensional image of another embodiment of the present invention adds the flow chart of strong method.In step 61, receive depth map from degree of depth generator 22 (Fig. 2).Then, in step 62, determine the ensuing degree of depth to strengthen to be to want execution of universe ground or regional the execution actually.
If be that universe ground is carried out the degree of depth and strengthened, then according to entire depth figure to produce universe degree of depth histogram (step 63A).Then,, the histogrammic depth layer level of the universe degree of depth is strengthened, for example used the illustrative S curve conversion of Fig. 5 institute (or mapping) in step 64A.
If strengthen for carry out the degree of depth regionally, then according to the depth map of cutting apart to produce a plurality of regional depth histograms (step 63B).The depth map that Fig. 7 illustration basis is cut apart is to produce a plurality of corresponding regional depth histograms.In this example, entire depth figure is split into 2x2 or 4 depth maps of cutting apart.Then,, the histogrammic degree of depth level of each regional depth is strengthened respectively, for example used the S curve that the regional depth histogram is changed (or mapping) in step 64B.Each regional depth histogram can impose different conversions, and some regional depth histograms can not changed yet.
The above is merely preferred embodiment of the present invention, is not in order to limit the scope of claim of the present invention; All other do not break away from the equivalence of being accomplished under the spirit that invention discloses and changes or modify, and all should be included in the application's the claim.

Claims (13)

1. the degree of depth strengthening system of a 3-dimensional image comprises:
One degree of depth generator is relevant at least one depth map of an image in order to generation; And
One degree of depth intensive, it is by stretching the relevant degree of depth histogram of this depth map, to strengthen this depth map, the wherein distribution of the degree of depth level of this degree of depth histogram pixel that is this image.
2. the degree of depth strengthening system of 3-dimensional image according to claim 1, wherein the histogrammic degree of depth level of this degree of depth is imposed the conversion of indicatrix.
3. the degree of depth strengthening system of 3-dimensional image according to claim 1, wherein histogrammic each degree of depth level of this degree of depth is imposed and adds, subtracts, takes advantage of or remove a numerical value, in order to balanced each this degree of depth level.
4. the degree of depth strengthening system of 3-dimensional image according to claim 1, wherein this degree of depth generator according to a left image producing a left depth map, and according to a right image to produce a right depth map.
5. the degree of depth strengthening system of 3-dimensional image according to claim 1 also comprises a degree of depth video imaging unit, and it receives should strengthen depth map, uses to produce one and strengthen left image and and strengthen right image.
6. the degree of depth of a 3-dimensional image adds strong method, comprises:
Reception is relevant at least one depth map of an image;
Generation is relevant to a degree of depth histogram of this depth map, wherein the distribution of the degree of depth level of this degree of depth histogram pixel that is this image; And
By stretching this degree of depth histogram, to strengthen this depth map.
7. the degree of depth like the said 3-dimensional image of claim 6 adds strong method, and wherein the histogrammic stretching, extension step of this degree of depth comprises:
Histogrammic each degree of depth level of this degree of depth is imposed a gain.
8. the degree of depth like the said 3-dimensional image of claim 7 adds strong method, and wherein the histogrammic stretching, extension step of this degree of depth comprises:
The histogrammic degree of depth level of this degree of depth is imposed the conversion of indicatrix.
9. the degree of depth like the said 3-dimensional image of claim 7 adds strong method, and wherein the histogrammic stretching, extension step of this degree of depth comprises:
Histogrammic each degree of depth level of this degree of depth imposed add, subtract, take advantage of or remove a numerical value, in order to balanced each this degree of depth level.
10. the degree of depth like the said 3-dimensional image of claim 7 adds strong method, and wherein this at least one depth map comprises the left depth map corresponding to a left image, reaches the right depth map corresponding to a right image.
11. the degree of depth like the said 3-dimensional image of claim 7 adds strong method, also comprises:
Receive and to strengthen depth map, use the generation one left image of reinforcement and and strengthen right image.
12. the degree of depth of a 3-dimensional image adds strong method, comprises:
Reception is relevant at least one depth map of an image;
Cutting apart this depth map makes and becomes a plurality of depth maps of cutting apart;
Cut apart depth map according to those, to produce a plurality of regional depth histograms; And
Change the depth characteristic of this image, to strengthen the depth map that this is cut apart respectively;
The wherein distribution of the degree of depth level of each this regional depth histogram this image pixel of cutting apart depth map for this is corresponding.
13. the degree of depth like the said 3-dimensional image of claim 12 adds strong method, wherein this reinforcement step of cutting apart depth map comprises:
Stretch this regional depth histogram.
CN201010281097XA 2010-09-09 2010-09-09 Depth reinforcing system and method for three dimensional images Pending CN102404583A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201010281097XA CN102404583A (en) 2010-09-09 2010-09-09 Depth reinforcing system and method for three dimensional images

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010281097XA CN102404583A (en) 2010-09-09 2010-09-09 Depth reinforcing system and method for three dimensional images

Publications (1)

Publication Number Publication Date
CN102404583A true CN102404583A (en) 2012-04-04

Family

ID=45886300

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010281097XA Pending CN102404583A (en) 2010-09-09 2010-09-09 Depth reinforcing system and method for three dimensional images

Country Status (1)

Country Link
CN (1) CN102404583A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102685523A (en) * 2011-03-18 2012-09-19 联发科技股份有限公司 Depth information generator, depth information generating method and depth adjusting apparatus thereof
CN106982365A (en) * 2016-10-26 2017-07-25 李应樵 A kind of method adjusted based on discrete probability distribution adaptive three-dimensional depth
US9760793B2 (en) 2013-10-30 2017-09-12 Htc Corporation Apparatus and computer-implemented method for generating a three-dimensional scene and non-transitory tangible computer readable medium thereof

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101247530A (en) * 2007-02-16 2008-08-20 三星电子株式会社 Three-dimensional image display apparatus and method for enhancing stereoscopic effect of image
CN101682794A (en) * 2007-05-11 2010-03-24 皇家飞利浦电子股份有限公司 Method, apparatus and system for processing depth-related information
CN101751661A (en) * 2008-12-01 2010-06-23 奇景光电股份有限公司 Image strengthening system related to depth and method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101247530A (en) * 2007-02-16 2008-08-20 三星电子株式会社 Three-dimensional image display apparatus and method for enhancing stereoscopic effect of image
CN101682794A (en) * 2007-05-11 2010-03-24 皇家飞利浦电子股份有限公司 Method, apparatus and system for processing depth-related information
CN101751661A (en) * 2008-12-01 2010-06-23 奇景光电股份有限公司 Image strengthening system related to depth and method thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102685523A (en) * 2011-03-18 2012-09-19 联发科技股份有限公司 Depth information generator, depth information generating method and depth adjusting apparatus thereof
US9760793B2 (en) 2013-10-30 2017-09-12 Htc Corporation Apparatus and computer-implemented method for generating a three-dimensional scene and non-transitory tangible computer readable medium thereof
CN106982365A (en) * 2016-10-26 2017-07-25 李应樵 A kind of method adjusted based on discrete probability distribution adaptive three-dimensional depth
CN106982365B (en) * 2016-10-26 2019-03-26 万云数码媒体有限公司 A method of it is adjusted based on discrete probability distribution adaptive three-dimensional depth

Similar Documents

Publication Publication Date Title
KR101690297B1 (en) Image converting device and three dimensional image display device including the same
CN1942902B (en) Ghost artifact reduction for rendering 2.5D graphics
JP5011316B2 (en) Rendering the output image
US8311318B2 (en) System for generating images of multi-views
CN100565589C (en) The apparatus and method that are used for depth perception
JP5150255B2 (en) View mode detection
US20060050383A1 (en) Three-dimentional video providing method and three dimentional video display device
KR102121389B1 (en) Glassless 3d display apparatus and contorl method thereof
JP2014056466A (en) Image processing device and method
US20110211043A1 (en) Method and system for encoding a 3d image signal, encoded 3d image signal, method and system for decoding a 3d image signal
US20150042770A1 (en) Display processor for 3d display
KR20110113923A (en) Image converting device and three dimensional image display device including the same
JP2011523743A (en) Video signal with depth information
US20120008852A1 (en) System and method of enhancing depth of a 3d image
CN103369331A (en) Image hole filling method, image hole filling device, video image processing method and video image processing device
US10122987B2 (en) 3D system including additional 2D to 3D conversion
CN102340678A (en) Stereoscopic display device with adjustable field depth and field depth adjusting method
CN103369336A (en) Apparatus and method
CN102404583A (en) Depth reinforcing system and method for three dimensional images
US20180109775A1 (en) Method and apparatus for fabricating a stereoscopic image
US20170142398A1 (en) 3d system including rendering with eye displacement
Ruijters et al. IGLANCE: transmission to medical high definition autostereoscopic displays
CN102780900B (en) Image display method of multi-person multi-view stereoscopic display
US10148933B2 (en) 3D system including rendering with shifted compensation
CN102612837A (en) Method and device for generating partial views and/or a stereoscopic image master from a 2d-view for stereoscopic playback

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20120404