CN104052985A - Three-dimensional image correction device and three-dimensional image correction method - Google Patents
Three-dimensional image correction device and three-dimensional image correction method Download PDFInfo
- Publication number
- CN104052985A CN104052985A CN201410312022.1A CN201410312022A CN104052985A CN 104052985 A CN104052985 A CN 104052985A CN 201410312022 A CN201410312022 A CN 201410312022A CN 104052985 A CN104052985 A CN 104052985A
- Authority
- CN
- China
- Prior art keywords
- image
- dimensional image
- imagery zone
- pixel
- pixel value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 11
- 238000003702 image correction Methods 0.000 title abstract 3
- 238000001514 detection method Methods 0.000 claims description 6
- 238000009499 grossing Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 claims description 2
- 238000012545 processing Methods 0.000 abstract description 11
- 238000010586 diagram Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 8
- 230000007246 mechanism Effects 0.000 description 4
- 238000012937 correction Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000013019 agitation Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002650 habitual effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- NHDHVHZZCFYRSB-UHFFFAOYSA-N pyriproxyfen Chemical compound C=1C=CC=NC=1OC(C)COC(C=C1)=CC=C1OC1=CC=CC=C1 NHDHVHZZCFYRSB-UHFFFAOYSA-N 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
Landscapes
- Image Processing (AREA)
Abstract
The invention relates to a three-dimensional image correction device, which comprises a depth generator, a depth image plotter, an image processor and an image corrector. The depth generator is used for receiving an input image and processing the input image to generate a depth map. The depth image plotter is used for generating a three-dimensional image according to the input image and the depth map. The image processor is used for detecting a pixel difference region of the depth image. The image processor correspondingly detects a first image area in the input image according to the pixel difference area, and correspondingly detects a second image area in the three-dimensional image according to the pixel difference area. The image processor is used for judging whether the first image area only comprises a single object. The image corrector is used for correcting the second image area in the three-dimensional image when the first image area only contains a single object.
Description
Technical field
The present invention is relevant for a kind of image processing system and image treatment method, and particularly relevant for a kind of 3-dimensional image means for correcting and 3-dimensional image bearing calibration.
Background technology
Along with scientific and technological progress, the play mode of image, by traditional two dimension (Two Dimension, 2D) image play mode, progressively proceeds to three-dimensional (Three Dimension, 3D) image play mode.Especially after A Fanda film in 2009 is shown, more lead one 3D image agitation, the manufacturer of display industries releases 3D display one after another, to meet consumer demand.
Because 3D technology is not yet universal, 3D signal source thereby comparatively shortage.For solving this problem, at present can be using multiple images or individual image as input source, by 3D display, utilize the degree of depth generator in it so that above-mentioned input source is processed, to produce depth map, degree of depth drawing image device (Depth image based rendering, DIBR) by 3D display produces 3D image according to depth map again.
Yet, above-mentioned degree of depth generator is when processing input source, can produce some situations, for example, the each several part of same item all can have identical depth information substantially, only degree of depth generator goes out two kinds of different depth informations by same item interpretation in vertical direction sometimes, and produces wrong depth map.Once degree of depth drawing image device produces 3D image according to wrong depth map, above-mentioned object can produce sawtooth (3D Jagged) phenomenon, has a strong impact on the quality of 3D display.
As can be seen here,, obviously still there is inconvenience and defect, and have much room for improvement in above-mentioned existing mode.In order to address the above problem, association area is there's no one who doesn't or isn't sought solution painstakingly, but does not develop yet for a long time suitable solution.
Summary of the invention
Summary of the invention aims to provide the simplification summary of content of the present invention, so that reader possesses basic understanding to content of the present invention.This summary of the invention is not the complete overview of content of the present invention, and its purpose is not being pointed out the key/critical element of the embodiment of the present invention or defining scope of the present invention.
One of content of the present invention object is that a kind of 3-dimensional image means for correcting and 3-dimensional image bearing calibration are being provided, and uses to improve to be present in the problems of the prior art.
For reaching above-mentioned purpose, a technology aspect of content of the present invention is about a kind of 3-dimensional image means for correcting.This 3-dimensional image means for correcting comprises degree of depth generator, degree of depth drawing image device, image processor and adjustment of image device.Upper in operation, degree of depth generator is inputted image in order to receive, and input image is processed to produce depth map.Degree of depth drawing image device in order to according to input image and depth map to produce 3-dimensional image.Image processor is in order to detect the poor region of pixel of depth map, wherein image processor according to the poor region of pixel correspondingly to detect first imagery zone of input in image, and correspondingly detect the second imagery zone in 3-dimensional image according to the poor region of pixel, wherein image processor is in order to judge whether only comprise single object in the first imagery zone.When adjustment of image device is used to only to comprise single object in the first imagery zone, the second imagery zone in 3-dimensional image is proofreaied and correct.
According to one embodiment of the invention, above-mentioned image processor is also in order to calculate the first pixel value difference in the first imagery zone, and compare the first pixel value difference and the first pre-set threshold value, and when the first pixel value difference is less than the first pre-set threshold value, judges in the first imagery zone and only comprise single object.
According to yet another embodiment of the invention, above-mentioned the first pixel value difference is luminance difference or the chroma difference in the first imagery zone.
According to another embodiment of the present invention, above-mentioned image processor is also in order to the second pixel value difference in the poor region of calculating pixel, and comparison the second pixel value difference and the second pre-set threshold value, when wherein adjustment of image device is also used to only comprise in the first imagery zone single object and the second pixel value difference and is greater than the second pre-set threshold value, the second imagery zone in 3-dimensional image is proofreaied and correct.
According to further embodiment of this invention, above-mentioned the second pixel value difference is the GTG difference in the poor region of pixel.
According to yet another embodiment of the invention, above-mentioned adjustment of image device carries out smoothing techniques in order to the second imagery zone in 3-dimensional image.
According to further embodiment of this invention, above-mentioned image processor also comprises an edge detecting device in order to rim detection is carried out to obtain fringe region in the poor region of pixel, wherein image processor also in order to according to fringe region correspondingly to obtain first imagery zone of input in image, and correspondingly obtain the second imagery zone in 3-dimensional image according to fringe region.
For reaching above-mentioned purpose, another technology aspect of content of the present invention is about a kind of 3-dimensional image bearing calibration.This 3-dimensional image bearing calibration comprises following steps: receive input image, and input image is processed to produce depth map; According to inputting image and depth map to produce 3-dimensional image; Detect the poor region of pixel of depth map; According to the poor region of pixel, correspondingly to obtain first imagery zone of input in image, and correspondingly obtain the second imagery zone in 3-dimensional image according to the poor region of pixel; Judge and in the first imagery zone, whether only comprise single object; And while only comprising single object in the first imagery zone, the second imagery zone in 3-dimensional image is proofreaied and correct.
According to one embodiment of the invention, above-mentionedly judge the step that whether only comprises single object in the first imagery zone, comprise: calculate the first pixel value difference in the first imagery zone; Compare the first pixel value difference and the first pre-set threshold value; And when the first pixel value difference is less than the first pre-set threshold value, judges in the first imagery zone and only comprise single object.
According to yet another embodiment of the invention, above-mentioned the first pixel value difference is luminance difference or the chroma difference in the first imagery zone.
According to another embodiment of the present invention, above-mentioned 3-dimensional image bearing calibration also comprises following steps: the second pixel value difference in the poor region of calculating pixel; And comparison the second pixel value difference and the second pre-set threshold value; While wherein only comprising single object in the first imagery zone, the step that the second imagery zone in 3-dimensional image is proofreaied and correct comprises: when only comprising single object and the second pixel value difference being greater than the second pre-set threshold value in the first imagery zone, the second imagery zone in 3-dimensional image is proofreaied and correct.
According to further embodiment of this invention, above-mentioned the second pixel value difference is the GTG difference in the poor region of pixel.
According to yet another embodiment of the invention, the above-mentioned step that the second imagery zone in 3-dimensional image is proofreaied and correct, comprises: the second imagery zone in 3-dimensional image is carried out to smoothing techniques.
According to further embodiment of this invention, the step in the poor region of pixel of above-mentioned detection depth map comprises: rim detection is carried out to obtain fringe region in the poor region of pixel; Wherein according to the poor region of pixel correspondingly to obtain first imagery zone of input in image, and comprise according to the step that the second imagery zone in 3-dimensional image is correspondingly obtained in the poor region of pixel: according to fringe region, correspondingly to obtain the first imagery zone in input image, and correspondingly obtain the second imagery zone in 3-dimensional image according to fringe region.
Therefore, according to technology contents of the present invention, the embodiment of the present invention is by proposing a kind of 3-dimensional image means for correcting and 3-dimensional image bearing calibration, adopt the mechanism of 3-dimensional image means for correcting and 3-dimensional image bearing calibration, can according to wrong depth map, produce the 3D image with crenellated phenomena to degree of depth drawing image device and proofread and correct, thereby guarantee the quality of 3D display.
After consulting below execution mode, persond having ordinary knowledge in the technical field of the present invention is when understanding easily essence spirit of the present invention and other goals of the invention, and the technology used in the present invention means with implement aspect.
Accompanying drawing explanation
For above and other object of the present invention, feature, advantage and embodiment can be become apparent, appended graphic being described as follows:
Fig. 1 illustrates the schematic diagram according to a kind of 3-dimensional image means for correcting of one embodiment of the invention;
Fig. 2 illustrates a kind of 3-dimensional image bearing calibration flow chart of an execution mode again according to the present invention;
Fig. 3 A illustrates a kind of image schematic diagram with crenellated phenomena;
Fig. 3 B illustrates a kind of image schematic diagram after 3-dimensional image means for correcting is processed according to one embodiment of the invention;
Fig. 3 C illustrates a kind of image schematic diagram after 3-dimensional image means for correcting is processed according to another embodiment of the present invention;
Fig. 4 illustrates the schematic diagram according to a kind of 3-dimensional image means for correcting of further embodiment of this invention.
Wherein, Reference numeral:
100,100a: 510: the first imagery zones of 3-dimensional image means for correcting
110: 520: the first imagery zones of degree of depth generator
120: degree of depth drawing image device 600: depth map
130: image processor 610: the poor region of pixel
132: edge detecting device 620: fringe region
140: adjustment of image device 700:3D image
200: 710: the second imagery zones of method
The 210～260: step 720: second imagery zone
500: input image
According to usual operating type, in figure, various features and element are not drawn to scale, and its drafting mode is to present specific features related to the present invention and element for the mode with best.In addition,, graphic of difference, with same or analogous component symbol, censure similar elements/components.
Embodiment
In order to make the narration of content of the present invention more detailed and complete, below for enforcement aspect of the present invention and specific embodiment illustrative description has been proposed; But this not implements or uses unique form of the specific embodiment of the invention.In execution mode, contained the feature of a plurality of specific embodiments and method step and its order with these specific embodiments of operation in order to construction.Yet, also can utilize other specific embodiments to reach identical or impartial function and step order.
Unless this specification separately has definition, the implication of science and technology vocabulary used herein is identical with habitual meaning with persond having ordinary knowledge in the technical field of the present invention's understanding.In addition,, under the situation of discord context conflict, this specification singular noun used contains the complex number type of this noun; And also contain the odd number type of this noun during plural noun used.
In addition, about " coupling " used herein, can refer to two or a plurality of element mutually directly make entity or in electrical contact, or mutually indirectly put into effect body or in electrical contact, also can refer to two or a plurality of element mutual operation or action.
For solving degree of depth drawing image device, according to the wrong depth map of degree of depth generator generation, cause three-dimensional (Three Dimension, there is the problem of crenellated phenomena in image 3D), the embodiment of the present invention proposes a kind of 3-dimensional image means for correcting, uses the sawtooth of above-mentioned 3D image (3D Jagged) phenomenon is proofreaied and correct.
Above-mentioned 3-dimensional image means for correcting is illustrated in Fig. 1 with the pattern of circuit box, is beneficial to understand the present invention.As shown in the figure, 3-dimensional image means for correcting 100 comprises degree of depth generator 110, degree of depth drawing image device (Depth image based rendering, DIBR) 120, image processor 130 and adjustment of image device 140.In structure, degree of depth generator 110 is electrically coupled to degree of depth drawing image device 120 and image processor 130, degree of depth drawing image device 120 is electrically coupled to image processor 130 and adjustment of image device 140, and image processor 130 is electrically coupled to adjustment of image device 140.So the present invention is not limited with the circuit box shown in Fig. 1, and it is only in order to illustrate illustratively one of implementation of the present invention.
For making the correction mechanism easy to understand of the 3-dimensional image means for correcting 100 shown in Fig. 1, below coordinate the steps flow chart of the 3-dimensional image bearing calibration 200 shown in Fig. 2 to describe.
First, as shown in step 210, by degree of depth generator 110, receive input image 500, and input image 500 is processed to produce depth map 600.Above-mentioned input image 500 can be multiple images or individual image, this input image 500 comprises many image informations, after the image information of 110 pairs of above-mentioned input images 500 of degree of depth generator is processed, produce corresponding a plurality of depth informations, these depth informations have formed the depth map 600 shown in Fig. 1 first half.
Subsequently, in step 220, by degree of depth drawing image device 120, according to inputting image 500 and depth map 600 to produce left-eye images and right-eye image, be used for synthesizing 3D image 700.In prior art, degree of depth generator 110 may produce wrong depth map 600, if degree of depth drawing image device 120 according to wrong depth map 600 to produce left-eye images or right-eye image, last synthetic 3D image 700 has crenellated phenomena, therefore, the 3-dimensional image means for correcting 100 of this case also possesses following correction mechanism and can address the above problem, illustrate as after.
Refer to step 230, utilize image processor 130 to detect the poor region 610 of pixel in depth map 600, the poor region 610 of this pixel can comprise positional information, and for example the poor region 610 of pixel is arranged in the information in the lower right corner of depth map 600.
Then, as shown in step 240, by image processor 130 according to the poor region 610 of pixel correspondingly to detect the first imagery zone 510 in the input image 500 shown in Fig. 1, and correspondingly detect the left-eye images of the image of 3D shown in Fig. 1 700 or the second imagery zone 710 in right-eye image according to the poor region 610 of pixel.It should be noted that, depth map 600 is to obtain by calculating the depth information of input image 500 substantially, and therefore, depth map 600 is reflected the depth information of respective regions in input image 500.Refer to Fig. 1 first half, the poor region 610 of pixel of depth map 600 lower right-most portion reflects the depth information of the first imagery zone 510 of input image 500 lower right-most portion substantially, then, as shown in the figure, the first imagery zone 510 only has single object, degree of depth generator 110 but interpretation mistakes and in depth map 600 corresponding part there is the poor region 610 of pixel, now degree of depth drawing image device 120 is according to wrong depth map 600, and produces crenellated phenomena in the second imagery zone 710 of 3D image 700 correspondences.
Sum up and opinion, although in input image 500, only there is single object, because of degree of depth generator 110 interpretation mistakes, the final 3D image 700 with crenellated phenomena that produces.So, microcosmic, makes single object in 3D image 700, look like two objects, and macroscopic makes single object in 3D image 700, seem distortion, distortion and loses single object kenel originally, has a strong impact on the quality of 3D image 700.For solving this problem, the 3-dimensional image means for correcting 100 of the embodiment of the present invention can interpretation go out in depth map 600 the poor region of the pixel that occurs, and corresponding region in 3D image 700 is proofreaied and correct and is solved the problems referred to above.
Yet furthermore, if adjustment of image processing is carried out in the poor region of occurred pixel, this kind of processing mode may cause crossing multizone in 3D image 700 and be corrected, and make 700 obfuscations of 3D image, this part refers to 3A and 3B figure to make an explanation.Fig. 3 A illustrates a kind of 3D image schematic diagram with crenellated phenomena, and as shown in the figure, English alphabet F in the drawings A point place has crenellated phenomena, can solve this problem via above-mentioned processing mode.The schematic diagram of the 3D image that above-mentioned processing mode produces refers to Fig. 3 B, by Fig. 3 B, found out the 3-dimensional image means for correcting 100 of the embodiment of the present invention, to crossing multizone in 3D image, proofread and correct, cause whole 3D image very fuzzy, accordingly, though above-mentioned processing mode can solve the problem of crenellated phenomena, for example English alphabet F is in the B of Fig. 3 B point place without obvious crenellated phenomena, and the 3D image of obfuscation can affect user's perception equally.
For solving the problem of 3D image fog, refer to step 250, by image processor 130, judge in the first imagery zone 510, whether only to comprise single object, as shown in Fig. 1 first half, if only comprise single object in the first imagery zone 510, now perform step 260, the second imagery zone 710 in 140 pairs of 3D images 700 of adjustment of image device is proofreaied and correct.In the present embodiment, the correcting mode of above-mentioned adjustment of image device 140, for example, for the second imagery zone 710 in 3D image 700 carries out smoothing techniques, to improve the crenellated phenomena of 3D image 700.So, 3-dimensional image means for correcting 100 is only proofreaied and correct real problematic region, but not simply the poor corresponding 3D imagery zone of occurred pixel is proofreaied and correct, in order to do with under the situation of sharpness that maintains 3D image, solve the problem of the crenellated phenomena of 3D image.
The result of above-mentioned processing mode refers to Fig. 3 C, as shown in the figure, because the 3-dimensional image means for correcting 100 of the embodiment of the present invention is only proofreaied and correct real problematic region, for example only for the C point place of Fig. 3 C, proofread and correct, therefore, English alphabet F in the C of Fig. 3 C point place without obvious crenellated phenomena, and maintain the sharpness of 3D image, for example the sharpness of English alphabet e in Fig. 3 A and Fig. 3 C is close, in addition, English alphabet e the sharpness of Fig. 3 C higher than English alphabet e the sharpness at Fig. 3 B.
Above-mentionedly judge the step that whether only comprises single object in the first imagery zone 510, specifically, the pixel value difference being calculated in the first imagery zone 510 by image processor 130, and compared pixels difference and pre-set threshold value, and when pixel value difference is less than pre-set threshold value, judges in the first imagery zone 510 and only comprise single object.For example, the pixel in image processor 130 calculating the first imagery zones 510 in vertical direction is poor, and as the pixel value difference in Y-axis, the computing formula after concluding is as follows:
Δ I=|I (x, y)-I (x, y ± 1) | ... formula 1
As above formula 1, and Δ I is pixel value difference, the pixel value that I (x, y) is datum mark, and I (x, y ± 1) is that datum mark is in Y-axis or the pixel value of lower mobile Yi Ge unit.After pixel value difference Δ I in obtaining the first imagery zone 510, pixel value difference Δ I and pre-set threshold value are compared, if pixel value difference Δ I is less than pre-set threshold value, represent that the margin of image element of the image in the first imagery zone 510 is apart from little, thereby judge in the first imagery zone 510 only have single object.In the present embodiment, above-mentioned pre-set threshold value can be determined according to actual demand.In addition, the present invention is not limited with above-described embodiment, and it is only in order to illustrate illustratively one of implementation of the present invention.
Above-mentioned judgment mode is may be same colour system based on single object, so poor principle that should be less of pixel of single object, yet the present invention is not as limit, also can consider other factors in design, as the integrated information of color and brightness, or all the other can be for the factor of judgement, to judge whether only comprise single object in the first imagery zone 510.
In addition,, in above-mentioned steps 250, if not only comprise single object in image processor 130 judgement the first imagery zones 510, for example, when the first imagery zone 510 comprises two articles or more objects, perform step 210.If so, refer to above-mentioned steps 260, once execute after correction program, continue execution step 210.It should be noted that, the step of the 3-dimensional image bearing calibration 200 shown in Fig. 2 does not limit by the element of 3-dimensional image means for correcting 100 to be carried out, above embodiment is only in order to one of implementation of the present invention to be described, the scope of the 3-dimensional image bearing calibration 200 of the embodiment of the present invention is worked as depending on claim.
In one embodiment, image processor 130 is the pixel value difference in the poor region 610 of pixel of the depth map shown in calculating chart 1 600 further, and more above-mentioned pixel value difference and pre-set threshold value, if when pixel value difference is greater than pre-set threshold value, the second imagery zone 710 in 3D image 700 is proofreaied and correct.Above-mentioned pixel value difference is the GTG difference in the poor region 610 of the pixel of depth map 600, and above-mentioned GTG value is the numerical value that represents the GTG degree of depth map 600, generally with 0～255, represents, 0 represents black, and 255 represent white.For example, the pixel value difference in the image processor 130 poor regions 610 of calculating pixel in vertical direction, as the pixel value difference in Y-axis, the computing formula after concluding is as follows:
Δ D=|D (x, y)-D (x, y ± 1) | ... formula 2
As above formula 2, and Δ D is pixel value difference, the pixel value that D (x, y) is datum mark, and D (x, y ± 1) is that datum mark is in Y-axis or the pixel value of lower mobile Yi Ge unit.After pixel value difference Δ D in obtaining the poor region 610 of pixel, pixel value difference Δ D and pre-set threshold value are compared, when if pixel value difference Δ D is greater than pre-set threshold value, the margin of image element distance of the image in the poor region 610 of represent pixel is excessive, thereby has and need to proofread and correct the second imagery zone 710 in 3D image 700.In the present embodiment, above-mentioned pre-set threshold value can be determined according to actual demand.In addition, the present invention is not limited with above-described embodiment, and it is only in order to illustrate illustratively one of implementation of the present invention.
In another embodiment, the image processor 130 of the embodiment of the present invention can adopt above-mentioned formula 1 and formula 2 in the lump, with the pixel value difference Δ D in the poor region 610 of pixel, be greater than pre-set threshold value Th1 (representative need to be proofreaied and correct the second imagery zone 710 in 3D image 700), and the pixel value difference Δ I in the first imagery zone 510 is less than under the situation of pre-set threshold value Th2 (represent in the first imagery zone 510 and only comprise single object), and the second imagery zone 710 in 3D image 700 is proofreaied and correct.So, will make the correction result of 3-dimensional image means for correcting 100 of the embodiment of the present invention more accurate.
Fig. 4 illustrates the schematic diagram according to a kind of 3-dimensional image means for correcting 100a of another embodiment of the present invention.Compared to the 3-dimensional image means for correcting 100 shown in Fig. 1, at this image processor 130 of 3-dimensional image means for correcting 100a, further comprise an edge detecting device 132 in order to rim detection is carried out to obtain fringe region 620 in the poor region 610 of pixel.In addition, image processor 130 also in order to according to fringe region 620 correspondingly to obtain first imagery zone 520 of input in image 500, and correspondingly obtain the second imagery zone 720 in 3D image 700 according to fringe region 620.The purpose of above-mentioned processing mode describe in detail as after.
If carry out above-mentioned steps according to the poor region 610 of the pixel shown in Fig. 1, because the poor region 610 of pixel is large compared with fringe region 620, thereby image processor 130 needs to process larger area imagery zone.So, after above-mentioned processing mode, image processor 130 more can be absorbed in the poor region 610 of pixel " really can produce the fringe region 620 of zigzag phenomenon ", and it is processed.Compared to the poor region 610 of above-mentioned pixel, these fringe region 620 scopes are less, and fringe region 620 deals with speed, when can further promoting the treatment effeciency of 3-dimensional image means for correcting 100a, and make result more accurate.
3-dimensional image bearing calibration 200 as above all can be carried out by software, hardware and/or firmware.For instance, if with execution speed and accuracy for primarily considering, it is main substantially can selecting hardware and/or firmware; If for primarily considering, it is main substantially can selecting software with design flexibility; Or, can adopt software, hardware and firmware work compound simultaneously.Should be appreciated that, above these lifted examples are not so-called, and which is better and which is worse minute, also not in order to limit the present invention, has the knack of this skill person when designing it depending on elasticity of demand at that time.
Moreover, in affiliated technical field, having and conventionally know that the knowledgeable is when understanding, each step in 3-dimensional image bearing calibration 200 is named according to the function of its execution, only in order to allow the technology of this case more become apparent, not in order to limit these steps.Each step is integrated into same step or is split into a plurality of steps, or arbitrary step is changed in another step and carried out, all still belonged to the execution mode of content of the present invention.
From the invention described above execution mode, application the present invention has following advantages.The embodiment of the present invention is by proposing a kind of 3-dimensional image means for correcting and 3-dimensional image bearing calibration, adopt the mechanism of 3-dimensional image means for correcting and 3-dimensional image bearing calibration, can according to wrong depth map, produce the 3D image with crenellated phenomena to degree of depth drawing image device and proofread and correct, thereby guarantee the quality of 3D display.
Furthermore, 3-dimensional image means for correcting and 3-dimensional image bearing calibration more can be by judging whether only comprise an object in the first imagery zone, and find out real problematic region and it is proofreaied and correct, in order to do with under the situation of sharpness that maintains 3D image, solve the problem of the crenellated phenomena of 3D image.
Although disclosed specific embodiments of the invention in execution mode above; so it is not in order to limit the present invention; persond having ordinary knowledge in the technical field of the present invention; under the situation departing from principle of the present invention and spirit not; when carrying out various changes and modification to it, thus protection scope of the present invention when with attach claim the person of being defined be as the criterion.
Claims (14)
1. a 3-dimensional image means for correcting, is characterized in that, comprises:
One degree of depth generator, in order to receive an input image, and processes to produce a depth map to this input image;
One degree of depth drawing image device, in order to according to this input image and this depth map to produce a 3-dimensional image; And
One image processor, in order to detect a poor region of pixel of this depth map, wherein this image processor according to the poor region of this pixel correspondingly to detect one first imagery zone in this input image, and correspondingly detect one second imagery zone in this 3-dimensional image according to the poor region of this pixel, wherein this image processor is in order to judge whether only comprise single object in this first imagery zone;
One adjustment of image device, while being used to only to comprise single object in this first imagery zone, proofreaies and correct this second imagery zone in this 3-dimensional image.
2. 3-dimensional image means for correcting according to claim 1, it is characterized in that, this image processor is also in order to calculate one first pixel value difference in this first imagery zone, and relatively this first pixel value difference and one first pre-set threshold value, and when this first pixel value difference is less than this first pre-set threshold value, judges in this first imagery zone and only comprise single object.
3. 3-dimensional image means for correcting according to claim 2, is characterized in that, this first pixel value difference is a luminance difference or the chroma difference in this first imagery zone.
4. 3-dimensional image means for correcting according to claim 2, it is characterized in that, this image processor is also in order to calculate one second pixel value difference in the poor region of this pixel, and relatively this second pixel value difference and one second pre-set threshold value, when wherein this adjustment of image device is also used to only comprise in this first imagery zone single object and this second pixel value difference and is greater than this second pre-set threshold value, this second imagery zone in this 3-dimensional image is proofreaied and correct.
5. 3-dimensional image means for correcting according to claim 4, is characterized in that, this second pixel value difference is the GTG difference in the poor region of this pixel.
6. 3-dimensional image means for correcting according to claim 1, is characterized in that, this adjustment of image device carries out smoothing techniques in order to this second imagery zone in this 3-dimensional image.
7. 3-dimensional image means for correcting according to claim 1, it is characterized in that, this image processor also comprises an edge detecting device in order to rim detection is carried out to obtain a fringe region in the poor region of this pixel, wherein this image processor also in order to according to this fringe region correspondingly to obtain this first imagery zone in this input image, and correspondingly obtain this second imagery zone in this 3-dimensional image according to this fringe region.
8. a 3-dimensional image bearing calibration, is characterized in that, comprises:
Receive an input image, and this input image is processed to produce a depth map;
According to this input image and this depth map to produce a 3-dimensional image;
Detect a poor region of pixel of this depth map;
According to the poor region of this pixel, correspondingly to obtain one first imagery zone in this input image, and correspondingly obtain one second imagery zone in this 3-dimensional image according to the poor region of this pixel;
Judge and in this first imagery zone, whether only comprise single object; And
While only comprising single object in this first imagery zone, this second imagery zone in this 3-dimensional image is proofreaied and correct.
9. 3-dimensional image bearing calibration according to claim 8, is characterized in that, judges the step that whether only comprises single object in this first imagery zone, comprises:
Calculate one first pixel value difference in this first imagery zone;
Relatively this first pixel value difference and one first pre-set threshold value; And
When this first pixel value difference is less than this first pre-set threshold value, judges in this first imagery zone and only comprise single object.
10. 3-dimensional image bearing calibration according to claim 9, is characterized in that, this first pixel value difference is a luminance difference or the chroma difference in this first imagery zone.
11. 3-dimensional image bearing calibrations according to claim 9, is characterized in that, also comprise:
Calculate one second pixel value difference in the poor region of this pixel; And
Relatively this second pixel value difference and one second pre-set threshold value;
While wherein only comprising single object in this first imagery zone, the step that this second imagery zone in this 3-dimensional image is proofreaied and correct comprises:
In this first imagery zone, only comprise single object and this second pixel is poor while being greater than this second pre-set threshold value, this second imagery zone in this 3-dimensional image is proofreaied and correct.
12. 3-dimensional image bearing calibrations according to claim 11, is characterized in that, this second pixel value difference is the GTG difference in the poor region of this pixel.
13. 3-dimensional image bearing calibrations according to claim 8, is characterized in that, the step that this second imagery zone in this 3-dimensional image is proofreaied and correct, comprises:
This second imagery zone in this 3-dimensional image is carried out to smoothing techniques.
14. 3-dimensional image bearing calibrations according to claim 8, is characterized in that, the step that detects this poor region of pixel of this depth map comprises:
Rim detection is carried out to obtain a fringe region in the poor region of this pixel;
Wherein according to the poor region of this pixel correspondingly to obtain this first imagery zone in this input image, and comprise according to the step that this second imagery zone in this 3-dimensional image is correspondingly obtained in the poor region of this pixel:
According to this fringe region, correspondingly to obtain this first imagery zone in this input image, and correspondingly obtain this second imagery zone in this 3-dimensional image according to this fringe region.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW103115546A TWI511079B (en) | 2014-04-30 | 2014-04-30 | Three-dimension image calibration device and method for calibrating three-dimension image |
| TW103115546 | 2014-04-30 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104052985A true CN104052985A (en) | 2014-09-17 |
| CN104052985B CN104052985B (en) | 2016-08-10 |
Family
ID=51505304
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410312022.1A Expired - Fee Related CN104052985B (en) | 2014-04-30 | 2014-07-02 | Three-dimensional image correction device and three-dimensional image correction method |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104052985B (en) |
| TW (1) | TWI511079B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI618031B (en) * | 2017-04-12 | 2018-03-11 | 和碩聯合科技股份有限公司 | Edge detection method of image |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008112762A1 (en) * | 2007-03-12 | 2008-09-18 | Conversion Works, Inc. | Systems amd methods for depth peeling using stereoscopic variables during the rendering of 2-d to 3-d images |
| CN101771893A (en) * | 2010-01-05 | 2010-07-07 | 浙江大学 | Video frequency sequence background modeling based virtual viewpoint rendering method |
| CN102811357A (en) * | 2011-06-03 | 2012-12-05 | 奇景光电股份有限公司 | Three-dimensional image processing system and method |
| CN102883175A (en) * | 2012-10-23 | 2013-01-16 | 青岛海信信芯科技有限公司 | Methods for extracting depth map, judging video scene change and optimizing edge of depth map |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101908230B (en) * | 2010-07-23 | 2011-11-23 | 东南大学 | Regional depth edge detection and binocular stereo matching-based three-dimensional reconstruction method |
| US20120274626A1 (en) * | 2011-04-29 | 2012-11-01 | Himax Media Solutions, Inc. | Stereoscopic Image Generating Apparatus and Method |
| TW201249172A (en) * | 2011-05-30 | 2012-12-01 | Himax Media Solutions Inc | Stereo image correction system and method |
| TWI504232B (en) * | 2011-06-22 | 2015-10-11 | Realtek Semiconductor Corp | Apparatus for rendering 3d images |
| KR101854188B1 (en) * | 2011-10-25 | 2018-05-08 | 삼성전자주식회사 | 3D image acquisition apparatus and method of acqiring depth information in the 3D image acquisition apparatus |
-
2014
- 2014-04-30 TW TW103115546A patent/TWI511079B/en not_active IP Right Cessation
- 2014-07-02 CN CN201410312022.1A patent/CN104052985B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008112762A1 (en) * | 2007-03-12 | 2008-09-18 | Conversion Works, Inc. | Systems amd methods for depth peeling using stereoscopic variables during the rendering of 2-d to 3-d images |
| CN101771893A (en) * | 2010-01-05 | 2010-07-07 | 浙江大学 | Video frequency sequence background modeling based virtual viewpoint rendering method |
| CN102811357A (en) * | 2011-06-03 | 2012-12-05 | 奇景光电股份有限公司 | Three-dimensional image processing system and method |
| CN102883175A (en) * | 2012-10-23 | 2013-01-16 | 青岛海信信芯科技有限公司 | Methods for extracting depth map, judging video scene change and optimizing edge of depth map |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104052985B (en) | 2016-08-10 |
| TW201541406A (en) | 2015-11-01 |
| TWI511079B (en) | 2015-12-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103824318B (en) | A kind of depth perception method of multi-cam array | |
| US9454821B2 (en) | One method of depth perception based on binary laser speckle images | |
| CN104661011B (en) | Stereoscopic image display method and hand-held terminal | |
| CN109341527B (en) | Automatic shadow compensation structured light projection three-dimensional measurement system and method | |
| EP2704097A2 (en) | Depth estimation device, depth estimation method, depth estimation program, image processing device, image processing method, and image processing program | |
| US10334231B2 (en) | Display method and system for converting two-dimensional image into multi-viewpoint image | |
| TWI398158B (en) | Method for generating the depth of a stereo image | |
| CN104484659A (en) | Method for automatically identifying and calibrating medical color images and medical gray scale images | |
| JP2013134706A (en) | Information processing device, information processing method, and program for the same | |
| KR20120114153A (en) | Image processing apparatus, image processing method, and computer readable medium | |
| CN103337069B (en) | High-quality three-dimensional color image acquisition methods and device based on multiple camera | |
| CN100399358C (en) | Image processing apparatus and method of same | |
| CN113393464B (en) | Three-dimensional detection method for plate glass defects | |
| CN103810708A (en) | Method and device for perceiving depth of laser speckle image | |
| US20180144497A1 (en) | Information processing apparatus, method, and program | |
| CN111383311B (en) | Normal map generation method, device, equipment and storage medium | |
| CN103942756A (en) | Post-processing filtering method for depth map | |
| CN101685000B (en) | Computer system and method for image boundary scan | |
| CN104581123A (en) | stereoscopic image display system and display method | |
| CN107424583B (en) | Display data processing method and system for special-shaped image | |
| CN104052985A (en) | Three-dimensional image correction device and three-dimensional image correction method | |
| CN105530505B (en) | 3-D view conversion method and device | |
| CN116912417A (en) | Texture mapping method, device, equipment and storage medium based on three-dimensional reconstruction of human face | |
| JP2013195368A (en) | Defect detector | |
| CN112614190B (en) | Method and device for projecting mapping |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160810 Termination date: 20200702 |