CN104717478A - Method for detecting and repairing blocking effect in 3D player - Google Patents
Method for detecting and repairing blocking effect in 3D player Download PDFInfo
- Publication number
- CN104717478A CN104717478A CN201510058583.8A CN201510058583A CN104717478A CN 104717478 A CN104717478 A CN 104717478A CN 201510058583 A CN201510058583 A CN 201510058583A CN 104717478 A CN104717478 A CN 104717478A
- Authority
- CN
- China
- Prior art keywords
- region
- value
- blocking effect
- current
- inspection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Processing Or Creating Images (AREA)
- Image Generation (AREA)
Abstract
The invention discloses a method for detecting and repairing the blocking effect in a 3D player. If it is judged that a current area is an unstable area, a neighbor area of the current area is found, whether the neighbor area is a stable area or not is judged, the stable area of the neighbor area is selected, and the maximum depth value and the minimum depth value are found in the selected stable area; for each pixel point in the current area, the relation between the current pixel point to be judged and another set value is judged, if the value of the current pixel point is larger than another set value, the current pixel point is endowed with the maximum depth value in the selected stable area; if the value of the current pixel point is smaller than another set value, the current pixel point is endowed with the minimum depth value in the selected stable area. Thus, the rendering quality of virtual viewpoints can be greatly improved.
Description
Technical field
The present invention relates to Digital Image Processing, technical field of computer vision, be specifically related to the inspection and repair method of blocking effect in a kind of 3D player.
Background technology
In recent years, bore hole 3D Display Technique becomes a popular research topic gradually, and bore hole 3D display is when just just bringing us 3D imaging effect without any need for when auxiliary equipment.Along with the progress of Grating Design and technique and the ripe gradually of 3D signal processing technology, bore hole 3D is transitioned into business market from Lab Products gradually.In the design of current bore hole 3D industry grating, manufacture, process technology is ripe gradually, therefore the difference of the signal processing technology of bore hole 3D directly results in the quality of the quality of complete machine, bore hole 3D shows film source and is generally divided into multiple views and super multiple views, multiple views generally comprises 4, 5, 8, 9 viewpoints, super multiple views is generally divided into 14, 28, 30 viewpoints, the mode that traditional many palaces lattice splice is due to the bottleneck of video decode, directly results in the significantly reduction of bore hole 3D display resolution, therefore the video input form of V+D is adopted effectively can to solve the problem of video resolution reduction in conjunction with DIBR technology, the quality of the virtual view that DIBR renders depends on the quality of depth map to a great extent, but existing video compression standard is as H263, H64, MPEG1, MEPG2, with MPEG4 all based on piecemeal change coding, therefore video can be caused to occur image fault, especially even more serious for low bit-rate video distortion.
Summary of the invention
Instant invention overcomes the deficiencies in the prior art, provide a kind of and significantly can improve the inspection and repair method that virtual view plays up blocking effect in the 3D player of quality.
Consider the problems referred to above of prior art, according to an aspect disclosed by the invention, the present invention by the following technical solutions:
An inspection and repair method for blocking effect in 3D player, determine interior zone or the fringe region of object, the process in its edge region comprises:
This depth map is also divided into a block by depth of decode figure;
Find out the maximum depth value in described piece and minimum depth value, and preserve respectively;
Compare with a set point by the difference of the maxima and minima in described piece, to judge that whether corresponding region is for stability region;
If judge, corresponding region is stable region, be then the mean value of this block by the depth value assignment of pixels all in this region;
If judge, current region is unstable region, then find out the adjacent area of this current region, and judge whether described adjacent area is stability region, and select the stability region of described adjacent area, in the stability region selected, find out maximum depth value and minimum depth value;
Pixel each in described current region is done as follows:
Judge the current relation waiting to judge pixel and another set point, if the value of current pixel point is greater than another set point described, then by the maximum depth value assignment in the stability region selected to current pixel point; If the value of current pixel point is less than another set point described, then by the minimum depth value assignment in the stability region selected to current pixel point.
In order to realize the present invention better, further technical scheme is:
According to one embodiment of the invention, described depth map is divided into the block of 16X16.
According to another embodiment of the invention, the computational methods of the mean value of described piece are:
wherein i, j are fast interior line number and row number.
According to another embodiment of the invention, a described set point is empirical value.
According to another embodiment of the invention, a described set point is 10.
According to another embodiment of the invention, described adjacent area selects 8 regions.
According to another embodiment of the invention, another set point described is the value of minValueOfPatch [i]+(maxValueOfPatch [i]-minValueOfPatch [i]) * ratio, ratio is 0.5.
Compared with prior art, one of beneficial effect of the present invention is:
The inspection and repair method of blocking effect in a kind of 3D player of the present invention, the blocking effect distortion phenomenon produced for video compression, in conjunction with DIBR Rendering, to the automatic inspection and repair of comparatively outburst area, significantly can improve the quality that virtual view is played up.
Accompanying drawing explanation
In order to clearer explanation present specification embodiment or technical scheme of the prior art, below the accompanying drawing used required in the description to embodiment or prior art is briefly described, apparently, the accompanying drawing that the following describes is only the reference to some embodiments in present specification, for those skilled in the art, when not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 shows the schematic flow sheet of the inspection and repair method of blocking effect in 3D player according to an embodiment of the invention.
Fig. 2 shows the adjacent area block diagram of the inspection and repair method of blocking effect in 3D player in accordance with another embodiment of the present invention.
Embodiment
Below in conjunction with embodiment, the present invention is described in further detail, but embodiments of the present invention are not limited thereto.
Because the bore hole 3D display of current main-stream is all realized by the mode of multi views, bore hole 3D video generally can be divided into many palaces lattice format video and V+D format video.They have following pluses and minuses separately: for the video of many palaces lattice of 9 palace lattice, it is had on 9 tunnels the view of parallax to be spliced to a view, due to the reason of Video coding and decoding efficiency, spliced view size is generally 1920X1080 or 3840X2160, traditional bore hole 3D player is after obtaining view, first 9 different views are separated from spliced view, then 1920X1080 or 3840X2160 is upsampled to, finally carry out View synthesis again, thus present bore hole 3D effect, the advantage of this mode is that Player Design is simple, require low to computing power, each view information is complete, but a fatal defect can be there is: due to what obtain through up-sampling algorithm during the final image for View synthesis, even if the definition that have employed good up-sampling algorithm video also can decline to a great extent, because the resolution of each view before up-sampling is only 640X360 or 1280X720.
In V+D form, because video is made up of former figure (video)+depth map (depth), the resolution of the image after combination is generally 1920X1080 or 3840X1080, wherein video information and depth information respectively account for half, therefore can ensure that video information can reach 960X1080 or 1920X1080, therefore the former figure information when same splicing resolution in video is more than 4 times of many palaces lattice mode, but this mode has a defect equally, namely only there is a real view information in road in video, the information of other road views all need by only Cun mono-tunnel real views information in conjunction with this view for depth map information use DIBR virtual technology to go out the information of other views, but the existence of the problem due to video compression blocking effect, depth value information is made to occur the error of certain limit, especially particularly evident in the marginal portion blocking effect phenomenon of object.Therefore seeming is even more important to eliminate the depth value (depth value before compression) of blocking effect phenomenon rediscover.
The core concept of DIBR algorithm be utilize existing view information to add corresponding depth map information calculates the view of other virtual views, depth map represents far and near information, larger this object of expression of depth value from video camera more close to, this object of less representative from video camera more away from.Playing up of virtual view can carry out Shift (x with reference to following formula, y)=dScale* (d (x, y)-step), wherein d (x, y) representative point (x, y) depth value, Shift (x, y) point (x is represented, y) play up after position, the factor is played up in dScale representative, it is an empirical value, the value of dScale play up more greatly after parallax larger, the 3D effect finally presented is stronger, less, the parallax after playing up is less, the 3D effect presented in duty is more weak, the value of dScale is generally 0.06, be 0.24 to the maximum, step represents the value of zero plane, general value is 128, by the value that arranges zero plane to realize going out screen or entering screen of object in final displayed scene.
From the foregoing, although the information of depth value is most important for DIBR Rendering algorithms, does not represent and do not allow any error, error is complete acceptable within the specific limits.Getting dScale is 0.24, and getting step is 128, and the span of (d (x, y)-step) is-128 to 128, and therefore the value of 1/dScale is approximately 4.When the error range of depth value is within 4, the result played up is the same.Therefore we only need to carry out deblocking effect process to the edge of object, and we only need carry out simple level and smooth at same interior of articles.
Very close at interior of articles depth value, and at the edge of object, then present stepped gradual change.
An inspection and repair method for blocking effect in 3D player, first determine which region is interior of articles region, which region is the border including object, and then to the smoothing operation in the region of interior of articles, edge part carries out deblocking effect operation.Idiographic flow as shown in Figure 2.
As shown in Figure 1, Fig. 1 shows the schematic flow sheet of the inspection and repair method of blocking effect in 3D player according to an embodiment of the invention, decoded depth map is divided into the block of 16X16, find out maximum depth value in block and be saved in maxValueOfPatch [i], wherein maxValueOfPatch is the array for preserving each piece of maximum, and i is the numbering of current block; Find out fast interior minimum depth value and be saved in minValueOfPatch [i], wherein minValueOfPatch is the array for preserving each piece of minimum value, and i is the numbering of current block; Calculate average depth value in block and be saved in avgValueOfPatch [i], wherein avgValueOfPatch is the array for preserving each piece of mean value, and i is the numbering of current block.The computational methods of mean value can be:
wherein i, j are fast interior line number and row number.
Judge whether the difference of the maxima and minima in this block is greater than threash1, if be greater than threash1, then this block be labeled as stable region, otherwise be labeled as unstable region.Namely stability region is expressed as isStableArea [i]=true, unstable region is expressed as isStableArea [i]=false, namely represent that this region exists blocking effect, wherein isStableArea is that i is the numbering of current block for preserving the array whether each piece be stable region.The value of threash1 is empirical value, is generally set to 10.
Judging whether this region is stable region, if this region is stable region, is then the mean value avgValueOfPatch [i] of this block by the depth value assignment of pixels all in this region.
If this region is unstable region, then make following operation:
As shown in Figure 2, first find out 8 adjacent areas in this region, judge whether the adjacent area 1,2,3,4,5,6,7,8 in Fig. 2 is stability region, select stability region and carry out next step judgement.
In the stability region selected, find out maximum depth value and be designated as depthMax.
In the stability region selected, find out minimum depth value and be designated as depthMin.
Pixel each in current region is done as follows:
Judge the current relation waiting to judge pixel and threash2.Wherein the value of threash2 is
The value of minValueOfPatch [i]+(maxValueOfPatch [i]-minValueOfPatch [i]) * ratio, ratio is 0.5.
If the value of current pixel point is greater than threash2, then by the value assignment of depthMax to current pixel point.
If the value of current pixel point is less than threash2, then by the value assignment of depthMin to current pixel point.
Repeat above operation, until all blocks are all disposed.
In this specification, each embodiment adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiment, identical similar portion cross-reference between each embodiment.
Spoken of in this manual " embodiment ", " another embodiment ", " embodiment ", etc., refer to the specific features, structure or the feature that describe in conjunction with this embodiment and be included at least one embodiment of the application's generality description.Multiple place occurs that statement of the same race is not necessarily refer to same embodiment in the description.Furthermore, when describing specific features, structure or a feature in conjunction with any embodiment, what advocate is also fall within the scope of the invention to realize this feature, structure or feature in conjunction with other embodiments.
Although with reference to multiple explanatory embodiment of the present invention, invention has been described here, but, should be appreciated that, those skilled in the art can design a lot of other amendment and execution mode, these amendments and execution mode will drop within spirit disclosed in the present application and spirit.More particularly, in the scope of and claim open in the application, multiple modification and improvement can be carried out to the building block of subject combination layout and/or layout.Except the modification of carrying out building block and/or layout is with except improvement, to those skilled in the art, other purposes also will be obvious.
Claims (7)
1. the inspection and repair method of blocking effect in 3D player, it is characterized in that interior zone or the fringe region of determining object, the process in its edge region comprises:
This depth map is also divided into a block by depth of decode figure;
Find out the maximum depth value in described piece and minimum depth value, and preserve respectively;
Compare with a set point by the difference of the maxima and minima in described piece, to judge that whether corresponding region is for stability region;
If judge, corresponding region is stable region, be then the mean value of this block by the depth value assignment of pixels all in this region;
If judge, current region is unstable region, then find out the adjacent area of this current region, and judge whether described adjacent area is stability region, and select the stability region of described adjacent area, in the stability region selected, find out maximum depth value and minimum depth value;
Pixel each in described current region is done as follows:
Judge the current relation waiting to judge pixel and another set point, if the value of current pixel point is greater than another set point described, then by the maximum depth value assignment in the stability region selected to current pixel point; If the value of current pixel point is less than another set point described, then by the minimum depth value assignment in the stability region selected to current pixel point.
2. the inspection and repair method of blocking effect in 3D player according to claim 1, is characterized in that described depth map is divided into the block of 16X16.
3. the inspection and repair method of blocking effect in 3D player according to claim 1, is characterized in that the computational methods of the mean value of described piece are:
wherein i, j are fast interior line number and row number.
4. the inspection and repair method of blocking effect in 3D player according to claim 1, is characterized in that a described set point is empirical value.
5. the inspection and repair method of blocking effect in 3D player according to claim 1, is characterized in that a described set point is 10.
6. the inspection and repair method of blocking effect in 3D player according to claim 1, is characterized in that described adjacent area selects 8 regions.
7. the inspection and repair method of blocking effect in 3D player according to claim 1, another set point described in it is characterized in that is the value of minValueOfPatch [i]+(maxValueOfPatch [i]-minValueOfPatch [i]) * ratio, ratio is 0.5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510058583.8A CN104717478B (en) | 2015-02-04 | 2015-02-04 | Method for detecting and repairing blocking effect in 3D player |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510058583.8A CN104717478B (en) | 2015-02-04 | 2015-02-04 | Method for detecting and repairing blocking effect in 3D player |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104717478A true CN104717478A (en) | 2015-06-17 |
| CN104717478B CN104717478B (en) | 2017-01-04 |
Family
ID=53416373
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510058583.8A Active CN104717478B (en) | 2015-02-04 | 2015-02-04 | Method for detecting and repairing blocking effect in 3D player |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104717478B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010003545A1 (en) * | 1999-12-08 | 2001-06-14 | Lg Electronics Inc. | Method for eliminating blocking effect in compressed video signal |
| KR100304897B1 (en) * | 1999-07-13 | 2001-11-01 | 구자홍 | Method of removal block effect and ringing effect for real time peocessing of compressed video signal |
| CN101527841A (en) * | 2008-03-06 | 2009-09-09 | 瑞昱半导体股份有限公司 | Method and device for eliminating image block effect |
| CN101540900A (en) * | 2008-03-20 | 2009-09-23 | 矽统科技股份有限公司 | Method for reducing block effect in video streaming |
| CN101790089A (en) * | 2009-01-23 | 2010-07-28 | 矽统科技股份有限公司 | Deblocking filtering method and image processing device |
| CN102098501A (en) * | 2009-12-09 | 2011-06-15 | 中兴通讯股份有限公司 | Method and device for removing block effects of video image |
| CN103997653A (en) * | 2014-05-12 | 2014-08-20 | 上海大学 | Depth video encoding method based on edges and oriented toward virtual visual rendering |
-
2015
- 2015-02-04 CN CN201510058583.8A patent/CN104717478B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100304897B1 (en) * | 1999-07-13 | 2001-11-01 | 구자홍 | Method of removal block effect and ringing effect for real time peocessing of compressed video signal |
| US20010003545A1 (en) * | 1999-12-08 | 2001-06-14 | Lg Electronics Inc. | Method for eliminating blocking effect in compressed video signal |
| CN101527841A (en) * | 2008-03-06 | 2009-09-09 | 瑞昱半导体股份有限公司 | Method and device for eliminating image block effect |
| CN101540900A (en) * | 2008-03-20 | 2009-09-23 | 矽统科技股份有限公司 | Method for reducing block effect in video streaming |
| CN101790089A (en) * | 2009-01-23 | 2010-07-28 | 矽统科技股份有限公司 | Deblocking filtering method and image processing device |
| CN102098501A (en) * | 2009-12-09 | 2011-06-15 | 中兴通讯股份有限公司 | Method and device for removing block effects of video image |
| CN103997653A (en) * | 2014-05-12 | 2014-08-20 | 上海大学 | Depth video encoding method based on edges and oriented toward virtual visual rendering |
Non-Patent Citations (2)
| Title |
|---|
| 杨戈等: "一种改进的基于后处理去除块效应算法", 《电子科技》 * |
| 石敏等: "一种基于边缘检测的去块效应算法", 《计算机工程与应用》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104717478B (en) | 2017-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6927980B2 (en) | Generating a triangular mesh for a 3D image | |
| JP5879528B2 (en) | Image generating apparatus and image generating method | |
| US9153032B2 (en) | Conversion method and apparatus with depth map generation | |
| EP2745269B1 (en) | Depth map processing | |
| US9639971B2 (en) | Image processing apparatus and method for processing transparency information of drawing commands | |
| US8810585B2 (en) | Method and apparatus for processing vertex | |
| CN102307312A (en) | Method for performing hole filling on destination image generated by depth-image-based rendering (DIBR) technology | |
| WO2012094076A9 (en) | Morphological anti-aliasing (mlaa) of a re-projection of a two-dimensional image | |
| CN103581650A (en) | Method for converting binocular 3D video into multicast 3D video | |
| Do et al. | GPU-accelerated real-time free-viewpoint DIBR for 3DTV | |
| US8619094B2 (en) | Morphological anti-aliasing (MLAA) of a re-projection of a two-dimensional image | |
| US20120133660A1 (en) | Data processing method and apparatus in heterogeneous multi-core environment | |
| TWI439961B (en) | Conversion algorithm for voids generated after converting 2D images | |
| US8577141B2 (en) | Method of enhancing contrast using bezier curve | |
| CN103337064A (en) | Method for removing mismatching point in image stereo matching | |
| CN104661014A (en) | Space-time combined cavity filling method | |
| CN104717478A (en) | Method for detecting and repairing blocking effect in 3D player | |
| CN106780705B (en) | Depth map robust smooth filtering method suitable for DIBR preprocessing process | |
| CN110910485A (en) | Immersive cave image manufacturing method | |
| CN110111380A (en) | 3D rendering transmission and method for reconstructing based on depth camera | |
| TW201428680A (en) | Image processing apparatus and foreground extraction method for stereo videos | |
| CN105141936B (en) | For the band direction FMM image repair methods of virtual visual point image | |
| Su et al. | A real-time full-HD 2D-to-3D conversion system using multicore technology | |
| Wang et al. | GPU based implementation of 3DTV system | |
| TW202137141A (en) | Methods and apparatus for edge compression anti-aliasing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |