WO2014036848A1 - Depth picture intra coding /decoding method and video coder/decoder - Google Patents

Depth picture intra coding /decoding method and video coder/decoder Download PDF

Info

Publication number
WO2014036848A1
WO2014036848A1 PCT/CN2013/077316 CN2013077316W WO2014036848A1 WO 2014036848 A1 WO2014036848 A1 WO 2014036848A1 CN 2013077316 W CN2013077316 W CN 2013077316W WO 2014036848 A1 WO2014036848 A1 WO 2014036848A1
Authority
WO
WIPO (PCT)
Prior art keywords
prediction
pattern
depth
unit
intra
Prior art date
Application number
PCT/CN2013/077316
Other languages
English (en)
French (fr)
Inventor
Hongbin Liu
Jie Jia
Siwei Ma
Shiqi Wang
Original Assignee
Lg Electronics (China) R & D Center Co., Ltd.
Peking University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lg Electronics (China) R & D Center Co., Ltd., Peking University filed Critical Lg Electronics (China) R & D Center Co., Ltd.
Publication of WO2014036848A1 publication Critical patent/WO2014036848A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167—Position within a video image, e.g. region of interest [ROI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding

Definitions

  • the invention relates to the technical fields of picture video coding/decoding as well as intra picture prediction, and more particularly, to depth picture intra coding/decoding method and video coder/decoder.
  • a depth picture is generally composed of smooth regions bounded by sharp edges.
  • the conventional intra prediction method based on a texture picture cannot well describe edge information. Therefore, at the 98 th MPEG meeting, HHI (Heinrich Hertz Institute) proposed an intra prediction method based on depth modeling to code the depth picture (H. Schwarz, K. Wegner, "Test Model under Consideration for HEVC based 3D video coding, ISO/IEC JTC1/SC29/WG11 MPEG, Doc. M12350, Nov.2011, Geneva, Switzerland).
  • the method totally includes four intra prediction patterns, wherein in the DMM3 (Depth Modeling Mode 3), each depth prediction unit (PU) is divided into two parts by a straight line for prediction. As shown in Fig.l, the prediction method is called as a Wedgelet method. For the two divided regions, either of them is predicted by a constant value.
  • each PU size corresponds to a number of prediction patterns.
  • the correspondence between the PU size and the number N of prediction patterns is shown in Table 1.
  • Table 1 correspondence between the PU size and the number of DMM3 prediction patterns
  • a coder takes a Co-located Texture Luma Block (CTLB) at the same position corresponding to a current depth PU as an original depth picture block, and calculates the optimal prediction pattern of a depth prediction unit based thereon.
  • a pixel value of a texture luma picture is expressed as I T
  • a prediction region 1 in the CTLB is Ri
  • a prediction region 2 is R 2
  • a pixel average value of the prediction region Ri is Ii ⁇ Ri)
  • a pixel average value of the prediction region R 2 is / ⁇ (3 ⁇ 4).
  • a predicted value of all pixels in the prediction region Ri is Ii ⁇ Ri), and a predicted value of all pixels in the prediction region R 2 is ⁇ (3 ⁇ 4
  • a distortion cost is obtained by calculating a mean square error of a predicted pixel value and a reconstructed pixel value, all the prediction patterns are searched, and the prediction pattern with the smallest distortion cost is selected as the optimal prediction pattern of the current depth prediction unit when the searching is stopped. That is:
  • a decoder calculates the optimal prediction pattern by the same method as the coder.
  • X.Zhao et al. proposed a DMM3 mode simplification scheme (X. Zhao, Y. Chen, L. Zhang, M. Karczewicz, 3D-CE6.h related: Depth Modeling Mode (DMM) 3 simplification for HTM, ISO/IEC JTC1/SC29/WG11 MPEG, Doc. JCT2-A0098, Swiss, 16-20, July 2012).
  • the scheme has a concept of using intra mode direction information of the CTLB to limit the prediction pattern to be searched, thereby defining a smaller available prediction pattern set, which reduces a searching space and decreases the complexity.
  • the scheme pre-judges whether a 4x 4 block at the top left of the CTLB corresponding to the current depth PU is intra prediction. If so, the DMM3 mode is allowed to be used; otherwise, the DMM3 mode is not allowed to be used. If the 4x 4 block at the top left of the CTLB adopts the intra prediction pattern, the searching for the optimal prediction pattern in the Wedgelet method is further performed.
  • the intra prediction direction of the 4x 4 block at the top left of the texture luma unit corresponding to the depth prediction unit is 0 or 1
  • it is determined that the prediction pattern is the available prediction pattern when the prediction pattern of the depth prediction unit is the 0 th prediction pattern in DMM3 (the corresponding region is divided such that one pixel at the top left belongs to one region, and other pixels belong to another region); or, when the intra prediction direction of the 4 x 4 block at the top left of the texture luma unit corresponding to the depth prediction unit is not 0 or 1, the difference between the intra prediction direction of the texture luma unit and the prediction pattern of the depth prediction unit is measured by using the following criterion, and each depth prediction pattern is mapped to an intra prediction direction by using the above difference, wherein the intra prediction direction refers to the intra prediction direction which the luma picture unit in the 3D-HEVC allows to adopt.
  • Start point coordinates of a division line for the prediction region of the prediction pattern in the Wedgelet method is set as S (Xs, Ys), and end point coordinates is E (Xe, Ye).
  • S start point coordinates of a division line for the prediction region of the prediction pattern in the Wedgelet method
  • E end point coordinates
  • For each prediction pattern there is a unique (S, E) combination corresponding thereto.
  • the intra prediction direction with the smallest difference is selected as the intra prediction direction to which the prediction pattern is mapped.
  • the prediction pattern can be taken as the available prediction pattern when the difference between the intra prediction direction to which the prediction pattern is mapped and the intra prediction direction of the 4x 4 block at the top left of the texture luma unit is within a preset range (for example, the difference of absolute value is less than or equal to 2); otherwise, the prediction pattern cannot be taken as the available prediction pattern.
  • a preset range for example, the difference of absolute value is less than or equal to 2
  • the searching at the coder/decoder is obtained by minimizing the difference between the predicted pixel value and the reconstructed pixel value of the texture picture. Therefore, the searched optimal prediction pattern is not necessarily a real optimal prediction pattern, which may influence the accuracy of the searching result.
  • An embodiment of the invention provides a depth picture intra coding method for decreasing the complexity of a video decoder and ensuring that the optimal prediction pattern be selected in depth modeling mode 3, the depth picture intra coding method including:
  • the prediction pattern being a prediction pattern in a depth modeling mode 3 (DMM3) in 3D-high efficiency video coding (3D-HEVC) corresponding to the depth prediction unit;
  • DMM3 depth modeling mode 3
  • 3D-HEVC 3D-high efficiency video coding
  • An embodiment of the invention further provides a depth picture intra decoding method for decreasing the complexity of a video decoder and ensuring that the optimal prediction pattern be selected in depth modeling mode 3, the depth picture intra decoding method including:
  • the prediction pattern being a prediction pattern in DMM3 in 3D-HEVC corresponding to the depth prediction unit;
  • An embodiment of the invention further provides a video coder for decreasing the complexity of a video decoder and ensuring that the optimal prediction pattern be selected in depth modeling mode 3, the video coder including: an available mode determining module, adapted to determine, according to preset rules, available prediction patterns from prediction patterns of a depth prediction unit, the prediction pattern being a prediction pattern in DMM3 in 3D-HEVC corresponding to the depth prediction unit;
  • a mean square error calculating module adapted to calculate, for the available prediction patterns, a mean square error of an original pixel value and a predicted pixel value of the corresponding depth prediction unit, to obtain a distortion cost
  • a selecting module adapted to select, from the available prediction patterns, a prediction pattern with the smallest mean square error as an optimal prediction pattern of the depth prediction unit;
  • a coding module adapted to code index information of the optimal prediction pattern, and perform depth picture intra coding according to the optimal prediction pattern.
  • An embodiment of the invention further provides a video decoder for decreasing the complexity of a video decoder and ensuring that the optimal prediction pattern be selected in depth modeling mode 3, the video decoder including:
  • an available mode determining module adapted to determine, according to preset rules, available prediction patterns from prediction patterns of a depth prediction unit, the prediction pattern being a prediction pattern in DMM3 in 3D-HEVC corresponding to the depth prediction unit;
  • an index information decoding module adapted to decode index information of optimal prediction pattern of the depth prediction unit
  • a determining module adapted to determine, according to the index information, an optimal prediction pattern of the depth prediction unit from the available prediction patterns
  • an intra decoding module adapted to perform, according to the optimal prediction pattern, depth picture intra decoding.
  • the available prediction patterns are determined from the prediction patterns of the depth prediction unit, and the optimal prediction pattern is obtained from the available prediction patterns, which may reduce the number of bits used in coding the index of the optimal prediction pattern, and decrease the complexity of coding/decoding; when selecting the optimal prediction pattern from the available prediction patterns, an coding end calculates the mean square error of the original pixel value and the predicted pixel value of the depth prediction unit to obtain the distortion cost, which can ensure the acquisition of the optimal prediction pattern as compared with a case in the prior art where the mean square error of the reconstructed pixel value and the predicted pixel value of the texture picture unit is calculated to obtain the distortion cost.
  • the coding end codes the index information of the optimal prediction pattern to be provided to a decoding end, thereby the decoding end does not need to search for the optimal prediction pattern when performing the depth picture intra decoding, the optimal prediction pattern can be directly obtained from the available prediction patterns by the index information, to be decoded, which greatly decreases the decoding complexity.
  • Fig.l is a schematic diagram of a depth prediction unit division in the Wedgelet method in the background art
  • Fig.2 is a flow chart of procedure of a depth picture intra coding method according to an embodiment of the invention.
  • Fig.3 is a flow chart of procedure of a depth picture intra decoding method according to an embodiment of the invention.
  • Fig.4 is a structural schematic diagram of a video coder according to an embodiment of the invention.
  • Fig.5 is a structural schematic diagram of a video decoder according to an embodiment of the invention. DETAILED DESCRIPTION OF THE EMBODIMENTS
  • Fig.2 is a flow chart of procedure of a depth picture intra coding method according to an embodiment of the invention. As shown in Fig.2, the method may include:
  • step 201 determining, according to preset rules, available prediction patterns from prediction patterns of a depth prediction unit, the prediction pattern being a prediction pattern in DMM3 in 3D-HEVC corresponding to the depth prediction unit;
  • step 202 calculating, for the available prediction patterns, a mean square error of an original pixel value and a predicted pixel value of the corresponding depth prediction unit, to obtain a distortion cost
  • step 203 selecting, from the available prediction patterns, a prediction pattern with the smallest distortion cost as an optimal prediction pattern of the depth prediction unit;
  • step 204 coding index information of the optimal prediction pattern, and performing depth picture intra coding according to the optimal prediction pattern.
  • the available prediction patterns are determined from the prediction patterns of the depth prediction unit, and the optimal prediction pattern is selected from the available prediction patterns, which may make the searching range for the optimal prediction pattern relatively small, reduce the number of bits used in coding the index of the optimal prediction pattern, and decrease the complexity of coding.
  • a 4x 4 block at the top left of the CTLB corresponding to the current depth PU is intra prediction. If so, the DMM3 mode is enabled; otherwise, the DMM3 mode is disabled. If the 4 x 4 block at the top left of the CTLB adopts the intra prediction pattern, the searching for the optimal prediction pattern in the Wedgelet method is further performed. The flow shown in Fig.2 is implemented.
  • the step of determining available prediction patterns from prediction patterns of a depth prediction unit according to preset rules may be:
  • the prediction pattern is an available prediction pattern when the prediction pattern of the depth prediction unit is the 0 th prediction pattern in DMM3 (the corresponding region is divided such that one pixel at the top left belongs to one region, and other pixels belong to another region);
  • the prediction pattern of the depth prediction unit is mapped to an intra prediction direction having the smallest difference from the prediction pattern, the intra prediction direction referring to the intra prediction direction which the luma picture unit in the 3D-HEVC allows to adopt;
  • the prediction pattern is determined as an available prediction pattern when the difference between the intra prediction direction to which the prediction pattern is mapped and the intra prediction direction of the 4x 4 block at the top left of the texture luma unit is within a preset range.
  • D[z] is the difference between the prediction pattern of the depth prediction unit and the z ' -th intra prediction direction
  • S (Xs, Ys) is the start point coordinates of a division line for the prediction region of the prediction pattern
  • E (Xe, Ye) is the end point coordinates of a division line for the prediction region of the prediction pattern
  • (Hi, Vi) is the directional information of the i-t intra prediction direction
  • z 2 ⁇ 34.
  • the intra prediction direction to which the prediction pattern is mapped is on the left or right side of the intra prediction direction of the 4x4 block at the top left of the texture luma unit with an angle of about 12 degrees; or the intra prediction direction of the 4x4 block at the top left of the texture luma unit is on the left or right side of the intra prediction direction to which the prediction pattern is mapped with an angle of about 12 degrees.
  • the unavailable prediction pattern is not within the searching range for the optimal prediction pattern, so that the searching range for the optimal prediction pattern can be relatively narrowed down, the number of bits used in coding the index of the optimal prediction pattern can be also reduced, and the coding complexity is decreased.
  • the embodiment of the invention when selecting the optimal prediction pattern from the available prediction patterns, the mean square error of the original pixel value and the predicted pixel value of the depth prediction unit is calculated to obtain the distortion cost, instead of the prior art in which the mean square error of the reconstructed pixel value and the predicted pixel value of the texture picture unit is calculated to obtain the distortion cost.
  • the embodiment of the invention can ensure the acquisition of the optimal prediction pattern.
  • ID is the depth prediction unit
  • I D (i) is the original pixel value of the position in the depth prediction unit
  • ID (RI) is the predicted pixel value of the prediction region Rj in the depth prediction unit
  • I D (R 2 ) is the predicted pixel value of the prediction region R2 in the depth prediction unit.
  • a prediction pattern with the smallest distortion cost is selected from the available prediction patterns, as an optimal prediction pattern of the depth prediction unit:
  • the index information of the optimal prediction pattern is coded to be provided to a decoding end, so that the decoding end does not need to search for the optimal prediction pattern when performing the depth picture intra decoding, but can obtain the optimal prediction pattern directly from the available prediction patterns by means of the index information so as to perform decoding, which greatly decreases the decoding complexity.
  • Fig. 3 is a flow chart of procedure of a depth picture intra decoding method according to an embodiment of the invention. As shown in Fig.3, the method may include:
  • step 301 determining, according to preset rules, available prediction patterns from prediction patterns of a depth prediction unit, the prediction pattern being a prediction pattern in DMM3 in 3D-HEVC corresponding to the depth prediction unit;
  • step 302 decoding index information of optimal prediction pattern of the depth prediction unit
  • step 303 determining, according to the index information, an optimal prediction pattern of the depth prediction unit from the available prediction patterns
  • step 304 performing, according to the optimal prediction pattern, depth picture intra decoding.
  • the available prediction patterns are determined from the prediction patterns of the depth prediction unit, and the optimal prediction pattern is obtained from the available prediction patterns, which may decrease the complexity of decoding;
  • the index information of the optimal prediction pattern provided by the coding end can be obtained through direct decoding, and it is possible to obtain the optimal prediction pattern from the available prediction patterns according to the index information, thereby does not need to search for the optimal prediction pattern, which greatly decreases the decoding complexity.
  • the step of the decoding end determining available prediction patterns from prediction patterns of a depth prediction unit according to preset rules may include:
  • the prediction pattern is an available prediction pattern when the prediction pattern of the depth prediction unit is the 0 th prediction pattern in DMM3 (the corresponding region is divided such that one pixel at the top left belongs to one region, and other pixels belong to another region);
  • the prediction pattern of the depth prediction unit is mapped to an intra prediction direction having the smallest difference from the prediction pattern, the intra prediction direction referring to the intra prediction direction which the luma picture unit in the 3D-HEVC allows to adopt;
  • the prediction pattern is determined as an available prediction pattern when the difference between the intra prediction direction to which the prediction pattern is mapped and the intra prediction direction of the 4x 4 block at the top left of the texture luma unit is within a preset range.
  • D[i ⁇ Vi x (Xs - Xe) - Hi x (Ye - Ys) ⁇
  • D[z] is the difference between the prediction pattern of the depth prediction unit and the z ' -th intra prediction direction
  • S (Xs, Ys) is the start point coordinates of a division line for the prediction region of the prediction pattern
  • E (Xe, Ye) is the end point coordinates of a division line for the prediction region of the prediction pattern
  • (Hi, Vi) is the directional information of the z ' -th intra prediction direction
  • z 2 ⁇ 34.
  • the prediction pattern is an available prediction pattern; otherwise, it can be determined that the prediction pattern is an unavailable prediction pattern.
  • an embodiment of the invention further provides a video coder and a video decoder as described in the following embodiment. Since the principle of the video coder to solve problems is similar to the depth picture intra coding method, and the principle of the video decoder to solve problems is similar to the depth picture intra decoding method, the implementations of the video coder and the video decoder can refer to the implementation of the corresponding method, and the same contents are not described again herein.
  • Fig.4 is a structural schematic diagram of a video coder according to an embodiment of the invention. As shown in Fig.4, the video coder may include:
  • an available mode determining module 401 adapted to determine, according to preset rules, available prediction patterns from prediction patterns of a depth prediction unit, the prediction pattern being a prediction pattern in DMM3 in 3D-HEVC corresponding to the depth prediction unit;
  • a mean square error calculating module 402 adapted to calculate, for the available prediction patterns, a mean square error of an original pixel value and a predicted pixel value of the corresponding depth prediction unit, to obtain a distortion cost;
  • a coding module 404 adapted to code index information of the optimal prediction pattern, and perform depth picture intra coding according to the optimal prediction pattern.
  • the available mode determining module 401 can be further adapted to: if the intra prediction direction of the 4x 4 block at the top left of the texture luma unit corresponding to the depth prediction unit is 0 or 1, determine that the prediction pattern is an available prediction pattern when the prediction pattern of the depth prediction unit is the 0 th prediction pattern in DMM3;
  • the intra prediction direction of the 4 x 4 block at the top left of the texture luma unit corresponding to the depth prediction unit is not 0 or 1, map the prediction pattern of the depth prediction unit to an intra prediction direction having the smallest difference from the prediction pattern, the intra prediction direction referring to the intra prediction direction which the luma picture unit in the 3D-HEVC allows to adopt; determine the prediction pattern as an available prediction pattern when the difference between the intra prediction direction to which the prediction pattern is mapped and the intra prediction direction of the 4x 4 block at the top left of the texture luma unit is within a preset range.
  • the available mode determining module 401 can be further adapted to: determine the difference between the prediction pattern and the intra prediction direction by the following formula:
  • D[z] is the difference between the prediction pattern of the depth prediction unit and the z ' -th intra prediction direction
  • S (Xs, Ys) is the start point coordinates of a division line for the prediction region of the prediction pattern
  • E (Xe, Ye) is the end point coordinates of a division line for the prediction region of the prediction pattern
  • (Hi, Vi) is the directional information of the i-t intra prediction direction
  • z 2 ⁇ 34.
  • the available mode determining module 401 can be further adapted to: determine the prediction pattern is an available prediction pattern when the intra prediction direction of the 4 x 4 block at the top left of the texture luma unit is not 0 or 1, and the difference of absolute value between the intra prediction direction to which the prediction pattern is mapped and the intra prediction direction of the 4x 4 block at the top left of the texture luma unit is less than or equal to 2.
  • the mean square error calculating module 402 can be further adapted to:
  • J ⁇ VD (0 - (*i )) 2 + ⁇ (ID V) - (#2 ))'
  • ID is the depth prediction unit
  • Io (i) is the original pixel value of the position in the depth prediction unit
  • ID (RI) is the predicted pixel value of the prediction region Ri in the depth prediction unit
  • ID (R 2 ) is the predicted pixel value of the prediction region R 2 in the depth prediction unit.
  • Fig.5 is a structural schematic diagram of a video decoder according to an embodiment of the invention. As shown in Fig.5, the video decoder may include:
  • an available mode determining module 501 adapted to determine, according to preset rules, available prediction patterns from prediction patterns of a depth prediction unit, the prediction pattern being a prediction pattern in DMM3 in 3D-HEVC corresponding to the depth prediction unit;
  • an index information decoding module 502 adapted to decode index information of optimal prediction pattern of the depth prediction unit
  • a determining module 503 adapted to determine, according to the index information, an optimal prediction pattern of the depth prediction unit from the available prediction patterns; and an intra decoding module 504, adapted to perform, according to the optimal prediction pattern, depth picture intra decoding.
  • the available mode determining module 501 can be further adapted to: if the intra prediction direction of the 4x 4 block at the top left of the texture luma unit corresponding to the depth prediction unit is 0 or 1, determine that the prediction pattern is an available prediction pattern when the prediction pattern of the depth prediction unit is the 0 th prediction pattern in DMM3;
  • the intra prediction direction of the 4 x 4 block at the top left of the texture luma unit corresponding to the depth prediction unit is not 0 or 1, map the prediction pattern of the depth prediction unit to an intra prediction direction having the smallest difference from the prediction pattern, the intra prediction direction referring to the intra prediction direction which the luma picture unit in the 3D-HEVC allows to adopt; determine the prediction pattern as an available prediction pattern when the difference between the intra prediction direction to which the prediction pattern is mapped and the intra prediction direction of the 4x 4 block at the top left of the texture luma unit is within a preset range.
  • the available mode determining module 501 can be further adapted to: determine the difference between the prediction pattern and the intra prediction direction by the following formula:
  • D[z] is the difference between the prediction pattern of the depth prediction unit and the z ' -th intra prediction direction
  • S (Xs, Ys) is the start point coordinates of a division line for the prediction region of the prediction pattern
  • E (Xe, Ye) is the end point coordinates of a division line for the prediction region of the prediction pattern
  • (Hi, Vi) is the directional information of the z ' -th intra prediction direction
  • z 2 ⁇ 34.
  • the available mode determining module 501 can be further adapted to: determine the prediction pattern is an available prediction pattern when the intra prediction direction of the 4 x 4 block at the top left of the texture luma unit is not 0 or 1, and the difference of absolute value between the intra prediction direction to which the prediction pattern is mapped and the intra prediction direction of the 4x 4 block at the top left of the texture luma unit is less than or equal to 2.
  • the available prediction patterns are determined from the prediction patterns of the depth prediction unit, and the optimal prediction pattern is obtained from the available prediction patterns, which may reduce the number of bits used in coding the index of the optimal prediction pattern, and decrease the complexity of coding/decoding; when selecting the optimal prediction pattern from the available prediction patterns, an coding end calculates the mean square error of the original pixel value and the predicted pixel value of the depth prediction unit to obtain the distortion cost, which can ensure the acquisition of the optimal prediction pattern as compared with a case in the prior art where the mean square error of the reconstructed pixel value and the predicted pixel value of the texture picture unit is calculated to obtain the distortion cost.
  • the coding end codes the index information of the optimal prediction pattern to be provided to a decoding end, thereby the decoding end does not need to search for the optimal prediction pattern when performing the depth picture intra decoding, the optimal prediction pattern can be directly obtained from the available prediction patterns by the index information, to be decoded, which greatly decreases the decoding complexity.
  • the embodiments of the invention can be applied to 3D video coding/decoding as well as multi-view video coding and decoding, for example, more specifically, to intra mode coding and decoding of a depth picture in 3D-HEVC.
  • the embodiments of the invention can be provided as a method, system, or computer program product. Therefore, the invention can adopt the form of a hardware-only embodiment, a software-only embodiment, or a software-hardware combined embodiment. Moreover, the invention can adopt the form of computer program product implemented on one or more computer applicable storage media (including, but not be limited to, disc storage, CD-ROM and optical memory, etc.) containing the computer applicable program codes therein.
  • computer applicable storage media including, but not be limited to, disc storage, CD-ROM and optical memory, etc.
  • the invention is described with reference to the flow charts and/or block diagrams of the method, apparatus (system) and computer program product according to the embodiment of the invention. It is to understand that each process and/or block in the flow chart and/or block diagram, and combination of the flow and/or block in the flow chart and/or block diagram can be implemented by the computer program instructions.
  • the computer program instructions can be provided to processors of the general-purpose computers, special purpose computers, embedded processors or other programmable data processing apparatuses to generate one machine, so as to generate a device for implementing the function specified in one or more flows in the flow chart and/or one or more blocks in the block diagrams by the instructions executed by the processors of the computers or other programmable data processing apparatuses.
  • the computer program instructions can be also stored in the computer readable memory capable of leading the computer or other programmable data processing apparatuses to operate in a specific way, so that the instructions stored in the computer readable memory generate the manufacturing product containing the instruction device which implements the functions specified in one or more flows in the flow charts and/or one or more blocks in the block diagrams.
  • the computer program instructions can be also loaded onto the computer or other programmable data processing apparatuses, such that the computer or other programmable apparatuses execute a series of operation steps to generate the processing implemented by the computer, so as to provide the step for implementing the functions specified in one or more flows in the flow charts and/or one or more blocks in the block diagrams by the instructions executed on the computers or other programmable apparatuses.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
PCT/CN2013/077316 2012-09-05 2013-06-17 Depth picture intra coding /decoding method and video coder/decoder WO2014036848A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210326165.9A CN103686165B (zh) 2012-09-05 2012-09-05 深度图像帧内编解码方法及视频编解码器
CN201210326165.9 2012-09-05

Publications (1)

Publication Number Publication Date
WO2014036848A1 true WO2014036848A1 (en) 2014-03-13

Family

ID=50236507

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/077316 WO2014036848A1 (en) 2012-09-05 2013-06-17 Depth picture intra coding /decoding method and video coder/decoder

Country Status (2)

Country Link
CN (1) CN103686165B (zh)
WO (1) WO2014036848A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015139634A1 (zh) * 2014-03-21 2015-09-24 华为技术有限公司 图像分割方式的编解码处理方法和装置
TWI581617B (zh) * 2014-06-13 2017-05-01 財團法人工業技術研究院 編碼方法與解碼方法、編解碼系統、編碼器與解碼器
CN104079943B (zh) * 2014-06-26 2017-11-28 华为技术有限公司 一种帧内深度图像块编码、解码的方法及装置
CN107810632A (zh) * 2015-05-06 2018-03-16 Ng编译码器股份有限公司 具有降低代价的块分割和细化的帧内模式选择的帧内预测处理器

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016049891A1 (en) * 2014-09-30 2016-04-07 Mediatek Singapore Pte. Ltd. Methods on segmentation coding in intra prediction
WO2016049913A1 (en) * 2014-09-30 2016-04-07 Mediatek Singapore Pte. Ltd. A simplified method for the depth modeling modes
CN105791863B (zh) * 2016-03-24 2018-11-30 西安电子科技大学 基于层的3d-hevc深度图帧内预测编码方法
US20180288439A1 (en) * 2017-03-31 2018-10-04 Mediatek Inc. Multiple Transform Prediction
CN108696750A (zh) * 2017-04-05 2018-10-23 深圳市中兴微电子技术有限公司 一种预测模式的判决方法及装置
CN107483931B (zh) * 2017-08-01 2019-10-08 南京邮电大学 一种基于显著度的hevc帧内编码深度划分快速决策方法
CN108337523B (zh) * 2018-01-31 2021-09-17 南京理工大学 基于dis遗传性的3d视频深度图像帧内快速编码方法
CN111385581B (zh) * 2018-12-28 2022-04-26 杭州海康威视数字技术股份有限公司 一种编解码方法及其设备
CN114157863B (zh) * 2022-02-07 2022-07-22 浙江智慧视频安防创新中心有限公司 基于数字视网膜的视频编码方法、系统及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009005626A2 (en) * 2007-06-28 2009-01-08 Thomson Licensing Single loop decoding of multi-vieuw coded video
WO2009051690A1 (en) * 2007-10-16 2009-04-23 Thomson Licensing Methods and apparatus for artifact removal for bit depth scalability
CN101521823A (zh) * 2009-03-27 2009-09-02 北京航空航天大学 空间相关的全景数据压缩方法
CN101547363A (zh) * 2009-04-03 2009-09-30 北京航空航天大学 一种空间相关的全景数据恢复方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101517768B1 (ko) * 2008-07-02 2015-05-06 삼성전자주식회사 영상의 부호화 방법 및 장치, 그 복호화 방법 및 장치

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009005626A2 (en) * 2007-06-28 2009-01-08 Thomson Licensing Single loop decoding of multi-vieuw coded video
WO2009051690A1 (en) * 2007-10-16 2009-04-23 Thomson Licensing Methods and apparatus for artifact removal for bit depth scalability
CN101521823A (zh) * 2009-03-27 2009-09-02 北京航空航天大学 空间相关的全景数据压缩方法
CN101547363A (zh) * 2009-04-03 2009-09-30 北京航空航天大学 一种空间相关的全景数据恢复方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
YANG XU ET AL.: "Efficient Intra-frame Coding Algorithm for the Depth Image in 3D video", JOURNAL OF XIDIAN UNIVERSITY., vol. 39, no. 3, June 2012 (2012-06-01), pages 7 - 13 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015139634A1 (zh) * 2014-03-21 2015-09-24 华为技术有限公司 图像分割方式的编解码处理方法和装置
TWI581617B (zh) * 2014-06-13 2017-05-01 財團法人工業技術研究院 編碼方法與解碼方法、編解碼系統、編碼器與解碼器
CN104079943B (zh) * 2014-06-26 2017-11-28 华为技术有限公司 一种帧内深度图像块编码、解码的方法及装置
US10218985B2 (en) 2014-06-26 2019-02-26 Huawei Technologies Co., Ltd. Intra-frame depth map block encoding and decoding methods, and apparatus
US10951901B2 (en) 2014-06-26 2021-03-16 Huawei Technologies Co., Ltd. Intra-frame depth map block encoding and decoding methods, and apparatus
CN107810632A (zh) * 2015-05-06 2018-03-16 Ng编译码器股份有限公司 具有降低代价的块分割和细化的帧内模式选择的帧内预测处理器
CN107810632B (zh) * 2015-05-06 2020-06-23 Ng编译码器股份有限公司 具有降低代价的块分割和细化的帧内模式选择的帧内预测处理器

Also Published As

Publication number Publication date
CN103686165B (zh) 2018-01-09
CN103686165A (zh) 2014-03-26

Similar Documents

Publication Publication Date Title
WO2014036848A1 (en) Depth picture intra coding /decoding method and video coder/decoder
US11234002B2 (en) Method and apparatus for encoding and decoding a texture block using depth based block partitioning
US11089330B2 (en) Method for sub-PU motion information inheritance in 3D video coding
WO2014114168A1 (en) Depth modeling mode coding and decoding method and video codec
CN108027983B (zh) 针对三维图像的三角形网格的生成
EP3065405A1 (en) Method for decoding video using buffer compression for motion vector competition
US20150264356A1 (en) Method of Simplified Depth Based Block Partitioning
KR20160070815A (ko) 비디오 코딩 블록의 파티션의 코너 비디오 부분을 결정하기 위한 방법
US9986257B2 (en) Method of lookup table size reduction for depth modelling mode in depth coding
US20140184739A1 (en) Foreground extraction method for stereo video
WO2020253528A1 (en) Systems and methods for predicting a coding block
US20200107026A1 (en) Intra-prediction for video coding using perspective information
da Silva et al. Fast mode selection algorithm based on texture analysis for 3D-HEVC intra prediction
CN110111380A (zh) 基于深度相机的3d图像传输及重建方法
CN110662073B (zh) 子块的边界滤波
Zhang et al. Simplified reference pixel selection for constant partition value coding in 3D-HEVC
WO2016123774A1 (zh) 编解码方法和编解码器
WO2015101251A1 (zh) 非对称运动分割方式编码的方法和编码设备
Maceira et al. Region-based depth map coding using a 3D scene representation
WO2015103747A1 (en) Motion parameter hole filling
CN103763557B (zh) 一种Do‑NBDV获取方法及视频解码装置
Wang et al. Fast mode decision in HEVC for depth image coding
WO2012174840A1 (en) Inter picture prediction encoding/decoding and method and apparatus for reference frame serial number encoding/decoding thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13835413

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13835413

Country of ref document: EP

Kind code of ref document: A1