WO2018076336A1 - 视频解码方法、视频解码装置和电子设备 - Google Patents

视频解码方法、视频解码装置和电子设备 Download PDF

Info

Publication number
WO2018076336A1
WO2018076336A1 PCT/CN2016/104007 CN2016104007W WO2018076336A1 WO 2018076336 A1 WO2018076336 A1 WO 2018076336A1 CN 2016104007 W CN2016104007 W CN 2016104007W WO 2018076336 A1 WO2018076336 A1 WO 2018076336A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
coding tree
filtering
video
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/104007
Other languages
English (en)
French (fr)
Inventor
冷杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu Ltd
Original Assignee
Fujitsu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Ltd filed Critical Fujitsu Ltd
Priority to PCT/CN2016/104007 priority Critical patent/WO2018076336A1/zh
Publication of WO2018076336A1 publication Critical patent/WO2018076336A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals

Definitions

  • the present application relates to the field of video processing, and in particular, to a video decoding method, a video decoding apparatus, and an electronic device.
  • HEVC High Efficiency Video Coding
  • FIG. 1 is a schematic diagram of decoding video data by using a frame-level multi-thread decoding method.
  • step 101 of the method all coding tree units in a video image are generated by parsing and reconstruction.
  • CTU 0 to CTU last, then, in step 102, performing deblocking filter processing and sample adaptive offset (SAO) processing based on all coding tree units in the frame video image, To generate the frame video image.
  • SAO sample adaptive offset
  • the inventor of the present application has found that the existing frame-level multi-threaded video decoding method has its own drawbacks. For example, when generating a frame of video image, the method needs to wait for all coding tree units to be formed before deblocking filtering can be performed. Processing, and after performing deblocking filtering processing on all coding tree units, sampling adaptive offset processing can be performed, that is, processing for parsing, reconstructing, and filtering a frame of video image is serial. It is difficult to quickly decode video data to obtain a video image frame, which is particularly prominent in the field of fast acquisition of video images, such as observation using an endoscope.
  • Embodiments of the present application provide a video decoding method, a video decoding apparatus, and an electronic device, which are related to video data.
  • Multi-thread decoding is performed at the coding tree unit level (CTU level), whereby the decoding time is shortened, and the video image frame can be quickly obtained.
  • CTU level coding tree unit level
  • a video decoding apparatus for decoding video data to obtain a video image frame, the video decoding apparatus comprising:
  • a parsing unit configured to parse a stream of video data to obtain parsed data corresponding to each coding tree unit (CTU) of the video image frame;
  • a reconstruction unit configured to perform a reconstruction process according to the parsed data acquired by the parsing unit to generate a coding tree unit (CTU);
  • CTU coding tree unit
  • a filtering unit configured to perform filtering processing according to the coding tree unit (CTU) generated by the reconstruction unit, to obtain a video image frame, where the first predetermined number of coding tree units are acquired by the parsing unit
  • the reconstruction unit performs a reconstruction process according to the parsed data that the parsing unit has acquired, and performs a reconstruction process in the refactoring unit.
  • the parsing unit continues to parse the stream of the video data to obtain parsed data corresponding to the remaining coding tree unit (CTU) of the video image frame;
  • the filtering unit performs filtering processing according to a coding tree unit (CTU) generated by the reconstruction unit, and performs filtering in the filtering unit.
  • the reconstruction unit proceeds with reconstruction processing to generate a residual coding tree unit (CTU) of the video image frame.
  • a video decoding method for decoding video data to obtain a video image frame, where the video decoding method includes:
  • Parsing a stream of video data to obtain parsed data corresponding to each coding tree unit (CTU) of the video image frame;
  • CTU coding tree unit
  • Performing filtering processing according to the generated coding tree unit (CTU) to obtain a video image frame wherein, when the first predetermined number of coding tree units (CTUs) corresponding to the parsed data are acquired, according to the already acquired Parsing the data for reconstruction processing, and, when performing a reconstruction process, continuing to parse the stream of the video data to obtain a remaining frame with the video image Parsing data corresponding to a coding tree unit (CTU); generating a second predetermined number of coding tree units
  • filtering processing is performed according to the generated coding tree unit (CTU), and when filtering processing is performed, reconstruction processing is continued to generate a residual coding tree unit (CTU) of the video image frame.
  • an electronic device including the video decoding device according to the first aspect of the embodiments of the present application.
  • the beneficial effects of the present application are: multi-thread decoding of coding tree unit level (CTU level) of video data, thereby shortening the decoding time and obtaining a video image frame quickly.
  • CTU level coding tree unit level
  • 1 is a schematic diagram of decoding video data by using a frame-level multi-thread decoding method
  • FIG. 2 is a schematic diagram of a video decoding apparatus according to Embodiment 1 of the present application.
  • FIG. 3 is a schematic diagram of a filtering unit according to Embodiment 1 of the present application.
  • FIG. 4 is a schematic diagram of a second filtering unit according to Embodiment 1 of the present application.
  • FIG. 5 is a schematic diagram of a relationship between an offset unit and a coding tree unit according to Embodiment 1 of the present application;
  • FIG. 6 is a schematic diagram of a decoding process of a video decoding apparatus according to Embodiment 1 of the present application;
  • FIG. 7 is a schematic diagram of a video decoding method according to Embodiment 2 of the present application.
  • FIG. 8 is a schematic diagram of a filtering processing method according to Embodiment 2 of the present application.
  • FIG. 9 is a schematic diagram of a method for performing sampling adaptive offset processing according to Embodiment 2 of the present application.
  • FIG. 10 is a schematic diagram showing the configuration of an electronic device according to Embodiment 3 of the present application.
  • Embodiment 1 of the present application provides a video decoding apparatus for decoding video data to obtain a video image frame.
  • 2 is a schematic diagram of a video decoding apparatus according to Embodiment 1.
  • the video decoding apparatus 200 may include a parsing unit 201, a reconstruction unit 202, and a filtering unit 203.
  • the parsing unit 201 is configured to parse a stream of video data to obtain parsing data corresponding to each coding tree unit (CTU) of the video image frame; Performing a reconstruction process according to the parsed data acquired by the parsing unit 201 to generate each coding tree unit (CTU) of the video image frame; the filtering unit 203 is configured to generate the coding tree unit according to the reconstruction unit 202 ( CTU) performs filtering processing to obtain a video image frame.
  • CTU reconstruction tree unit
  • the resolving unit 202 may perform reconfiguration processing according to the parsed data that the parsing unit 201 has acquired. And, while the reconstruction unit 202 performs the reconstruction process, the parsing unit 201 may continue to parse the stream of video data to obtain a remaining coding tree unit (CTU) with the video image frame.
  • CTU coding tree unit
  • the filtering unit 203 may perform filtering processing according to the coding tree unit (CTU) generated by the reconstruction unit 202, and When the filtering unit 203 performs the filtering process, the reconstruction unit 202 may continue the reconstruction process to generate a residual coding tree unit (CTU) of the video image frame, whereby, for one video image frame, the reconstruction unit 202 and The filtering unit 203 can perform parallel processing to improve decoding efficiency.
  • CTU coding tree unit
  • the parsing unit 201, the reconstructing unit 202, and the filtering unit 203 can perform parallel processing, that is, at the same time, the parsing unit 201 and the resolving unit 202 and filtering unit 203 can process different coding tree units in the video image frame, thereby enabling multi-thread decoding at the coding tree unit level in one video image frame, thereby improving decoding efficiency of video data, and Get a video image frame quickly.
  • the parsing unit 201 may parse the code stream of the video data to obtain parsed data, and the parsing data may be, for example, header information data of the code stream, and the parsing may be, for example, a network abstract layer (Network Abstract Layer, NAL) header information parsing, video parameter set (VPS) header information parsing, sequence parameter set (SPS) header information parsing, and/or picture parameter set (PPS) header information parsing, etc. .
  • NAL Network Abstract Layer
  • NAL Network Abstract Layer
  • VPS video parameter set
  • SPS sequence parameter set
  • PPS picture parameter set
  • the timing at which the parsing unit 201 starts the parsing process may be controlled by the processing progress of the reconstructing unit 202 and/or the filtering unit 203, for example, the filtering unit 203 does not complete the encoding trees for the current video image frame.
  • the filtering processing or reconstruction unit 202 of the unit (CTU) does not complete all the coding tree units (CTUs) of the current video image frame
  • the parsing unit 201 may not start the analysis processing corresponding to the video image of the next frame, thereby You can avoid data confusion when decoding to generate different video image frames.
  • the reconstruction unit 202 may perform a reconstruction process according to the parsed data obtained by the parsing unit 201 to generate each coding tree unit in the video image frame.
  • the reconstruction unit 202 may be based on the frame. This reconstruction process is performed by inter prediction and/or intra prediction. Regarding the specific manner of the reconstruction process, reference may be made to the prior art, which is not described in this embodiment.
  • FIG. 3 is a schematic diagram of the filtering unit of the embodiment.
  • the filtering unit 203 may include a first filtering unit 301 and a second filtering unit 302.
  • the first filtering unit 301 is configured to perform deblocking filtering processing according to the coding tree unit (CTU) generated by the reconstruction unit 202; the second filtering unit 302 is configured to perform according to the first filtering unit 301.
  • CTU coding tree unit
  • SAO Sample Adaptive Offset
  • the first filtering unit 301 may perform deblocking filtering processing on the offset unit having an offset with respect to the coding tree unit (CTU), wherein each offset unit may be relative to each generated coding tree unit.
  • CTU coding tree unit
  • the coding tree unit (CTU) is shifted 4 pixels to the left and 4 pixels upward.
  • the second filtering unit 302 performs sampling adaptive offset (SAO) processing on the coding tree unit based on the result of the deblocking filtering process of the first filtering unit 301, where the first filtering unit 301 is completed.
  • SAO sampling adaptive offset
  • the second filtering unit 302 may perform adaptive offset based on the third predetermined number of offset units that have performed the past block filtering process (SAO Processing, whereby, for one video image frame, the first filtering unit 301 and the second filtering unit 302 can perform parallel processing to improve decoding efficiency.
  • the second filtering unit 302 may include a selecting subunit 401 and a filtering subunit 402.
  • the selecting subunit 401 may select a first coding tree unit (CTU) in a coding tree unit (CTU) that has not been subjected to oversampling adaptive offset (SAO) processing according to a processing result of the first filtering unit 301, where The offset unit in which all the pixels in the first coding tree unit (CTU) are located is subjected to the past block filtering process by the first filtering unit 301; the first coding tree unit selected by the filtering sub-unit 402 on the selection sub-unit 401 (CTU) performs sampling adaptive offset (SAO) processing.
  • CTU first coding tree unit
  • SAO sampling adaptive offset
  • the second filtering unit 302 needs to perform the sample adaptive offset (SAO) processing on the coding tree unit in the case where each pixel in each coding tree unit is subjected to the past block filtering process; Since there is an offset between the offset unit and the coding tree unit, there is a case where some pixels in a certain coding tree unit are not subjected to the past block filtering process. Therefore, the selection sub-unit 401 needs to pick out the coding tree unit, that is, the first coding tree unit, in which each pixel is subjected to the past block filtering process, and the sampling sub-unit performs sampling adaptive offset on the first coding tree unit. (SAO) processing.
  • SAO sample adaptive offset
  • Figure 5 is a schematic diagram of the relationship between an offset unit and a coding tree unit. As shown in FIG. 5, in the video image frame 500, there are a total of M rows of coding tree units, and each row of coding tree units includes (N+1) coding tree units, wherein the first row coding tree unit is CTU10 to CTU1N.
  • the offset unit corresponding to each coding tree unit in the first row is CTU'10 ⁇ CTU'1N
  • the coding tree unit in the second row is CTU20 ⁇ CTU2N
  • the offset unit corresponding to each coding tree unit in the second row is CTU' 20 to CTU '2N
  • each coding tree unit is represented by a solid line frame
  • each offset unit is represented by a dashed box
  • each offset unit can be moved to the left by 4 pixels with respect to each generated coding tree unit (CTU), and Move up 4 pixels.
  • each of the offset units CTU'10 to CTU'1N of the first row is In the case where the deblocking filtering process is performed, 4*4 pixels in the lower right corner of each coding tree unit of the first row are not subjected to deblocking filtering processing, as shown by the hatched area 501 of FIG. 5, therefore, The selection subunit 401 is temporarily unable to select the first coding tree unit from the first row coding tree unit.
  • the selector Unit 401 may select coding tree unit CTU10 as the first coding tree unit, and filter sub-unit 402 may perform sample adaptive offset (SAO) processing on coding tree unit CTU10.
  • SAO sample adaptive offset
  • the specific processing manner of performing the sampling adaptive offset processing may refer to the prior art, and is not described in this embodiment.
  • the decoded video image frame is obtained.
  • the parsing unit 201, the reconstructing unit 202, and the filtering unit 203 can perform parallel processing on the video image frame, thereby enabling one video image to be realized. Multi-thread decoding at the coding tree unit level in the frame, thereby improving the decoding efficiency of the video data, and quickly obtaining a video image frame.
  • Figure 6 is a schematic diagram of the decoding process.
  • the parsing unit 201, the reconstructing unit 202, and the filtering unit 203 of the video decoding apparatus 200 may be controlled by three threads 601, 602, and 603, and the video image frame includes (L+1) coding units CTU0 ⁇ . CTUL.
  • the horizontal axis of the coordinate axis in Fig. 6 represents time t, and the vertical axis represents each thread.
  • the resolving unit 202 may perform reconfiguration processing according to the parsed data that the parsing unit 201 has acquired.
  • the first predetermined number may be 1, that is, in the case that the parsing unit 201 acquires the parsed data corresponding to the coding tree unit CTU0, the re-establishing unit 202 may be under the control of the thread 602, according to the parsing unit 201.
  • the acquired parsed data corresponding to the coding tree unit CTU0 is subjected to reconstruction processing to generate a coding tree unit CTU0.
  • the parsing unit 201 continues to parse the code stream of the video image data to acquire the parsed data corresponding to the remaining coding tree unit of the video image frame. .
  • the filtering unit 203 performs filtering processing according to the coding tree unit (CTU) generated by the reconstruction unit 202, for example,
  • the second predetermined number may be 1, that is, in the case that the reconstruction unit 202 generates the coding tree unit CTU0, the filtering unit 203 may perform filtering according to the coding tree unit CTU0 generated by the reconstruction unit 202 under the control of the thread 603. Process to obtain a video image frame.
  • the reconstruction unit 202 proceeds to perform reconstruction processing to generate a residual coding tree unit (CTU) of the video image frame.
  • CTU residual coding tree unit
  • the filtering process or the reconstruction unit 202 that does not complete the coding tree unit (CTU) for the current video image frame at the filtering unit 203 does not complete the coding tree unit (CTU) for the current video image frame.
  • the parsing unit 201 may not perform the parsing process corresponding to the next frame of the video image frame under the control of the thread 601.
  • the parsing unit 201, the reconstructing unit 202, and the filtering unit 203 of the decoding device 200 can process different coding tree units in one video image frame, thereby It can realize multi-thread decoding at the coding tree unit level in one video image frame, thereby improving the decoding efficiency of the video data, and quickly obtaining a video image frame.
  • Embodiment 2 of the present application provides a video decoding method corresponding to the video decoding apparatus of Embodiment 1.
  • FIG. 7 is a schematic diagram of a video decoding method according to this embodiment. As shown in FIG. 7, the video decoding method includes:
  • Step 701 Parse a stream of video data to obtain parsed data corresponding to each coding tree unit (CTU) of the video image frame.
  • CTU coding tree unit
  • Step 702 Perform reconstruction processing according to the acquired parsed data to generate a coding tree unit (CTU);
  • CTU coding tree unit
  • Step 703 Perform filtering processing according to the generated coding tree unit (CTU) to obtain a video image frame.
  • CTU coding tree unit
  • step 702 reconstruction is performed according to the parsed data that has been acquired. Processing, and, when performing a reconstruction process, continuing to parse the stream of the video data to obtain a corresponding coding tree unit (CTU) of the video image frame Analytic data; in the case where a second predetermined number of coding tree units (CTUs) are generated, filtering processing is performed according to the generated coding tree unit (CTU), and when filtering processing is performed, reconstruction processing is continued to A residual coding tree unit (CTU) of the video image frame is generated.
  • CTU coding tree unit
  • step 701 in the case where the filtering processing for each coding tree unit (CTU) of the current video image frame is not completed in step 703, step 701 does not perform the analysis processing corresponding to the next frame video image frame.
  • CTU coding tree unit
  • FIG. 8 is a schematic diagram of a filtering processing method according to the generated coding tree unit (CTU) according to the embodiment. As shown in FIG. 8, the method includes:
  • Step 801 Perform deblocking filter processing according to the coding tree unit (CTU);
  • Step 802 Perform a sample adaptive offset (SAO) process according to the result of the deblocking filtering process.
  • SAO sample adaptive offset
  • FIG. 9 is a schematic diagram of a method for performing sample adaptive offset processing according to a result of a deblocking filtering process according to the embodiment. As shown in FIG. 9, the method includes:
  • Step 901 Select, according to a result of the deblocking filtering process, a first coding tree unit (CTU) in the coding tree unit (CTU) that has not been subjected to sample adaptive offset (SAO) processing, where The offset unit in which all the pixels in the first coding tree unit (CTU) are located is subjected to a de-blocking filter process by the first filtering unit;
  • SAO sample adaptive offset
  • Step 902 Perform sample adaptive offset (SAO) processing on the selected first coding tree unit (CTU).
  • SAO sample adaptive offset
  • the parsing, reconstruction processing and filtering processing can perform parallel processing on the video image frame, thereby enabling encoding in a video image frame.
  • Multi-thread decoding at the tree unit level thereby improving the decoding efficiency of video data, and quickly obtaining a video image frame.
  • Embodiment 3 of the present application provides an electronic device, where the electronic device includes the video decoding device as described in Embodiment 1.
  • FIG. 10 is a schematic diagram showing the configuration of an electronic device according to Embodiment 3 of the present application.
  • the electronic device 1000 can include a central processing unit (CPU) 1001 and a memory 1002; the memory 1002 is coupled to the central processing unit 1001.
  • the memory 1002 can store various data; in addition, a program for video decoding is stored, and the program is executed under the control of the central processing unit 1001.
  • the functionality of the video decoding device can be integrated into the central processor 1001.
  • the central processing unit 1001 can be configured to:
  • Parsing a stream of video data to obtain parsed data corresponding to each coding tree unit (CTU) of the video image frame;
  • CTU coding tree unit
  • Performing filtering processing according to the generated coding tree unit (CTU) to obtain a video image frame wherein, when the first predetermined number of coding tree units (CTUs) corresponding to the parsed data are acquired, according to the already acquired Parsing the data for reconstruction processing, and, when performing a reconstruction process, continuing to parse the stream of the video data to obtain a remaining frame with the video image Parsing data corresponding to a coding tree unit (CTU);
  • CTUs coding tree units
  • filtering processing is performed according to the generated coding tree unit (CTU), and when filtering processing is performed, reconstruction processing is continued to generate the video The remaining coding tree unit (CTU) of the image frame.
  • the central processing unit 1001 can also be configured to:
  • the central processing unit 1001 can also be configured to:
  • the reconstruction process is performed based on inter prediction and/or intra prediction.
  • the central processing unit 1001 can also be configured to:
  • CTU coding tree unit
  • a Sample Adaptive Offset (SAO) process is performed.
  • the central processing unit 1001 can also be configured to:
  • a de-blocking filter process is performed on pixels in the offset unit, wherein the offset unit moves a predetermined number of pixels in a predetermined direction with respect to the coding tree unit (CTU).
  • CTU coding tree unit
  • the central processing unit 1001 can also be configured to:
  • a first coding tree unit (CTU) in the coding tree unit (CTU) that has not been subjected to Sample Adaptive Offset (SAO) processing wherein The offset unit in which all the pixels in the first coding tree unit (CTU) are located is subjected to a de-blocking filter process by the first filtering unit;
  • a sample adaptive offset (SAO) process is performed on the selected first coding tree unit (CTU).
  • the electronic device 1000 may further include: an input and output unit 1003, a display unit 1004, and the like; wherein the functions of the above components are similar to those of the prior art, and details are not described herein again. It should be noted that the electronic device 1000 does not have to include all the components shown in FIG. 10; in addition, the electronic device 1000 may further include components not shown in FIG. 10, and reference may be made to the prior art.
  • the embodiment of the present application further provides a computer readable program, wherein the program causes the video decoding device or the electronic device to perform the video decoding described in Embodiment 2 when the program is executed in a video decoding device or an electronic device method.
  • the embodiment of the present application further provides a storage medium storing a computer readable program, wherein the storage medium stores the computer readable program, wherein the computer readable program causes the video decoding device or the electronic device to perform the embodiment 2 Video decoding method.
  • a video decoding apparatus described in connection with an embodiment of the present invention may be directly embodied as hardware, a software module executed by a processor, or a combination of both.
  • one or more of the functional blocks shown in Figures 2-4 and/or one or more combinations of functional blocks may correspond to various software modules of a computer program flow, or to individual hardware modules.
  • These software modules may correspond to the respective steps shown in Embodiment 2, respectively.
  • These hardware modules can be implemented, for example, by curing these software modules using a Field Programmable Gate Array (FPGA).
  • FPGA Field Programmable Gate Array
  • the software module can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.
  • a storage medium can be coupled to the processor to enable the processor to read information from, and write information to, the storage medium; or the storage medium can be an integral part of the processor.
  • Processor And the storage medium can be located in the ASIC.
  • the software module can be stored in the memory of the mobile terminal or in a memory card that can be inserted into the mobile terminal.
  • the software module can be stored in the MEGA-SIM card or a large-capacity flash memory device.
  • One or more of the functional block diagrams described with respect to Figures 2-4 and/or one or more combinations of functional block diagrams may be implemented as a general purpose processor, digital signal processor (DSP) for performing the functions described herein.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • One or more of the functional block diagrams described with respect to Figures 2-4 and/or one or more combinations of functional block diagrams may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, multiple microprocessors One or more microprocessors in conjunction with DSP communication or any other such configuration.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

本申请实施例提供一种视频解码方法、视频解码装置和电子设备,该视频解码装置包括:解析单元,其用于对视频数据的码流进行解析,以获取与视频图像帧的各编码树单元对应的解析数据;重构单元,其用于根据所述解析单元所获取的所述解析数据,进行重构处理,以生成编码树单元;以及滤波单元,其用于根据所述重构单元所生成的所述编码树单元进行滤波处理,以获得视频图像帧。根据本申请的实施例,在对视频数据解码以生成一个视频图像帧的过程中,解析单元、重构单元和滤波单元可以进行并行处理,由此,能够实现一个视频图像帧内的编码树单元级别的多线程解码,从而提高对视频数据的解码效率,能够快速地得到一个视频图像帧。

Description

视频解码方法、视频解码装置和电子设备 技术领域
本申请涉及视频处理领域,尤其涉及一种视频解码方法、视频解码装置和电子设备。
背景技术
随着电子技术的不断发展,视频信息已经成为人们生活和工作中不可缺少的一部分。
为了更好地适应超高清视频业务的需求,新一代的视频压缩标准-高效视频编码(High Efficiency Video Coding,HEVC)标准被指定。
在现有的基于高效视频编码(HEVC)标准的解码器中,通常使用帧级别(frame level)的多线程解码(decoding)方式。图1是采用帧级别的多线程解码方式对视频数据进行解码的一个示意图,如图1所示,在该方法的步骤101中,通过解析和重构生成一帧视频图像中的所有编码树单元CTU 0~CTU last,然后,在步骤102中,基于该帧视频图像中的所有编码树单元进行去块滤波(de-blocking filter)处理和取样自适应偏移(Sample Adaptive Offset,SAO)处理,以生成该帧视频图像。
应该注意,上面对技术背景的介绍只是为了方便对本申请的技术方案进行清楚、完整的说明,并方便本领域技术人员的理解而阐述的。不能仅仅因为这些方案在本申请的背景技术部分进行了阐述而认为上述技术方案为本领域技术人员所公知。
申请内容
本申请的发明人发现,现有的帧级别多线程视频解码方式存在自身的缺陷,例如,该方法在生成一帧视频图像时,需要待全部编码树单元都形成了以后,才能进行去块滤波处理,并且在对全部编码树单元进行去块滤波处理以后,才能进行取样自适应偏移处理,也就是说,用于生成一帧视频图像的解析、重构和滤波等处理是串行的,难以快速地对视频数据进行解码以得到视频图像帧,这一问题在例如使用内窥镜进行观察等需要快速获取视频图像的领域中显得尤为突出。
本申请的实施例提供一种视频解码方法、视频解码装置和电子设备,对视频数据 进行编码树单元级别(CTU level)的多线程解码,由此,缩短了解码时间,能够快速得到视频图像帧。
根据本申请实施例的第一方面,提供一种视频解码装置,用于对视频数据进行解码,以获得视频图像帧,该视频解码装置包括:
解析单元,其用于对视频数据的码流(stream)进行解析(sparse),以获取与视频图像帧的各编码树单元(CTU)对应的解析数据;
重构单元,其用于根据所述解析单元所获取的所述解析数据,进行重构(reconstruct)处理,以生成编码树单元(CTU);以及
滤波单元,其用于根据所述重构单元所生成的所述编码树单元(CTU)进行滤波处理,以获得视频图像帧,其中,在所述解析单元获取了第一预定数量的编码树单元(CTU)所对应的解析数据的情况下,所述重构单元根据所述解析单元已经获取的解析数据进行重构(reconstruct)处理,并且,在所述重构单元进行重构(reconstruct)处理时,所述解析单元继续对所述视频数据的码流(stream)进行解析(sparse),以获取与所述视频图像帧的剩余编码树单元(CTU)所对应的解析数据;在所述重构单元生成了第二预定数量的编码树单元(CTU)的情况下,所述滤波单元根据所述重构单元生成的编码树单元(CTU)进行滤波处理,并且,在所述滤波单元进行滤波处理时,所述重构单元继续进行重构处理,以生成所述视频图像帧的剩余编码树单元(CTU)。
根据本申请实施例的第二方面,提供一种视频解码方法,用于对视频数据进行解码,以获得视频图像帧,该视频解码方法包括:
对视频数据的码流(stream)进行解析(sparse),以获取与视频图像帧的各编码树单元(CTU)对应的解析数据;
根据所获取的所述解析数据,进行重构(reconstruct)处理,以生成编码树单元(CTU);以及
根据所生成的所述编码树单元(CTU)进行滤波处理,以获得视频图像帧,其中,获取了第一预定数量的编码树单元(CTU)所对应的解析数据的情况下,根据已经获取的解析数据进行重构(reconstruct)处理,并且,在进行重构(reconstruct)处理时,继续对所述视频数据的码流(stream)进行解析(sparse),以获取与所述视频图像帧的剩余编码树单元(CTU)所对应的解析数据;在生成了第二预定数量的编码树单元 (CTU)的情况下,根据生成的编码树单元(CTU)进行滤波处理,并且,在进行滤波处理时,继续进行重构处理,以生成所述视频图像帧的剩余编码树单元(CTU)。
根据本申请实施例的第三方面,提供一种电子设备,包括本申请实施例第一方面所述的视频解码装置。
本申请的有益效果在于:对视频数据进行编码树单元级别(CTU level)的多线程解码,由此,缩短了解码时间,能够快速得到视频图像帧。
参照后文的说明和附图,详细公开了本发明的特定实施方式,指明了本发明的原理可以被采用的方式。应该理解,本发明的实施方式在范围上并不因而受到限制。在所附权利要求的精神和条款的范围内,本发明的实施方式包括许多改变、修改和等同。
针对一种实施方式描述和/或示出的特征可以以相同或类似的方式在一个或更多个其它实施方式中使用,与其它实施方式中的特征相组合,或替代其它实施方式中的特征。
应该强调,术语“包括/包含”在本文使用时指特征、整件、步骤或组件的存在,但并不排除一个或更多个其它特征、整件、步骤或组件的存在或附加。
附图说明
所包括的附图用来提供对本发明实施例的进一步的理解,其构成了说明书的一部分,用于例示本发明的实施方式,并与文字描述一起来阐释本发明的原理。显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。在附图中:
图1是采用帧级别的多线程解码方式对视频数据进行解码的一个示意图;
图2是本申请实施例1的视频解码装置的一个示意图;
图3是本申请实施例1的滤波单元的一个示意图;
图4是本申请实施例1的第二滤波单元的一个示意图;
图5是本申请实施例1的偏移单元与编码树单元的关系的一个示意图;
图6是本申请实施例1的视频解码装置的解码流程的一个示意图;
图7是本申请实施例2的视频解码方法的一个示意图;
图8是本申请实施例2的进行滤波处理方法的一个示意图;
图9是本申请实施例2的进行取样自适应偏移处理的方法的一个示意图;
图10是本申请实施例3的电子设备的一个构成示意图。
具体实施方式
参照附图,通过下面的说明书,本申请的前述以及其它特征将变得明显。在说明书和附图中,具体公开了本申请的特定实施方式,其表明了其中可以采用本申请的原则的部分实施方式,应了解的是,本申请不限于所描述的实施方式,相反,本申请包括落入所附权利要求的范围内的全部修改、变型以及等同物。下面结合附图对本申请的各种实施方式进行说明。这些实施方式只是示例性的,不是对本申请的限制。
实施例1
本申请实施例1提供一种视频解码装置,用于对视频数据进行解码,以获得视频图像帧。图2是实施例1的视频解码装置的一个示意图,如图2所示,该视频解码装置200可以包括:解析单元201、重构单元202以及滤波单元203。
在本实施例中,解析单元201用于对视频数据的码流(stream)进行解析(sparse),以获取与视频图像帧的各编码树单元(CTU)对应的解析数据;重构单元202用于根据解析单元201所获取的解析数据,进行重构(reconstruct)处理,以生成视频图像帧的各编码树单元(CTU);滤波单元203用于根据重构单元202所生成的编码树单元(CTU)进行滤波处理,以获得视频图像帧。
在本实施例中,在解析单元201获取了第一预定数量的编码树单元(CTU)所对应的解析数据的情况下,重构单元202可以根据解析单元201已经获取的解析数据进行重构处理,并且,在重构单元202进行重构处理的同时,解析单元201可以继续对视频数据的码流(stream)进行解析(sparse),以获取与该视频图像帧的剩余编码树单元(CTU)所对应的解析数据,由此,针对一个视频图像帧,解析单元201和重构单元202可以进行并行处理,以提高解码效率。
在本实施例中,在重构单元202生成了第二预定数量的编码树单元(CTU)的情况下,滤波单元203可以根据重构单元202生成的编码树单元(CTU)进行滤波处理,并且,在滤波单元203进行滤波处理时,重构单元202可以继续进行重构处理,以生成该视频图像帧的剩余编码树单元(CTU),由此,针对一个视频图像帧,重构单元202和滤波单元203可以进行并行处理,从而提高解码效率。
根据本实施例,在对视频数据解码以生成一个视频图像帧的过程中,解析单元201、重构单元202和滤波单元203可以进行并行处理,即,在同一时刻,解析单元201、重构单元202和滤波单元203可以针对该视频图像帧中的不同编码树单元进行处理,由此,能够实现一个视频图像帧内的编码树单元级别的多线程解码,从而提高对视频数据的解码效率,能够快速地得到一个视频图像帧。
在本实施例中,解析单元201可以对视频数据的码流进行解析,以获得解析数据,该解析数据例如可以是码流的头信息数据,该解析例如可以是网络抽象层(Network Abstract Layer,NAL)头信息解析、视频参数集(Video Parameter Set,VPS)头信息解析、序列参数集(Sequence Parameter Set,SPS)头信息解析和/或图像参数集(Picture Parameter Set,PPS)头信息解析等。关于解析的具体方式,可以参考现有技术,本实施例不再说明。
在本实施例中,解析单元201开始进行解析处理的时机可以受到重构单元202和/或滤波单元203的处理进度的控制,例如,在滤波单元203没有完成针对当前视频图像帧的各编码树单元(CTU)的滤波处理或重构单元202没有完成当前视频图像帧的全部编码树单元(CTU)的情况下,解析单元201可以不开始进行与下一帧视频图像对应的解析处理,由此,可以避免在解码以生成不同视频图像帧时发生数据的混淆。
在本实施例中,重构单元202可以根据解析单元201所获得的解析数据,进行重构(reconstruct)处理以生成视频图像帧中的各编码树单元,例如,该重构单元202可以基于帧间预测(inter prediction)和/或帧内预测(intra prediction)来进行该重构处理。关于重构处理的具体方式,可以参考现有技术,本实施例不再进行说明。
图3是本实施例的滤波单元的一个示意图,如图3所示,滤波单元203可以包括第一滤波单元301和第二滤波单元302。
其中,第一滤波单元301用于根据重构单元202所生成的编码树单元(CTU)进行去块滤波(de-blocking filter)处理;第二滤波单元302用于根据第一滤波单元301的去块滤波处理的结果,进行取样自适应偏移(Sample Adaptive Offset,SAO)处理。
在本实施例中,第一滤波单元301可以针对相对于编码树单元(CTU)具有偏移的偏移单元进行去块滤波处理,其中,各偏移单元可以相对于各已生成的编码树单元(CTU)向预定方向移动预定数量的像素,例如,各偏移单元可以相对于各已生成的 编码树单元(CTU)向左移动4个像素,并且向上移动4个像素。关于去块滤波处理的具体方式,可以参考现有技术,本实施例不再进行说明。
在本实施例中,第二滤波单元302基于第一滤波单元301的去块滤波处理的结果,针对编码树单元进行取样自适应偏移(SAO)处理,其中,在第一滤波单元301完成了对第三预定数量的偏移单元进行去块滤波处理的情况下,第二滤波单元302可以基于已经进行过去块滤波处理的该第三预定数量的偏移单元,来进行自适应偏移(SAO)处理,由此,针对一个视频图像帧,第一滤波单元301和第二滤波单元302可以进行并行处理,以提高解码效率。
图4是本实施例的第二滤波单元的一个示意图,如图4所示,第二滤波单元302可以包括选择子单元401和滤波子单元402。
其中,选择子单元401可以根据第一滤波单元301的处理结果,在尚未进行过取样自适应偏移(SAO)处理的编码树单元(CTU)中,选择第一编码树单元(CTU),该第一编码树单元(CTU)中的所有像素所处的偏移单元都被第一滤波单元301进行过去块滤波处理;滤波子单元402对选择子单元401所选择出的该第一编码树单元(CTU)进行取样自适应偏移(SAO)处理。
在本实施例中,第二滤波单元302需要在一个编码树单元中每个像素都被进行过去块滤波处理的情况下,才能对该编码树单元进行取样自适应偏移(SAO)处理;而由于偏移单元与编码树单元之间具有偏移,所以,存在着在某个编码树单元中有部分像素没有被进行过去块滤波处理的情况。因此,选择子单元401需要挑选出每个像素都被进行过去块滤波处理的编码树单元,即第一编码树单元,并由滤波子单元402对该第一编码树单元进行取样自适应偏移(SAO)处理。
图5是偏移单元与编码树单元的关系的一个示意图。如图5所示,在视频图像帧500中,共有M行编码树单元,每一行编码树单元中包含有(N+1)个编码树单元,其中,第一行编码树单元为CTU10~CTU1N,第一行的各编码树单元对应的偏移单元为CTU’10~CTU’1N,第二行编码树单元为CTU20~CTU2N,第二行的各编码树单元对应的偏移单元为CTU’20~CTU’2N,各编码树单元用实线框表示,各偏移单元用虚线框表示,各偏移单元可以相对于各已生成的编码树单元(CTU)向左移动4个像素,并且向上移动4个像素。
如图5所示,在第一滤波单元301对第一行的各偏移单元CTU’10~CTU’1N都 进行了去块滤波处理的情况下,第一行的每一个编码树单元的右下角都有4*4个像素没有进行去块滤波处理,如图5的画斜线区域501所示,因此,选择子单元401暂时无法从第一行编码树单元中选择出第一编码树单元。
在第一滤波单元301对第二行的偏移单元CTU’10、CTU’11进行了去块滤波处理的情况下,编码树单元CTU10中的全部像素都进行过去块滤波处理,因此,选择子单元401可以选择编码树单元CTU10作为第一编码树单元,并且,滤波子单元402可以对编码树单元CTU10进行取样自适应偏移(SAO)处理。
在本实施例中,进行取样自适应偏移处理的具体处理方式可以参考现有技术,本实施例不再说明。
在本实施例中,当一帧视频图像中的全部编码树单元都经历了取样自适应偏移(SAO)处理后,即得到经过解码后的视频图像帧。
根据本实施例,在对视频数据解码以生成一个视频图像帧的过程中,解析单元201、重构单元202和滤波单元203可以针对该视频图像帧进行并行处理,由此,能够实现一个视频图像帧内的编码树单元级别的多线程解码,从而提高对视频数据的解码效率,能够快速地得到一个视频图像帧。
下面,结合一个实例来说明本实施例1的视频解码装置的解码流程。图6是该解码流程的一个示意图。
如图6所示,视频解码装置200的解析单元201、重构单元202和滤波单元203可以受控于3个线程601、602和603,视频图像帧包含(L+1)个编码单元CTU0~CTUL。图6中坐标轴的横轴表示时间t,纵轴表示各线程。
如图6所示,在解析单元201获取了第一预定数量的编码树单元(CTU)所对应的解析数据的情况下,重构单元202可以根据解析单元201已经获取的解析数据进行重构处理,例如,该第一预定数量可以是1,即,在解析单元201获取了编码树单元CTU0所对应的解析数据的情况下,重构单元202可以在线程602的控制下,根据解析单元201已经获取的与编码树单元CTU0对应的解析数据进行重构处理,以生成编码树单元CTU0。
如图6所示,在重构单元202进行重构(reconstruct)处理时,解析单元201继续对视频图像数据的码流进行解析,以获取与视频图像帧的剩余编码树单元所对应的解析数据。
如图6所示,在重构单元202生成了第二预定数量的编码树单元(CTU)的情况下,滤波单元203根据重构单元202生成的编码树单元(CTU)进行滤波处理,例如,该第二预定数量可以是1,即,在重构单元202生成了编码树单元CTU0的情况下,滤波单元203可以在线程603的控制下,根据重构单元202生成的编码树单元CTU0进行滤波处理,以获得视频图像帧。
如图6所示,在滤波单元203进行滤波处理时,重构单元202继续进行重构处理,以生成视频图像帧的剩余编码树单元(CTU)。
此外,在本实施例中,在滤波单元203没有完成针对当前视频图像帧的各编码树单元(CTU)的滤波处理或重构单元202没有完成针对当前视频图像帧的各编码树单元(CTU)的重构处理的情况下,如果解析单元201已经完成了对CTUL所对应的解析数据的获取,那么解析单元201可以在线程601的控制下不进行与下一帧视频图像帧对应的解析处理。
如图6所示,根据本实施例,在同一时刻T,解码装置200的解析单元201、重构单元202和滤波单元203可以针对一个视频图像帧中的不同编码树单元进行处理,由此,能够实现一个视频图像帧内的编码树单元级别的多线程解码,从而提高对视频数据的解码效率,能够快速地得到一个视频图像帧。
实施例2
本申请实施例2提供一种视频解码方法,与实施例1的视频解码装置对应。
图7是本实施例的视频解码方法的一个示意图,如图7所示,该视频解码方法包括:
步骤701、对视频数据的码流(stream)进行解析(sparse),以获取与视频图像帧的各编码树单元(CTU)对应的解析数据;
步骤702、根据所获取的所述解析数据,进行重构(reconstruct)处理,以生成编码树单元(CTU);以及
步骤703、根据所生成的所述编码树单元(CTU)进行滤波处理,以获得视频图像帧。
在本实施例中,在步骤701获取了第一预定数量的编码树单元(CTU)所对应的解析数据的情况下,在步骤702中根据已经获取的解析数据进行重构(reconstruct) 处理,并且,在进行重构(reconstruct)处理时,继续对所述视频数据的码流(stream)进行解析(sparse),以获取与所述视频图像帧的剩余编码树单元(CTU)所对应的解析数据;在生成了第二预定数量的编码树单元(CTU)的情况下,根据生成的编码树单元(CTU)进行滤波处理,并且,在进行滤波处理时,继续进行重构处理,以生成所述视频图像帧的剩余编码树单元(CTU)。
在本实施例中,在步骤703没有完成针对当前视频图像帧的各编码树单元(CTU)的滤波处理的情况下,步骤701不进行与下一帧视频图像帧对应的解析处理。
图8是本实施例的根据所生成的所述编码树单元(CTU)进行滤波处理方法的一个示意图,如图8所示,该方法包括:
步骤801、根据所述编码树单元(CTU)进行去块滤波(de-blocking filter)处理;以及
步骤802、根据所述去块滤波处理的结果,进行取样自适应偏移(Sample Adaptive Offset,SAO)处理。
图9是本实施例的根据去块滤波处理的结果进行取样自适应偏移处理的方法的一个示意图,如图9所示,该方法包括:
步骤901、根据去块滤波处理的结果,在尚未进行过取样自适应偏移(Sample Adaptive Offset,SAO)处理的所述编码树单元(CTU)中,选择第一编码树单元(CTU),其中,所述第一编码树单元(CTU)中的所有像素所处的偏移单元都被第一滤波单元进行过去块滤波(de-blocking filter)处理;
步骤902、对选择出的所述第一编码树单元(CTU)进行取样自适应偏移(Sample Adaptive Offset,SAO)处理。
根据本实施例,在对视频数据解码以生成一个视频图像帧的过程中,解析、重构处理和滤波处理可以针对该视频图像帧进行并行处理,由此,能够实现一个视频图像帧内的编码树单元级别的多线程解码,从而提高对视频数据的解码效率,能够快速地得到一个视频图像帧。
实施例3
本申请实施例3提供一种电子设备,所述电子设备包括:如实施例1所述的视频解码装置。
图10是本申请实施例3的电子设备的一个构成示意图。如图10所示,电子设备1000可以包括:中央处理器(CPU)1001和存储器1002;存储器1002耦合到中央处理器1001。其中该存储器1002可存储各种数据;此外还存储进行视频解码的程序,并且在中央处理器1001的控制下执行该程序。
在一个实施方式中,视频解码装置的功能可以被集成到中央处理器1001中。
其中,中央处理器1001可以被配置为:
对视频数据的码流(stream)进行解析(sparse),以获取与视频图像帧的各编码树单元(CTU)对应的解析数据;
根据所获取的所述解析数据,进行重构(reconstruct)处理,以生成编码树单元(CTU);以及
根据所生成的所述编码树单元(CTU)进行滤波处理,以获得视频图像帧,其中,获取了第一预定数量的编码树单元(CTU)所对应的解析数据的情况下,根据已经获取的解析数据进行重构(reconstruct)处理,并且,在进行重构(reconstruct)处理时,继续对所述视频数据的码流(stream)进行解析(sparse),以获取与所述视频图像帧的剩余编码树单元(CTU)所对应的解析数据;
在生成了第二预定数量的编码树单元(CTU)的情况下,根据生成的编码树单元(CTU)进行滤波处理,并且,在进行滤波处理时,继续进行重构处理,以生成所述视频图像帧的剩余编码树单元(CTU)。
中央处理器1001还可以被配置为:
在没有完成针对当前视频图像帧的各编码树单元(CTU)的滤波处理的情况下,不进行与下一帧视频图像帧对应的解析处理。
中央处理器1001还可以被配置为:
基于帧间预测(inter prediction)和/或帧内预测(intra prediction)来进行所述重构处理。
中央处理器1001还可以被配置为:
根据所述编码树单元(CTU)进行去块滤波(de-blocking filter)处理;以及
根据所述去块滤波处理的结果,进行取样自适应偏移(Sample Adaptive Offset,SAO)处理。
中央处理器1001还可以被配置为:
针对偏移单元中的像素进行去块滤波(de-blocking filter)处理,其中,所述偏移单元相对于所述编码树单元(CTU)向预定方向移动了预定数量的像素。
中央处理器1001还可以被配置为:
根据去块滤波处理的结果,在尚未进行过取样自适应偏移(Sample Adaptive Offset,SAO)处理的所述编码树单元(CTU)中,选择第一编码树单元(CTU),其中,所述第一编码树单元(CTU)中的所有像素所处的偏移单元都被第一滤波单元进行过去块滤波(de-blocking filter)处理;以及
对选择出的所述第一编码树单元(CTU)进行取样自适应偏移(Sample Adaptive Offset,SAO)处理。
此外,如图10所示,电子设备1000还可以包括:输入输出单元1003和显示单元1004等;其中,上述部件的功能与现有技术类似,此处不再赘述。值得注意的是,电子设备1000也并不是必须要包括图10中所示的所有部件;此外,电子设备1000还可以包括图10中没有示出的部件,可以参考现有技术。
本申请实施例还提供一种计算机可读程序,其中当在视频解码装置或电子设备中执行所述程序时,所述程序使得所述视频解码装置或电子设备执行实施例2所述的视频解码方法。
本申请实施例还提供一种存储有计算机可读程序的存储介质,其中,所述存储介质存储上述计算机可读程序,所述计算机可读程序使得视频解码装置或电子设备执行实施例2所述的视频解码方法。
结合本发明实施例描述的视频解码装置可直接体现为硬件、由处理器执行的软件模块或二者组合。例如,图2-4中所示的功能框图中的一个或多个和/或功能框图的一个或多个组合,既可以对应于计算机程序流程的各个软件模块,亦可以对应于各个硬件模块。这些软件模块,可以分别对应于实施例2所示的各个步骤。这些硬件模块例如可利用现场可编程门阵列(FPGA)将这些软件模块固化而实现。
软件模块可以位于RAM存储器、闪存、ROM存储器、EPROM存储器、EEPROM存储器、寄存器、硬盘、移动磁盘、CD-ROM或者本领域已知的任何其它形式的存储介质。可以将一种存储介质耦接至处理器,从而使处理器能够从该存储介质读取信息,且可向该存储介质写入信息;或者该存储介质可以是处理器的组成部分。处理器 和存储介质可以位于ASIC中。该软件模块可以存储在移动终端的存储器中,也可以存储在可插入移动终端的存储卡中。例如,若设备(例如移动终端)采用的是较大容量的MEGA-SIM卡或者大容量的闪存装置,则该软件模块可存储在该MEGA-SIM卡或者大容量的闪存装置中。
针对图2-4描述的功能框图中的一个或多个和/或功能框图的一个或多个组合,可以实现为用于执行本申请所描述功能的通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或其它可编程逻辑器件、分立门或晶体管逻辑器件、分立硬件组件、或者其任意适当组合。针对图2-4描述的功能框图中的一个或多个和/或功能框图的一个或多个组合,还可以实现为计算设备的组合,例如,DSP和微处理器的组合、多个微处理器、与DSP通信结合的一个或多个微处理器或者任何其它这种配置。
以上结合具体的实施方式对本申请进行了描述,但本领域技术人员应该清楚,这些描述都是示例性的,并不是对本申请保护范围的限制。本领域技术人员可以根据本申请的原理对本申请做出各种变型和修改,这些变型和修改也在本申请的范围内。

Claims (13)

  1. 一种视频解码装置,用于对视频数据进行解码,以获得视频图像帧,该视频解码装置包括:
    解析单元,其用于对视频数据的码流进行解析,以获取与视频图像帧的各编码树单元对应的解析数据;
    重构单元,其用于根据所述解析单元所获取的所述解析数据,进行重构处理,以生成编码树单元;以及
    滤波单元,其用于根据所述重构单元所生成的所述编码树单元进行滤波处理,以获得视频图像帧,
    其中,在所述解析单元获取了第一预定数量的编码树单元所对应的解析数据的情况下,所述重构单元根据所述解析单元已经获取的解析数据进行重构处理,并且,在所述重构单元进行重构处理时,所述解析单元继续对所述视频数据的码流进行解析,以获取与所述视频图像帧的剩余编码树单元所对应的解析数据;
    在所述重构单元生成了第二预定数量的编码树单元的情况下,所述滤波单元根据所述重构单元生成的编码树单元进行滤波处理,并且,在所述滤波单元进行滤波处理时,所述重构单元继续进行重构处理,以生成所述视频图像帧的剩余编码树单元。
  2. 如权利要求1所述的视频解码装置,其中,
    在所述滤波单元没有完成针对当前视频图像帧的各编码树单元的滤波处理的情况下,所述解析单元不进行与下一帧视频图像帧对应的解析处理。
  3. 如权利要求1所述的视频解码装置,其中,
    所述重构单元基于帧间预测和/或帧内预测来进行所述重构处理。
  4. 如权利要求1所述的视频解码装置,其中,所述滤波单元包括:
    第一滤波单元,其用于根据所述编码树单元进行去块滤波处理;以及
    第二滤波单元,其用于根据所述第一滤波单元的去块滤波处理的结果,进行取样自适应偏移处理。
  5. 如权利要求4所述的视频解码装置,其中,
    所述第一滤波单元针对偏移单元中的像素进行去块滤波处理,其中,所述偏移单元相对于所述编码树单元向预定方向移动了预定数量的像素。
  6. 如权利要求5所述的视频解码装置,其中,所述第二滤波单元包括:
    选择子单元,其根据所述第一滤波单元的处理结果,在尚未进行过取样自适应偏移处理的所述编码树单元中,选择第一编码树单元,其中,所述第一编码树单元(中的所有像素所处的偏移单元都被第一滤波单元进行过去块滤波处理;
    滤波子单元,其对所述选择子单元所选择出的所述第一编码树单元进行取样自适应偏移处理。
  7. 一种电子设备,其包括权利要求1-6中的任一项所述的视频解码装置。
  8. 一种视频解码方法,用于对视频数据进行解码,以获得视频图像帧,该视频解码方法包括:
    对视频数据的码流进行解析,以获取与视频图像帧的各编码树单元对应的解析数据;
    根据所获取的所述解析数据,进行重构处理,以生成编码树单元;以及
    根据所生成的所述编码树单元进行滤波处理,以获得视频图像帧,
    其中,获取了第一预定数量的编码树单元所对应的解析数据的情况下,根据已经获取的解析数据进行重构处理,并且,在进行重构处理时,继续对所述视频数据的码流进行解析),以获取与所述视频图像帧的剩余编码树单元所对应的解析数据;
    在生成了第二预定数量的编码树单元的情况下,根据生成的编码树单元进行滤波处理,并且,在进行滤波处理时,继续进行重构处理,以生成所述视频图像帧的剩余编码树单元。
  9. 如权利要求8所述的视频解码方法,其中,
    在没有完成针对当前视频图像帧的各编码树单元的滤波处理的情况下,不进行与下一帧视频图像帧对应的解析处理。
  10. 如权利要求8所述的视频解码方法,其中,
    基于帧间预测和/或帧内预测来进行所述重构处理。
  11. 如权利要求8所述的视频解码方法,其中,根据所生成的所述编码树单元进行滤波处理包括:
    根据所述编码树单元进行去块滤波处理;以及
    根据所述去块滤波处理的结果,进行取样自适应偏移处理。
  12. 如权利要求11所述的视频解码方法,其中,
    针对偏移单元中的像素进行去块滤波处理,其中,所述偏移单元相对于所述编码树单元向预定方向移动了预定数量的像素。
  13. 如权利要求12所述的视频解码方法,其中,根据所述去块滤波处理的结果,进行取样自适应偏移处理包括:
    根据所述去块滤波处理的结果,在尚未进行过取样自适应偏移处理的所述编码树单元中,选择第一编码树单元,其中,所述第一编码树单元中的所有像素所处的偏移单元都被第一滤波单元进行过去块滤波处理;以及
    对选择出的所述第一编码树单元进行取样自适应偏移处理。
PCT/CN2016/104007 2016-10-31 2016-10-31 视频解码方法、视频解码装置和电子设备 Ceased WO2018076336A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/104007 WO2018076336A1 (zh) 2016-10-31 2016-10-31 视频解码方法、视频解码装置和电子设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/104007 WO2018076336A1 (zh) 2016-10-31 2016-10-31 视频解码方法、视频解码装置和电子设备

Publications (1)

Publication Number Publication Date
WO2018076336A1 true WO2018076336A1 (zh) 2018-05-03

Family

ID=62024200

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/104007 Ceased WO2018076336A1 (zh) 2016-10-31 2016-10-31 视频解码方法、视频解码装置和电子设备

Country Status (1)

Country Link
WO (1) WO2018076336A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116389830A (zh) * 2023-06-05 2023-07-04 云印技术(深圳)有限公司 信息解析提取方法、装置、设备及存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101345879A (zh) * 2008-08-20 2009-01-14 炬力集成电路设计有限公司 去块滤波方法、装置及预测重构和去块滤波方法与系统
CN102098503A (zh) * 2009-12-14 2011-06-15 中兴通讯股份有限公司 一种多核处理器并行解码图像的方法和装置
US20110274178A1 (en) * 2010-05-06 2011-11-10 Canon Kabushiki Kaisha Method and device for parallel decoding of video data units
CN102625108A (zh) * 2012-03-30 2012-08-01 浙江大学 一种基于多核处理器实现的h.264解码方法
WO2014205717A1 (zh) * 2013-06-27 2014-12-31 北京大学深圳研究生院 视频解码方法及解码器
CN105323586A (zh) * 2015-04-07 2016-02-10 佛山世寰智能科技有限公司 一种用于多核并行视频编码和解码的共享内存接口
WO2016055484A1 (en) * 2014-10-06 2016-04-14 Canon Kabushiki Kaisha Method and apparatus for vector encoding in video coding and decoding

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101345879A (zh) * 2008-08-20 2009-01-14 炬力集成电路设计有限公司 去块滤波方法、装置及预测重构和去块滤波方法与系统
CN102098503A (zh) * 2009-12-14 2011-06-15 中兴通讯股份有限公司 一种多核处理器并行解码图像的方法和装置
US20110274178A1 (en) * 2010-05-06 2011-11-10 Canon Kabushiki Kaisha Method and device for parallel decoding of video data units
CN102625108A (zh) * 2012-03-30 2012-08-01 浙江大学 一种基于多核处理器实现的h.264解码方法
WO2014205717A1 (zh) * 2013-06-27 2014-12-31 北京大学深圳研究生院 视频解码方法及解码器
WO2016055484A1 (en) * 2014-10-06 2016-04-14 Canon Kabushiki Kaisha Method and apparatus for vector encoding in video coding and decoding
CN105323586A (zh) * 2015-04-07 2016-02-10 佛山世寰智能科技有限公司 一种用于多核并行视频编码和解码的共享内存接口

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116389830A (zh) * 2023-06-05 2023-07-04 云印技术(深圳)有限公司 信息解析提取方法、装置、设备及存储介质

Similar Documents

Publication Publication Date Title
JP6590918B2 (ja) 画像を符号化する方法、画像を復号する方法、画像を符号化する装置、画像を復号する装置、及びプログラム
CN106937121B (zh) 图像解码和编码方法、解码和编码装置、解码器及编码器
RU2018117534A (ru) Устройство и способ обработки изображений
CN102369554B (zh) 用以旋转图像的设备和方法
RU2019137954A (ru) Сигнализация опорных изображений
RU2610670C1 (ru) Кодирование и декодирование многоуровневого видеопотока
JP2018529255A (ja) イメージ予測方法および装置
CN108471513A (zh) 视频融合方法、装置及服务器
US20170302958A1 (en) Method, device and electronic equipment for coding/decoding
CN103096054B (zh) 一种视频图像滤波处理方法和装置
CN103404146A (zh) 视频文件修复方法及装置
WO2019137313A1 (zh) 一种媒体信息的处理方法及装置
CN113473126A (zh) 视频流的处理方法、装置、电子设备及计算机可读介质
JP7758792B2 (ja) ビデオ画像処理方法、装置、および記憶媒体
CN116308992A (zh) 图像处理方法和装置、电子设备、计算机可读存储介质
CN101252691A (zh) 一种多处理器并行实现高分辨率图像滤波的方法
CN109698956B (zh) 用于对图像中兴趣区域进行解码的装置及方法
WO2018076336A1 (zh) 视频解码方法、视频解码装置和电子设备
CN103379318B (zh) 一种视频码流编码方法和装置
WO2010120239A1 (en) Image encoder and method for encoding images
TWI514851B (zh) 影像編碼/解碼系統與其方法
WO2018068259A1 (zh) 图像编码/解码方法、装置以及图像处理设备
US10748305B2 (en) Image capturing apparatus that can reduce amount of data that is to be recorded, method for controlling the image capturing apparatus, and storage medium
CN118233655B (zh) 一种基于置信图的视频编码深度学习环路滤波方法及系统
CN107809638B (zh) 基于摄像头图像视频混合题材的滤波处理方法及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16920071

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16920071

Country of ref document: EP

Kind code of ref document: A1