WO2018086363A1 - 一种图像输出装置、方法及解码器 - Google Patents

一种图像输出装置、方法及解码器 Download PDF

Info

Publication number
WO2018086363A1
WO2018086363A1 PCT/CN2017/092006 CN2017092006W WO2018086363A1 WO 2018086363 A1 WO2018086363 A1 WO 2018086363A1 CN 2017092006 W CN2017092006 W CN 2017092006W WO 2018086363 A1 WO2018086363 A1 WO 2018086363A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
output
difference
images
decoded
Prior art date
Application number
PCT/CN2017/092006
Other languages
English (en)
French (fr)
Inventor
李辉武
Original Assignee
珠海格力电器股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 珠海格力电器股份有限公司 filed Critical 珠海格力电器股份有限公司
Publication of WO2018086363A1 publication Critical patent/WO2018086363A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8166—Monomedia components thereof involving executable data, e.g. software
    • H04N21/8193—Monomedia components thereof involving executable data, e.g. software dedicated tools, e.g. video decoder software or IPMP tool

Definitions

  • the present invention relates to the field of image processing, and in particular, to an image output apparatus, method, and decoder.
  • the decoded image display order is identified by the image sequence number (POC), which is not necessarily the same as the image decoding order. Therefore, it is necessary to reorder the decoded images according to the POC from small to large.
  • the decoded image will be placed in the Decoded Image Buffer (DPB). Due to memory size and efficiency limitations, it is not possible to save the image without discarding it. Therefore, some management strategy is needed to reorder the images in the DPB as soon as possible. Output, then remove the image that is no longer needed for reference from the DPB.
  • the method for decoding the image rearranged output in the prior art is as shown in FIG. 1. If the current image is an instant decoding refresh image (IDR) image, all the images in the DPB are output, and then the buffer is cleared. If the current image is not an IDR image, the number of images in the DPB is judged. If the DPB is not full, the Insert Image module is executed. If the DPB is full and the current image is a reference frame, then the image with the smallest POC is found in the image labeled "not output" in the DPB, and is output.
  • IDR instant decoding refresh image
  • the image is a non-reference frame, then it is deleted from the DPB, otherwise In the image labeled "not output”, continue to search for the image with the smallest POC, output it, and loop it until it finds a non-reference frame, delete it, and the vacated position is used to store the current image; if the DPB is full However, if the current image is not a reference frame, then all the images in the DPB whose POC is smaller than the current image are output first, and then the current image is directly output, and it is not required to be stored in the DPB. Problems with this approach: (1) need to allocate additional memory; (2) due to the need to wait for the DPB to complete the image reordering output, there will be an image output is not timely and the play jam phenomenon.
  • the main object of the present invention is to overcome the above drawbacks of the prior art, and to provide an image output apparatus, method and decoder, which realize fast reordering output of decoded images and improve video playback fluency.
  • An aspect of the present invention provides an image output apparatus including a sequence number difference value obtaining unit for acquiring a first difference between serial numbers of sequentially output images, and an output image determining unit for obtaining the obtained The first difference is determined to determine the sequence number of the next output image.
  • the method further includes a sequence number difference updating unit, configured to wait for the decoded image buffer to be filled, arrange all the images of the decoded image buffer in ascending order according to the image serial number, and calculate between adjacent image serial numbers
  • the difference is the first difference is 1 when the odd value is greater than or equal to the even value; and the first difference is 2 when the even value is greater than the odd value.
  • the method further includes: a determining unit, configured to determine whether the number of unoutputted images in the decoded image buffer area is greater than the number of reference frames, and when the number of unoutputted images is greater than the number of reference frames and the instant decoding refresh image is received previously After the first difference has not been re-determined, the operation of the sequence number difference updating unit is triggered.
  • a determining unit configured to determine whether the number of unoutputted images in the decoded image buffer area is greater than the number of reference frames, and when the number of unoutputted images is greater than the number of reference frames and the instant decoding refresh image is received previously After the first difference has not been re-determined, the operation of the sequence number difference updating unit is triggered.
  • the method further includes: a determining unit, configured to determine whether the number of unoutputted images in the decoded image buffer area is greater than a reference frame number, and is used to trigger the sequence when the number of unoutputted images is greater than the number of reference frames The operation of the difference value acquisition unit and the output image determination unit.
  • a determining unit configured to determine whether the number of unoutputted images in the decoded image buffer area is greater than a reference frame number, and is used to trigger the sequence when the number of unoutputted images is greater than the number of reference frames The operation of the difference value acquisition unit and the output image determination unit.
  • the method further includes an image output unit, configured to output an image with the smallest image serial number in the decoded image buffer area when the number of unoutputted images is greater than the number of reference frames, and determine the next determined according to the output image determining unit The serial number of the output image is output, and the image corresponding to the serial number of the next output image is output.
  • an image output unit configured to output an image with the smallest image serial number in the decoded image buffer area when the number of unoutputted images is greater than the number of reference frames, and determine the next determined according to the output image determining unit The serial number of the output image is output, and the image corresponding to the serial number of the next output image is output.
  • the method further includes an image output unit, configured to: when the number of unoutputted images is not greater than the number of reference frames, the sequence of the next output image according to the sequence number of the next output image The corresponding image output.
  • the image output unit when an image corresponding to the sequence number of the next output image exists in the decoded image buffer, the image output unit outputs an image corresponding to the sequence number of the next output image until the next output image
  • the image corresponding to the serial number is not stored in the decoded image buffer; when the image corresponding to the serial number of the next output image is not stored in the decoded image buffer, the output non-reference frame is deleted from the decoded image buffer .
  • Yet another aspect of the present invention provides a decoder comprising the image output device of any of the above.
  • a further aspect of the present invention provides an image output method comprising: a sequence number difference value obtaining step of acquiring a first difference between serial numbers of sequentially outputted images; and an output image determining step for obtaining according to the The first difference is determined by the sequence number of the next output image.
  • the method further includes a sequence number difference updating step, configured to wait for the decoded image buffer to be filled, arrange all the images of the decoded image buffer in ascending order according to the image serial number, and calculate between adjacent image serial numbers
  • the difference is the first difference is 1 when the odd value is greater than or equal to the even value; and the first difference is 2 when the even value is greater than the odd value.
  • the method further includes a determining step of determining whether the number of unoutputted images in the decoded image buffer is greater than the number of reference frames, and the number of unoutputted images is greater than the number of reference frames and the instant decoding refresh image is received before.
  • the sequence number difference update step is performed.
  • the method further includes a determining step, configured to determine whether the number of unoutputted images in the decoded image buffer area is greater than a reference frame number, and when the number of unoutputted images is greater than the number of reference frames, performing the sequence number difference A value acquisition step and the output image determination step.
  • a determining step configured to determine whether the number of unoutputted images in the decoded image buffer area is greater than a reference frame number, and when the number of unoutputted images is greater than the number of reference frames, performing the sequence number difference A value acquisition step and the output image determination step.
  • the method further includes an image output step, configured to output an image with the smallest image serial number in the decoded image buffer area when the number of unoutputted images is greater than the number of reference frames, and according to the Outputting the sequence number of the next output image determined by the step of determining the image, and outputting the image corresponding to the serial number of the next output image
  • the method further includes an image output step, configured to output an image corresponding to the serial number of the next output image according to the sequence number of the next output image when the number of unoutputted images is not greater than the number of reference frames .
  • the image output step when an image corresponding to the sequence number of the next output image exists in the decoded image buffer, the image output step outputs an image corresponding to the serial number of the next output image until the next output image The image corresponding to the serial number is not stored in the decoded image buffer; when the image corresponding to the serial number of the next output image is not stored in the decoded image buffer, the output non-reference frame is deleted from the decoded image buffer .
  • the solution of the invention can support 1080P30 H.264 high-definition decoding in a system with relatively small memory, thereby saving product cost; in addition, it can realize fast re-sorting output of decoded images and improve video playback fluency.
  • FIG. 1 is a flow chart of a method for decoding an image rearrangement output provided by the prior art
  • FIG. 2 is a schematic structural view of an embodiment of an image output device provided by the present invention.
  • FIG. 3 is a schematic structural view of an embodiment of an image output device provided by the present invention.
  • FIG. 4 is a schematic structural view of an embodiment of an image output device provided by the present invention.
  • FIG. 5 is a schematic diagram of a method in an embodiment of an image output method provided by the present invention.
  • FIG. 6 is a flow chart of a method in an embodiment of an image output method provided by the present invention.
  • an image output apparatus 10 includes a sequence number difference value obtaining unit 101 and an output image determining unit 103.
  • the sequence number difference obtaining unit is configured to acquire a first difference between serial numbers of sequentially output images.
  • an output image determining unit configured to determine a sequence number of the next output image according to the acquired first difference value.
  • FIG. 3 is a schematic structural view of an embodiment of an image output device provided by the present invention. Ben DETAILED DESCRIPTION OF THE INVENTION One aspect of the invention is combined with aspects of other embodiments of the invention.
  • An image output apparatus 20 includes a sequence number difference value acquisition unit 201 and an output image determination unit 203, and a sequence number difference value update unit 205.
  • the sequence number difference obtaining unit is configured to acquire a first difference between serial numbers of sequentially output images. For example, in general, between the two IDR images, it is necessary to determine the first difference once. Since the POC difference between images is likely to vary in different image sequences, it is necessary to re-estimate the POC difference after encountering the IDR image.
  • an output image determining unit configured to determine a sequence number of the next output image according to the acquired first difference value.
  • the sequence number of the next output image is the sum of the current output image sequence number and the first difference.
  • a sequence number difference updating unit configured to wait for the decoded image buffer area to be filled, arrange all the images of the decoded image buffer area in ascending order according to the image sequence number, and calculate a difference between adjacent image serial numbers, when the difference is If the odd value in the value is greater than or equal to the even value, then the first difference is 1; when the even value in the difference is greater than the odd value, the first difference is 2.
  • the operation of the sequence number difference updating unit is triggered.
  • FIG. 4 is a schematic structural view of an embodiment of an image output device provided by the present invention.
  • One embodiment of the invention incorporates aspects of other embodiments of the invention.
  • An image output apparatus 30 includes a sequence number difference value acquisition unit 301, an output image determination unit 303, a sequence number difference value update unit 305, and a determination unit 307.
  • the sequence number difference obtaining unit is configured to acquire a first difference between serial numbers of sequentially output images. For example, in general, between the two IDR images, it is necessary to determine the first difference once. Since the POC difference between images is likely to vary in different image sequences, it is necessary to re-estimate the POC difference after encountering the IDR image.
  • an output image determining unit configured to determine a sequence number of the next output image according to the acquired first difference value.
  • the sequence number of the next frame output image is the sum of the current output image sequence number and the first difference.
  • a sequence number difference updating unit configured to wait for the decoded image buffer area to be filled, arrange all the images of the decoded image buffer area in ascending order according to the image sequence number, and calculate a difference between adjacent image serial numbers, when the difference is If the odd value in the value is greater than or equal to the even value, then the first difference is 1; when the even value in the difference is greater than the odd value, the first difference is 2.
  • the determining unit is configured to determine whether the number of unoutputted images in the decoded image buffer area is greater than the number of reference frames, and the number of unoutputted images is greater than the number of reference frames and has not been re-determined after receiving the instant decoding refresh image The first difference is described, and the operation of the sequence number difference update unit is triggered.
  • a determining unit configured to determine whether the number of unoutputted images in the decoded image buffer area is greater than the number of reference frames, and when the number of unoutputted images is greater than the number of reference frames, the triggering sequence number difference obtaining unit is used. And the output image determines the operation of the unit.
  • the image output device further includes an image output unit, configured to output an image with the smallest image serial number in the decoded image buffer area when the number of unoutputted images is greater than the number of reference frames, and determine according to the output image determining unit The next frame outputs the sequence number of the image, and outputs the image corresponding to the sequence number of the next output image.
  • an image output unit configured to output an image with the smallest image serial number in the decoded image buffer area when the number of unoutputted images is greater than the number of reference frames, and determine according to the output image determining unit The next frame outputs the sequence number of the image, and outputs the image corresponding to the sequence number of the next output image.
  • the image output unit is further configured to: when the number of unoutputted images is not greater than the number of reference frames, output an image corresponding to the serial number of the next output image according to the serial number of the next output image.
  • the image output unit outputs an image corresponding to the serial number of the next output image until the serial number of the next output image corresponds to The image is not stored in the decoded image buffer.
  • the non-reference frame is deleted from the decoded image buffer.
  • An embodiment of the present invention provides a decoder including an image output apparatus provided by various embodiments of the present invention.
  • FIG. 5 is a schematic diagram of a method in an embodiment of an image output method provided by the present invention.
  • An image output method includes steps S410 and S420.
  • Step S410 a sequence number difference value obtaining step of acquiring a first difference between serial numbers of sequentially output images. For example, in general, between the two IDR images, it is necessary to determine the first difference once. Since the POC difference between images is likely to vary in different image sequences, it is necessary to re-estimate the POC difference after encountering the IDR image.
  • Step S420 an output image determining step, configured to determine a sequence number of the next output image according to the acquired first difference value.
  • the sequence number of the next output image is the sum of the current output image sequence number and the first difference.
  • the image output method may further include a sequence number difference update step, configured to wait for the decoded image buffer to be filled, arrange all the images of the decoded image buffer in ascending order according to the image serial number, and calculate adjacent images.
  • the difference between the serial numbers, when the odd value in the difference is greater than or equal to the even value, the first difference is 1.
  • the image output method may further include a determining step of determining whether the number of unoutputted images in the decoded image buffer area is greater than the number of reference frames, and when the number of unoutputted images is greater than the number of reference frames and previously received The first difference value is not re-determined after the image is refreshed in real time, and the sequence number difference update step is performed.
  • a determining step configured to determine whether the number of unoutputted images in the decoded image buffer is greater than the number of reference frames, and when the number of unoutputted images is greater than the number of reference frames, performing the sequence number difference obtaining step And the output image determining step.
  • the image output method may further include an image outputting step of outputting an image with the smallest image serial number in the decoded image buffer area when the number of unoutputted images is greater than the number of reference frames, and determining steps according to the output image The determined serial number of the next output image is output, and the image corresponding to the serial number of the next output image is output.
  • the image output method may further include an image output step, and configured to: when the number of unoutputted images is not greater than the number of reference frames, the serial number of the next output image according to the sequence number of the next output image Corresponding image output.
  • the image output step outputs an image corresponding to the serial number of the next output image until the serial number of the next output image corresponds to The image is not stored in the decoded image buffer; when the image corresponding to the sequence number of the next output image is not stored in the decoded image buffer, the non-reference frame is deleted from the decoded image buffer.
  • FIG. 6 is a flow chart of a method in an embodiment of an image output method provided by the present invention.
  • the process it is first determined whether it is an IDR image. If it is an IDR image, all images in the DPB are output, and then the buffer is cleared. Different image sequences, the POC difference between images is likely to change, so after encountering the IDR image, you need to set the estimated POC difference Flag (that is, make the estimated POC difference Flag variable True) and set next_poc ( This parameter is used to record the serial number of the next output image) as -1.
  • the estimated POC difference Flag that is, make the estimated POC difference Flag variable True
  • next_poc This parameter is used to record the serial number of the next output image
  • the current image is not an IDR image, it is judged whether the number of images marked as "not output" in the DPB is larger than the number of reference frames in the DPB.
  • the condition is met, first determine whether it is necessary to re-estimate the POC difference.
  • the estimated POC difference Flag variable is True, it indicates that the POC difference needs to be re-estimated. At this time, the POC difference has not been estimated after receiving the previous IDR image. .
  • the estimated POC difference Flag variable is NOT True, there is no need to re-estimate the POC difference.
  • the POC difference If it is necessary to re-estimate the POC difference, first wait for the DPB to be full, press POC to ascend all the images in the DPB, and then calculate the POC difference between the images. If the odd value is large, the POC difference (ie, the first difference) is considered as 1; If the even value is large, the POC difference gap is considered to be 2; finally, the estimated POC difference Flag is cleared (that is, the estimated POC difference Flag variable is NOT TURE). When the DPB is full, the POC difference is estimated to improve the correctness of the final estimated result.
  • next_poc cur_poc+gap
  • next_poc is the serial number of the next output image
  • cur_poc is the current output image.
  • the serial number, gap is the first difference; continue to find the image according to the next_poc value, if it is output, set the POC value next_poc of the next output image, and loop until the image does not exist in the DPB.
  • the solution of the invention can support 1080P30 H.264 high-definition decoding in a system with relatively small memory, thereby saving product cost; in addition, it can realize fast re-sorting output of decoded images and improve video playback fluency.
  • each functional unit may be integrated in one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the disclosed technical contents may be implemented in other manners.
  • the device embodiments described above are only schematic.
  • the division of the unit may be a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, unit or module, and may be electrical or otherwise.
  • the units described as separate components may or may not be physically separate, and the components of the control device may or may not be physical units, ie may be located in one place or may be distributed over multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and the like. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

本发明提供一种图像输出装置、方法及解码器。其中，装置包括：包括序列号差值获取单元，用于获取顺次输出的图像的序列号之间的第一差值；输出图像确定单元，用于根据获取的所述第一差值，确定下一输出图像的序列号。本发明提供的方案能够实现解码后的图像快速重排序输出，改善视频播放流畅度。

Description

一种图像输出装置、方法及解码器 技术领域
本发明涉及图像处理领域，尤其涉及图像输出装置、方法及解码器。
背景技术
在H.264中，解码后的图像显示顺序是由图像序列号(POC)来标识的,与图像的解码顺序不一定相同。所以需要把解码后的图像按照POC从小到大重新排序。已解码图像会被放到解码图像缓存区(DPB)中，由于内存大小与效率的限制，不可能一直保存图像而不丢弃，因此需要采用某种管理策略，尽快重排序DPB中的图像并及时输出，然后把不再需要用作参考的图像从DPB中删除。
现有技术的解码图像重排输出的方法如图1所示，若当前图像是即时解码刷新图像(IDR)图像，则将DPB中所有图像都输出,然后清空缓冲区。如果当前图像不是IDR图像，则判断DPB中图像数量。如果DPB未满,那么执行插入图像模块。如果DPB已满且当前图像是参考帧,那么在DPB中标定为“未输出”的图像中找到POC最小的图像,将其输出,若此图像是非参考帧,那么把它从DPB中删除,否则,在标定为“未输出”的图像中继续寻找POC最小的图像,将其输出,循环下去,直到找到一个非参考帧,将它删除,空出的位置用来存放当前图像；如果DPB已满,但当前图像不是参考帧,那么先把DPB中POC小于当前图像的所有图像输出,然后直接输出当前图像,不需要将它存入DPB。这种做法存在的问题：(1)需要额外分配内存；(2)由于需要等DPB满才开始进行图像重排序输出，会存在图像输出不及时而导致播放卡顿现象。
发明内容
本发明的主要目的在于克服上述现有技术的缺陷，提出了图像输出装置、方法及解码器，实现解码后的图像快速重排序输出，改善视频播放流畅度。
本发明一方面提供了一种图像输出装置，包括序列号差值获取单元，用于获取顺次输出的图像的序列号之间的第一差值；输出图像确定单元，用于根据获取的所述第一差值，确定下一输出图像的序列号。
可选地，还包括序列号差值更新单元，用于等待解码图像缓存区被填满后，按照图像序列号升序排列所述解码图像缓存区的所有图像，并计算相邻图像序列号之间的差值，当差值中奇数值大于等于偶数值，则所述第一差值为1；当差值中偶数值大于奇数值，则所述第一差值为2。
可选地，还包括判断单元，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数且此前接收到即时解码刷新图像后还未重新确定所述第一差值，触发序列号差值更新单元的工作。
可选地，还包括判断单元，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数时，用于触发所述序列号差值获取单元和所述输出图像确定单元的工作。
可选地，还包括图像输出单元，用于当未输出图像的数量大于参考帧个数时，输出解码图像缓存区中图像序列号最小的图像，并根据所述输出图像确定单元确定的下一输出图像的序列号，将所述下一输出图像的序列号对应的图像输出。
可选地，还包括图像输出单元，用于当未输出图像的数量不大于参考帧个数时，根据下一输出图像的序列号，将所述下一输出图像的序列 号对应的图像输出。
可选地，当解码图像缓存区中存在所述下一输出图像的序列号对应的图像，则所述图像输出单元输出所述下一输出图像的序列号对应的图像，直至下一输出图像的序列号对应的图像未存储于所述解码图像缓存区；当解码图像缓存区中未存储所述下一输出图像的序列号对应的图像，则从所述解码图像缓存区删除已输出非参考帧。
本发明又一方面提供了一种解码器，包括上述任一所述的图像输出装置。
本发明再一方面提供了一种图像输出方法，包括：序列号差值获取步骤，用于获取顺次输出的图像的序列号之间的第一差值；输出图像确定步骤，用于根据获取的所述第一差值，确定下一输出图像的序列号。
可选地，还包括序列号差值更新步骤，用于等待解码图像缓存区被填满后，按照图像序列号升序排列所述解码图像缓存区的所有图像，并计算相邻图像序列号之间的差值，当差值中奇数值大于等于偶数值，则所述第一差值为1；当差值中偶数值大于奇数值，则所述第一差值为2。
可选地，还包括判断步骤，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数且此前接收到即时解码刷新图像后还未重新确定所述第一差值，执行序列号差值更新步骤。
可选地，还包括判断步骤，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数时，执行所述序列号差值获取步骤和所述输出图像确定步骤。
可选地，还包括图像输出步骤，用于当未输出图像的数量大于参考帧个数时，输出解码图像缓存区中图像序列号最小的图像，并根据所述 输出图像确定步骤确定的下一输出图像的序列号，将所述下一输出图像的序列号对应的图像输出
可选地，还包括图像输出步骤，还用于当未输出图像的数量不大于参考帧个数时，根据下一输出图像的序列号，将所述下一输出图像的序列号对应的图像输出。
可选地，当解码图像缓存区中存在所述下一输出图像的序列号对应的图像，则所述图像输出步骤输出所述下一输出图像的序列号对应的图像，直至下一输出图像的序列号对应的图像未存储于所述解码图像缓存区；当解码图像缓存区中未存储所述下一输出图像的序列号对应的图像，则从所述解码图像缓存区删除已输出非参考帧。
本发明的方案，能够在内存比较小的系统支持1080P30 H.264高清解码，节省产品成本；另外，能够实现解码后的图像快速重排序输出，改善视频播放流畅度。
附图说明
此处所说明的附图用来提供对本发明的进一步理解，构成本发明的一部分，本发明的示意性实施例及其说明用于解释本发明，并不构成对本发明的不当限定。在附图中：
图1是现有技术提供的解码图像重排输出的方法流程图；
图2是本发明提供的图像输出装置的一实施例中的结构示意图；
图3是本发明提供的图像输出装置的一实施例中的结构示意图；
图4是本发明提供的图像输出装置的一实施例中的结构示意图；
图5是本发明提供的图像输出方法的一实施例中的方法示意图；
图6是本发明提供的图像输出方法的一实施例中的方法流程图。
具体实施方式
为使本发明的目的、技术方案和优点更加清楚，下面将结合本发明具体实施例及相应的附图对本发明技术方案进行清楚、完整地描述。显然，所描述的实施例仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
需要说明的是，本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本发明的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
图2是本发明提供的图像输出装置的一实施例中的结构示意图。本发明一具体实施方式，提供了一种图像输出装置10包括序列号差值获取单元101和输出图像确定单元103。
其中，序列号差值获取单元，用于获取顺次输出的图像的序列号之间的第一差值。
输出图像确定单元，用于根据获取的所述第一差值，确定下一输出图像的序列号。
图3是本发明提供的图像输出装置的一实施例中的结构示意图。本 发明一具体实施方式，结合本发明其他实施方式的各个方面。
一种图像输出装置20包括序列号差值获取单元201和输出图像确定单元203以及序列号差值更新单元205。
其中，序列号差值获取单元，用于获取顺次输出的图像的序列号之间的第一差值。例如，一般情况下，在两个IDR图像之间，需要确定一次第一差值。因为在不同的图像序列，图像之间的POC差值是有可能变化的，所以在遇到IDR图像后，需要重新估计POC差值。
输出图像确定单元，用于根据获取的所述第一差值，确定下一输出图像的序列号。例如，下一输出图像的序列号是当前输出图像序列号与第一差值之和。
序列号差值更新单元，用于等待解码图像缓存区被填满后，按照图像序列号升序排列所述解码图像缓存区的所有图像，并计算相邻图像序列号之间的差值，当差值中奇数值大于等于偶数值，则所述第一差值为1；当差值中偶数值大于奇数值，则所述第一差值为2。一般情况下，当此前接收到一IDR图像但还未重新确定第一差值时，再接收到新的解码后图像后，触发序列号差值更新单元的工作。
图4是本发明提供的图像输出装置的一实施例中的结构示意图。本发明一具体实施方式，结合本发明其他实施方式的各个方面。
一种图像输出装置30包括序列号差值获取单元301、输出图像确定单元303、序列号差值更新单元305以及判断单元307。
其中，序列号差值获取单元，用于获取顺次输出的图像的序列号之间的第一差值。例如，一般情况下，在两个IDR图像之间，需要确定一次第一差值。因为在不同的图像序列，图像之间的POC差值是有可能变化的，所以在遇到IDR图像后，需要重新估计POC差值。
输出图像确定单元，用于根据获取的所述第一差值，确定下一输出图像的序列号。例如，下一帧输出图像的序列号是当前输出图像序列号与第一差值之和。
序列号差值更新单元，用于等待解码图像缓存区被填满后，按照图像序列号升序排列所述解码图像缓存区的所有图像，并计算相邻图像序列号之间的差值，当差值中奇数值大于等于偶数值，则所述第一差值为1；当差值中偶数值大于奇数值，则所述第一差值为2。
判断单元，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数且此前接收到即时解码刷新图像后还未重新确定所述第一差值，触发序列号差值更新单元的工作。
和/或判断单元，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数时，用于触发序列号差值获取单元和输出图像确定单元的工作。
可选地，图像输出装置还包括图像输出单元，用于当未输出图像的数量大于参考帧个数时，输出解码图像缓存区中图像序列号最小的图像，并根据所述输出图像确定单元确定的下一帧输出图像的序列号，将所述下一输出图像的序列号对应的图像输出。
可选地，图像输出单元，还用于当未输出图像的数量不大于参考帧个数时，根据下一输出图像的序列号，将所述下一输出图像的序列号对应的图像输出。
当解码图像缓存区中存在所述下一输出图像的序列号对应的图像，则所述图像输出单元输出所述下一输出图像的序列号对应的图像，直至下一输出图像的序列号对应的图像未存储于所述解码图像缓存区。当解 码图像缓存区中未存储所述下一输出图像的序列号对应的图像，则从所述解码图像缓存区删除已输出非参考帧。
本发明一实施方式提供了一种解码器，包括本发明各个实施方式提供的图像输出装置。
图5是本发明提供的图像输出方法的一实施例中的方法示意图。一种图像输出方法，包括步骤S410和步骤S420。
步骤S410，序列号差值获取步骤，用于获取顺次输出的图像的序列号之间的第一差值。例如，一般情况下，在两个IDR图像之间，需要确定一次第一差值。因为在不同的图像序列，图像之间的POC差值是有可能变化的，所以在遇到IDR图像后，需要重新估计POC差值。
步骤S420，输出图像确定步骤，用于根据获取的所述第一差值，确定下一输出图像的序列号。例如，下一输出图像的序列号是当前输出图像序列号与第一差值之和。
可选地，图像输出方法还可以包括序列号差值更新步骤，用于等待解码图像缓存区被填满后，按照图像序列号升序排列所述解码图像缓存区的所有图像，并计算相邻图像序列号之间的差值，当差值中奇数值大于等于偶数值，则所述第一差值为1。
可选地，图像输出方法还可以包括判断步骤，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数且此前接收到即时解码刷新图像后还未重新确定所述第一差值，执行序列号差值更新步骤。
和/或判断步骤，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数时，执行所述序列号差值获取步骤和所述输出图像确定步骤。
可选地，图像输出方法还可以包括图像输出步骤，用于当未输出图像的数量大于参考帧个数时，输出解码图像缓存区中图像序列号最小的图像，并根据所述输出图像确定步骤确定的下一输出图像的序列号，将所述下一输出图像的序列号对应的图像输出。
可选地，图像输出方法还可以包括图像输出步骤，还用于当未输出图像的数量不大于参考帧个数时，根据下一输出图像的序列号，将所述下一输出图像的序列号对应的图像输出。
当解码图像缓存区中存在所述下一输出图像的序列号对应的图像，则所述图像输出步骤输出所述下一输出图像的序列号对应的图像，直至下一输出图像的序列号对应的图像未存储于所述解码图像缓存区；当解码图像缓存区中未存储所述下一输出图像的序列号对应的图像，则从所述解码图像缓存区删除已输出非参考帧。
图6是本发明提供的图像输出方法的一实施例中的方法流程图。
流程开始，先判断是否是IDR图像，如果是IDR图像，则将DPB中所有图像都输出,然后清空缓冲区。不同的图像序列，图像之间的POC差值是有可能变化的，所以在遇到IDR图像后，都需要置位估计POC差值Flag(即令估计POC差值Flag变量为True)和设置next_poc(该参数用于记录下一输出图像的序列号)为-1。
如果当前图像不是IDR图像，则判断DPB中标定为“未输出”的图像数量是否大于DPB中参考帧个数。
如果条件成立，先判断是否需要重新估计POC差值，当估计POC差值Flag变量为True时，表示需要重新估计POC差值，此时代表收到之前的IDR图像后还未估计过POC差值。当估计POC差值Flag变量为NOT True时，则不需要重新估计POC差值。
如果需要重新估计POC差值，则先等DPB满，按POC升序DPB中所有图像，然后计算图像之间POC差值，如果奇数值多，则认为POC差值(即第一差值)gap为1；如果偶数值多，则认为POC差值gap为2；最后清除估计POC差值Flag(即令估计POC差值Flag变量为NOT TURE)。等DPB满才开始估计POC差值，能够提高最终估算出的结果正确性。
如果不需要估计POC差值，则输出DPB中POC最小的图像，然后设置下一输出图像的POC值：next_poc＝cur_poc+gap，其中next_poc为下一输出图像的序列号，cur_poc为当前输出图像的序列号，gap为第一差值；按照next_poc值继续寻找图像,如果存在将其输出,设置设置下一输出图像的POC值next_poc，循环下去,直到DPB中不存在此图像。
如果DPB中标定为“未输出”的图像数量小于DPB中参考帧个数，按照next_poc值寻找图像,如果存在将其输出,设置设置下一输出图像的POC值next_poc，循环下去,直到DPB中不存在此图像。最后从DPB中删除已输出非参考帧。
本发明的方案，能够在内存比较小的系统支持1080P30 H.264高清解码，节省产品成本；另外，能够实现解码后的图像快速重排序输出，改善视频播放流畅度。
本文中所描述的功能可在硬件、由处理器执行的软件、固件或其任何组合中实施。如果在由处理器执行的软件中实施，那么可将功能作为一或多个指令或代码存储于计算机可读媒体上或经由计算机可读媒体予以传输。其它实例及实施方案在本发明及所附权利要求书的范围及精神内。举例来说，归因于软件的性质，上文所描述的功能可使用由处理器、 硬件、固件、硬连线或这些中的任何者的组合执行的软件实施。此外，各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。
在本申请所提供的几个实施例中，应该理解到，所揭露的技术内容，可通过其它的方式实现。其中，以上所描述的装置实施例仅仅是示意性的，例如所述单元的划分，可以为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，单元或模块的间接耦合或通信连接，可以是电性或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为控制装置的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可为个人计算机、服务器或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述仅为本发明的实施例而已，并不用于限制本发明，对于本 领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的权利要求范围之内。

Claims (15)

  1. 一种图像输出装置，其特征在于，包括：
    序列号差值获取单元，用于获取顺次输出的图像的序列号之间的第一差值；
    输出图像确定单元，用于根据获取的所述第一差值，确定下一输出图像的序列号。
  2. 根据权利要求1的装置，其特征在于，还包括：序列号差值更新单元，用于等待解码图像缓存区被填满后，按照图像序列号升序排列所述解码图像缓存区的所有图像，并计算相邻图像序列号之间的差值，当差值中奇数值大于等于偶数值，则所述第一差值为1；当差值中偶数值大于奇数值，则所述第一差值为2。
  3. 根据权利要求2所述的装置，其特征在于，还包括判断单元，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数且此前接收到即时解码刷新图像后还未重新确定所述第一差值，触发序列号差值更新单元的工作。
  4. 根据权利要求1或2所述的装置，其特征在于，还包括判断单元，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数时，用于触发所述序列号差值获取单元和所述输出图像确定单元的工作。
  5. 根据权利要求4所述的装置，其特征在于，还包括图像输出单元，用于当未输出图像的数量大于参考帧个数时，输出解码图像缓存区中图像序列号最小的图像，并根据所述输出图像确定单元确定的下一输出图像的序列号，将所述下一输出图像的序列号对应的图像输出。
  6. 根据权利要求4或5所述的装置，其特征在于，还包括图像输出单元，用于当未输出图像的数量不大于参考帧个数时，根据下一输出 图像的序列号，将所述下一输出图像的序列号对应的图像输出。
  7. 根据权利要求5或6所述的装置，其特征在于，当解码图像缓存区中存在所述下一输出图像的序列号对应的图像，则所述图像输出单元输出所述下一输出图像的序列号对应的图像，直至下一输出图像的序列号对应的图像未存储于所述解码图像缓存区；
    当解码图像缓存区中未存储所述下一输出图像的序列号对应的图像，则从所述解码图像缓存区删除已输出非参考帧。
  8. 一种解码器，其特征包括，如权利要求1-7任一所述的图像输出装置。
  9. 一种图像输出方法，其特征在于，包括：
    序列号差值获取步骤，用于获取顺次输出的图像的序列号之间的第一差值；
    输出图像确定步骤，用于根据获取的所述第一差值，确定下一输出图像的序列号。
  10. 根据权利要求9的方法，其特征在于，还包括：序列号差值更新步骤，用于等待解码图像缓存区被填满后，按照图像序列号升序排列所述解码图像缓存区的所有图像，并计算相邻图像序列号之间的差值，当差值中奇数值大于等于偶数值，则所述第一差值为1；当差值中偶数值大于奇数值，则所述第一差值为2。
  11. 根据权利要求10所述的方法，其特征在于，还包括判断步骤，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数且此前接收到即时解码刷新图像后还未重新确定所述第一差值，执行序列号差值更新步骤。
  12. 根据权利要求9或10所述的方法，其特征在于，还包括判断步 骤，用于判断所述解码图像缓存区中未输出图像的数量是否大于参考帧个数，当未输出图像的数量大于参考帧个数时，执行所述序列号差值获取步骤和所述输出图像确定步骤。
  13. 根据权利要求12所述的方法，其特征在于，还包括图像输出步骤，用于当未输出图像的数量大于参考帧个数时，输出解码图像缓存区中图像序列号最小的图像，并根据所述输出图像确定步骤确定的下一输出图像的序列号，将所述下一输出图像的序列号对应的图像输出
  14. 根据权利要求12或13所述的方法，其特征在于，还包括图像输出步骤，还用于当未输出图像的数量不大于参考帧个数时，根据下一输出图像的序列号，将所述下一输出图像的序列号对应的图像输出。
  15. 根据权利要求13或14所述的方法，其特征在于，当解码图像缓存区中存在所述下一输出图像的序列号对应的图像，则所述图像输出步骤输出所述下一输出图像的序列号对应的图像，直至下一输出图像的序列号对应的图像未存储于所述解码图像缓存区；
    当解码图像缓存区中未存储所述下一输出图像的序列号对应的图像，则从所述解码图像缓存区删除已输出非参考帧。
PCT/CN2017/092006 2016-11-14 2017-07-06 一种图像输出装置、方法及解码器 WO2018086363A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611024600.7A CN106713927B (zh) 2016-11-14 2016-11-14 一种图像输出装置、方法及解码器
CN201611024600.7 2016-11-14

Publications (1)

Publication Number Publication Date
WO2018086363A1 true WO2018086363A1 (zh) 2018-05-17

Family

ID=58940073

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/092006 WO2018086363A1 (zh) 2016-11-14 2017-07-06 一种图像输出装置、方法及解码器

Country Status (2)

Country Link
CN (1) CN106713927B (zh)
WO (1) WO2018086363A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024113601A1 (zh) * 2022-11-29 2024-06-06 深圳市中兴微电子技术有限公司 一种视频解码处理方法、装置、存储介质及电子装置

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106713927B (zh) * 2016-11-14 2019-08-13 珠海格力电器股份有限公司 一种图像输出装置、方法及解码器

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103931189A (zh) * 2011-09-22 2014-07-16 Lg电子株式会社 用信号发送图像信息的方法和装置，以及使用其的解码方法和装置
US20150156501A1 (en) * 2013-12-02 2015-06-04 Nokia Corporation Video encoding and decoding
CN104935944A (zh) * 2014-03-18 2015-09-23 华为技术有限公司 一种视频数据编码、解码的方法和装置
CN105308971A (zh) * 2013-06-03 2016-02-03 高通股份有限公司 假设的参考解码器模型和跨层随机存取跳过图片的一致性
US20160134888A1 (en) * 2013-07-16 2016-05-12 Fujitsu Limited Video encoding apparatus, video encoding method, video decoding apparatus, and video decoding method
CN105659599A (zh) * 2013-10-14 2016-06-08 瑞典爱立信有限公司 可缩放视频中的图序计数对齐
US20160330459A1 (en) * 2014-01-03 2016-11-10 Samsung Electronics Co., Ltd. Method for encoding video and apparatus therefor, and method for decoding video and apparatus therefor using effective parameter delivery
CN106713927A (zh) * 2016-11-14 2017-05-24 珠海格力电器股份有限公司 一种图像输出装置、方法及解码器

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1271864C (zh) * 2004-08-05 2006-08-23 联合信源数字音视频技术（北京）有限公司 视频解码缓冲区控制装置及方法
CN102789804B (zh) * 2011-05-17 2016-03-02 华为软件技术有限公司 视频播放方法、播放器、监控平台及视频播放系统
CN103945221B (zh) * 2014-04-09 2018-08-07 浙江大学 视频编解码方法、装置及生成的视频码流
CN105323587B (zh) * 2014-06-09 2018-08-28 浙江大学 视频的图像输出管理方法及装置、传输视频码流的方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103931189A (zh) * 2011-09-22 2014-07-16 Lg电子株式会社 用信号发送图像信息的方法和装置，以及使用其的解码方法和装置
CN105308971A (zh) * 2013-06-03 2016-02-03 高通股份有限公司 假设的参考解码器模型和跨层随机存取跳过图片的一致性
US20160134888A1 (en) * 2013-07-16 2016-05-12 Fujitsu Limited Video encoding apparatus, video encoding method, video decoding apparatus, and video decoding method
CN105659599A (zh) * 2013-10-14 2016-06-08 瑞典爱立信有限公司 可缩放视频中的图序计数对齐
US20150156501A1 (en) * 2013-12-02 2015-06-04 Nokia Corporation Video encoding and decoding
US20160330459A1 (en) * 2014-01-03 2016-11-10 Samsung Electronics Co., Ltd. Method for encoding video and apparatus therefor, and method for decoding video and apparatus therefor using effective parameter delivery
CN104935944A (zh) * 2014-03-18 2015-09-23 华为技术有限公司 一种视频数据编码、解码的方法和装置
CN106713927A (zh) * 2016-11-14 2017-05-24 珠海格力电器股份有限公司 一种图像输出装置、方法及解码器

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024113601A1 (zh) * 2022-11-29 2024-06-06 深圳市中兴微电子技术有限公司 一种视频解码处理方法、装置、存储介质及电子装置

Also Published As

Publication number Publication date
CN106713927A (zh) 2017-05-24
CN106713927B (zh) 2019-08-13

Similar Documents

Publication Publication Date Title
CN109803180B (zh) 视频预览图生成方法、装置、计算机设备及存储介质
US8666192B2 (en) Apparatus and method for ultra-high resolution video processing
CN108093293B (zh) 一种视频渲染方法及系统
JP2017525234A5 (zh)
JP2016538756A5 (ja) 復号方法
JP2015533058A5 (zh)
JP2016509403A5 (zh)
WO2018086363A1 (zh) 一种图像输出装置、方法及解码器
WO2019144839A1 (zh) 一种用于替换视频中的对象的方法和装置
WO2019184822A1 (zh) 多媒体文件处理方法和装置、存储介质及电子装置
US10269155B1 (en) Image artifact masking
WO2019076109A1 (zh) 图像信息的池化方法及装置、存储介质、处理器
US20190306436A1 (en) Method and system for switching display from first video source to second video source
WO2017186036A1 (zh) 一种播放处理方法、终端设备及计算机存储介质
WO2012059008A1 (zh) 图像显示处理方法及装置
CN106470291A (zh) 从音频/视频解码器中的时间同步中的中断中恢复
CN115334335B (zh) 视频插帧方法及装置
EP3242222A1 (en) Searching method and apparatus
CN112468875A (zh) 视频解码帧的显示输出控制方法及装置、存储介质、终端
WO2016202306A1 (zh) 视频处理方法及装置
US9495727B2 (en) Video channel display method and apparatus
US20180199019A1 (en) Digital image conversion method and apparatus, storage medium, and device
US20200260075A1 (en) Systems and methods for group of pictures encoding
WO2017215474A1 (zh) 一种动画生成方法和装置
WO2017028029A1 (zh) 背景模型的提取方法、装置以及图像处理设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17869596

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17869596

Country of ref document: EP

Kind code of ref document: A1