WO2019084792A1 - 一种编码方法及装置 - Google Patents

一种编码方法及装置 Download PDF

Info

Publication number
WO2019084792A1
WO2019084792A1 PCT/CN2017/108651 CN2017108651W WO2019084792A1 WO 2019084792 A1 WO2019084792 A1 WO 2019084792A1 CN 2017108651 W CN2017108651 W CN 2017108651W WO 2019084792 A1 WO2019084792 A1 WO 2019084792A1
Authority
WO
WIPO (PCT)
Prior art keywords
image block
current image
coding
motion vector
intra
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/108651
Other languages
English (en)
French (fr)
Inventor
苏文艺
赵亮
朱磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Priority to PCT/CN2017/108651 priority Critical patent/WO2019084792A1/zh
Priority to CN201780008551.4A priority patent/CN108702510A/zh
Publication of WO2019084792A1 publication Critical patent/WO2019084792A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding

Definitions

  • the present application relates to the field of video coding, and more particularly to an encoding method and apparatus.
  • An I frame sometimes referred to as an intra-coded frame, is a key frame in a video image.
  • An I frame is an independent frame with all the information, and can be independently coded without reference to other image frames.
  • a P frame (or a B frame) may also be referred to as an inter-coded frame, and an inter-frame coding technique is used, that is, information needs to be coded and referenced with reference to other image frames.
  • Inter-frame coding is equivalent to temporal low-pass filtering of the image, so that consecutive P-frames have similar similarity. Therefore, during video playback, if the played video content is a video content carried in a P frame, the human eye will feel that the playback process of the video content is smooth.
  • I frames are usually encoded periodically during video encoding.
  • the periodically occurring I frame blocks the smooth propagation of the video content, causing the video content viewed by the human eye to flicker.
  • the present application provides an encoding method and apparatus, which can reduce the degree of flicker of a video to some extent.
  • an encoding method including: acquiring a current image block to be encoded, the current image block being any one of an I frame or an I strip; inter-coding the current image block, Obtaining inter-frame coding information of the current image block, where the inter-frame coding information includes a reconstructed image block of the current image block; determining, according to the inter-frame coding information, whether the current image block generates flicker; The current image block is generated to generate flicker, and the reconstructed image block is intra-coded to obtain an intra-frame coding result of the current image block; according to the intra-frame coding result, the generation The code stream information corresponding to the current image block is described.
  • an encoder comprising: a memory for storing a program; a processor, configured to execute a program stored in the memory, when the program is executed, the processor is configured to execute as the first The encoding method described in the aspect.
  • a third aspect provides an image processing system, comprising: an image acquisition system, configured to acquire an image; and the encoder according to the second aspect, configured to encode an image collected by the image acquisition system to obtain a code stream. Information; an image transmission system for transmitting the code stream information.
  • a drone comprising the image processing system of the third aspect.
  • a computer storage medium comprising computer instructions that, when executed on a computer, cause the computer to perform the method of the first aspect.
  • a computer program product that, when executed on a computer, causes the computer to perform the method of the first aspect.
  • the technical solution provided by the present application changes the encoding mode of the image block in the traditional I frame or the I strip, first inter-codes the current image block in the I frame or the I strip, and determines the current image based on the inter-frame encoding information. Whether the intraframe coding of the block causes a flicker effect. If the intra-coding of the current image block causes a flickering effect, the reconstructed image block obtained by inter-coding is used instead of the current image block for intra-coding.
  • the interframe coding technique has the characteristics of time low-pass filtering.
  • the video content of the corresponding image block in the first few frames may be more similar, and intra-coding of the reconstructed image block may avoid a large jump of the encoded video content to a certain extent, thereby reducing the video content to a certain extent.
  • the degree of flicker during playback may be more similar, and intra-coding of the reconstructed image block may avoid a large jump of the encoded video content to a certain extent, thereby reducing the video content to a certain extent.
  • the degree of flicker during playback may be more similar, and intra-coding of the reconstructed image block may avoid a large jump of the encoded video content to a certain extent, thereby reducing the video content to a certain extent.
  • the degree of flicker during playback may be more similar, and intra-coding of the reconstructed image block may avoid a large jump of the encoded video content to a certain extent, thereby reducing the video content to a certain
  • FIG. 1 is an exemplary diagram of an arrangement of I frames.
  • FIG. 2 is an exemplary diagram of an arrangement of I strips.
  • FIG. 3 is a schematic structural diagram of an encoding system to which an embodiment of the present invention is applicable.
  • FIG. 4 is a schematic flowchart of an encoding method according to an embodiment of the present invention.
  • FIG. 5 is a schematic flow diagram of one implementation of step 430 of FIG.
  • FIG. 6 is a schematic flow diagram of another implementation of step 430 of FIG.
  • FIG. 7 is a diagram showing an example of surrounding image blocks of a current image block according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of an encoder according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of an image processing system according to an embodiment of the present invention.
  • FIG. 10 is a schematic structural diagram of a drone according to an embodiment of the present invention.
  • the technical solution provided by the present application can be applied to various systems related to video coding, such as a video codec system, a video storage system, a video transmission system, a drone image transmission system, and the like.
  • the technical solution provided by the present application can be applied to various video coding standards, such as H.263, H.264, H.265/AVC (advanced video coding), moving picture experts group (moving picture experts group, MPEG) and so on.
  • video coding standards such as H.263, H.264, H.265/AVC (advanced video coding), moving picture experts group (moving picture experts group, MPEG) and so on.
  • the video encoding process produces I and P frames (or B frames).
  • the appearance of an I frame blocks the smooth propagation of the video content, causing the video content viewed by the human eye to flicker (this phenomenon can be referred to as the flicker effect of the video).
  • flicker effect of the video this phenomenon can be referred to as the flicker effect of the video.
  • the causes of the flickering effect of the video will be described in detail below.
  • I is usually periodically encoded. frame.
  • GDR gradual refresh
  • the flickering effect of the video is generally generated.
  • the P frame is encoded by the inter-frame coding mode, and the inter-frame coding is equivalent to performing low-pass filtering on the consecutive P frames, which makes the P-frames of consecutive occurrences have higher similarity, and the human eye is watching P.
  • the video content corresponding to the frame the video content is perceived to be smooth.
  • this type of image frame blocks the smooth propagation of the video content, causing periodic flicker of the video content.
  • the human eye since the position of the I strip changes periodically, the human eye not only feels the periodic flicker of the video content, but also feels that the flickering portion of the video is moving, forming a roller effect.
  • Embodiments of the present invention provide an encoding method, which can reduce the degree of flicker of a video.
  • an encoding system 300 to which an embodiment of the present invention is applicable will be described in detail in conjunction with FIG. 3.
  • the authoring system 300 can include an initialization module 310, a motion estimation module 320, Inter-coding module 330, intra-coding module 340 and entropy encoding module 350.
  • the initialization module 310 can be used to initialize the video content to be encoded, such as block division of the image frame to be encoded, to form an image block to be encoded (sometimes referred to as a macro bloack (MB)).
  • MB macro bloack
  • the different video coding and decoding standards have their respective corresponding image block division manners, which are not specifically limited in the embodiment of the present invention.
  • the motion estimation module 320 can be used for motion estimation of the current image block to be encoded, such as calculating a motion vector (MV) of the current image block, a reference image block, and the like.
  • the information output by the motion estimation module 320 can be input to the inter-frame coding module 330 as inter-frame coding information.
  • the inter coding module 330 and the intra coding module 340 can be used for inter coding and intra coding of the current image block, respectively.
  • Encoding system 300 typically encodes the current image block by selecting one of the inter-coding modes and/or intra-coding modes of the current image block.
  • the coding mode may be, for example, an coding mode in which the rate distortion cost is the smallest in the inter coding mode or the intra coding mode, that is, the optimal coding mode. It should be noted that, for a P frame or a P strip (which may also be a B frame or a B strip), the encoding system 300 usually selects an inter coding mode from the inter coding mode to encode the current image block.
  • the encoding system 300 typically encodes the current image block from one of the intra-coded modes of the intra-coded mode.
  • all frames may be first inter-coded by the inter-frame coding module 330, and then whether intra-coding is required, and intra-frame coding is required, and whether to use the current image block for intra-frame coding is confirmed. Or reconstruct the picture block for intra-frame coding; it can also determine whether the frame requires intra-frame coding, and if it is determined that intra-frame coding is required, it is determined whether intra-frame coding is required, which is not limited herein.
  • the entropy encoding module 350 may perform an entropy encoding operation on the data encoded by the inter encoding module 330 or the intra encoding module 340 to obtain a code stream to be stored or to be transmitted.
  • FIG. 4 is a schematic flowchart of an encoding method according to an embodiment of the present invention.
  • the encoding method of Figure 4 can be performed, for example, by an encoder, such as a video encoder.
  • the encoding method can include steps 410-450. The steps in Figure 4 are described in detail below.
  • a current image block to be encoded is obtained.
  • the current image block may be any one of an I frame or an I slice.
  • step 420 the current image block is inter-coded to obtain inter-frame coding information of the current image block.
  • the inter coding mode may also be referred to as an inter mode or an inter mode.
  • the current image block may be inter-coded using one or more inter-coding modules.
  • One or more The inter-frame coding mode may be selected according to actual needs, or may be determined according to the codec standard actually used, which is not limited by the embodiment of the present invention. Taking H.264/AVC as an example, the at least one inter-coding mode may include, for example, one or more of the following inter-coding modes: inter-frame 16 ⁇ 16 mode, inter-frame 16 ⁇ 8 mode, inter-frame 8 ⁇ 16 mode, inter-frame 8 ⁇ 8 mode (inter-frame 8 ⁇ 8 mode can be further subdivided into inter-frame 4 ⁇ 4 mode) and the like.
  • step 420 can include inter-coding the current image block using an optimal inter coding mode to obtain inter-coded information of the current image block.
  • the interframe coding information obtained in step 420 can be understood as some kind of information related to interframe coding.
  • the information may be, for example, the information generated by the inter-frame coding process, or the information used in the inter-frame coding process, or the information included in the inter-frame coding result, which is not limited by the embodiment of the present invention.
  • the inter-coded information may include reconstructed image blocks of the current image block. Assuming that the current image block is encoded in an inter-coding mode, the reconstructed image block may be a reconstructed image block corresponding to the current image block in the inter-coding mode. Assuming that the current image block is encoded in a plurality of inter-coding modes, the reconstructed image block may be any one of the plurality of inter-coding modes (hereinafter referred to as the target inter-coding mode). Reconstructed image block under ).
  • the rate-distortion cost of the plurality of inter-coding modes is estimated, and the target inter-coding mode is selected from the plurality of inter-coding modes according to the rate-distortion cost of the plurality of inter-coding modes.
  • the target inter-coding mode may be an optimal inter-coding mode among the plurality of inter-coding modes described above.
  • the optimal inter coding mode referred to in this application may, for example, refer to an inter coding mode in which the rate distortion cost is the smallest among a plurality of inter coding modes.
  • the inter-frame coding information may further include at least one of the following: a reference image block corresponding to the current image block, a motion vector corresponding to the current image block, and the like.
  • the reference image block corresponding to the current image block may be an image block in a reference image frame corresponding to the current image frame where the current image block is located, and the position of the reference image frame and/or the reference image block at the reference image frame may be an inter-frame coding mode determine. Assuming that the current image block is encoded in an inter-coding mode, the reference image block corresponding to the current image block may be a reference image block corresponding to the current image block in the inter-coding mode.
  • the reference image block corresponding to the current image block may be a reference image block corresponding to the current image block in the inter-coding mode.
  • the reference image corresponding to the current image block The block may be a reference image block corresponding to the current image block in any one of the plurality of inter-coding modes.
  • the reference image block corresponding to the current image block may be a reference image block corresponding to the current image block in the optimal inter coding mode among the plurality of inter coding modes described above.
  • the motion vector corresponding to the image block may correspond to the image block in the inter-coding mode.
  • Sport vector Assuming that the image block is encoded in a plurality of inter-coding modes, the motion vector corresponding to the image block may be a motion vector corresponding to the image block in any one of the plurality of inter-coding modes. . As an example, the motion vector corresponding to the image block may be a motion vector corresponding to the optimal inter coding mode of the image block in the foregoing multiple inter coding modes.
  • step 430 it is determined whether the current image block will produce flicker based on the interframe coding information.
  • the current image block produces flickering, which means that when the video is played to the video content contained in the current image block, the continuity of the video playback is interrupted, and the human eye perceives that the video content has a jump.
  • step 430 there are a plurality of implementations of the step 430, which are not limited by the embodiment of the present invention.
  • whether the current image block will generate flicker may be determined according to the similarity between the reconstructed image block of the current image block and the current image block.
  • whether the current image block may generate flicker may be determined according to the similarity of the reconstructed image block of the current image block and the reference image block corresponding to the current image block.
  • whether the current image block may generate flicker may be determined according to the consistency of the motion vector corresponding to the current image block and the motion vector corresponding to the surrounding image block of the current image block.
  • two or more of the above examples may also be combined to determine if the current image block will produce a flicker.
  • the specific implementation of step 430 is detailed below, and will not be described in detail herein.
  • step 440 if the current image block is to be flickering, the reconstructed image block is intra-coded to obtain an intra-coded result of the current image block.
  • an encoding object (or a coded source image block) is a current image block.
  • the reconstructed image block may be used as the encoding target instead of the current image block for intra coding.
  • the reconstructed image block is an image block obtained based on inter-frame coding, and the inter-frame coding technique has the characteristics of time low-pass filtering. Therefore, compared with the current image block, the reconstructed image block and the corresponding image in the previous or previous frames are reconstructed.
  • the video content of the block may be closer, and intra-coding of the reconstructed image block will be To a certain extent, it avoids a large jump in the encoded video content, thereby reducing the degree of flicker of the video content during playback.
  • the quantization parameter (QP) corresponding to the intra-frame coding may be the same as or different from the quantization parameter corresponding to the inter-frame coding.
  • the quantization parameter corresponding to the intra-frame coding may be set to be smaller than the inter-frame coding corresponding. Quantitative parameters.
  • the encoded data may not be quantized, so that distortion of the video content generated by the quantization process may be avoided.
  • Intra_qp may represent a quantization parameter corresponding to intra coding
  • delta_qp may indicate a difference between a quantization parameter corresponding to the inter coding and a quantization parameter corresponding to the intra coding.
  • the value of delta_qp may be a positive integer, for example, may be a positive integer greater than 3.
  • the method of FIG. 4 may further include: if the current image block does not generate flicker, the current image block may be intra-coded to obtain an intra-coded result of the current image block.
  • step 450 code stream information corresponding to the current image block is generated according to the intra-frame coding result.
  • the intra-coded result may be subsequently processed based on a conventional manner to generate code stream information.
  • an operation such as entropy coding can be performed on the intraframe coding result.
  • data can be deblocked and filtered.
  • the embodiment of the present invention changes the encoding mode of the image block in the traditional I frame or the I strip, first performs interframe coding on the current image block in the I frame or the I strip, and determines the current image block based on the interframe encoding information. Whether intraframe coding will cause a flicker effect. If the intra-coding of the current image block causes a flickering effect, the reconstructed image block obtained by inter-coding is used instead of the current image block for intra-coding.
  • the interframe coding technique has the characteristics of time low-pass filtering. Therefore, compared with the current image block, the reconstructed image block may be more similar to the video content of the corresponding image block in the previous frame or the previous few frames.
  • the intra-coding of the image block will avoid the large jump of the encoded video content to a certain extent, thus reducing the degree of flicker of the video content during playback.
  • step 430 is illustrated by way of example with reference to specific embodiments.
  • the inter-frame coding information may further include a reference image block corresponding to the current image block.
  • step 430 can include steps 432-434.
  • step 432 the similarity of the reconstructed image block and the reference image block is determined.
  • step 434 it is determined whether the current image block will produce flicker based on the similarity between the reconstructed image block and the reference image block.
  • the degree of similarity between the reconstructed image block and the reference image block can be measured in a variety of ways. For example, the sum of absolute error (SAE) and/or sum of squares for error (SSE) of the reconstructed image block and the reference image block can be compared.
  • SAE sum of absolute error
  • SSE sum of squares for error
  • step 434 is related to the definition of the value of the similarity. It is assumed that the higher the similarity between the reconstructed image block and the reference image block, the larger the similarity of the reconstructed image block and the reference image block, the step 434 may include: if the similarity is less than or less than or equal to the first preset threshold, determining The current image block will produce a flicker. Further, in some embodiments, step 434 may further include determining that the current image block does not generate flicker if the similarity is greater than or equal to the first predetermined threshold.
  • the step 434 may include: if the similarity is greater than or equal to the first predetermined threshold, determining The current image block will produce a flicker. Further, in some embodiments, step 434 may further include determining that the current image block does not produce flicker if the similarity is less than or less than or equal to the first predetermined threshold.
  • inter-frame coding has the characteristics of temporal low-pass filtering, unless the video content itself is abrupt, the similarity between the reconstructed image block and the reference image block is generally higher (or less). Therefore, if the reconstructed image block and the reference image block have low similarity (or a large difference), it can be understood that the video content itself is abrupt, for example, the scene depicted by the video suddenly switches from one scene to another completely different scene, which A natural change in video content, not the flickering effect of the video due to encoding.
  • the embodiment of the present invention determines that the current image block does not generate flicker, and may still generate an intra-frame coding result of the current image block by directly performing intra-frame coding on the current image block.
  • the embodiment of the invention can distinguish the normal mutation of the video content from the flicker of the video content, and adopt different coding strategies, thereby improving the coding quality of the video.
  • the current image block may be directly used as the reconstructed image block corresponding to the current image block.
  • step 434 in the embodiment of FIG. 5 may be replaced with determining whether the current image block will produce a flicker based on the similarity of the current image block and the reference image block.
  • the interframe coding information may also include a motion vector corresponding to the current image block.
  • step 430 can include steps 436-438.
  • step 436 a difference between the motion vector corresponding to the current image block and the motion vector corresponding to the surrounding image block of the current image block is determined.
  • the surrounding image block of the current image block may refer to the image block that has been encoded around the current image block.
  • the surrounding image blocks of the current image block can be defined in various ways.
  • a surrounding image block of the current image block may include adjacent image blocks of the current image block.
  • a surrounding image block of a current image block can include adjacent image blocks of adjacent image blocks of the current image block.
  • the surrounding image block of the current image block may include one image block, and may also include two or more image blocks.
  • the surrounding image blocks of the image block X may include the image block A, the image block B, the image block C, and the image block D.
  • the surrounding image blocks of the image block X may be the image block A and the image block B.
  • step 438 it is determined whether the current image block will generate flicker according to the difference between the motion vector corresponding to the current image block and the motion vector corresponding to the surrounding image block.
  • the embodiment of the present invention determines that the current image block does not generate flicker, and still generates an intra-frame coding result of the current image block by directly performing intra-frame coding on the current image block.
  • the embodiment of the invention can distinguish the normal mutation of the video content from the flicker of the video content, and adopt different coding strategies, thereby improving the coding quality of the video.
  • the difference between the motion vector corresponding to the current image block and the motion vector corresponding to the surrounding image block may be defined in various ways.
  • the difference between the motion vector corresponding to the current image block and the motion vector corresponding to the surrounding image block may be defined as a motion vector corresponding to the current image block and each surrounding image block pair.
  • the minimum value of the difference in the motion vector may be defined as an average value of the difference between the motion vector corresponding to the current image block and the motion vector corresponding to each surrounding image block.
  • Step 438 may include determining that the current image block produces a flicker if the difference between the motion vector corresponding to the current image block and the motion vector corresponding to the surrounding image block is less than or less than a second predetermined threshold. Further, in some embodiments, step 438 may further include determining that the current image block does not generate flicker if the difference between the motion vector corresponding to the current image block and the motion vector corresponding to the surrounding image block is greater than a second predetermined threshold.
  • the current image block is the image block X shown in FIG. 7
  • the surrounding image block of the current image block is taken as an example of the image block A-D as shown in FIG. 7 .
  • the motion vector corresponding to the image block X is mv x .
  • the motion vectors corresponding to the image block AD are mv x , mv a , mv b , mv c and mv d , respectively .
  • the components of mv x along the x and y directions are denoted by mv xx and mv yy , respectively.
  • the components of mv a along the x and y directions are denoted by mv ax and mv ay , respectively.
  • the components of mv b along the x and y directions are denoted by mv bx and mv by , respectively.
  • the components of mv c along the x and y directions are denoted by mv cx and mv cy , respectively.
  • the components of mv d along the x and y directions are denoted by mv dx and mv dy , respectively.
  • the difference mv_diff between the motion vector corresponding to the current image block and the motion vector corresponding to the surrounding image block can be calculated by the following formula:
  • Mv_diff (mv_diff a +mv_diff b +mv_diff c +mv_diff d )/8, where:
  • Mv_diff a ABS(mv xx -mv ax )+ABS(mv xy -mv ay );
  • Mv_diff b ABS(mv xx -mv bx )+ABS(mv xy -mv by );
  • Mv_diff c ABS(mv xx -mv cx )+ABS(mv xy -mv cy );
  • Mv_diff d ABS(mv xx -mv dx )+ABS(mv xy -mv dy ).
  • mv_diff can be compared to a second predetermined threshold mv_thres. If mv_diff is greater than mv_thres, it can be considered that the motion vector corresponding to the current image block and the motion vector corresponding to the surrounding image block have a large difference (or poor consistency). If mv_diff is smaller than mv_thres, it can be considered that the difference between the motion vector corresponding to the current image block and the motion vector corresponding to the surrounding image block is small (or the consistency is good). Mv_thres can be determined empirically or experimentally, and mv_thres can be set to 6, for example, or set to 8.
  • the embodiment of FIG. 6 may be performed separately or in combination with the embodiment of FIG. 5. For example, after determining, by the embodiment of FIG. 5, that the similarity between the reconstructed image block and the reference image block is higher (greater than the first preset threshold), the embodiment of FIG. 6 may be further performed to determine when The difference between the motion vector corresponding to the previous image block and the motion vector corresponding to the surrounding image block of the current image block (eg, whether the difference is greater than a second predetermined threshold), and the result obtained in the embodiment of FIG. 6 is taken as the final result.
  • the embodiment of FIG. 5 may be further performed to determine the similarity between the reconstructed image block and the reference image block (eg, determining whether the similarity is Greater than the first predetermined threshold), and the results obtained in the embodiment of FIG. 5 are taken as the final result.
  • the encoder 800 can include a memory 810 and a processor 820.
  • Memory 810 can be used to store programs.
  • the processor 820 can be used to execute programs stored in the memory 810.
  • the processor 820 may be configured to acquire a current image block to be encoded, where the current image block is any one of an I frame or an I slice; and interframe coding the current image block, Obtaining inter-frame coding information of the current image block, where the inter-frame coding information includes a reconstructed image block of the current image block; determining, according to the inter-frame coding information, whether the current image block generates flicker; The current image block is generated to generate flicker, and the reconstructed image block is intra-coded to obtain an intra-frame coding result of the current image block; and the code stream information corresponding to the current image block is generated according to the intra-frame coding result.
  • the inter-frame coding information further includes a reference image block corresponding to the current image block
  • the processor 820 is configured to determine a similarity between the reconstructed image block and the reference image block. And determining, according to the similarity between the reconstructed image block and the reference image block, whether the current image block generates a flicker.
  • the processor 820 is configured to determine that the current image block generates a flicker if the similarity is less than or equal to a first preset threshold.
  • the processor 820 is configured to determine that the current image block does not generate flicker if the similarity is greater than or equal to a first preset threshold.
  • the reference image block is a reference image block corresponding to the current image block in an optimal inter coding mode.
  • the reference image block is an image block in a reference image frame corresponding to a current image frame where the current image block is located, and the reference image block is in the reference image frame.
  • the position is determined by the optimal inter coding mode.
  • the inter-frame coding information further includes the current image block pair a motion vector
  • the processor 820 is configured to determine a difference between a motion vector corresponding to the current image block and a motion vector corresponding to a surrounding image block of the current image block; and a motion vector sum corresponding to the current image block A difference in a motion vector corresponding to the surrounding image block determines whether the current image block generates a flicker.
  • the processor 820 is configured to determine, if a difference between a motion vector corresponding to the current image block and a motion vector corresponding to the surrounding image block is less than or equal to a second preset threshold. The current image block will produce a flicker.
  • the processor 820 is configured to determine, if a difference between a motion vector corresponding to the current image block and a motion vector corresponding to the surrounding image block is greater than the second preset threshold, The current image block does not produce flicker.
  • the surrounding image block is an adjacent image block of the current image block.
  • the motion vector corresponding to the current image block is a motion vector corresponding to an optimal inter coding mode of the current image block.
  • the motion vector corresponding to the surrounding image block is a motion vector corresponding to an optimal inter coding mode of the surrounding image block.
  • the processor 820 is configured to perform intra coding on the reconstructed image block according to a quantization parameter corresponding to intra coding, where the quantization parameter corresponding to the intra coding is smaller than The interframe encodes a corresponding quantization parameter.
  • the processor 820 is further configured to: according to the quantization parameter corresponding to the inter-frame coding, and the preset quantization parameter corresponding to the inter-frame coding, corresponding to the intra-frame coding The difference between the quantization parameters determines a quantization parameter corresponding to the intra coding mode.
  • the processor 820 is further configured to perform intra coding on the current image block if the current image block does not generate flicker, to obtain intra coding of the current image block. result.
  • the processor 820 is configured to entropy encode the intra-coded result to obtain code stream information corresponding to the current image block.
  • An embodiment of the present invention also provides an image processing system.
  • the image processing system 900 can include an image acquisition system 910, an encoder 800, and an image transmission system 920.
  • the encoder 800 can be used to encode the image acquired by the image acquisition system 910 to obtain code stream information.
  • Image transmission system 920 can be used to transmit code stream information.
  • the embodiment of the invention further provides a drone.
  • the drone 1000 can include an image processing system 900.
  • the drone 1000 can also include a housing, and the image processing system 900 can be located inside the housing.
  • the computer program product includes one or more computer instructions.
  • the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • the computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be from a website site, computer, server or data center Transmission to another website site, computer, server or data center via wired (eg coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg infrared, wireless, microwave, etc.).
  • the computer readable storage medium can be any available media that can be accessed by a computer or a data storage device such as a server, data center, or the like that includes one or more available media.
  • the usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (such as a digital video disc (DVD)), or a semiconductor medium (such as a solid state disk (SSD)).
  • a magnetic medium for example, a floppy disk, a hard disk, a magnetic tape
  • an optical medium such as a digital video disc (DVD)
  • a semiconductor medium such as a solid state disk (SSD)
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • Another point that is shown or discussed between each other The coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

提供了一种编码方法及装置。该编码方法包括:获取待编码的当前图像块,当前图像块为I帧或I条带中的任一图像块;对当前图像块进行帧间编码;根据帧间编码信息确定当前图像块是否会产生闪烁;如果当前图像块会产生闪烁,对重建图像块进行帧内编码;根据帧内编码结果,生成当前图像块对应的码流信息。本申请提供的技术方案基于帧间编码信息判断当前图像块的帧内编码是否会导致闪烁效应。如果当前图像块的帧内编码会导致闪烁效应,则采用帧间编码得到的重建图像块代替当前图像块进行帧内编码,可以一定程度上降低了视频内容在播放过程中的闪烁程度。

Description

一种编码方法及装置
版权申明
本专利文件披露的内容包含受版权保护的材料。该版权为版权所有人所有。版权所有人不反对任何人复制专利与商标局的官方记录和档案中所存在的该专利文件或者该专利披露。
技术领域
本申请涉及视频编码领域,并且更为具体地,涉及一种编码方法及装置。
背景技术
I帧有时也可称为帧内(intra)编码帧,是视频图像中的关键帧。I帧是一种自带全部信息的独立帧,一般不需要参考其他图像帧便可独立地进行编解码。
P帧(或B帧)有时也可称为帧间(inter)编码帧,采用的是帧间编码技术,即需要参考其他图像帧的信息进行编解码。帧间编码相当于对图像进行了时间低通滤波,使得连续出现的P帧相似性强。因此,在视频播放过程中,如果播放的视频内容为P帧中承载视频内容,人眼会感觉到视频内容的播放过程很平滑(smooth)。
为了实现视频内容的容错或随机访问(如实现视频播放过程中的快进或快退),在视频编码过程中,通常会周期性地编码I帧。但是,周期性出现的I帧会阻断视频内容的平滑传播,导致人眼观看到的视频内容出现闪烁。
发明内容
本申请提供一种编码方法及装置,可以一定程度降低视频的闪烁程度。
第一方面,提供一种编码方法,包括:获取待编码的当前图像块,所述当前图像块为I帧或I条带中的任一图像块;对所述当前图像块进行帧间编码,得到所述当前图像块的帧间编码信息,所述帧间编码信息包括所述当前图像块的重建图像块;根据所述帧间编码信息,确定所述当前图像块是否会产生闪烁;如果所述当前图像块会产生闪烁,对所述重建图像块进行帧内编码,得到所述当前图像块的帧内编码结果;根据所述帧内编码结果,生成所 述当前图像块对应的码流信息。
第二方面,提供一种编码器,包括:存储器,用于存储程序;处理器,用于执行所述存储器中存储的程序,当所述程序被执行时,所述处理器用于执行如第一方面所述的编码方法。
第三方面,提供一种图像处理系统,包括:图像采集系统,用于采集图像;如第二方面所述的编码器,用于对所述图像采集系统采集到的图像进行编码,得到码流信息;图像传输系统,用于传输所述码流信息。
第四方面,提供一种无人机,包括如第三方面所述的图像处理系统。
第五方面,提供一种计算机存储介质,包括计算机指令,当所述计算机指令在计算机上运行时,使得所述计算机执行如第一方面所述的方法。
第六方面,提供一种计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行第一方面所述的方法。
本申请提供的技术方案更改了传统I帧或I条带中的图像块的编码方式,先对I帧或I条带中的当前图像块进行帧间编码,并基于帧间编码信息判断当前图像块的帧内编码是否会导致闪烁效应。如果当前图像块的帧内编码会导致闪烁效应,则采用帧间编码得到的重建图像块代替当前图像块进行帧内编码。帧间编码技术具有时间低通滤波的特性,因此,对于必须要进行帧内编码的I帧或者I条带的当前图像块,,当前图像块帧间编码得到的重建图像块与前一帧或前几帧图像中的对应图像块的视频内容可能更加近似,对重建图像块进行帧内编码会一定程度上避免编码后的视频内容出现较大的跳变,从而一定程度上降低了视频内容在播放过程中的闪烁程度。
附图说明
图1是I帧的布置方式的示例图。
图2是I条带的布置方式的示例图。
图3是可应用本发明实施例的一种编码系统的示意性结构图。
图4是本发明实施例提供的编码方法的示意性流程图。
图5是图4中的步骤430的一种实现方式的示意性流程图。
图6是图4中的步骤430的另一实现方式的示意性流程图。
图7是本发明实施例提供的当前图像块的周围图像块的示例图。
图8是本发明实施例提供的编码器的示意性结构图。
图9是本发明实施例提供的图像处理系统的示意性结构图。
图10是本发明实施例提供的无人机的示意性结构图。
具体实施方式
本申请提供的技术方案可应用于与视频编码相关的各种系统,如视频编解码系统、视频存储系统、视频传输系统、无人机图传系统等。
本申请提供的技术方案可应用于各种视频编码标准中,如H.263,H.264,H.265/AVC(高级视频编码,advanced video coding),动态图像专家组(moving picture experts group,MPEG)等。
上文已经指出,视频编码过程会产生I帧和P帧(或B帧)。I帧的出现会阻断视频内容的平滑传播,导致人眼观看到的视频内容出现闪烁(这种现象可以称为视频的闪烁效应)。为了便于理解,下面对视频的闪烁效应的产生原因进行详细说明。
如图1所示,在视频存储或视频传输领域,为了实现视频内容的容错或随机访问(如视频播放过程中的快进或快退),在视频编码过程中,通常会周期性地编码I帧。或者,如图2所示,在某些需要更好的用户体验和网络性能的视频存储或视频传输领域(如无人机图传领域),在视频编码过程中,通常会基于逐渐刷新(gradual decoding refresh,GDR)技术周期性地编码图像帧中的I条带(slice)。
无论视频编码过程是周期性编码I帧,还是周期性编码I条带,一般都会产生视频的闪烁效应。以图1为例,P帧采用帧间编码模式进行编码,帧间编码相当于对连续出现的P帧进行时间低通滤波,会使得连续出现的P帧相似性比较高,人眼在观看P帧对应的视频内容的过程中,会感觉视频内容很平滑。但是,由于视频内容中周期性地插入了采用帧内编码模式编码的I帧,这种类型的图像帧会阻断视频内容的平滑传播,造成视频内容的周期性闪烁。对于基于GDR技术编码的视频内容而言,由于I条带的位置会周期性变动,人眼不但会感觉到视频内容的周期性闪烁,还会感觉到视频的闪烁部分在移动,形成滚筒效应。
本发明实施例提供一种编码方法,可以降低视频的闪烁程度。为了便于理解,先结合图3,对可应用本发明实施例的一种编码系统300进行详细介绍。如图3所示,编解系统300可以包括初始化模块310,运动估计模块320, 帧间编码模块330,帧内编码模块340以及熵编码模块350。
初始化模块310可用于对待编码的视频内容进行初始化,如对待编码的图像帧进行块划分,形成待编码的图像块(有时也可称为宏块(macro bloack,MB))。不同视频编解码标准具有各自对应的图像块划分方式,本发明实施例对此不作具体限定。
运动估计模块320可用于对待编码的当前图像块进行运动估计,如计算当前图像块的运动矢量(motion vector,MV)、参考图像块等。运动估计模块320输出的信息可作为帧间编码信息输入至帧间编码模块330中。
帧间编码模块330和帧内编码模块340可分别用于对当前图像块进行帧间编码和帧内编码。编码系统300通常会从当前图像块的帧间编码模式和/或帧内编码模式中选取一种编码模式对当前图像块进行编码。该编码模式例如可以是帧间编码模式或帧内编码模式中的率失真代价最小的编码模式,即最优编码模式。需要说明的是,对于P帧或P条带(也可以是B帧或B条带)而言,编码系统300通常会从帧间编码模式中选取一种帧间编码模式对当前图像块进行编码;相对地,对于I帧或I条带而言,编码系统300通常会从帧内编码模式中一种帧内编码模式对当前图像块进行编码。对于本发明来说,可以先对所有帧都通过帧间编码模块330先进行帧间编码,然后看是否需要帧内编码,需要帧内编码的,在确认是否使用当前图像块进行帧内编码,还是重建图相块进行帧内编码;也可以判断当帧是否需要帧内编码,如果确定需要帧内编码,再确定是否需要进行帧内编码,这里不做限定。
熵编码模块350可以对帧间编码模块330或帧内编码模块340编码后的数据进行熵编码操作,得到待存储或待传输的码流。图4是本发明实施例提供的编码方法的示意性流程图。图4的编码方法例如可以由编码器执行,如视频编码器。如图4所示,该编码方法可以包括步骤410-450。下面对图4中的各个步骤进行详细介绍。
在步骤410中,获取待编码的当前图像块。该当前图像块可以是I帧或I条带中的任一图像块。
在步骤420中,对当前图像块进行帧间编码,得到当前图像块的帧间编码信息。
帧间编码模式有时也可称为帧间模式,或inter模式。在步骤420中,可以采用一种或多种帧间编码模块对当前图像块进行帧间编码。该一种或多 种帧间编码模式可以根据实际需要选取,也可以根据实际使用的编解码标准确定,本发明实施例对此并不限定。以H.264/AVC为例,该至少一种帧间编码模式例如可以包括以下帧间编码模式中的一种或多种:帧间16×16模式,帧间16×8模式,帧间8×16模式,帧间8×8模式(帧间8×8模式还可以进一步细分为帧间4×4模式)等。
进一步地,在一些实施例中,步骤420可以包括:使用最优帧间编码模式对当前图像块进行帧间编码,得到当前图像块的帧间编码信息。步骤420得到的帧间编码信息可以理解为与帧间编码相关的某种信息。该信息例如可以是帧间编码过程产生的信息,也可以帧间编码过程使用的信息,也可以是帧间编码结果中包含的信息,本发明实施例对此并不限定。
帧间编码信息可以包括当前图像块的重建图像块。假设当前图像块以一种帧间编码模式进行了编码,则该重建图像块可以为当前图像块在该帧间编码模式下对应的重建图像块。假设当前图像块以多种帧间编码模式进行了编码,则该重建图像块可以为该多种帧间编码模式中的任意一种帧间编码模式(下称该编码模式为目标帧间编码模式)下的重建图像块。可选地,在一些实施例中,只要估算多种帧间编码模式的率失真代价,并根据多种帧间编码模式的率失真代价从多种帧间编码模式中选取目标帧间编码模式即可,无需针对多种帧间编码模式均进行一次帧间编码。作为一个示例,该目标帧间编码模式可以为上述多种帧间编码模式中的最优帧间编码模式。本申请提及的最优帧间编码模式例如可以指多种帧间编码模式中的率失真代价最小的帧间编码模式。
进一步地,在一些实施例中,帧间编码信息还可以包括以下信息中的至少一种:当前图像块对应的参考图像块,当前图像块对应的运动矢量等。当前图像块对应的参考图像块可以为当前图像块所在的当前图像帧对应的参考图像帧中的图像块,且参考图像帧和/或参考图像块在参考图像帧的位置可以由帧间编码模式确定。假设当前图像块以一种帧间编码模式进行了编码,则当前图像块对应的参考图像块可以为当前图像块在该帧间编码模式下对应的参考图像块。
假设当前图像块以一种帧间编码模式进行了编码,则当前图像块对应的参考图像块可以为当前图像块在该帧间编码模式下对应的参考图像块。假设当前图像块以多种帧间编码模式进行了编码,则当前图像块对应的参考图像 块可以为当前图像块在该多种帧间编码模式中的任意一种帧间编码模式下对应的参考图像块。作为一个示例,当前图像块对应的参考图像块可以为当前图像块在上述多种帧间编码模式中的最优帧间编码模式下对应的参考图像块。
假设某个图像块(如当前图像块或下文描述的周围图像块)以一种帧间编码模式进行了编码,则该图像块对应的运动矢量可以为该图像块在该帧间编码模式下对应的运动矢量。假设该图像块以多种帧间编码模式进行了编码,则该图像块对应的运动矢量可以为该图像块在该多种帧间编码模式中的任意一种帧间编码模式下对应的运动矢量。作为一个示例,该图像块对应的运动矢量可以为该图像块在上述多种帧间编码模式中的最优帧间编码模式下对应的运动矢量。
在步骤430中,根据帧间编码信息确定当前图像块是否会产生闪烁。
当前图像块产生闪烁可指视频播放到当前图像块所包含的视频内容时,视频播放的连续性出现中断,人眼感觉到视频内容出现跳变。
步骤430的实现方式可以有多种,本发明实施例对此并不限定。作为一个示例,可以根据当前图像块的重建图像块与当前图像块的相似性确定当前图像块是否会产生闪烁。作为另一个示例,可以根据当前图像块的重建图像块与当前图像块对应的参考图像块的相似性确定当前图像块是否会产生闪烁。作为又一个示例,可以根据当前图像块对应的运动矢量与当前图像块的周围图像块对应的运动矢量的一致性确定当前图像块是否会产生闪烁。当然,在一些实施例中,还可以将上述示例中的两种或多种相结合,以确定当前图像块是否会产生闪烁。步骤430的具体实现方式详见下文,此处暂不详述。
在步骤440中,如果当前图像块会产生闪烁,对重建图像块进行帧内编码,得到当前图像块的帧内编码结果。
传统编码技术中,无论是帧间编码还是帧内编码,编码对象(或称编码的源图像块)均是当前图像块。本发明实施例中,如果判断出当前图像块会产生闪烁,则可以采用重建图像块代替当前图像块作为编码对象进行帧内编码。重建图像块是基于帧间编码得到的图像块,帧间编码技术具有时间低通滤波的特性,因此,相比于当前图像块,重建图像块与前一帧或前几帧图像中的对应图像块的视频内容可能更加接近,对重建图像块进行帧内编码会一 定程度上避免编码后的视频内容出现较大的跳变,从而一定程度上降低了视频内容在播放过程中的闪烁程度。
当需要采用重建图像块代替当前图像块进行帧内编码时,帧内编码对应的量化参数(quantization parameter,QP)与帧间编码对应的量化参数可以相同,也可以不同。作为一个示例,为了使得当前图像块的帧内编码结果与前一帧或前几帧图像中的对应图像块的视频内容更加接近,可以将帧内编码对应的量化参数设置为小于帧间编码对应的量化参数。可选地,在一些实施例中,在帧内编码的过程中,可以不对编码数据进行量化,从而可以避免量化过程产生的视频内容的失真。
帧内编码对应的量化参数可以预先设定,也可以在线计算。以在线计算帧内编码对应的量化参数为例,在基于帧内编码对应的量化参数,对重建图像块进行帧内编码之前,可以先根据帧间编码对应的量化参数,以及预先设定的帧间编码对应的量化参数与帧内编码对应的量化参数的差值,确定帧内编码模式对应的量化参数。例如,假设帧间编码对应的量化参数为inter_qp,可以采用公式intra_qp=inter_qp–delta_qp确定帧内编码对应的量化参数。intra_qp可以表示帧内编码对应的量化参数,delta_qp可以表示帧间编码对应的量化参数与帧内编码对应的量化参数的差异。delta_qp的取值可以是正整数,例如可以是大于3的正整数。
可选地,在一些实施例中,图4的方法还可包括:如果当前图像块不会产生闪烁,可以对当前图像块进行帧内编码,得到当前图像块的帧内编码结果。
在步骤450中,根据帧内编码结果,生成当前图像块对应的码流信息。
例如,可以基于传统方式对帧内编码结果进行后续处理,以生成码流信息。如图1所示,可以对帧内编码结果进行熵编码等操作。又如,在熵编码之前,还可以对数据进行去块(deblocking)滤波等操作。
本发明实施例更改了传统I帧或I条带中的图像块的编码方式,先对I帧或I条带中的当前图像块进行帧间编码,并基于帧间编码信息判断当前图像块的帧内编码是否会导致闪烁效应。如果当前图像块的帧内编码会导致闪烁效应,则采用帧间编码得到的重建图像块代替当前图像块进行帧内编码。帧间编码技术具有时间低通滤波的特性,因此,相比于当前图像块,重建图像块与前一帧或前几帧图像中的对应图像块的视频内容可能更加近似,对重 建图像块进行帧内编码会一定程度上避免编码后的视频内容出现较大的跳变,从而一定程度上降低了视频内容在播放过程中的闪烁程度。
下面结合具体的实施例,对步骤430的实现方式进行举例说明。
作为一个示例,帧间编码信息还可包括当前图像块对应的参考图像块。在该示例中,如图5所示,步骤430可以包括步骤432-434。
在步骤432中,确定重建图像块和参考图像块的相似度。
在步骤434中,根据重建图像块和参考图像块的相似度,确定当前图像块是否会产生闪烁。
重建图像块和参考图像块之间的相似度的衡量方式可以有多种。例如,可以比较重建图像块和参考图像块的绝对误差和(sum of absolute error,SAE)和/或误差平方和(sum of squares for error,SSE)。
步骤434的具体实现方式与相似度的取值的定义方式有关。假设重建图像块和参考图像块的相似度越高,重建图像块和参考图像块的相似度的取值越大,则步骤434可以包括:如果相似度小于或小于等于第一预设阈值,确定当前图像块会产生闪烁。进一步地,在一些实施例中,步骤434还可以包括:如果相似度大于或大于等于第一预设阈值,确定当前图像块不会产生闪烁。假设重建图像块和参考图像块的相似度越高,重建图像块和参考图像块的相似度的取值越小,则步骤434可以包括:如果相似度大于或大于等于第一预设阈值,确定当前图像块会产生闪烁。进一步地,在一些实施例中,步骤434还可以包括:如果相似度小于或小于等于第一预设阈值,确定当前图像块不会产生闪烁。
由于帧间编码具有时间低通滤波的特性,因此,除非视频内容本身发生突变,重建图像块和参考图像块之间的相似性一般较高(或差异较小)。因此,如果重建图像块和参考图像块相似性较低(或差异较大),可以理解为视频内容本身发生突变,例如,视频描绘的场景突然从一个场景切换到完全不同的另一个场景,这属于视频内容的自然变化,并非由于编码而造成的视频的闪烁效应。在这种情况下,本发明实施例判定当前图像块不会产生闪烁,仍可采用对当前图像块直接进行帧内编码的方式生成当前图像块的帧内编码结果。本发明实施例可以对视频内容的正常突变与视频内容的闪烁进行区分,并采用不同的编码策略,从而可以提高视频的编码质量。
由于当前图像块对应的重建图像块与当前图像块类似,因此,在一些实 施例中,可以直接将当前图像块作为当前图像块对应的重建图像块。或者,在一些实施例中,图5实施例中的步骤434可以替换为根据当前图像块和参考图像块的相似度,确定当前图像块是否会产生闪烁。
作为另一个示例,帧间编码信息还可包括当前图像块对应的运动矢量。如图6所示,步骤430可以包括步骤436-438。
在步骤436中,确定当前图像块对应的运动矢量和当前图像块的周围图像块对应的运动矢量的差异。
当前图像块的周围图像块可以指当前图像块周围的已完成编码的图像块。当前图像块的周围图像块的定义方式可以有多种。例如,当前图像块的周围图像块可以包括当前图像块的相邻图像块。又如,当前图像块的周围图像块可以包括当前图像块的相邻图像块的相邻图像块。此外,当前图像块的周围图像块可以包括一个图像块,也可以包括两个甚至更多的图像块。
下面以当前图像块的周围图像块为当前图像块的相邻图像块为例,给出当前图像块的周围图像块的一种可能的定义方式。如图7所示,假设当前图像块为图像块X,则图像块X的周围图像块可以包括图像块A、图像块B、图像块C以及图像块D。或者,图像块X的周围图像块可以为图像块A和图像块B。
在步骤438中,根据当前图像块对应的运动矢量和周围图像块对应的运动矢量的差异,确定当前图像块是否会产生闪烁。
除非视频内容本身发生突变,当前图像块对应的运动矢量和周围图像块对应的运动矢量的差异一般较小。因此,当前图像块对应的运动矢量和周围图像块对应的运动矢量的差异较大,可以理解为视频内容本身发生突变,例如,视频描绘的场景突然从一个场景切换到完全不同的另一个场景,这属于视频内容的自然变化,并非由于编码而造成的视频的闪烁效应。在这种情况下,本发明实施例判定当前图像块不会产生闪烁,仍采用对当前图像块直接进行帧内编码的方式生成当前图像块的帧内编码结果。本发明实施例可以对视频内容的正常突变与视频内容的闪烁进行区分,并采用不同的编码策略,从而可以提高视频的编码质量。
当前图像块对应的运动矢量和周围图像块对应的运动矢量的差异的定义方式可以有多种。例如,当前图像块对应的运动矢量和周围图像块对应的运动矢量的差异可以定义为当前图像块对应的运动矢量和各周围图像块对 应的运动矢量的差值的最小值。又如,当前图像块对应的运动矢量和周围图像块对应的运动矢量的差异可以定义为当前图像块对应的运动矢量和各周围图像块对应的运动矢量的差值的平均值。
步骤438可以包括如果当前图像块对应的运动矢量与周围图像块对应的运动矢量的差异小于或小于等于第二预设阈值,确定当前图像块会产生闪烁。进一步地,在一些实施例中,步骤438还可以包括如果当前图像块对应的运动矢量与周围图像块对应的运动矢量的差异大于第二预设阈值,确定当前图像块不会产生闪烁。
示例性的,以当前图像块为如图7所示的图像块X,当前图像块的周围图像块为如图7所示的图像块A-D为例进行说明。
假设图像块X对应的运动矢量为mvx。图像块A-D对应的运动矢量分别为mvx,mva,mvb,mvc以及mvd。mvx沿x和y方向的分量分别用mvxx和mvyy表示。mva沿x和y方向的分量分别用mvax和mvay表示。mvb沿x和y方向的分量分别用mvbx和mvby表示。mvc沿x和y方向的分量分别用mvcx和mvcy表示。mvd沿x和y方向的分量分别用mvdx和mvdy表示。当前图像块对应的运动矢量和周围图像块对应的运动矢量的差异mv_diff可以采用如下公式计算:
mv_diff=(mv_diffa+mv_diffb+mv_diffc+mv_diffd)/8,其中:
mv_diffa=ABS(mvxx-mvax)+ABS(mvxy-mvay);
mv_diffb=ABS(mvxx-mvbx)+ABS(mvxy-mvby);
mv_diffc=ABS(mvxx-mvcx)+ABS(mvxy-mvcy);以及
mv_diffd=ABS(mvxx-mvdx)+ABS(mvxy-mvdy)。
接着,可以将mv_diff与第二预设阈值mv_thres比较。如果mv_diff大于mv_thres,则可以认为当前图像块对应的运动矢量和周围图像块对应的运动矢量的差异较大(或一致性较差)。如果mv_diff小于mv_thres,则可以认为当前图像块对应的运动矢量和周围图像块对应的运动矢量的差异较小(或一致性较好)。mv_thres可以根据经验或实验确定,mv_thres例如可以设定为6,或者设定为8。
需要说明的是,图6的实施例可以为单独执行,也可以与图5的实施例相结合。例如,在经过图5的实施例判断出重建图像块和参考图像块的相似度较高(大于第一预设阈值)之后,可以进一步执行图6的实施例,判断当 前图像块对应的运动矢量和当前图像块的周围图像块对应的运动矢量的差异(如该差异是否大于第二预设阈值),并将图6实施例得到的结果作为最终的结果。或者,可以先利用图6所示的实施例判断当前图像块对应的运动矢量和当前图像块的周围图像块对应的运动矢量的差异,如果判断出当前图像块对应的运动矢量和当前图像块的周围图像块对应的运动矢量的差异较大(如该差异大于第二预设阈值),则可以进一步执行图5的实施例,判断重建图像块和参考图像块的相似度(如判断相似度是否大于第一预设阈值),并将图5实施例得到的结果作为最终的结果。
本发明实施例还提供了一种编码器。如图8所示,该编码器800可以包括存储器810和处理器820。存储器810可用于存储程序。处理器820可用于执行存储器810中存储的程序。当该程序被执行时,处理器820可用于获取待编码的当前图像块,所述当前图像块为I帧或I条带中的任一图像块;对所述当前图像块进行帧间编码,得到所述当前图像块的帧间编码信息,所述帧间编码信息包括所述当前图像块的重建图像块;根据所述帧间编码信息,确定所述当前图像块是否会产生闪烁;如果所述当前图像块会产生闪烁,对所述重建图像块进行帧内编码,得到所述当前图像块的帧内编码结果;根据所述帧内编码结果,生成所述当前图像块对应的码流信息。
可选地,在一些实施例中,所述帧间编码信息还包括所述当前图像块对应的参考图像块,所述处理器820用于确定所述重建图像块和所述参考图像块的相似度;根据所述重建图像块和所述参考图像块的相似度,确定所述当前图像块是否会产生闪烁。
可选地,在一些实施例中,所述处理器820用于如果所述相似度小于或小于等于第一预设阈值,确定所述当前图像块会产生闪烁。
可选地,在一些实施例中,所述处理器820用于如果所述相似度大于等于第一预设阈值,确定所述当前图像块不会产生闪烁。
可选地,在一些实施例中,所述参考图像块为所述当前图像块在最优帧间编码模式下对应的参考图像块。
可选地,在一些实施例中,所述参考图像块为所述当前图像块所在的当前图像帧对应的参考图像帧中的图像块,且所述参考图像块在所述参考图像帧中的位置由所述最优帧间编码模式确定。
可选地,在一些实施例中,所述帧间编码信息还包括所述当前图像块对 应的运动矢量,所述处理器820用于确定所述当前图像块对应的运动矢量和所述当前图像块的周围图像块对应的运动矢量的差异;根据所述当前图像块对应的运动矢量和所述周围图像块对应的运动矢量的差异,确定所述当前图像块是否会产生闪烁。
可选地,在一些实施例中,所述处理器820用于如果所述当前图像块对应的运动矢量与所述周围图像块对应的运动矢量的差异小于或小于等于第二预设阈值,确定所述当前图像块会产生闪烁。
可选地,在一些实施例中,所述处理器820用于如果所述当前图像块对应的运动矢量与所述周围图像块对应的运动矢量的差异大于所述第二预设阈值,确定所述当前图像块不会产生闪烁。
可选地,在一些实施例中,所述周围图像块为所述当前图像块的相邻图像块。
可选地,在一些实施例中,所述当前图像块对应的运动矢量为所述当前图像块的最优帧间编码模式对应的运动矢量。
可选地,在一些实施例中,所述周围图像块对应的运动矢量为所述周围图像块的最优帧间编码模式对应的运动矢量。
可选地,在一些实施例中,所述处理器820用于基于帧内编码对应的量化参数,对所述重建图像块进行所述帧内编码,其中所述帧内编码对应的量化参数小于所述帧间编码对应的量化参数。
可选地,在一些实施例中,所述处理器820还用于根据所述帧间编码对应的量化参数,以及预先设定的所述帧间编码对应的量化参数与所述帧内编码对应的量化参数的差值,确定所述帧内编码模式对应的量化参数。
可选地,在一些实施例中,所述处理器820还用于如果所述当前图像块不会产生闪烁,对所述当前图像块进行帧内编码,得到所述当前图像块的帧内编码结果。
可选地,在一些实施例中,所述处理器820用于对所述帧内编码结果进行熵编码,得到所述当前图像块对应的码流信息。
本发明实施例还提供了一种图像处理系统。如图9所示,该图像处理系统900可以包括图像采集系统910、编码器800以及图像传输系统920。编码器800可用于对图像采集系统910采集到的图像进行编码,得到码流信息。图像传输系统920可用于传输码流信息。
本发明实施例还提供一种无人机。如图10所示,该无人机1000可以包括图像处理系统900。进一步地,无人机1000还可以包括壳体,图像处理系统900可以位于壳体内部。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其他任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本发明实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line,DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质(例如,软盘、硬盘、磁带)、光介质(例如数字视频光盘(digital video disc,DVD))、或者半导体介质(例如固态硬盘(solid state disk,SSD))等。
需要说明的是,在不冲突的前提下,本申请描述的各个实施例和/或各个实施例中的技术特征可以任意的相互组合,组合之后得到的技术方案也应落入本申请的保护范围。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间 的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (36)

  1. 一种编码方法,其特征在于,包括:
    获取待编码的当前图像块,所述当前图像块为I帧或I条带中的任一图像块;
    对所述当前图像块进行帧间编码,得到所述当前图像块的帧间编码信息,所述帧间编码信息包括所述当前图像块的重建图像块;
    根据所述帧间编码信息,确定所述当前图像块是否会产生闪烁;
    如果所述当前图像块会产生闪烁,对所述重建图像块进行帧内编码,得到所述当前图像块的帧内编码结果;
    根据所述帧内编码结果,生成所述当前图像块对应的码流信息。
  2. 如权利要求1所述的编码方法,其特征在于,所述帧间编码信息还包括所述当前图像块对应的参考图像块,
    所述根据所述帧间编码信息,确定所述当前图像块是否会产生闪烁,包括:
    确定所述重建图像块和所述参考图像块的相似度;
    根据所述重建图像块和所述参考图像块的相似度,确定所述当前图像块是否会产生闪烁。
  3. 如权利要求2所述的编码方法,其特征在于,所述根据所述重建图像块和所述参考图像块的相似度,确定所述当前图像块是否会产生闪烁,包括:
    如果所述相似度小于或小于等于第一预设阈值,确定所述当前图像块会产生闪烁。
  4. 如权利要求3所述的编码方法,其特征在于,所述根据所述重建图像块和所述参考图像块的相似度,确定所述当前图像块是否会产生闪烁,还包括:
    如果所述相似度大于所述第一预设阈值,确定所述当前图像块不会产生闪烁。
  5. 如权利要求2-4中任一项所述的编码方法,其特征在于,所述参考图像块为所述当前图像块在最优帧间编码模式下对应的参考图像块。
  6. 如权利要求5所述的编码方法,其特征在于,所述参考图像块为所述当前图像块所在的当前图像帧对应的参考图像帧中的图像块,且所述参考 图像块在所述参考图像帧中的位置由所述最优帧间编码模式确定。
  7. 如权利要求1-3,5,6中任一项所述的编码方法,其特征在于,所述帧间编码信息还包括所述当前图像块对应的运动矢量,
    所述根据所述帧间编码信息,确定所述当前图像块是否会产生闪烁,包括:
    确定所述当前图像块对应的运动矢量和所述当前图像块的周围图像块对应的运动矢量的差异;
    根据所述当前图像块对应的运动矢量和所述周围图像块对应的运动矢量的差异,确定所述当前图像块是否会产生闪烁。
  8. 如权利要求7所述的编码方法,其特征在于,所述根据所述当前图像块对应的运动矢量和所述周围图像块对应的运动矢量的差异,确定所述当前图像块是否会产生闪烁,包括:
    如果所述当前图像块对应的运动矢量与所述周围图像块对应的运动矢量的差异小于或小于等于第二预设阈值,确定所述当前图像块会产生闪烁。
  9. 如权利要求8所述的编码方法,其特征在于,所述根据所述当前图像块对应的运动矢量和所述周围图像块对应的运动矢量的差异,确定所述当前图像块是否会产生闪烁,还包括:
    如果所述当前图像块对应的运动矢量与所述周围图像块对应的运动矢量的差异大于所述第二预设阈值,确定所述当前图像块不会产生闪烁。
  10. 如权利要求7-9中任一项所述的编码方法,其特征在于,所述周围图像块为所述当前图像块的相邻图像块。
  11. 如权利要求7-10中任一项所述的编码方法,其特征在于,所述当前图像块对应的运动矢量为所述当前图像块的最优帧间编码模式对应的运动矢量。
  12. 如权利要求7-11中任一项所述的编码方法,其特征在于,所述周围图像块对应的运动矢量为所述周围图像块的最优帧间编码模式对应的运动矢量。
  13. 如权利要求1-12中任一项所述的编码方法,其特征在于,所述对所述重建图像块进行帧内编码,包括:
    基于帧内编码对应的量化参数,对所述重建图像块进行所述帧内编码,其中所述帧内编码对应的量化参数小于所述帧间编码对应的量化参数。
  14. 如权利要求13所述的编码方法,其特征在于,在所述基于帧内编码对应的量化参数,对所述重建图像块进行所述帧内编码之前,所述编码方法还包括:
    根据所述帧间编码对应的量化参数,以及预先设定的所述帧间编码对应的量化参数与所述帧内编码对应的量化参数的差值,确定所述帧内编码模式对应的量化参数。
  15. 如权利要求1-14中任一项所述的编码方法,其特征在于,所述编码方法还包括:
    如果所述当前图像块不会产生闪烁,对所述当前图像块进行帧内编码,得到所述当前图像块的帧内编码结果。
  16. 如权利要求1-15中任一项所述的编码方法,其特征在于,所述根据所述帧内编码结果,生成所述当前图像块对应的码流信息,包括:
    对所述帧内编码结果进行熵编码,得到所述当前图像块对应的码流信息。
  17. 一种编码器,其特征在于,包括:
    存储器,用于存储程序;
    处理器,用于执行所述存储器中存储的程序,当所述程序被执行时,所述处理器用于获取待编码的当前图像块,所述当前图像块为I帧或I条带中的任一图像块;对所述当前图像块进行帧间编码,得到所述当前图像块的帧间编码信息,所述帧间编码信息包括所述当前图像块的重建图像块;根据所述帧间编码信息,确定所述当前图像块是否会产生闪烁;如果所述当前图像块会产生闪烁,对所述重建图像块进行帧内编码,得到所述当前图像块的帧内编码结果;根据所述帧内编码结果,生成所述当前图像块对应的码流信息。
  18. 如权利要求17所述的编码器,其特征在于,所述帧间编码信息还包括所述当前图像块对应的参考图像块,所述处理器用于确定所述重建图像块和所述参考图像块的相似度;根据所述重建图像块和所述参考图像块的相似度,确定所述当前图像块是否会产生闪烁。
  19. 如权利要求18所述的编码器,其特征在于,所述处理器用于如果所述相似度小于或小于等于第一预设阈值,确定所述当前图像块会产生闪烁。
  20. 如权利要求19所述的编码器,其特征在于,所述处理器用于如果 所述相似度大于等于第一预设阈值,确定所述当前图像块不会产生闪烁。
  21. 如权利要求18-20中任一项所述的编码器,其特征在于,所述参考图像块为所述当前图像块在最优帧间编码模式下对应的参考图像块。
  22. 如权利要求21所述的编码器,其特征在于,所述参考图像块为所述当前图像块所在的当前图像帧对应的参考图像帧中的图像块,且所述参考图像块在所述参考图像帧中的位置由所述最优帧间编码模式确定。
  23. 如权利要求17-19,21,22中任一项所述的编码器,其特征在于,所述帧间编码信息还包括所述当前图像块对应的运动矢量,所述处理器用于确定所述当前图像块对应的运动矢量和所述当前图像块的周围图像块对应的运动矢量的差异;根据所述当前图像块对应的运动矢量和所述周围图像块对应的运动矢量的差异,确定所述当前图像块是否会产生闪烁。
  24. 如权利要求23所述的编码器,其特征在于,所述处理器用于如果所述当前图像块对应的运动矢量与所述周围图像块对应的运动矢量的差异小于或小于等于第二预设阈值,确定所述当前图像块会产生闪烁。
  25. 如权利要求24所述的编码器,其特征在于,所述处理器用于如果所述当前图像块对应的运动矢量与所述周围图像块对应的运动矢量的差异大于所述第二预设阈值,确定所述当前图像块不会产生闪烁。
  26. 如权利要求23-25中任一项所述的编码器,其特征在于,所述周围图像块为所述当前图像块的相邻图像块。
  27. 如权利要求23-26中任一项所述的编码器,其特征在于,所述当前图像块对应的运动矢量为所述当前图像块的最优帧间编码模式对应的运动矢量。
  28. 如权利要求23-27中任一项所述的编码器,其特征在于,所述周围图像块对应的运动矢量为所述周围图像块的最优帧间编码模式对应的运动矢量。
  29. 如权利要求17-28中任一项所述的编码器,其特征在于,所述处理器用于基于帧内编码对应的量化参数,对所述重建图像块进行所述帧内编码,其中所述帧内编码对应的量化参数小于所述帧间编码对应的量化参数。
  30. 如权利要求29所述的编码器,其特征在于,所述处理器还用于根据所述帧间编码对应的量化参数,以及预先设定的所述帧间编码对应的量化参数与所述帧内编码对应的量化参数的差值,确定所述帧内编码模式对应的 量化参数。
  31. 如权利要求17-30中任一项所述的编码器,其特征在于,所述处理器还用于如果所述当前图像块不会产生闪烁,对所述当前图像块进行帧内编码,得到所述当前图像块的帧内编码结果。
  32. 如权利要求17-31中任一项所述的编码器,其特征在于,所述处理器用于对所述帧内编码结果进行熵编码,得到所述当前图像块对应的码流信息。
  33. 一种图像处理系统,其特征在于,包括:
    图像采集系统,用于采集图像;
    如权利要求17-32中任一项所述的编码器,用于对所述图像采集系统采集到的图像进行编码,得到码流信息;
    图像传输系统,用于传输所述码流信息。
  34. 一种无人机,其特征在于,包括如权利要求33所述的图像处理系统。
  35. 一种计算机存储介质,其特征在于,包括计算机指令,当所述计算机指令在计算机上运行时,使得所述计算机执行如权利要求1-16中任一项所述的方法。
  36. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1-16中任一项所述的方法。
PCT/CN2017/108651 2017-10-31 2017-10-31 一种编码方法及装置 Ceased WO2019084792A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/108651 WO2019084792A1 (zh) 2017-10-31 2017-10-31 一种编码方法及装置
CN201780008551.4A CN108702510A (zh) 2017-10-31 2017-10-31 一种编码方法及装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/108651 WO2019084792A1 (zh) 2017-10-31 2017-10-31 一种编码方法及装置

Publications (1)

Publication Number Publication Date
WO2019084792A1 true WO2019084792A1 (zh) 2019-05-09

Family

ID=63844095

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/108651 Ceased WO2019084792A1 (zh) 2017-10-31 2017-10-31 一种编码方法及装置

Country Status (2)

Country Link
CN (1) CN108702510A (zh)
WO (1) WO2019084792A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111279694A (zh) * 2018-11-28 2020-06-12 深圳市大疆创新科技有限公司 Gdr码流编码方法、终端设备、机器可读存储介质
CN111247800B (zh) * 2019-01-25 2022-07-19 深圳市大疆创新科技有限公司 确定图像信息量的方法与装置
CN111566584A (zh) * 2019-06-28 2020-08-21 深圳市大疆创新科技有限公司 一种图像处理的方法、装置和无人机
CN110351560A (zh) * 2019-07-17 2019-10-18 深圳市网心科技有限公司 一种编码方法、系统及电子设备和存储介质
CN110996102B (zh) * 2020-03-03 2020-05-22 眸芯科技(上海)有限公司 抑制p/b帧中帧内块呼吸效应的视频编码方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101091393A (zh) * 2004-12-28 2007-12-19 日本电气株式会社 运动图像编码方法以及利用其的装置、计算机程序
US20100315557A1 (en) * 2009-06-11 2010-12-16 Texas Instruments Incorporated Reducing flicker in the display of video streams
CN102833532A (zh) * 2011-06-16 2012-12-19 安讯士有限公司 用于对数字视频数据进行编码的方法和数字视频编码器系统
CN103179394A (zh) * 2013-01-21 2013-06-26 北京航空航天大学 一种基于区域视频质量平稳的i帧码率控制方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4449915B2 (ja) * 2006-02-08 2010-04-14 ソニー株式会社 符号化装置、符号化方法およびプログラム、並びに、記録媒体

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101091393A (zh) * 2004-12-28 2007-12-19 日本电气株式会社 运动图像编码方法以及利用其的装置、计算机程序
US20100315557A1 (en) * 2009-06-11 2010-12-16 Texas Instruments Incorporated Reducing flicker in the display of video streams
CN102833532A (zh) * 2011-06-16 2012-12-19 安讯士有限公司 用于对数字视频数据进行编码的方法和数字视频编码器系统
CN103179394A (zh) * 2013-01-21 2013-06-26 北京航空航天大学 一种基于区域视频质量平稳的i帧码率控制方法

Also Published As

Publication number Publication date
CN108702510A (zh) 2018-10-23

Similar Documents

Publication Publication Date Title
CN116506635B (zh) 用于对图像执行逐步解码刷新处理的方法和系统
CN105409216B (zh) 丢失视频数据的条件隐藏
US11743475B2 (en) Advanced video coding method, system, apparatus, and storage medium
US9414086B2 (en) Partial frame utilization in video codecs
JP5555741B2 (ja) デジタル映像データを符号化するための方法およびデジタル映像符号化システム
US20150312575A1 (en) Advanced video coding method, system, apparatus, and storage medium
WO2019084792A1 (zh) 一种编码方法及装置
WO2010135609A1 (en) Adaptive picture type decision for video coding
US9432694B2 (en) Signal shaping techniques for video data that is susceptible to banding artifacts
CN114222127B (zh) 一种视频编码方法、视频解码方法及装置
CN113259671B (zh) 视频编解码中的环路滤波方法、装置、设备及存储介质
CN118694954A (zh) 基于cclm预测的图像解码方法及其装置
US9565404B2 (en) Encoding techniques for banding reduction
CN107409211B (zh) 一种视频编解码方法及装置
US20150189306A1 (en) Video encoder with block merging and methods for use therewith
CN108781298A (zh) 编码器、图像处理系统、无人机及编码方法
US9542611B1 (en) Logo detection for macroblock-based video processing
CN117616751A (zh) 动态图像组的视频编解码
JP7579996B2 (ja) Dpbパラメータをシグナリングする画像符号化/復号化方法及び装置、並びにビットストリームを保存したコンピュータ可読記録媒体
CN119420916A (zh) 视频帧处理方法、装置、电子设备和存储介质
WO2016193949A1 (en) Advanced video coding method, system, apparatus and storage medium
CN114208182B (zh) 用于基于去块滤波对图像进行编码的方法及其设备
US20160360219A1 (en) Preventing i-frame popping in video encoding and decoding
WO2016154888A1 (zh) 一种图像编码的方法及编码装置
JP7492027B2 (ja) Ptl関連情報をシグナリングする画像符号化/復号方法および装置、ならびにビットストリームを記憶したコンピュータ読み取り可能記録媒体

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17931071

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17931071

Country of ref document: EP

Kind code of ref document: A1