WO2016165603A1 - 一种视频数据的编解码方法及装置 - Google Patents

一种视频数据的编解码方法及装置 Download PDF

Info

Publication number
WO2016165603A1
WO2016165603A1 PCT/CN2016/079034 CN2016079034W WO2016165603A1 WO 2016165603 A1 WO2016165603 A1 WO 2016165603A1 CN 2016079034 W CN2016079034 W CN 2016079034W WO 2016165603 A1 WO2016165603 A1 WO 2016165603A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
mode
frame
target
decoding
Prior art date
Application number
PCT/CN2016/079034
Other languages
English (en)
French (fr)
Inventor
宋锦
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2016165603A1 publication Critical patent/WO2016165603A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • H04N19/463Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a method and an apparatus for encoding and decoding video data.
  • the video data is converted into a code stream through processes such as prediction, transformation, quantization, and entropy coding, which removes redundant information between data and improves the transmission efficiency of the video data.
  • the frame rate up-conversion technique is a video post-processing technique that converts a low frame rate video into a high frame rate video by inserting an intermediate frame into the original video frame to provide better visual quality.
  • the multi-reference frame technique is to perform motion compensation on a macroblock or sub-block in the multi-reference frame mode, and the encoding selects one frame from the past several encoded frames as a reference frame, and seeks the current coded macroblock or sub- The best matching block of the block for better prediction. In the case where many objects are obscured, etc., the introduction of multiple reference frames can improve coding efficiency.
  • the encoding end does not select the processing mode of the video frame, and does not need to transmit the video data such as the processing method of the video frame to the decoding end.
  • the decoding end selectively performs a frame rate up-conversion operation based on one or several adaptive rules, and the adaptive rules may include the intensity of motion, the mode selection of the encoding, the texture structure of the video content, and the like.
  • FIG. 1 is an operation manner in which a decoding end adaptively performs video frame processing in the prior art.
  • the motion vector information of the previously decoded frame may be counted, and it is determined whether the average length of the motion vector of the decoded frame exceeds a threshold. If the average length of the motion vector exceeds the threshold, the previous frame is repeated, inserted before the current frame, and then the next frame can be processed. If the average length of the motion vector does not exceed the threshold, the frame rate up conversion algorithm is used to obtain the interpolated frame, and the interpolated frame is inserted before the current frame, and then the next frame can be processed.
  • the decoding end adopts an adaptive method (the processing method of the video data cannot be known from the encoding end), and thus the error processing of the processing method of the non-video data cannot be guaranteed, and the interpolation cannot be guaranteed.
  • Applicability of algorithms such as frame rate up-conversion algorithms.
  • the prior art adopts a simple interpolation method to distinguish between motion conditions (including severe and gentle motion conditions), and there is no specific requirement for the content of the reference frame of the reference frame list, so that in the case of a high frame rate video source The performance of the reference frame algorithm cannot be fully utilized, and the video quality cannot be guaranteed.
  • the embodiment of the invention provides a method and a device for encoding and decoding video data, which can improve the diversity and flexibility of coding mode selection, ensure the processing quality of video data, and enhance the user experience of video data coding.
  • a first aspect of the embodiments of the present invention provides a method for encoding video data, which may include:
  • the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information
  • the time complexity information includes: length information of the motion vector, or index information of the reference frame;
  • the spatial complexity information includes: at least change range information of the image chrominance, image texture information, and image coding mode information.
  • One type
  • the to-be-processed frame is pre-processed according to the first coding mode and the second coding mode, where the first The coding mode and the second coding mode are different coding modes;
  • the to-be-processed frame is encoded.
  • the specified information is frame rate information
  • the specified information is consistent with a preset condition for processing the to-be-processed frame by starting multiple coding modes, including:
  • the frame rate indicated by the frame rate information is greater than a preset frame rate threshold.
  • the specified information is time complexity information
  • the specified information is consistent with a preset condition for processing the to-be-processed frame by starting multiple coding modes, including:
  • the time complexity indicated by the time complexity information is greater than a preset time complexity threshold.
  • the specified information is spatial complexity information
  • the specified information is consistent with a preset condition for processing the to-be-processed frame by starting multiple coding modes, including:
  • the spatial complexity indicated by the spatial complexity information is greater than a preset spatial complexity threshold.
  • the performing the to-be-processed frame according to the first coding manner and the second coding manner, respectively Pre-processing including:
  • the first coding mode Performing, by the first coding mode, the first video quality processing on the to-be-processed frame to obtain video data that meets a specified video quality indicator, where the pre-processing result of the first coding mode includes the first video quality processing The amount of the first encoded data amount consumed;
  • the pre-processing result according to the first coding mode and the pre-processing result of the second coding mode are Selecting a target coding mode from the first coding mode and the second coding mode includes:
  • the performing the to-be-processed frame according to the first coding manner and the second coding manner, respectively Pre-processing including:
  • the first coding mode performs, by the first coding mode, the first video quality processing on the to-be-processed frame to obtain video data in a case of consuming a specified coded data amount, where the pre-processing result of the first coding mode includes the a first quality indicator of the video data obtained by a video quality processing;
  • the pre-processing result includes a second quality indicator of the video data obtained by the second video quality processing.
  • the pre-processing result according to the first coding mode and the pre-processing result of the second coding mode are Selecting a target coding mode from the first coding mode and the second coding mode includes:
  • the first quality indicator is higher than the second quality indicator, and if the determination result is yes, selecting the first coding mode as the target coding mode, and if the determination result is no, the second coding The mode is selected as the target encoding mode.
  • the pre-processing result according to the first coding mode and the foregoing is selected from the first coding mode and the second coding mode, and includes:
  • the first coding mode is selected as the target coding mode, and if the determination result is no, the second coding mode is selected as the target coding mode.
  • the pre-processing result according to the first coding mode and the pre-processing result of the second coding mode are Selecting a target coding mode from the first coding mode and the second coding mode includes:
  • the method further includes:
  • Indexing the target coding mode encoding the index information of the target coding mode to obtain identification information of the target coding mode, and transmitting the identification information to the decoding end in the form of a code stream
  • Marking the target coding mode by using a physical quantity that characterizes time domain information to obtain identification information of the target coding mode, and transmitting the identification information of the target coding mode to the decoding end as control information;
  • the physical quantity that represents the time domain information includes: image display information or a time stamp.
  • the method further includes:
  • the processed frame to be processed is added to the reference frame list to generate a reference frame list corresponding to the next to-be-processed frame.
  • a second aspect of the embodiments of the present invention provides a method for decoding video data, which may include:
  • the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information
  • the time complexity information includes: length information of the motion vector, or index information of the reference frame;
  • the spatial complexity information includes: at least change range information of the image chrominance, image texture information, and image coding mode information.
  • One type
  • the specified information is frame rate information
  • the specified information meets a preset condition for processing the to-be-processed frame in a startup target decoding manner, including:
  • the frame rate indicated by the frame rate information is greater than a preset frame rate threshold.
  • the specified information is time complexity information
  • the specified information meets a preset condition for processing the to-be-processed frame in a startup target decoding manner, including:
  • the time complexity indicated by the time complexity information is greater than a preset time complexity threshold.
  • the specified information is spatial complexity information
  • the specified information meets a preset condition for processing the to-be-processed frame in a startup target decoding manner, including:
  • the spatial complexity indicated by the spatial complexity information is greater than a preset spatial complexity threshold.
  • the determining, according to the identifier information carried in the code stream information of the to-be-processed frame, The target decoding mode of the processing frame including:
  • Decoding the code stream information of the to-be-processed frame acquiring index information for marking the target coding mode carried in the code stream information, and determining the target coding mode according to the index information;
  • the target decoding mode of the to-be-processed frame is determined according to the correspondence between the preset encoding mode and the decoding mode, in combination with the target encoding mode.
  • the determining, according to the identifier information carried in the code stream information of the to-be-processed frame, The target decoding mode of the processing frame including:
  • the identifier information includes image display information or a timestamp, determining that the target encoding mode is the video encoding standard technology, and determining the video encoding standard technology according to a correspondence between a preset encoding mode and a decoding mode. Corresponding target decoding mode;
  • the target encoding mode is the frame rate up conversion technique or the resolution scaling technology, and according to a preset correspondence between a coding mode and a decoding mode Determining a target decoding mode corresponding to the frame rate up-conversion technique or a target decoding mode corresponding to the resolution scaling technique.
  • the determining, according to the target decoding manner, determining to decode the to-be-processed frame Additional information including:
  • the target decoding mode is the decoding mode corresponding to the video coding standard technology
  • the auxiliary information that is to be processed is decoded, and the auxiliary information is residual data information and control header information corresponding to the to-be-processed frame;
  • the target decoding mode is the decoding mode corresponding to the frame rate up-conversion technology, acquiring auxiliary information for decoding the to-be-processed frame, where the auxiliary information is empty;
  • the target decoding mode is a decoding mode corresponding to the resolution scaling technology
  • acquiring auxiliary information for decoding the to-be-processed frame where the auxiliary information is residual data information corresponding to the scaling process of the to-be-processed frame and Control header information.
  • the method further includes:
  • the processed frame to be processed is added to the reference frame list to generate a reference frame list corresponding to the next to-be-processed frame.
  • a third aspect of the embodiments of the present invention provides an apparatus for encoding video data, which may include:
  • An acquiring module configured to acquire specified information of a to-be-processed frame in the video data, where the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information;
  • the time complexity information includes: length information of the motion vector, or index information of the reference frame;
  • the spatial complexity information includes: at least change range information of the image chrominance, image texture information, and image coding mode information.
  • One type
  • a pre-processing module configured to: when the specified information acquired by the acquiring module meets a preset condition for processing the to-be-processed frame by starting multiple coding modes, respectively, according to the first coding mode and the second coding mode, respectively Processing the frame for pre-processing, wherein the first coding mode and the second coding mode are different coding modes;
  • a processing module configured to: according to the pre-processing result of the first coding mode and the pre-processing result of the second coding mode processed by the pre-processing module, from the first coding mode and the second coding mode Selecting a target encoding mode, and encoding the to-be-processed frame according to the target encoding manner.
  • the specified information is frame rate information
  • the preprocessing module is specifically configured to:
  • the specified information is time complexity information
  • the preprocessing module is specifically configured to:
  • the specified information is spatial complexity information
  • the preprocessing module is specifically configured to:
  • the pre-processing module is specifically configured to:
  • the first coding mode Performing, by the first coding mode, the first video quality processing on the to-be-processed frame to obtain video data that meets a specified video quality indicator, where the pre-processing result of the first coding mode includes the first video quality processing The amount of the first encoded data amount consumed;
  • the processing module is specifically configured to:
  • the pre-processing module is specifically configured to:
  • the first coding mode performs, by the first coding mode, the first video quality processing on the to-be-processed frame to obtain video data in a case of consuming a specified coded data amount, where the pre-processing result of the first coding mode includes the a first quality indicator of the video data obtained by a video quality processing;
  • the processing module is specifically configured to:
  • the processing module is specifically configured to:
  • the first coding mode is selected as the target coding mode, and if the determination result is no, the second coding mode is selected as the target coding mode.
  • the processing module is specifically configured to:
  • the coding device is further included Including a tag module, the tag module is used to:
  • Marking the target coding mode by using a physical quantity that characterizes time domain information to obtain identification information of the target coding mode, and transmitting the identification information of the target coding mode to the decoding end as control information;
  • the physical quantity that represents the time domain information includes: image display information or a time stamp.
  • the coding apparatus further includes:
  • a reference frame determining module configured to determine whether the target coding mode selected by the processing module is a video coding standard technology, and if the target coding mode is the video coding standard technology, the processed to-be-processed frame to be processed
  • the reference frame list is added to generate a reference frame list corresponding to the next to-be-processed frame.
  • a fourth aspect of the embodiments of the present invention provides a decoding apparatus for video data, which may include:
  • An acquiring module configured to acquire specified information of a to-be-processed frame in the video data, where the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information;
  • the time complexity information includes: length information of the motion vector, or index information of the reference frame;
  • the spatial complexity information includes: at least change range information of the image chrominance, image texture information, and image coding mode information.
  • One type
  • a determining module configured to determine, according to the identifier information carried in the code stream information of the to-be-processed frame, when the specified information acquired by the acquiring module meets a preset condition of the to-be-processed frame in the startup target decoding mode a target decoding mode of the to-be-processed frame;
  • a processing module configured to determine, according to the target decoding manner determined by the determining module, auxiliary information for decoding the to-be-processed frame, and decode the to-be-processed frame according to the target decoding manner and the auxiliary information.
  • the specified information is frame rate information
  • the determining module is specifically configured to:
  • the specified information is time complexity information
  • the determining module is specifically configured to:
  • the specified information is spatial complexity information
  • the determining module is specifically configured to:
  • the determining module is specifically configured to:
  • Decoding the code stream information of the to-be-processed frame acquiring index information for marking the target coding mode carried in the code stream information, and determining the target coding mode according to the index information;
  • the target decoding mode of the to-be-processed frame is determined according to the correspondence between the preset encoding mode and the decoding mode, in combination with the target encoding mode.
  • the determining module is specifically configured to:
  • the identifier information includes image display information or a timestamp, determining that the target encoding mode is the video encoding standard technology, and determining the video encoding standard technology according to a correspondence between a preset encoding mode and a decoding mode. Corresponding target decoding mode;
  • Determining the target coding side if there is no image display information or a time stamp in the identification information The frame rate up-conversion technique or the resolution-scaling technique, and determining a target decoding mode corresponding to the frame rate up-conversion technique according to a correspondence between a preset encoding mode and a decoding mode, or the resolution
  • the target decoding method corresponding to the scaling technique
  • the processing module is specifically configured to:
  • auxiliary information for decoding the to-be-processed frame when the target decoding mode determined by the determining module is a decoding mode corresponding to the video coding standard technology, where the auxiliary information is corresponding to the to-be-processed frame Residual data information and control header information;
  • the target decoding mode determined by the determining module is a decoding mode corresponding to the frame rate up-conversion technology, acquiring auxiliary information for decoding the to-be-processed frame, where the auxiliary information is empty;
  • the target decoding mode determined by the determining module is a decoding mode corresponding to the resolution scaling technology
  • acquiring auxiliary information for decoding the to-be-processed frame where the auxiliary information is subjected to scaling processing for the to-be-processed frame Residual data information and control header information.
  • the decoding apparatus further includes:
  • a reference frame determining module configured to determine whether the target decoding mode determined by the determining module is a decoding mode corresponding to the video coding standard technology
  • the processed frame to be processed is added to the reference frame list to generate a reference frame list corresponding to the next to-be-processed frame.
  • a fifth aspect of the embodiments of the present invention provides a codec system for video data, comprising: the coding device provided in the foregoing third aspect, and the decoding device provided in the foregoing fourth aspect.
  • the embodiment of the present invention may determine, according to the specified information of the to-be-processed frame of the video data, whether to process the frame to be processed by using multiple coding modes, and further pre-process the frame to be processed according to the first coding mode and the second coding mode.
  • the processing result determines which encoding mode is selected to encode the frame to be processed for the target encoding mode.
  • the embodiment of the invention can select a specific coding mode to encode the processing frame from a plurality of coding modes, improve the video processing quality of the to-be-processed frame of the video data, and enhance the user experience of the video data processing.
  • FIG. 1 is a schematic diagram of adaptive decoding of video frames in a decoding end in the prior art
  • FIG. 2 is a schematic flowchart diagram of a first embodiment of a method for encoding video data according to an embodiment of the present invention
  • FIG. 3 is a schematic flowchart diagram of a second embodiment of a method for encoding video data according to an embodiment of the present invention
  • FIG. 4 is a schematic flowchart diagram of a third embodiment of a method for encoding video data according to an embodiment of the present invention.
  • FIG. 5 is a schematic flowchart of an embodiment of a method for decoding video data according to an embodiment of the present disclosure
  • FIG. 6 is a schematic structural diagram of a first embodiment of an encoding apparatus for video data according to an embodiment of the present disclosure
  • FIG. 7 is a schematic structural diagram of a second embodiment of an encoding apparatus for video data according to an embodiment of the present disclosure.
  • FIG. 8 is a schematic structural diagram of a third embodiment of an encoding apparatus for video data according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic structural diagram of an embodiment of a decoding apparatus for video data according to an embodiment of the present disclosure.
  • FIG. 10 is another schematic structural diagram of an embodiment of a decoding apparatus for video data according to an embodiment of the present disclosure.
  • FIG. 11 is a schematic structural diagram of an embodiment of a codec system for video data according to an embodiment of the present invention.
  • the encoding method and the decoding method of the video data described in the embodiment of the present invention may determine the video data according to the frame rate of the frame to be processed of the video data, or the time complexity information, or the spatial complexity information such as the image complexity in the video data.
  • the encoding method used for encoding can improve the encoding quality and decoding quality of video data.
  • the video data encoding method and decoding method and apparatus provided by the embodiments of the present invention are specifically described in the following with reference to FIG. 2 and FIG.
  • FIG. 2 is a schematic flowchart diagram of a first embodiment of a method for encoding video data according to an embodiment of the present invention.
  • the encoding method of the video data described in the embodiment of the present invention includes the following steps:
  • S101 Obtain specified information of a to-be-processed frame in the video data, where the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information.
  • the processing frame may be parsed first, and the specified information of the to-be-processed frame is obtained, and then the specified information of the to-be-processed frame may be determined according to the specified information of the to-be-processed frame.
  • the encoding method encodes the processed frame.
  • the encoding end may preset a condition that the specified information of the to-be-processed frame needs to be satisfied when a plurality of encoding modes are used to perform encoding processing on the processing frame, and further, after obtaining the specified information of the to-be-processed frame, The specified information of the processing frame determines whether the specified information is a preset condition. If the specified information of the to-be-processed frame obtained above meets the preset condition, multiple encoding modes may be initiated to perform pre-processing on the processed frame. If the specified information of the to-be-processed frame obtained by the above does not satisfy the preset condition, the video data to be processed may be encoded according to the general coding mode.
  • the foregoing general coding mode may be a coding mode specified by an existing video coding and decoding standard, for example, a hybrid architecture coding mode specified in the H.264 standard, and is not limited herein.
  • the specified information of the to-be-processed frame described in the embodiment of the present invention may include: frame rate information, time complexity information, spatial complexity information, and the like.
  • the time complexity information of the to-be-processed frame may include: length information of a motion vector of a to-be-processed frame, or index information of a reference frame of a to-be-processed frame. That is, in the embodiment of the present invention, the encoding end may determine the motion intensity of the motion picture included in the to-be-processed frame according to the length information of the motion vector of the frame to be processed, or the index information of the reference frame, and the physical quantity of the time complexity. .
  • the above physical quantities reflecting the complexity of time are only examples, not Exhaustive, including but not limited to the above information.
  • the spatial complexity information of the to-be-processed frame may include: image range change information, image texture information, image coding mode information, and the like. That is, in the embodiment of the present invention, the encoding end may determine the image content included in the to-be-processed frame according to the physical quantity of the spatial complexity, such as the variation range of the image chromaticity contained in the frame to be processed, the image texture or the image encoding mode.
  • the encoding end may determine the specific encoding mode according to the frame rate of the video data. If the specified information of the to-be-processed frame is the frame rate information, the encoding end may determine that the specified information of the to-be-processed frame is consistent with starting when the frame rate indicated by the frame rate information of the to-be-processed frame is greater than a preset frame rate threshold. The encoding method processes the preset condition of the frame to be processed.
  • the encoding end may determine whether to directly adopt the encoding mode specified by the video coding and decoding standard according to the frame rate of the frame to be processed, or whether multiple encoding methods are needed for simultaneous processing to obtain multiple encoding modes.
  • the target is encoded in the middle of the screening. For example, when the coding end determines that the frame rate of the video data to be processed is greater than 60 frames/second, the video data to be processed may be processed by using multiple coding modes, and then the coding mode in which the processing result is more satisfactory is selected as the video data to be processed.
  • the target coding mode otherwise the general coding mode is directly used, that is, the coding mode specified in the video coding and decoding standard, and will not be described here.
  • the code end may indicate that the time complexity indicated by the time complexity information of the to-be-processed frame is greater than a preset time complexity threshold.
  • the preset condition for processing the to-be-processed frame by starting multiple coding modes is met. For example, when the length of the average motion vector of the video data to be processed is greater than 5, it may be determined that the time complexity indicated by the time complexity information of the to-be-processed frame is greater than a preset time complexity threshold.
  • a plurality of encoding modes may be activated to simultaneously process the processed video data to select a target encoding mode. If the time complexity of the video data to be processed does not meet the preset condition, the video data to be processed is directly encoded by using a general encoding mode, and details are not described herein again.
  • the encoding end may determine that the specified information of the to-be-processed frame meets the preset condition for processing the to-be-processed frame by starting multiple coding modes when the spatial complexity indicated by the spatial complexity information of the to-be-processed frame is greater than the preset spatial complexity threshold. . For example, when the number of textures of a certain texture strength in the to-be-processed frame exceeds 40%, the encoding end may determine that the image texture of the to-be-processed frame is greater than a preset spatial complexity threshold, and thus may initiate multiple encoding modes to encode the processed data. Otherwise, it is processed using the general encoding method.
  • the general coding mode described in the embodiment of the present invention may specifically be the coding mode specified in the current video coding and decoding standard, and generally refers to a hybrid architecture coding method including steps of prediction, transformation, quantization, and entropy coding, or Other coding methods such as prediction and transformation in the time domain and frequency domain are not limited herein.
  • the first encoding mode and the second encoding mode may be activated, and then The first coding mode and the second coding mode process the frame to be processed.
  • the coding end may perform pre-processing on the processing frame according to the foregoing first coding mode and the second coding mode, to determine, according to the processing result of the foregoing pre-processing, which specific coding mode is to be used for coding.
  • the purpose of the preprocessing of the processing frame to be processed by the encoding end is to determine which encoding mode is better for the encoding mode, rather than directly adopting the first encoding mode and the second encoding mode.
  • the frame is encoded. Therefore, when the encoding side performs preprocessing on the processing frame, the video frame to be processed may be simplified (for example, compression processing, etc.) to obtain frame data of a smaller data size, and then the compressed frame data is performed. Processing, and thus the target coding mode can be determined by the comparison of the processing results.
  • the foregoing compression processing is performed in one of the pre-processing manners, and the specific processing manner may be limited according to the usage application scenario, and details are not described herein again.
  • the first coding mode described in the embodiment of the present invention may specifically be a video coding standard technology specified by a video coding and decoding standard, or a frame rate up conversion technology, or a resolution scaling technology.
  • the video coding standard technology specified by the above video coding and decoding standard may include coding technologies specified in video coding standards such as H.263, H.264, and H.265, and is not limited herein.
  • the above coding modes are merely examples, not exhaustive, and include but are not limited to the above coding modes.
  • the second coding mode described in the embodiment of the present invention is a coding technology different from the first coding mode, and may specifically include a video coding standard technology different from the video coding and decoding standard of the first coding mode, or different from The frame rate up-conversion technique of the first coding mode, or the resolution scaling technique different from the first coding mode, and the like.
  • the above coding modes are merely examples, not exhaustive, and include but are not limited to the above coding modes. which is, The first coding mode may be any one of the foregoing multiple coding technologies, and the second coding mode may also be any one of the foregoing multiple coding technologies, but the coding technology selected by the second coding mode and the first coding mode are used.
  • the coding technique is different.
  • the second coding mode can only be any one of the video coding standard technologies specified by the video coding and decoding standard, or any resolution scaling technology, or Is the frame rate up conversion technique B. That is, the first coding mode is the frame rate up-conversion technique A, and the second coding mode is not the frame rate up-conversion technique A.
  • the foregoing selection of the first coding mode and the second coding mode may be determined according to a time application scenario requirement, and is not limited herein.
  • the multi-coding may be performed according to the pre-processing result of the foregoing multiple encoding modes.
  • the encoding end may preprocess the frame to be processed by using the first encoding mode and the second encoding mode, and further, the video quality or the first encoding mode of the video data obtained by preprocessing the first encoding mode to be processed may be processed.
  • the amount of encoded data consumed during the preprocessing of the frame, the video quality of the video data obtained by preprocessing the frame to be processed in the second encoding mode, or the encoding used in the preprocessing of the frame to be processed in the second encoding mode The information such as the amount of data is compared, and the coding mode that satisfies the requirements of the specific application scenario is selected from the first coding mode and the second coding mode according to the comparison result as the target coding mode for performing specific coding processing on the frame to be processed.
  • the target encoding mode may be used to encode the processed frame.
  • the target encoding mode may be first notified to the decoding end, and the decoding end may determine the encoding mode used by the encoding end to encode the processing frame according to the information transmitted by the encoding end, and then use the phase. The corresponding decoding method is decoded, and there is no need to judge by itself, which reduces the false positive rate of the coding mode.
  • the encoding end may notify the decoding end of the target encoding mode by using multiple sending manners, wherein different sending modes correspond to different identification information, and the encoding end may send the identification information of the target encoding mode to the sending manner by using different sending manners.
  • Decoding end Specifically, the encoding end can select the sending manner of sending the index information, and the encoding end can adopt the index.
  • the method marks the target coding mode, encodes the index information of the target coding mode to obtain the identification information of the target coding mode, and further transmits the identification information of the target coding mode to the decoding end in the form of a code stream.
  • the decoding end may determine the target coding mode according to the index information carried in the code stream information by parsing the code stream information, and further perform decoding processing on the frame to be processed according to the decoding mode corresponding to the target coding mode.
  • the index information may be encoded in an equal probability manner. For example, if there are two encoding modes, the first encoding mode is encoded as 0, and the second encoding mode is encoded as 1.
  • the encoding end may also encode the index information according to an unequal probability according to actual statistical characteristics.
  • the encoding end may also encode the index information by using a combination of equal probability and unequal probability. For example, if there are three encoding modes, the first encoding mode may be encoded as 0, the second encoding mode may be encoded as 10, and the third encoding mode may be encoded as 11.
  • the encoding end can determine the encoding mode of the index information according to the application requirements, and is not limited herein.
  • the encoding end may also mark the target encoding mode by using the physical quantity that characterizes the time domain information to obtain the identification information of the target encoding mode, and transmit the identification information of the target encoding mode to the decoding end as the control information.
  • the decoding end can determine the target coding mode according to the control information transmitted by the coding end, and further can perform decoding processing on the processing frame according to the decoding mode corresponding to the target coding mode.
  • the manner of the above-mentioned target coding mode is only an example, and is not exhaustive, including but not limited to the above implementation manner, and is not limited herein.
  • the physical quantity for characterizing the time domain information may include: image display information or a time stamp, etc., and is not limited herein.
  • image display information is a physical quantity that characterizes the display order of each frame of image at the decoding end, and is transmitted as a kind of control information to the decoding side.
  • the encoding end and the decoding end may specify that when the "image display information" corresponding to a certain image display position exists, the frame to be processed is processed by using the first encoding mode; otherwise, the frame to be processed is processed by using the second encoding mode.
  • the "time stamp" is control information added at the transmission system layer when transmitting the video information, and at which point in time the decoding end plays the corresponding video information.
  • the encoding end and the decoding end may specify that when the time stamp information interval symbol of a certain video clip is specified, the first encoding manner is used for encoding, otherwise, when the sparsity of the time stamp information interval exceeds a preset threshold, the second encoding is used.
  • the encoding end may use information such as image display information or time stamp as the identification information of the target encoding mode, and transmit the target encoding mode to the decoding end through information such as image display information or time stamp.
  • the encoding end may determine, according to the frame rate information of the to-be-processed frame of the video data or the time complexity information or the spatial complexity information waiting for the specified information of the processing frame, whether to adopt a plurality of coding modes to be processed in the video to be processed.
  • the frame is processed, or the frame to be processed is processed in accordance with the general encoding method specified by the video codec standard. If the specified information such as the frame rate or the time complexity of the video data to be processed is consistent with a preset condition for starting a plurality of encoding modes, the first encoding mode and the second encoding mode may be used to respectively perform the to-be-processed frame in the video data.
  • the pre-processing may further determine, according to the pre-processing result of the first coding mode and the second coding mode, which one of the coding modes is selected to encode the to-be-processed frame. After the coding end selects the target coding mode, the target coding mode may be notified to the decoding end according to the specified information transmission mode, so that the decoding end performs decoding processing on the video data to be processed according to the decoding mode corresponding to the target coding mode.
  • the embodiment of the invention can select a specific coding mode to encode the processing frame from a plurality of coding modes, improve the video processing quality of the to-be-processed frame of the video data, and enhance the user experience of the video data processing.
  • FIG. 3 is a schematic flowchart diagram of a second embodiment of a method for encoding video data according to an embodiment of the present invention.
  • the encoding method of the video data described in the embodiment of the present invention includes the following steps:
  • S201 Obtain specified information of a to-be-processed frame in the video data, where the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information.
  • step S101 the specific implementation process of the encoding information of the to-be-processed frame in the embodiment of the present invention may be referred to step S101 in the foregoing first embodiment, and details are not described herein again.
  • S202 Perform the first video quality processing on the to-be-processed frame to obtain the specified video quality according to the first coding mode, if the specified information is consistent with a preset condition for processing the to-be-processed frame by using multiple coding modes.
  • Step S102 in the embodiment is not described herein again.
  • the method for starting an algorithm described in the embodiment of the present invention may be performed separately for each frame. Determine whether to start, that is, it can be the judgment method at the frame level. Further, the encoding end determines whether to start processing the processing of the video data by using multiple encoding methods, and may also be the image group level determining manner. For example, when encoding an image group, the multi-frame data included in one image group can be collectively determined once, so that the multi-frame data in the image group is processed by using two encoding methods, and then the target encoding mode is selected.
  • the target encoding method may also be a sequence level judgment method, that is, one sequence of frame data (consisting of a plurality of image groups) is judged once to determine whether to start multiple encoding modes for processing.
  • a strip level judgment method or a slice level judgment method wherein the above strips and slices are two ways of constructing a frame. That is, the encoding end may split the frame data according to the manner of strips or slices, split the data of one frame into multiple stripe data or multiple pieces of data, and then determine and determine according to the strip level. Whether the stripe data initiates multiple encoding methods for processing, or whether the chip-level data starts multiple encoding methods for processing, etc., is not limited herein.
  • the first coding mode and the second coding mode described in the embodiments of the present invention may be different two coding modes, or may be different three or four types.
  • the coding method is not limited here. The present invention will be specifically described by taking the case where the first coding mode and the second coding mode are two different coding modes.
  • the encoding end may perform first video quality processing on the processing frame according to the first encoding manner to obtain video data that meets the specified video quality indicator. Further, the encoding end may further determine a size of the encoded data (ie, a size of the first encoded data amount) consumed by the first video quality processing of the frame to be processed according to the first encoding manner, where the first video quality processing is used.
  • the first encoded data amount size is a pre-processing result of pre-processing the frame to be processed in the first encoding mode.
  • the encoding end may perform second video quality processing on the processing target frame according to the second encoding manner to obtain video data that meets the specified video quality indicator.
  • the pre-processing result of performing pre-processing on the to-be-processed frame in the second coding mode includes a second amount of coded data consumed by the second video quality process.
  • the foregoing specified video quality indicator may include a subjective quality indicator or an objective quality indicator.
  • the above objective quality indicator may include: a peak signal to noise ratio or a structural similarity.
  • the quality indicators of the above objective quality of the video are only examples, not exhaustive, including but not limited to the above quality indicators.
  • the above subjective quality indicators may include: subjective assessment scores, psychological model scores, minimum visible error scores, time and space domain human eye masking effects, or physiological characteristics scores.
  • the quality indicators of subjective quality of the above videos are merely examples, not exhaustive, including but not limited to the above quality indicators.
  • step S204 Determine whether the size of the first encoded data is smaller than the size of the second encoded data. If the determination result is yes, step S205 is performed, otherwise step S206 is performed.
  • the pre-processing result of the first encoding manner may include the first encoded data volume size, and The second coded data amount included in the preprocessing result of the two coding mode is compared, and the target coding mode is selected from the first coding mode and the second coding mode according to the comparison result.
  • the encoding end may determine whether the size of the first encoded data quantity is smaller than the size of the second encoded data quantity. If the determination result is yes, if the same processing target is determined, the first encoding mode is processed by the processing target frame.
  • the amount of coded data is small, that is, the processing performance of the first coding mode is better than the second coding mode, and the first coding mode can be selected as the target coding mode. If the size of the first encoded data is greater than the size of the second encoded data, the processing performance of the second encoding mode may be better than the first encoding mode, and the second encoding mode may be determined as the target encoding mode.
  • the specific implementation process of the encoding of the to-be-processed frame by using the target encoding mode may be referred to the implementation manner described in step S103 in the first embodiment, and details are not described herein again.
  • step S208 Determine whether the target coding mode is a video coding standard technology. If the determination result is yes, execute step S209.
  • the encoding end determines the target encoding mode, and after encoding the frame to be processed by using the target encoding manner, determining whether to connect the to-be-processed frame to the reference frame corresponding to the next to-be-processed frame according to the target encoding manner.
  • List That is, when the encoding end encodes a frame to be processed (for example, the Nth frame, N is a natural number), the processed frame before the frame to be processed (for example, the N-1th frame) can be encoded.
  • a reference frame list of a to-be-processed frame (Nth frame) is generated after encoding is completed.
  • the encoding end may determine, according to the encoding manner of the N-1th frame, whether the N-1 frame can be used as a reference for the frame data encoding of the next frame (ie, the Nth frame). frame. If yes, the foregoing N-1th frame may be added to the reference frame list, that is, the N-1th frame is added to the encoded reference frame list, and a new reference frame list is generated, and the reference frame list is used as the reference frame list.
  • the encoding end may determine, according to the encoding manner of the Nth frame, whether the Nth frame can be used as the reference frame of the frame data encoding of the next frame (ie, the N+1th frame). If yes, the foregoing Nth frame may be added to the reference frame list, that is, the Nth frame is added to the encoded reference frame list, and a new reference frame list is generated, and the reference frame list is used as the first frame ( N+1th frame) List of encoded reference frames.
  • the to-be-processed frame may be added to the reference frame list to generate a reference frame corresponding to the next to-be-processed frame. List. If the target coding mode is not the video coding standard technology specified by the video coding and decoding standard, the to-be-processed frame is not connected to the reference frame list. In a specific implementation, if the target coding mode is a video coding standard technology specified by a video coding and decoding standard, the coding end may transmit the selection result of the target coding mode to the decoding end by sending the index information, or display the information by sending the image.
  • the manner of controlling the information passes the selection result of the target encoding mode to the decoding end.
  • the decoding end may parse the index information or the control information to determine a target encoding mode. If the target coding mode is the coding mode of the frame rate up-conversion, after the coding end determines the coding mode for encoding the frame to be processed, it is not necessary to transmit the video data information of any current frame to the decoding end. If the decoding end does not receive any information from the encoding end, the default target encoding mode may be the encoding mode of the frame rate up conversion.
  • the video data of each frame of the encoding end is in accordance with the foregoing implementation manner. Therefore, when the encoding end processes the processing frame, the target encoding mode of the processed frame before the frame to be processed may be received, and then The target encoding mode of the to-be-processed frame determines whether the processed frame can be the reference frame of the current pending frame.
  • the encoding end when the encoding end sends the target encoding mode to the decoding end, the method for transmitting the index information is used, and the encoding end may assign “image display information” to the processing frame of the encoding mode specified by the video coding and decoding standard, and A processed frame having "image display information" generates a reference frame list of a frame to be processed in accordance with the principle of the near and far position of the frame to be processed.
  • the encoder can get the place to be
  • the five video frames before the frame are assumed to be F1 to F5.
  • the encoding methods used by F1, F3, and F4 are the encoding methods specified by the video codec standard, and the encoding methods used by F2 and F5 are frame rate up-conversion.
  • the encoding end can obtain the "image display information" carried in each video frame of F1 to F5. Specifically, the encoding end may determine, according to the coding manner adopted by each of the video frames, that the “image display information” of each video frame is 0, none, 1, 2, and none. At this time, the encoding end may determine that the reference frame of the to-be-processed frame is F1, F3, and F4, and further, the reference frame list of the to-be-processed frame is determined to be F4, F3, and F1 according to the positional relationship between each reference frame and the to-be-processed frame.
  • the encoding end may process the processed frame having the “image display information” according to the near and far position of the to-be-processed frame.
  • a reference frame list is generated, which in turn can also map discontinuous "image display information" into a continuous reference index.
  • the encoding end can obtain 5 video frames before the frame to be processed, which is assumed to be F1 to F5, wherein the encoding modes used by F1, F3, and F4 are the encoding modes specified by the video codec standard, and F2 and F5 are used.
  • the coding mode of the frame rate up-conversion can obtain the "image display information" carried in each video frame of F1 to F5 by the encoding end as 0, none, 2, 3, and no. Further, the encoding end can determine the pending processing.
  • the reference frames of the frame are F1, F3, and F4, and the reference frame list of the to-be-processed frame is determined to be F4, F3, and F1 according to the positional relationship between each reference frame and the to-be-processed frame.
  • the reference index of the reference frames F4, F3, and F1 may be (3, 2, 0) mapped to (3, 2, 1).
  • the encoding end may determine, according to the frame rate or time complexity of the video data to be processed, whether to process the to-be-processed frame in the video to be processed by using multiple encoding modes, or according to the video coding and decoding standard.
  • the general encoding method treats the processed frames. If the specified information such as the frame rate or the time complexity of the video data to be processed satisfies the preset condition, the first coding mode and the second coding mode may be used to preprocess the to-be-processed frame in the video data to be processed, and then according to the foregoing
  • the pre-processing results of the first coding mode and the second coding mode determine which one of the coding modes is selected for encoding the frame to be processed.
  • the target coding mode may be notified to the decoding end according to the specified information transmission mode, so that the decoding end decodes the video data to be processed according to the decoding mode corresponding to the target coding mode, and the decoding end does not need to judge by itself. Improve the accuracy of the decoding end of the encoding method.
  • the encoding end may further encode the frame to be processed according to the target encoding mode according to the reference frame list corresponding to the pre-generated frame to be processed, and improve the encoded video of the to-be-processed video. Quality enhances the user experience of video data processing.
  • FIG. 4 is a schematic flowchart diagram of a third embodiment of a method for encoding video data according to an embodiment of the present invention.
  • the encoding method of the video data described in the embodiment of the present invention includes the following steps:
  • S301 Obtain specified information of a to-be-processed frame in the video data, where the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information.
  • step S101 the specific implementation process of the encoding information of the to-be-processed frame in the embodiment of the present invention may be referred to step S101 in the foregoing first embodiment, and details are not described herein again.
  • step S102 the specific implementation process of the pre-processing of the frame to be processed by the encoding end according to the first encoding mode and the second encoding mode in the embodiment of the present invention can be referred to step S102 in the foregoing first embodiment. Steps S202 and S203 in the second embodiment are not described herein again.
  • the encoding end may perform the first video quality processing on the to-be-processed frame according to the first encoding manner to obtain video data in a case where the size of the specified encoded data amount is consumed. Further, the encoding end may further determine a quality indicator (ie, a first quality indicator) of the video data obtained after performing the first video quality processing on the frame to be processed according to the first encoding manner.
  • the first quality indicator of the video data obtained by the first video quality processing is a pre-processing result of pre-processing the frame to be processed in the first coding mode.
  • the encoding end may perform second video quality processing on the to-be-processed frame according to the second encoding manner to obtain video data in a case where the size of the specified encoded data amount is consumed, wherein the pre-processing result of the second encoding mode includes the second The second quality indicator of the video data obtained by the video quality processing.
  • the above quality indicators may include objective quality indicators and subjective quality indicators, specifically See the second embodiment above, and details are not described herein again.
  • step S304 Determine whether the first quality indicator is higher than the second quality indicator. If the determination result is yes, execute step S305. Otherwise, execute step S306.
  • the first encoding indicator may include the first quality indicator and the second encoding.
  • the second quality indicator included in the preprocessing result of the mode is compared, and the target coding mode is selected from the first coding mode and the second coding mode according to the comparison result.
  • the encoding end may determine whether the first quality indicator is higher than the second quality indicator. If the determination result is yes, the video obtained by processing the frame to be processed in the first encoding mode may be determined when the same amount of encoded data is consumed.
  • the quality is higher, that is, the processing performance of the first coding mode is better than the second coding mode, and the first coding mode can be selected as the target coding mode. If the first quality indicator is lower than the second quality indicator, the processing performance of the second coding mode may be better than the first coding mode, and the second coding mode may be determined as the target coding mode.
  • the encoding end when the encoding end selects the target encoding mode from the first encoding mode and the second encoding mode, the size of the first encoded data amount and the second encoded data amount, and the first quality indicator and The second quality indicator is comprehensively judged.
  • the encoding end may obtain the first quality indicator and the second quality indicator, and the first encoded data quantity size and the second encoded data quantity size from the pre-processing results of the first encoding mode and the second encoding mode, and further may determine a ratio of a quality indicator to a size of the first encoded data amount, and a ratio of the second quality indicator to the second encoded data amount.
  • the first encoding mode may be determined as the target of the to-be-processed frame.
  • the coding mode otherwise, the second coding mode is determined as the target coding mode of the to-be-processed frame.
  • the encoding end may also select according to a specific application scenario of the to-be-processed frame. If the to-be-processed frame is the video data of the specified application scenario, the encoding mode of the guaranteed video quality may be forced to be encoded, and the encoding mode of the video data of a specific application mode may be specified. Specifically, the encoding end may determine whether the to-be-processed frame is a video frame in the monitoring video data or the close-up video data.
  • the above-mentioned to-be-processed frame can be processed using a higher quality coding method.
  • the target coding mode may be selected according to the first quality indicator included in the pre-processing result of the first coding mode and the second quality indicator included in the pre-processing result of the second coding mode. If the first quality indicator is higher than the second quality indicator, the first coding mode is selected as the target coding mode of the surveillance video; otherwise, the second coding mode is selected as the target coding mode of the surveillance video.
  • the specific implementation process of the encoding of the to-be-processed frame by using the target encoding mode may be referred to the implementation manner described in step S103 in the first embodiment, and details are not described herein again.
  • step S308. Determine whether the target coding mode is a video coding standard technology. If the determination result is yes, execute step S309.
  • steps S308 and S309 can be referred to the implementations described in steps S208 and S209 in the second embodiment, and details are not described herein again.
  • the encoding end may determine, according to the frame rate or time complexity of the video data to be processed, or the space complexity, whether to process the to-be-processed frame in the video to be processed by using multiple encoding modes, or according to the video encoding and decoding.
  • the general encoding method specified by the standard processes the frames to be processed.
  • the first coding mode and the second coding mode may be used to preprocess the to-be-processed frame in the video data to be processed, and then according to the foregoing
  • the pre-processing results of the first coding mode and the second coding mode determine which one of the coding modes is selected for encoding the frame to be processed.
  • the target coding mode may be notified to the decoding end according to the specified information transmission mode, so that the decoding end decodes the video data to be processed according to the decoding mode corresponding to the target coding mode, and the decoding end does not need to judge by itself.
  • the encoding end may further encode the frame to be processed according to the target encoding mode according to the reference frame list corresponding to the pre-generated frame to be processed, improve the encoded video quality of the video to be processed, and enhance the user experience of the video data processing.
  • FIG. 5 is a flowchart of a first embodiment of a method for decoding video data according to an embodiment of the present invention.
  • the decoding method of the video data described in the embodiment of the present invention includes the following steps:
  • S401 Obtain specified information of a to-be-processed frame in the video data, where the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information.
  • the implementation process of the decoding end and the implementation process of the foregoing coding end described in the embodiment of the present invention are mutually inverse processes, that is, the implementation process described by the decoding end is the inverse process of the implementation process of the foregoing coding end.
  • the specified information of the to-be-processed frame of the video data described in the embodiment of the present invention includes: frame rate information, time complexity information, spatial complexity information, and the like.
  • the time complexity information of the to-be-processed video data includes: length information of the motion vector, or index information of the reference frame;
  • the spatial complexity information includes: range information of the image chrominance, image texture information, and image coding mode information. Wait.
  • the decoding end of the embodiment of the present invention obtains the specified information of the to-be-processed frame, and determines whether the specified information meets the preset condition of the target decoding mode to process the preset condition of the to-be-processed frame.
  • the decoding end when the decoding end determines that the specified information meets the preset condition, determining, according to the identifier information carried in the code stream information of the to-be-processed frame, the target encoding used by the encoding end to encode the processing frame.
  • the target decoding mode of the to-be-processed frame may be determined according to a manner that the decoding end and the encoding end pre-protocol.
  • the decoding end can receive the code stream information transmitted by the encoding end, decode the code stream information, and determine the target encoding mode used by the encoding end according to the information carried in the code stream information.
  • the decoding end may determine the target encoding mode according to the encoding manner of the index information and the encoding information carried in the code stream information, and may further determine according to the encoding end and the decoding end.
  • the correspondence between the coding mode and the decoding mode determines the target decoding mode corresponding to the target coding mode.
  • the identification information received by the decoding end is control information such as image display information corresponding to the encoding mode
  • the decoding end may determine the target encoding mode according to the specified image display information providing manner and the image display information carried in the code stream information.
  • the target coding mode may be determined as a video coding standard technology, and then the preset The correspondence between the coding mode and the decoding mode determines the target decoding mode corresponding to the target coding mode. If the code stream information of the frame to be processed is decoded by the decoder, and the image display information or the time stamp is not included in the identifier information carried in the code stream information, the target coding mode is determined as the frame rate up conversion technique or the resolution.
  • the rate scaling technique may further determine a target decoding mode corresponding to the frame rate up-conversion technique or a target decoding mode corresponding to the resolution scaling technique according to a correspondence between a preset encoding mode and a decoding mode.
  • the decoding end may agree with the encoding end to encode the index information of the target encoding mode. For example, if there are two encoding modes, the first encoding mode may be encoded as 0, and the second encoding mode encoded as 1, the decoding end receives After the code stream information is obtained, the code stream information may be parsed, and the target coded information carried in the code stream is determined according to an agreed manner.
  • the decoding end may agree with the encoding end on the correspondence between the control information of the target encoding mode and the image display information. For example, if there are two encoding modes, the first encoding mode may be specified to be given “image display information” and the second encoding. The method does not give "image display information".
  • the target encoding mode may be determined to be the first encoding mode. If the image display information is not included in the control information, it may be determined that the target encoding mode is the second encoding mode.
  • the method for determining the target coding mode is only an example. For details, refer to the implementation manner described in the foregoing coding end, which is not limited herein.
  • the decoding end may perform decoding processing on the video data to be processed according to a general decoding manner.
  • the foregoing general decoding mode is a hybrid structure decoding mode specified by the video coding and decoding standard.
  • the specific implementation manner of the foregoing hybrid architecture decoding mode refer to the execution mode specified in the video data coding and decoding standard, and details are not described herein again.
  • S403. Determine auxiliary information for decoding the to-be-processed frame according to the target decoding mode, and decode the to-be-processed frame according to the target decoding mode and the auxiliary information.
  • the to-be-processed frame in the video data to be processed may be decoded according to the target decoding mode corresponding to the target coding mode.
  • the specified information corresponding to the target encoding mode used by the encoding end may be determined according to the information determining manner corresponding to each encoding manner pre-protocolized by the encoding end, and thus may be processed from The specified information is obtained in the video data, and the video data to be processed is decoded according to the specified information to obtain video data.
  • the decoding end may obtain the treatment The auxiliary information for decoding the frame, wherein the auxiliary information is residual data information and control header information corresponding to the frame to be processed.
  • the target decoding mode is the decoding mode corresponding to the frame rate up-conversion technology
  • the decoding end does not need to acquire the auxiliary information for processing the frame to be processed, that is, the auxiliary information for decoding the to-be-processed frame is empty.
  • the auxiliary information for decoding the frame to be processed is acquired, wherein the auxiliary information is residual data information and control header information corresponding to the scaling process of the to-be-processed frame.
  • the encoding end encodes the processing frame to use the video encoding standard technology specified by the video coding and decoding standard, the decoding end needs to obtain the complete residual data information and control header information after determining the decoding mode corresponding to the target encoding mode.
  • the video to be processed is decoded.
  • the decoding end does not need to acquire any data information, and only needs to decode according to the decoding mode corresponding to the frame rate conversion technology. If the encoding end uses the resolution scaling technique to encode the processed frame, the decoding end needs to obtain the reduced residual data information and the control header information to decode the processed video. Further, the coding end may also adopt other coding modes, and the information to be transmitted may further include: filter coefficient information or correction information, etc., and is not limited herein.
  • the decoding end decodes the to-be-processed frame according to the target decoding mode and the acquired auxiliary information, and the decoding end may further determine, according to the decoding manner of the to-be-processed frame, whether the to-be-processed frame can be used as a reference for the next to-be-processed frame. frame. Specifically, the decoding end may determine whether the target decoding mode is a decoding mode corresponding to the video coding standard technology. If the target decoding mode is a decoding mode corresponding to the video coding standard technology, the processed pending frame is added to the reference frame list. To generate a reference frame list corresponding to the next pending frame. For a specific implementation, the implementation of the reference frame list of the frame to be processed by the decoding end can be referred to the implementation manner described in the embodiment of the encoding end, and details are not described herein again.
  • the decoding end may determine, according to the video data to be processed, the decoding mode to be processed in the video encoding and decoding standard to be decoded, and determine the video data to be processed by the encoding end according to the identification information sent by the encoding end.
  • the encoded target decoding mode is further decoded according to the target decoding mode.
  • the decoding end does not need to determine the decoding mode according to the adaptive criterion, which reduces the misjudgment of the encoding mode of the video data to be processed, enhances the decoding accuracy of the video data to be processed, and improves the quality of the video data decoding.
  • FIG. 6 a structure of a first embodiment of an encoding apparatus for video data according to an embodiment of the present invention is shown. schematic diagram.
  • the encoding device described in the embodiment of the present invention includes:
  • the obtaining module 10 is configured to acquire specified information of a to-be-processed frame in the video data, where the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information.
  • the time complexity information includes: length information of the motion vector, or index information of the reference frame; the spatial complexity information includes: at least change range information of the image chrominance, image texture information, and image coding mode information.
  • the spatial complexity information includes: at least change range information of the image chrominance, image texture information, and image coding mode information.
  • the pre-processing module 20 is configured to: when the specified information acquired by the acquiring module meets a preset condition for processing the to-be-processed frame by starting multiple coding modes, respectively, according to the first coding mode and the second coding mode, The to-be-processed frame is pre-processed, wherein the first coding mode and the second coding mode are different coding modes.
  • the processing module 30 is configured to: according to the pre-processing result of the first coding mode and the pre-processing result of the second coding mode processed by the pre-processing module, from the first coding mode and the second coding mode Selecting a target encoding mode, and encoding the to-be-processed frame according to the target encoding manner.
  • the foregoing specified information is frame rate information
  • the pre-processing module 20 is specifically configured to:
  • the foregoing specified information is time complexity information
  • the pre-processing module 20 is specifically configured to:
  • the foregoing information is spatial complexity information
  • the pre-processing module 20 is specifically configured to:
  • the encoding device described in the embodiment of the present invention is an execution body of the encoding method of the video data provided by the embodiment of the present invention, that is, the encoding end described in the foregoing embodiment of the encoding method.
  • the implementation manner described in the first embodiment of the encoding method of the video data provided by the embodiment of the present invention may be implemented by the encoding module, the pre-processing module 20, and the processing module 30, which are described in the embodiment of the present invention.
  • the implementation process reference may be made to the implementations described in the respective steps (steps S101 to S103) in the first embodiment of the encoding method of the video data, and details are not described herein again.
  • the encoding apparatus may determine, according to the frame rate information of the to-be-processed frame of the video data or the time complexity information or the spatial complexity information waiting for the specified information of the processing frame, whether to adopt a plurality of coding modes to treat the to-be-processed video.
  • the frame is processed for processing, or the frame to be processed is processed according to the general encoding method specified by the video codec standard. If the specified information such as the frame rate or the time complexity of the video data to be processed is consistent with a preset condition for starting a plurality of encoding modes, the first encoding mode and the second encoding mode may be used to respectively perform the to-be-processed frame in the video data.
  • the pre-processing may further determine, according to the pre-processing result of the first coding mode and the second coding mode, which one of the coding modes is selected to encode the to-be-processed frame. After the coding apparatus selects the target coding mode, the target coding mode may be notified to the decoding apparatus according to the specified information transmission mode, so that the decoding apparatus performs decoding processing on the video data to be processed according to the decoding mode corresponding to the target coding mode.
  • the encoding apparatus described in the embodiment of the present invention can select a specific encoding manner from a plurality of encoding modes to perform encoding processing on the frame to be processed, improve the video processing quality of the to-be-processed frame of the video data, and enhance the user experience of the video data processing. .
  • FIG. 7 is a schematic structural diagram of a second embodiment of an encoding apparatus for video data according to an embodiment of the present invention.
  • the encoding device described in the embodiment of the present invention includes:
  • the obtaining module 10 is configured to acquire specified information of a to-be-processed frame in the video data, where the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information.
  • the time complexity information includes: length information of the motion vector, or index information of the reference frame; the spatial complexity information includes: at least change range information of the image chrominance, image texture information, and image coding mode information.
  • the spatial complexity information includes: at least change range information of the image chrominance, image texture information, and image coding mode information.
  • the foregoing obtaining module 10 may be implemented by the obtaining module 10 in the first embodiment of the foregoing encoding apparatus.
  • the specific implementation process refer to the description of step S101 of the first embodiment of the encoding method of the video data. The implementation of this will not be repeated here.
  • the pre-processing module 21 is configured to: when the specified information acquired by the acquiring module meets a preset condition for processing the to-be-processed frame by starting multiple coding modes, respectively, according to the first coding mode and the second coding mode, respectively.
  • the to-be-processed frame is pre-processed, wherein the first coding mode and the second coding mode are different coding modes.
  • the pre-processing module 21 may perform the implementation performed by the pre-processing module 20 in the first embodiment of the encoding apparatus. Further, the following operations may be performed:
  • the foregoing pre-processing module 21 is specifically configured to:
  • the first coding mode Performing, by the first coding mode, the first video quality processing on the to-be-processed frame to obtain video data that meets a specified video quality indicator, where the pre-processing result of the first coding mode includes the first video quality processing The amount of the first encoded data amount consumed;
  • the processing module 31 is configured to: according to the pre-processing result of the first coding mode and the pre-processing result of the second coding mode processed by the pre-processing module, from the first coding mode and the second coding mode Selecting a target encoding mode, and encoding the to-be-processed frame according to the target encoding manner.
  • processing module 31 described in the embodiment of the present invention may perform the implementation performed by the processing module 30 in the first embodiment of the foregoing encoding apparatus. Further, the following operations may also be performed:
  • the foregoing processing module 31 is specifically configured to:
  • the encoding apparatus described in the embodiments of the present invention further includes a marking module 40, wherein the marking module 40 is configured to:
  • Indexing the target coding mode encoding the index information of the target coding mode to obtain identification information of the target coding mode, and transmitting the identification information to the decoding end in the form of a code stream
  • Marking the target coding mode by using a physical quantity that characterizes time domain information to obtain identification information of the target coding mode, and transmitting the identification information of the target coding mode to the decoding end as control information;
  • the physical quantity that represents the time domain information includes: image display information or a time stamp.
  • the encoding apparatus described in the embodiments of the present invention further includes:
  • the reference frame determining module 50 is configured to determine whether the target encoding mode selected by the processing module is a video encoding standard technology, and if the target encoding mode is the video encoding standard technology, the processed to-be-processed A frame is added to the reference frame list to generate a reference frame list corresponding to the next to-be-processed frame.
  • the coding apparatus provided by the embodiment of the present invention may specifically be the execution body of the coding method of the video data provided by the embodiment of the present invention, that is, the coding described in the embodiment of the coding method of the video data provided by the embodiment of the present invention.
  • the encoding apparatus may perform the first coding method of the video data by using various modules (including the acquisition module 10, the preprocessing module 21, the processing module 31, the labeling module 40, and the reference frame judging module 50).
  • various modules including the acquisition module 10, the preprocessing module 21, the processing module 31, the labeling module 40, and the reference frame judging module 50.
  • the encoding apparatus may determine, according to information such as a frame rate or a time complexity of the video data to be processed, whether to process the to-be-processed frame in the video to be processed by using multiple encoding modes, or according to the video coding and decoding standard.
  • the general encoding method treats the processed frames.
  • the first coding mode and the second coding mode may be used to preprocess the to-be-processed frame in the video data to be processed, and then according to the foregoing
  • the pre-processing results of the first coding mode and the second coding mode determine which one of the coding modes is selected for encoding the frame to be processed.
  • the target coding mode may be notified to the decoding device according to the specified information transmission mode, so that the decoding device performs decoding processing on the video data to be processed according to the decoding mode corresponding to the target coding mode, and the decoding device does not need to judge by itself.
  • the encoding device may further encode the frame to be processed according to the target encoding mode according to the reference frame list corresponding to the pre-generated frame to be processed, improve the encoded video quality of the video to be processed, and enhance the user experience of the video data processing.
  • FIG. 8 is a schematic structural diagram of a third embodiment of an apparatus for encoding video data according to an embodiment of the present invention.
  • the encoding device described in the embodiment of the present invention includes:
  • the obtaining module 10 is configured to acquire specified information of a to-be-processed frame in the video data, where the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information.
  • the time complexity information includes: length information of the motion vector, or index information of the reference frame; the spatial complexity information includes: at least change range information of the image chrominance, image texture information, and image coding mode information.
  • the spatial complexity information includes: at least change range information of the image chrominance, image texture information, and image coding mode information.
  • step S101 of the first embodiment of the foregoing video data encoding method refers to the implementation manner described in step S101 of the first embodiment of the foregoing video data encoding method, and details are not described herein again.
  • the pre-processing module 22 is configured to: when the specified information acquired by the acquiring module meets a preset condition for processing the to-be-processed frame by starting multiple coding modes, respectively, according to the first coding mode and the second coding mode, respectively.
  • the to-be-processed frame is pre-processed, wherein the first coding mode and the second coding mode are different coding modes.
  • the pre-processing module 22 may perform the implementation performed by the pre-processing module 20 in the first embodiment of the encoding apparatus and the pre-processing module 21 in the second embodiment of the encoding apparatus, and further, Do the following:
  • the foregoing pre-processing module 22 is specifically configured to:
  • the first coding mode performs, by the first coding mode, the first video quality processing on the to-be-processed frame to obtain video data in a case of consuming a specified coded data amount, where the pre-processing result of the first coding mode includes the a first quality indicator of the video data obtained by a video quality processing;
  • the processing module 32 is configured to: according to the pre-processing result of the first coding mode and the pre-processing result of the second coding mode processed by the pre-processing module, from the first coding mode and the second coding mode Selecting a target encoding mode, and encoding the to-be-processed frame according to the target encoding manner.
  • the processing module 32 described in the embodiment of the present invention may perform the implementation performed by the processing module 30 in the first embodiment of the encoding apparatus and the processing module 31 in the second embodiment.
  • the following operations can also be performed:
  • the processing module 32 is specifically configured to:
  • the foregoing processing module 32 may also be specifically configured to:
  • the first coding mode is selected as the target coding mode, and if the determination result is no, the second coding mode is selected as the target coding mode.
  • the foregoing processing module 32 may also be specifically configured to:
  • the encoding apparatus described in the embodiments of the present invention further includes a marking module 40, wherein the marking module 40 is configured to:
  • Marking the target coding mode by using a physical quantity that characterizes time domain information to obtain identification information of the target coding mode, and transmitting the identification information of the target coding mode to the decoding end as control information;
  • the physical quantity that represents the time domain information includes: image display information or a time stamp.
  • the encoding apparatus described in the embodiments of the present invention further includes:
  • the reference frame determining module 50 is configured to determine whether the target coding mode selected by the processing module is For the video coding standard technology, if the target coding mode is the video coding standard technology, the processed frame to be processed is added to the reference frame list to generate a reference frame list corresponding to the next to-be-processed frame.
  • the coding apparatus provided by the embodiment of the present invention may specifically be the execution body of the coding method of the video data provided by the embodiment of the present invention, that is, the coding described in the embodiment of the coding method of the video data provided by the embodiment of the present invention.
  • the encoding apparatus may perform the first coding method of the video data by using various modules (including the acquisition module 10, the preprocessing module 22, the processing module 32, the labeling module 40, and the reference frame judging module 50).
  • various modules including the acquisition module 10, the preprocessing module 22, the processing module 32, the labeling module 40, and the reference frame judging module 50.
  • the encoding device may determine, according to the frame rate or time complexity of the video data to be processed, or the spatial complexity, whether to process the to-be-processed frame in the video to be processed by using multiple encoding modes, or according to the video encoding and decoding.
  • the general encoding method specified by the standard processes the frames to be processed.
  • the first coding mode and the second coding mode may be used to preprocess the to-be-processed frame in the video data to be processed, and then according to the foregoing
  • the pre-processing results of the first coding mode and the second coding mode determine which one of the coding modes is selected for encoding the frame to be processed.
  • the target coding mode may be notified to the decoding device according to the specified information transmission mode, so that the decoding device performs decoding processing on the video data to be processed according to the decoding mode corresponding to the target coding mode, and the decoding device does not need to judge by itself.
  • the encoding device may further encode the frame to be processed according to the target encoding mode according to the reference frame list corresponding to the pre-generated frame to be processed, improve the encoded video quality of the video to be processed, and enhance the user experience of the video data processing.
  • FIG. 9 is a schematic structural diagram of an embodiment of a decoding apparatus for video data according to an embodiment of the present invention.
  • the decoding device described in the embodiment of the present invention includes:
  • the obtaining module 60 is configured to acquire specified information of a to-be-processed frame in the video data, where the specified information includes at least one of frame rate information, time complexity information, and spatial complexity information.
  • the time complexity information includes: length information of the motion vector, or index information of the reference frame; the spatial complexity information includes: a range of information of the image chrominance, and image texture information. And at least one of image encoding mode information.
  • a determining module 70 configured to: according to the identifier information carried in the code stream information of the to-be-processed frame, when the specified information acquired by the acquiring module meets a preset condition of the to-be-processed frame in the startup target decoding mode, Determining a target decoding mode of the to-be-processed frame.
  • the processing module 80 is configured to determine, according to the target decoding manner determined by the determining module, auxiliary information for decoding the to-be-processed frame, and decode the to-be-processed frame according to the target decoding manner and the auxiliary information.
  • the foregoing specified information is frame rate information
  • the determining module 70 is specifically configured to:
  • the foregoing specified information is time complexity information
  • the determining module 70 is specifically configured to:
  • the foregoing specified information is spatial complexity information
  • the determining module 70 is specifically configured to:
  • the determining module 70 is specifically configured to:
  • Decoding the code stream information of the to-be-processed frame acquiring index information for marking the target coding mode carried in the code stream information, and determining the target coding mode according to the index information;
  • the target decoding mode of the to-be-processed frame is determined according to the correspondence between the preset encoding mode and the decoding mode, in combination with the target encoding mode.
  • the determining module 70 is specifically configured to:
  • the identifier information includes image display information or a timestamp, determining that the target encoding mode is the video encoding standard technology, and determining the video encoding standard technology according to a correspondence between a preset encoding mode and a decoding mode. Corresponding target decoding mode;
  • the target encoding mode is the frame rate up conversion technique or the resolution scaling technology, and according to a preset correspondence between a coding mode and a decoding mode Determining a target decoding mode corresponding to the frame rate up-conversion technique or a target decoding mode corresponding to the resolution scaling technique.
  • the foregoing processing module 80 is specifically configured to:
  • auxiliary information for decoding the to-be-processed frame when the target decoding mode determined by the determining module is a decoding mode corresponding to the video coding standard technology, where the auxiliary information is corresponding to the to-be-processed frame Residual data information and control header information; or
  • the target decoding mode determined by the determining module is a decoding mode corresponding to the frame rate up-conversion technology, acquiring auxiliary information for decoding the to-be-processed frame, where the auxiliary information is empty;
  • the target decoding mode determined by the determining module is a decoding mode corresponding to the resolution scaling technology
  • acquiring auxiliary information for decoding the to-be-processed frame where the auxiliary information is subjected to scaling processing for the to-be-processed frame Residual data information and control header information.
  • the decoding apparatus (such as FIG. 10) described in the embodiments of the present invention further includes:
  • the reference frame determining module 90 is configured to determine whether the target decoding mode determined by the determining module is a decoding mode corresponding to the video coding standard technology
  • the processed frame to be processed is added to the reference frame list to generate a reference frame list corresponding to the next to-be-processed frame.
  • the decoding apparatus provided by the embodiment of the present invention is the execution end of the method for decoding the video data provided by the embodiment of the present invention, that is, the decoding end described in the embodiment of the method for decoding video data provided by the embodiment of the present invention.
  • the decoding device may perform the implementation manner described in the embodiment of the decoding method of the video data provided by the embodiment of the present invention by using an acquireable module, a determining module, a processing module, a reference frame determining module, and the like.
  • an acquireable module a determining module
  • a processing module a reference frame determining module
  • the decoding device may determine, according to the video data to be processed, the decoding mode specified in the video encoding and decoding standard, and decode the video data to be processed, and determine, according to the identification information sent by the encoding device, the encoding device to process the video data.
  • the encoded target decoding mode is further decoded according to the target decoding mode.
  • the decoding device does not need to determine the decoding mode according to the adaptive criterion, reduces the misjudgment of the encoding mode of the video data to be processed, enhances the accuracy of decoding the video data of the frame to be processed, and improves the quality of decoding the video data.
  • FIG. 11 is a schematic structural diagram of an embodiment of a codec system for video data according to an embodiment of the present invention, including: an encoding apparatus 1000 and a decoding apparatus 2000 according to an embodiment of the present invention.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Abstract

本发明实施例公开了一种视频数据的编码方法,包括:获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种;若所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,则按照第一编码方式和第二编码方式分别对待处理帧进行预处理,其中,第一编码方式和第二编码方式是不同的编码方式;根据第一编码方式的预处理结果和第二编码方式的预处理结果,从第一编码方式和第二编码方式中选择目标编码方式,并根据所述目标编码方式对所述待处理帧进行编码。本发明实施例还公开了一种视频数据的编码装置。采用本发明,具有保证视频数据处理的质量,增强视频数据编码的用户体验的优点。

Description

一种视频数据的编解码方法及装置
本申请要求于2015年4月16日提交中国专利局、申请号为201510180497.4,发明名称为“一种视频数据的编解码方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明涉及通信技术领域,尤其涉及一种视频数据的编解码方法及装置。
背景技术
当前视频编解码过程中,视频数据将通过预测、变换、量化和熵编码等过程,被变成码流,去除了数据间的冗余信息,提高了视频数据的传输效率。帧速率上转换技术是一种视频后处理技术,通过在原有视频帧中插入中间帧的方式,将低帧率视频转变成高帧率视频,提供更好的视觉质量。多参考帧技术是在多参考帧模式下,对一个宏块或者子块进行运动补偿时,编码会从过去的若干个已编码帧中选定一帧作为参考帧,寻求当前编码宏块或子块的最佳匹配块,以获得更好的预测效果。在很多物体存在遮蔽等情况下,多参考帧的引入能够提高编码效率。
现有技术的视频数据编解码方法中编码端不做视频帧的处理方式的选择,也不需要传送视频帧的处理方式等视频数据至解码端。解码端基于一种或者几种自适应规则,选择性地进行帧速率上转换的操作,自适应规则可以包括运动的激烈程度,编码的模式选择,视频内容的纹理结构等。如图1,图1是现有技术中解码端自适应地进行视频帧处理的一操作方式。解码端处理当前帧的数据时,可统计前一已解码帧的运动矢量信息,判断上述已解码帧的运动矢量的平均长度是否超过阈值。若运动矢量的平均长度超过阈值,则重复前一帧,将其插入当前帧之前,进而可接着处理下一帧。如运动矢量的平均长度未超过阈值,则用帧速率上转换算法得到插值帧,将插值帧插入当前帧之前,进而可接着处理下一帧。
现有技术中解码端采用自适应的方法(无法从编码端获知视频数据的处理方式)进而无法保证对不视频数据的处理方式产生误判决,无法保证对于插值 算法(如帧速率上转换算法)的适用性。现有技术采用简单的插值方法未对运动情况(包括剧烈的和平缓的运动情况)进行区分,对参考帧列表的入列参考帧的内容没有特定要求,使得在高帧率视频源的情况下,无法充分发挥参考帧算法的性能,无法保证视频质量。
发明内容
本发明实施例提供一种视频数据的编解码方法及装置,可提高编码方式选择的多样性和灵活性,保证视频数据的处理质量,增强视频数据编码的用户体验。
本发明实施例第一方面提供了一种视频数据的编码方法,其可包括:
获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种;
其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息中的至少一种;
若所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,则按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,其中,所述第一编码方式和所述第二编码方式是不同的编码方式;
根据所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,并根据所述目标编码方式对所述待处理帧进行编码。
结合第一方面,在第一种可能的实现方式中,所述指定信息为帧率信息;
所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,包括:
所述帧率信息所指示的帧率大于预设的帧率阈值。
结合第一方面,在第二种可能的实现方式中,所述指定信息为时间复杂度信息;
所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,包括:
所述时间复杂度信息所指示的时间复杂度大于预设的时间复杂度阈值。
结合第一方面,在第三种可能的实现方式中,所述指定信息为空间复杂度信息;
所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,包括:
所述空间复杂度信息所指示的空间复杂度大于预设空间复杂度阈值。
结合第一方面至第一方面第三种可能的实现方式中任一种,在第四种可能的实现方式中,所述按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,包括:
按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得满足指定视频质量指标的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理所耗费的第一编码数据量大小;
按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得满足所述指定视频质量指标的视频数据,其中,所述第二编码方式的预处理结果包括所述第二视频质量处理所耗费的第二编码数据量大小。
结合第一方面第四种可能的实现方式,在第五种可能的实现方式中,所述根据所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,包括:
判断所述第一编码数据量大小是否小于所述第二编码数据量大小,若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
结合第一方面至第一方面第三种可能的实现方式中任一种,在第六种可能的实现方式中,所述按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,包括:
按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得耗费指定编码数据量大小的情况下的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理得到的所述视频数据的第一质量指标;
按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得耗费所述指定编码数据量大小的情况下的视频数据,其中,所述第二编码方式的 预处理结果包括所述第二视频质量处理得到的所述视频数据的第二质量指标。
结合第一方面第六种可能的实现方式,在第七种可能的实现方式中,所述根据所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,包括:
判断所述第一质量指标是否高于所述第二质量指标,若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
结合第一方面第四种可能的实现方式和第一方面第六种可能的实现方式,在第八种可能的实现方式中,所述根据所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,包括:
获取所述第一编码数据量大小和第二编码数据量大小,以及所述第一质量指标和所述第二质量指标;
判断所述第一质量指标与所述第一编码数据量大小的比值,是否高于所述第二质量指标与所述第二编码数据量大小的比值;
若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
结合第一方面第六种可能的实现方式,在第九种可能的实现方式中,所述根据所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,包括:
判断所述待处理帧是否为监控视频数据或者特写视频数据中的视频帧;
若判断结果为是,则获取所述第一质量指标和所述第二质量指标;
判断所述第一质量指标是否高于所述第二质量指标,若判断结果为是,则将所述第一编码方式选择为目标编码方式。
结合第一方面,在第十种可能的实现方式中,所述从所述第一编码方式和所述第二编码方式中选择目标编码方式之后,所述方法还包括:
采用索引的方式对所述目标编码方式进行标记,对所述目标编码方式的索引信息进行编码以得到所述目标编码方式的标识信息,并将所述标识信息以码流的形式传递给解码端;或者
采用表征时域信息的物理量对所述目标编码方式进行标记以得到所述目标编码方式的标识信息,并将所述目标编码方式的标识信息作为控制信息传递给解码端;
其中,所述表征时域信息的物理量包括:图像显示信息或者时间戳。
结合第一方面第十种可能的实现方式,在第十一种可能的实现方式中,所述根据所述目标编码方式对所述待处理帧进行编码之后,所述方法还包括:
判断所述目标编码方式是否为视频编码标准技术;
若所述目标编码方式为所述视频编码标准技术,则将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
本发明实施例第二方面提供了一种视频数据的解码方法,其可包括:
获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种;
其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息中的至少一种;
若所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件,则根据所述待处理帧的码流信息中携带的标识信息,确定所述待处理帧的目标解码方式;
根据所述目标解码方式确定对所述待处理帧进行解码的辅助信息,根据所述目标解码方式和所述辅助信息解码所述待处理帧。
结合第二方面,在第一种可能的实现方式中,所述指定信息为帧率信息;
所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件,包括:
所述帧率信息所指示的帧率大于预设的帧率阈值。
结合第二方面,在第二种可能的实现方式中,所述指定信息为时间复杂度信息;
所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件,包括:
所述时间复杂度信息所指示的时间复杂度大于预设的时间复杂度阈值。
结合第二方面,在第三种可能的实现方式中,所述指定信息为空间复杂度信息;
所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件,包括:
所述空间复杂度信息所指示的空间复杂度大于预设空间复杂度阈值。
结合第二方面至第二方面第三种可能的实现方式中任一种,在第四种可能的实现方式中,所述根据所述待处理帧的码流信息中携带的标识信息,确定所述待处理帧的目标解码方式,包括:
对所述待处理帧的码流信息进行解码,获取所述码流信息中携带的用于标记目标编码方式的索引信息,根据所述索引信息确定所述目标编码方式;
按照预设的编码方式和解码方式的对应关系,结合所述目标编码方式确定所述待处理帧的目标解码方式。
结合第二方面至第二方面第三种可能的实现方式中任一种,在第五种可能的实现方式中,所述根据所述待处理帧的码流信息中携带的标识信息,确定所述待处理帧的目标解码方式,包括:
对所述待处理帧的码流信息进行解码,获取所述码流信息中携带的标识信息是否包含图像显示信息或者时间戳;
若所述标识信息中包含图像显示信息或者时间戳,则确定所述目标编码方式为所述视频编码标准技术,并按照预设的编码方式和解码方式的对应关系,确定所述视频编码标准技术对应的目标解码方式;
若所述标识信息中没有图像显示信息或者时间戳,则确定所述目标编码方式为所述帧速率上转换技术或者所述分辨率缩放技术,并按照预设的编码方式和解码方式的对应关系,确定所述帧速率上转换技术对应的目标解码方式,或者所述分辨率缩放技术对应的目标解码方式。
结合第二方面第四种可能的实现方式或者第二方面第五种可能的实现方式,在第六种可能的实现方式中,所述根据所述目标解码方式确定对所述待处理帧进行解码的辅助信息,包括:
当所述目标解码方式为所述视频编码标准技术对应的解码方式时,获取对 所述待处理帧进行解码的辅助信息,所述辅助信息为所述待处理帧对应的残差数据信息和控制头信息;
当所述目标解码方式为帧速率上转换技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为空;
当所述目标解码方式为分辨率缩放技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为所述待处理帧进行缩放处理对应的残差数据信息和控制头信息。
结合第二方面第六种可能的实现方式,在第七种可能的实现方式中,所述根据所述目标解码方式确定对所述待处理帧进行解码的辅助信息,根据所述目标解码方式和所述辅助信息解码所述待处理帧之后,所述方法还包括:
判断所述目标解码方式是否为所述视频编码标准技术对应的解码方式;
若所述目标解码方式为所述视频编码标准技术对应的解码方式,则将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
本发明实施例第三方面提供了一种视频数据的编码装置,其可包括:
获取模块,用于获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种;
其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息中的至少一种;
预处理模块,用于在所述获取模块获取的所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件时,按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,其中,所述第一编码方式和所述第二编码方式是不同的编码方式;
处理模块,用于根据所述预处理模块处理的所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,并根据所述目标编码方式对所述待处理帧进行编码。
结合第三方面,在第一种可能的实现方式中,所述指定信息为帧率信息;
所述预处理模块,具体用于:
判断所述帧率信息所指示的帧率是否大于预设的帧率阈值,若判断结果为是,则确定所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件。
结合第三方面,在第二种可能的实现方式中,所述指定信息为时间复杂度信息;
所述预处理模块,具体用于:
判断所述时间复杂度信息所指示的时间复杂度是否大于预设的时间复杂度阈值,若判断结果为是,则确定所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件。
结合第三方面,在第三种可能的实现方式中,所述指定信息为空间复杂度信息;
所述预处理模块,具体用于:
判断所述空间复杂度信息所指示的空间复杂度是否大于预设空间复杂度阈值,若判断结果为是,则确定所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件。
结合第三方面至第三方面第三种可能的实现方式中任一种,在第四种可能的实现方式中,所述预处理模块,具体用于:
按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得满足指定视频质量指标的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理所耗费的第一编码数据量大小;
按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得满足所述指定视频质量指标的视频数据,其中,所述第二编码方式的预处理结果包括所述第二视频质量处理所耗费的第二编码数据量大小。
结合第三方面第四种可能的实现方式,在第五种可能的实现方式中,所述处理模块,具体用于:
判断所述预处理模块处理得到的所述第一编码数据量大小是否小于所述第二编码数据量大小,若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
结合第三方面至第三方面第三种可能的实现方式中任一种,在第六种可能的实现方式中,所述预处理模块,具体用于:
按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得耗费指定编码数据量大小的情况下的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理得到的所述视频数据的第一质量指标;
按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得耗费所述指定编码数据量大小的情况下的视频数据,其中,所述第二编码方式的预处理结果包括所述第二视频质量处理得到的所述视频数据的第二质量指标。
结合第三方面第六种可能的实现方式,在第七种可能的实现方式中,所述处理模块,具体用于:
判断所述预处理模块处理得到的所述第一质量指标是否高于所述第二质量指标,若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
结合第三方面第四种可能的实现方式和第三方面第六种可能的实现方式,在第八种可能的实现方式中,所述处理模块,具体用于:
获取所述预处理模块处理的所述第一编码数据量大小和第二编码数据量大小,以及所述第一质量指标和所述第二质量指标;
判断所述第一质量指标与所述第一编码数据量大小的比值,是否高于所述第二质量指标与所述第二编码数据量大小的比值;
若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
结合第三方面第六种可能的实现方式,在第九种可能的实现方式中,所述处理模块,具体用于:
判断所述待处理帧是否为监控视频数据或者特写视频数据中的视频帧;
若判断结果为是,则获取所述预处理模块处理的所述第一质量指标和所述第二质量指标;
判断所述第一质量指标是否高于所述第二质量指标,若判断结果为是,则将所述第一编码方式选择为目标编码方式。
结合第三方面,在第三方面第十种可能的实现方式中,所述编码装置还包 括标记模块,所述标记模块用于:
采用索引的方式对所述目标编码方式进行标记,对所述目标编码方式的索引信息进行编码以得到所述目标编码方式的标识信息,并将所述标识信息以码流的形式传递给解码端;或者
采用表征时域信息的物理量对所述目标编码方式进行标记以得到所述目标编码方式的标识信息,并将所述目标编码方式的标识信息作为控制信息传递给解码端;
其中,所述表征时域信息的物理量包括:图像显示信息或者时间戳。
结合第三方面第十种可能的实现方式,在第十一种可能的实现方式中,所述编码装置,还包括:
参考帧判断模块,用于判断所述处理模块选择的所述目标编码方式是否为视频编码标准技术,若所述目标编码方式为所述视频编码标准技术,则将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
本发明实施例第四方面提供了一种视频数据的解码装置,其可包括:
获取模块,用于获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种;
其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息中的至少一种;
确定模块,用于在所述获取模块获取的所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件时,根据所述待处理帧的码流信息中携带的标识信息,确定所述待处理帧的目标解码方式;
处理模块,用于根据所述确定模块确定的所述目标解码方式确定对所述待处理帧进行解码的辅助信息,根据所述目标解码方式和所述辅助信息解码所述待处理帧。
结合第四方面,在第一种可能的实现方式中,所述指定信息为帧率信息;
所述确定模块,具体用于:
判断所述帧率信息所指示的帧率是否大于预设的帧率阈值,若判断结果为是,则确定所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件。
结合第四方面,在第二种可能的实现方式中,所述指定信息为时间复杂度信息;
所述确定模块,具体用于:
判断所述时间复杂度信息所指示的时间复杂度是否大于预设的时间复杂度阈值,若判断结果为是,则确定所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件。
结合第四方面,在第三种可能的实现方式中,所述指定信息为空间复杂度信息;
所述确定模块,具体用于:
判断所述空间复杂度信息所指示的空间复杂度是否大于预设空间复杂度阈值,若判断结果为是,则确定所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件。
结合第四方面至第四方面第三种可能的实现方式中任一种,在第四种可能的实现方式中,所述确定模块,具体用于:
对所述待处理帧的码流信息进行解码,获取所述码流信息中携带的用于标记目标编码方式的索引信息,根据所述索引信息确定所述目标编码方式;
按照预设的编码方式和解码方式的对应关系,结合所述目标编码方式确定所述待处理帧的目标解码方式。
结合第四方面至第四方面第三种可能的实现方式中任一种,在第五种可能的实现方式中,所述确定模块,具体用于:
对所述待处理帧的码流信息进行解码,获取所述码流信息中携带的标识信息是否包含图像显示信息或者时间戳;
若所述标识信息中包含图像显示信息或者时间戳,则确定所述目标编码方式为所述视频编码标准技术,并按照预设的编码方式和解码方式的对应关系,确定所述视频编码标准技术对应的目标解码方式;
若所述标识信息中没有图像显示信息或者时间戳,则确定所述目标编码方 式为所述帧速率上转换技术或者所述分辨率缩放技术,并按照预设的编码方式和解码方式的对应关系,确定所述帧速率上转换技术对应的目标解码方式,或者所述分辨率缩放技术对应的目标解码方式。
结合第四方面第四种可能的实现方式或者第四方面第五种可能的实现方式,在第六种可能的实现方式中,所述处理模块,具体用于:
当所述确定模块确定的所述目标解码方式为所述视频编码标准技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为所述待处理帧对应的残差数据信息和控制头信息;
当所述确定模块确定的所述目标解码方式为帧速率上转换技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为空;
当所述确定模块确定的所述目标解码方式为分辨率缩放技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为所述待处理帧进行缩放处理对应的残差数据信息和控制头信息。
结合第四方面第六种可能的实现方式,在第七种可能的实现方式中,所述解码装置还包括:
参考帧判断模块,用于判断所述确定模块确定的所述目标解码方式是否为所述视频编码标准技术对应的解码方式;
若所述目标解码方式为所述视频编码标准技术对应的解码方式,则将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
本发明实施例第五方面提供了一种视频数据的编解码系统,包括:上述第三方面提供的编码装置和上述第四方面提供的解码装置。
本发明实施例可根据视频数据的待处理帧的指定信息,确定是否采用多种编码方式对待处理帧进行处理,进而可根据上述第一编码方式和第二编码方式对待处理帧进行预处理的预处理结果确定选择具体哪一种编码方式为目标编码方式对待处理帧进行编码。本发明实施例可从多种编码方式中选择具体一种编码方式对待处理帧进行编码处理,提高了视频数据的待处理帧的视频处理质量,增强了视频数据处理的用户体验。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是现有技术中解码端自适应进行视频帧处理的一示意图;
图2是本发明实施例提供的视频数据的编码方法的第一实施例流程示意图;
图3是本发明实施例提供的视频数据的编码方法的第二实施例流程示意图;
图4是本发明实施例提供的视频数据的编码方法的第三实施例流程示意图;
图5是本发明实施例提供的视频数据的解码方法的实施例流程示意图;
图6是本发明实施例提供的视频数据的编码装置的第一实施例结构示意图;
图7是本发明实施例提供的视频数据的编码装置的第二实施例结构示意图;
图8是本发明实施例提供的视频数据的编码装置的第三实施例结构示意图;
图9是本发明实施例提供的视频数据的解码装置的实施例的一结构示意图;
图10是本发明实施例提供的视频数据的解码装置的实施例的另一结构示意图;
图11是本发明实施例提供的视频数据的编解码系统的实施例的结构示意图。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是 全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
本发明实施例中所描述的视频数据的编码方法和解码方法可根据视频数据待处理帧的帧率,或者时间复杂度信息,或者视频数据中图像复杂度等空间复杂度信息确定对视频数据进行编码所使用的编码方式,可提高视频数据的编码质量和解码质量。下面将结合图2-图11,分别从编码端和解码端对本发明实施例提供的视频数据的编码方法和解码方法及装置进行具体描述。
参见图2,是本发明实施例提供的视频数据的编码方法的第一实施例流程示意图。本发明实施例中所描述的视频数据的编码方法,包括步骤:
S101,获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种。
在一些可行的实施方式中,编码端对视频数据的待处理帧进行编码之前,可首先对待处理帧进行解析,获取待处理帧的指定信息,进而可根据待处理帧的指定信息确定采用什么样的编码方式对待处理帧进行编码。具体的,编码端可预先设定启动多种编码方式对待处理帧进行编码处理时,上述待处理帧的指定信息所需满足的条件,进而可在获取得到待处理帧的指定信息之后,根据待处理帧的指定信息判断上述指定信息是否预设条件。若上述获取得到的待处理帧的指定信息满足预设条件,则可启动多种编码方式对待处理帧进行预处理。若上述获取得到的待处理帧的指定信息不满足预设条件,则可按照一般编码方式对待处理视频数据进行编码。具体的,上述一般编码方式具体可为现有的视频编解码标准所规定的编码方式,例如H.264标准中规定的混合架构编码方式,在此不做限制。
具体实现中,本发明实施例中所描述的待处理帧的指定信息可包括:帧率信息、时间复杂度信息以及空间复杂度信息等。其中,上述待处理帧的时间复杂度信息可包括:待处理帧的运动矢量的长度信息,或者待处理帧的参考帧的索引信息。即,在本发明实施例中,编码端可根据待处理帧的运动矢量的长度信息,或者参考帧的索引信息等反映时间复杂度的物理量来判断待处理帧中包含的运动画面的运动剧烈程度。上述反映时间复杂度的物理量仅是举例,而非 穷举,包含但不限于上述信息。上述待处理帧的空间复杂度信息可包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息等。即,在本发明实施例中,编码端可根据待处理帧中包含的图像色度的变化范围、图像纹理或者图像编码模式等反映空间复杂度的物理量来判断待处理帧中包含的图像内容。
S102,若所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,则按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,其中,所述第一编码方式和所述第二编码方式是不同的编码方式。
在一些可行的实施方式中,由于视频数据的帧率不同,视频数据的编码需求也将不同,为了保证视频数据的编码质量,编码端可根据视频数据的帧率确定具体采用的编码方式。若上述待处理帧的指定信息为帧率信息,则编码端可在上述待处理帧的帧率信息指示的帧率大于预设的帧率阈值时,确定待处理帧的指定信息符合启动多种编码方式处理待处理帧的预设条件。即,在本发明实施例中,编码端可根据待处理帧的帧率确定是否直接采用视频编解码标准所规定的编码方式,或者是否需要采用多种编码方式进行同时处理以从多种编码方式中筛选得到目标编码方式。例如,当编码端判断得到待处理视频数据的帧率大于60帧/秒时,可使用多种编码方式对待处理视频数据进行处理,进而从中选择处理结果更加满足需求的编码方式作为待处理视频数据的目标编码方式,否则直接使用一般的编码方式,即视频编解码标准中所规定的编码方式,在此不再赘述。
在一些可行的实施方式中,若上述待处理帧的指定信息为时间复杂度信息,则编码端可在上述待处理帧的时间复杂度信息所指示的时间复杂度大于预设的时间复杂度阈值时,确定待处理帧的指定信息符合启动多种编码方式处理待处理帧的预设条件。例如,当待处理视频数据的平均运动矢量的长度大于5时,则可判断待处理帧的时间复杂度信息所指示的时间复杂度大于预设的时间复杂度阈值。进一步的,可启动多种编码方式对待处理视频数据进行同时处理,以从中选择目标编码方式。若待处理视频数据的时间复杂度不满足预设条件,则直接使用一般的编码方式对待处理视频数据进行编码,在此不再赘述。
在一些可行的实施方式中,若上述待处理帧的指定信息为空间复杂度信息, 则编码端可在上述待处理帧的空间复杂度信息所指示的空间复杂度大于预设空间复杂度阈值时,确定待处理帧的指定信息符合启动多种编码方式处理待处理帧的预设条件。例如,当待处理帧中具体某一个纹理强度的纹理数超过40%时,编码端可判断待处理帧的图像纹理大于预设空间复杂度阈值,进而可启动多种编码方式对待处理数据进行编码,否则使用一般的编码方式进行处理。本发明实施例中所描述的一般的编码方式具体可为现阶段视频编解码标准中规定的编码方式,一般指包括:预测、变换、量化和熵编码等步骤的混合架构编码方式,也可为其它的时域、频域的预测和变换等编码方式,在此不做限制。
在一些可行的实施方式中,编码端确定上述待处理帧的指定信息符合启动多种编码方式处理待处理帧预设条件之后,则可启动第一编码方式和第二编码方式,进而可按照上述第一编码方式和第二编码方式对待处理帧进行处理。具体的,编码端可按照上述第一编码方式和第二编码方式分别对待处理帧进行预处理,以根据上述预处理的处理结果确定选择具体哪一种编码方式对待处理帧进行编码。具体实现中,编码端对待处理帧进行预处理的目的是为了确定具体哪一种编码方式对待处理方式的编码效果会更好一些,而非直接采用上述第一编码方式和第二编码方式对待处理帧进行编码,故此,编码端对待处理帧进行预处理时,可先将待处理视频帧进行简化处理(例如压缩处理等),得到较小数据大小的帧数据,再对压缩后的帧数据进行处理,进而可通过处理结果的比对确定目标编码方式。具体实现中,上述压缩处理进行预处理方式中的一种实现方式,具体处理方式可根据使用应用场景限定,在此不再赘述。
具体实现中,本发明实施例中所描述的第一编码方式具体可为视频编解码标准所规定的视频编码标准技术,或者帧速率上转换技术,或者分辨率缩放技术等。其中,上述视频编解码标准所规定的视频编码标准技术可包括H.263、H.264以及H.265等视频编码标准中所规定的编码技术,在此不做限制。上述编码方式仅是举例,而非穷举,包含但不限于上述编码方式。此外,本发明实施例中所描述的第二编码方式为不同与第一编码方式的编码技术,具体可包括不同于第一编码方式的视频编解码标准所规定的视频编码标准技术,或者不同于第一编码方式的帧速率上转换技术,或者不同于第一编码方式的分辨率缩放技术等。上述编码方式仅是举例,而非穷举,包含但不限于上述编码方式。即, 第一编码方式可为上述多种编码技术中的任一种,第二编码方式也可为上述多种编码技术中任一种,但是第二编码方式选定的编码技术与第一编码方式的编码技术不同。例如,当第一编码方式为帧速率上转换技术A时,第二编码方式只能为视频编解码标准所规定的视频编码标准技术中的任一种,或者任一种分辨率缩放技术,或者是帧速率上转换技术B。即第一编码方式为帧速率上转换技术A,第二编码方式则不为帧速率上转换技术A。具体实现中,上述第一编码方式和第二编码方式的选择可根据时间应用场景需求确定,在此不做限制。
S103,根据所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,并根据所述目标编码方式对所述待处理帧进行编码。
在一些可行的实施方式中,编码端使用第一编码方式和第二编码方式等多种编码方式同时对待处理帧进行预处理之后,可根据上述多种编码方式的预处理结果从上述多种编码方式中选择目标编码方式。具体的,编码端可使用第一编码方式和第二编码方式对待处理帧进行预处理,进而可将第一编码方式对待处理帧进行预处理得到的视频数据的视频质量或者第一编码方式对待处理帧进行预处理过程中所耗费的编码数据量大小,与第二编码方式对待处理帧进行预处理得到的视频数据的视频质量,或者第二编码方式对待处理帧进行预处理过程中所耗费的编码数据量大小等信息进行比对,根据比对结果从上述第一编码方式和第二编码方式中选择满足具体应用场景需求的编码方式作为对待处理帧进行具体编码处理的目标编码方式。
在一些可行的实施方式中,编码端选择了目标编码方式之后,可使用目标编码方式对待处理帧进行编码。此外,编码端选择了目标编码方式之后,可首先将目标编码方式告知给解码端,解码端可根据编码端传送的信息确定编码端对待处理帧进行编码时所采用的编码方式,进而可使用相对应的解码方式进行解码,无需自行判断,减少了编码方式的误判率。具体实现中,编码端可通过多种发送方式将目标编码方式告知解码端,其中,不同的发送方式对应着不同的标识信息,编码端可通过不同的发送方式将目标编码方式的标识信息发送给解码端。具体的,编码端可选择发送索引信息的发送方式,编码端可采用索引 的方式对目标编码方式进行标记,对目标编码方式的索引信息进行编码以得到目标编码方式的标识信息,进而可将目标编码方式的标识信息以码流的形式传递给解码端。解码端可通过解析码流信息,根据码流信息中携带的索引信息确定目标编码方式,进而可根据目标编码方式对应的解码方式对待处理帧进行解码处理。编码端对目标编码方式的索引信息进行编码时,可以以等概率的方式编码索引信息,例如,若有两种编码方式,则第一编码方式编码为0,第二编码方式编码为1。具体的,编码端也可以以实际统计特性,按照不等概率的方式编码索引信息。例如,若有三种编码方式,则第一编码方式可编码为0,第二编码方式可编码为10,第三编码方式可编码为110。进一步的,编码端也可采用等概率和不等概率两种方式混合编码的方式编码索引信息。例如,若有三种编码方式,第一编码方式可编码为0,第二编码方式可编码为10,第三编码方式可编码为11。具体实现中,编码端可根据使用应用需求确定索引信息的编码方式,在此不做限制。
此外,编码端也可采用表征时域信息的物理量对目标编码方式进行标记以得到目标编码方式的标识信息,并将目标编码方式的标识信息作为控制信息传递给解码端。解码端可根据编码端传递的控制信息确定目标编码方式,进而可根据目标编码方式对应的解码方式对待处理帧进行解码处理。上述目标编码方式的传递方式仅是举例,而非穷举,包含但不限于上述实现方式,在此不做限制。其中,上述表征时域信息的物理量可包括:图像显示信息或者时间戳等,在此不做限制。例如,“图像显示信息”是表征每一帧图像在解码端的显示顺序的物理量,作为一种控制信息会被传递到解码端。编码端和解码端可规定当某一个图像显示位置对应的“图像显示信息”存在时,使用第一编码方式对待处理帧进行处理,否则,使用第二编码方式对待处理帧进行处理。又或者,“时间戳”是在传输视频信息时,在传输系统层加入的控制信息,表征在解码端在哪一个时间点来播放相对应的视频信息。编码端和解码端可以规定当某一个视频片断的时间戳信息间隔符号规定时,使用第一编码方式进行编码,否则,当上述时间戳信息间隔的稀疏度超过预设阈值时,使用第二编码方式进行编码。编码端可将图像显示信息或者时间戳等信息作为目标编码方式的标识信息,通过图像显示信息或者时间戳等信息将目标编码方式传递给解码端。
在本发明实施例中编码端可根据视频数据的待处理帧的帧率信息或者时间复杂度信息或者空间复杂度信息等待处理帧的指定信息判断是否采用多种编码方式对待处理视频中的待处理帧进行处理,或者按照视频编解码标准所规定的一般编码方式对待处理帧进行处理。若待处理视频数据的帧率或者时间复杂度等指定信息符合启动多种编码方式进行处理的预设条件,则可采用第一编码方式和第二编码方式分别对视频数据中的待处理帧进行预处理,进而可根据上述第一编码方式和第二编码方式的预处理结果确定选择具体哪一种编码方式为待处理帧进行编码。编码端选择目标编码方式之后,可按照指定信息发送方式将目标编码方式告知给解码端,以供解码端根据目标编码方式对应的解码方式对待处理视频数据进行解码处理。本发明实施例可从多种编码方式中选择具体一种编码方式对待处理帧进行编码处理,提高了视频数据的待处理帧的视频处理质量,增强了视频数据处理的用户体验。
参见图3,是本发明实施例提供的视频数据的编码方法的第二实施例流程示意图。本发明实施例中所描述的视频数据的编码方法,包括步骤:
S201,获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种。
在一些可行的实施方式中,本发明实施例中所描述的编码端获取待处理帧的指定信息的具体实现过程可参见上述第一实施例中的步骤S101,在此不再赘述。
S202,若所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,则按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得满足指定视频质量指标的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理所耗费的第一编码数据量大小。
S203,按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得满足所述指定视频质量指标的视频数据,其中,所述第二编码方式的预处理结果包括所述第二视频质量处理所耗费的第二编码数据量大小。
在一些可行的实施方式中,本发明实施例中所描述的编码端按照第一编码方式和第二编码方式对待处理帧进行预处理的具体实现过程可参见上述第一 实施例中的步骤S102,在此不再赘述。
进一步的,在一些可行的实施方式中,本发明实施例中所描述的算法启动方式,即确定是否使用多种编码方式对待处理帧进行处理的启动方式,可以是每一帧都进行单独判断、确定是否启动,即可以是帧级的判断方式。进一步的,编码端确定是否使用多种编码方式对待处理视频数据进行处理的启动方式,还可以是图像组级的判断方式。例如,在编码一个图像组时,可将一个图像组中包含的多帧数据集中进行一次判断,使得该图像组中的多帧数据都使用两种编码方式进行处理,再从中选择目标编码方式,或者都使用三种编码方式进行处理,再选择目标编码方式。进一步的,还可以是序列级的判断方式,即一个序列的帧数据(由多个图像组构成)一次判断,确定是否启动多种编码方式进行处理。或者是条带级的判断方式,或者片级的判断方式,其中,上述条带和片是构成帧的两种方式。即,编码端可按照条带的方式或者片的方式对帧数据进行拆分,将一帧数据拆分为多个条带数据或者多片数据,进而可按照条带级的方式进行判断,确定条带数据是否启动多种编码方式进行处理,或者片级数据是否启动多种编码方式进行处理等,在此不做限制。
进一步的,在一些可行的实施方式中,本发明实施例中所描述的第一编码方式和第二编码方式可为不同的两种编码方式,也可为不同的三种或者四种等多种编码方式,在此不做限制。本发明将以第一编码方式和第二编码方式为两种不同的编码方式这种情况为例,进行具体说明。
在一些可行的实施方式中,编码端可按照第一编码方式对待处理帧进行第一视频质量处理,以获得满足指定视频质量指标的视频数据。进一步的,编码端还可确定按照第一编码方式对待处理帧进行第一视频质量处理所耗费的编码数据量大小(即第一编码数据量大小),其中,上述第一视频质量处理所耗费的第一编码数据量大小即为第一编码方式对待处理帧进行预处理的预处理结果。此外,编码端还可按照第二编码方式对待处理帧进行第二视频质量处理,以获得满足上述指定视频质量指标的视频数据。其中,上述第二编码方式对待处理帧进行预处理的预处理结果包括第二视频质量处理所耗费的第二编码数据量大小。具体实现中,上述指定视频质量指标可包括主观质量指标或者客观质量指标。其中,上述客观质量指标可包括:峰值信噪比或者结构相似度等。 上述视频客观质量的质量指标仅是举例,而非穷举,包含但不限于上述质量指标。上述主观质量指标可包括:主观评估评分、心理学模型评分、最小可见误差评分、时空域人眼掩饰效应或者生理特点的评分等。上述视频主观质量的质量指标仅是举例,而非穷举,包含但不限于上述质量指标。
S204,判断所述第一编码数据量大小是否小于所述第二编码数据量大小,若判断结果为是,则执行步骤S205,否则执行步骤S206。
S205,将所述第一编码方式选择为目标编码方式。
S206,将所述第二编码方式选择为目标编码方式。
在一些可行的实施方式中,编码端按照第一编码方式和第二编码方式对待处理帧进行预处理之后,则可将第一编码方式的预处理结果中包括第一编码数据量大小,与第二编码方式的预处理结果中包括的第二编码数据量大小进行比对,根据比对结果从第一编码方式和第二编码方式中选择目标编码方式。具体的,编码端可判断第一编码数据量大小是否小于第二编码数据量大小,若判断结果为是,则可确定相同处理目标的情况下,第一编码方式对待处理帧进行处理所耗费的编码数据量较小,即第一编码方式的处理性能优于第二编码方式,进而可将第一编码方式选择为目标编码方式。若第一编码数据量大小大于第二编码数据量大小,则可将第二编码方式的处理性能优于第一编码方式,进而可将第二编码方式确定为目标编码方式。
S207,根据所述目标编码方式对所述待处理帧进行编码。
具体实现中,编码端使用目标编码方式对待处理帧进行编码的具体实现过程可参见第一实施例中的步骤S103所描述的实现方式,在此不再赘述。
S208,判断所述目标编码方式是否为视频编码标准技术,若判断结果为是,则执行步骤S209。
S209,将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
在一些可行的实施方式中,编码端确定了目标编码方式,使用目标编码方式对待处理帧进行编码之后,还可根据目标编码方式确定是否将待处理帧接入下一个待处理帧对应的参考帧列表中。即,编码端对待处理帧(例如第N帧,N为自然数)进行编码时,可在对待处理帧之前的已处理帧(例如第N-1帧) 进行编码完成之后生成待处理帧(第N帧)的参考帧列表。编码端对第N-1帧的帧数据进行处理之后,可根据第N-1帧的编码方式确定第N-1帧是否可以作为其下一帧(即第N帧)的帧数据编码的参考帧。若是,则可将上述第N-1帧加入到参考帧列表中,即,将第N-1帧加入到其编码的参考帧列表中,生成一个新的参考帧列表,将该参考帧列表作为第一帧(第N帧)编码的参考帧列表。编码端对第N帧的帧数据进行处理之后,可根据第N帧的编码方式确定第N帧是否可以作为其下一帧(即第N+1帧)的帧数据编码的参考帧。若是,则可将上述第N帧加入到参考帧列表中,即,将第N帧加入到其编码的参考帧列表中,生成一个新的参考帧列表,将该参考帧列表作为第一帧(第N+1帧)编码的参考帧列表。
在一些可行的实施方式中,若上述目标编码方式为视频编解码标准所规定的视频编码标准技术,则可将上述待处理帧加入到参考帧列表中,生成下一个待处理帧对应的参考帧列表。若上述目标编码方式不是视频编解码标准所规定的视频编码标准技术,则不将待处理帧接入到参考帧列表中。具体实现中,若上述目标编码方式为视频编解码标准所规定的视频编码标准技术,则编码端可通过发送索引信息的方式将目标编码方式的选择结果传递给解码端,或者通过发送图像显示信息等控制信息的方式将目标编码方式的选择结果传递给解码端。解码端接收到上述索引信息或者控制信息之后,则可对上述索引信息或者控制信息进行解析,确定目标编码方式。若上述目标编码方式为帧速率上转换的编码方式,编码端确定了对待处理帧进行编码的编码方式之后,无需发送任何当前帧的视频数据信息到解码端。解码端若未从编码端接收到任何信息,则可默认目标编码方式为帧速率上转换的编码方式。
具体实现中,编码端对每一帧的视频数据都是依照上述实现方式,故此,编码端对待处理帧进行处理时,可接收到待处理帧之前的已处理帧的目标编码方式,进而可根据待处理帧的目标编码方式确定已处理帧是否可为当前待处理帧的参考帧。具体的,当编码端发送目标编码方式给解码端时采用的是发送索引信息的方法,则编码端可对采用视频编解码标准所规定的编码方式的处理帧赋予“图像显示信息”,并将具有“图像显示信息”的已处理帧按照靠近待处理帧的远近位置原则,生成待处理帧的参考帧列表。例如,编码端可获取待处 理帧之前的5个视频帧,假设为F1到F5,其中,F1、F3和F4使用的编码方式为视频编解码标准所规定的编码方式,F2和F5使用的是帧速率上转换的编码方式,则编码端可获取到F1到F5各个视频帧中携带的“图像显示信息”的情况。具体的,编码端可根据上述各个视频帧采用的编码方式确定各个视频帧的“图像显示信息”为0、无、1、2、无,此时,编码端可确定待处理帧的参考帧为F1、F3和F4,进而可根据各个参考帧和待处理帧的位置关系确定待处理帧的参考帧列表为F4、F3、F1。
在一些可行的实施方式中,若编码端传递目标编码方式给解码端采用的是发送控制信息的方法,则编码端可将具有“图像显示信息”的已处理帧按照靠近待处理帧的远近位置原则,生成参考帧列表,进而还可将不连续的“图像显示信息”映射为连续的参考索引。例如,编码端可获取待处理帧之前的5个视频帧,假设为F1到F5,其中,F1、F3和F4使用的编码方式为视频编解码标准所规定的编码方式,F2和F5使用的是帧速率上转换的编码方式,则编码端可获取到F1到F5各个视频帧中携带的“图像显示信息”的情况为0、无、2、3、无.进一步的,编码端可确定待处理帧的参考帧为F1、F3和F4,进而可根据各个参考帧和待处理帧的位置关系确定待处理帧的参考帧列表为F4、F3、F1。其中,上述参考帧F4、F3、F1的参考索引可有(3,2,0)映射为(3,2,1)。
在本发明实施例中编码端可根据待处理视频数据的帧率或者时间复杂度等信息判断是否采用多种编码方式对待处理视频中的待处理帧进行处理,或者按照视频编解码标准所规定的一般编码方式对待处理帧进行处理。若待处理视频数据的帧率或者时间复杂度等指定信息满足预设条件,则可采用第一编码方式和第二编码方式分别对待处理视频数据中的待处理帧进行预处理,进而可根据上述第一编码方式和第二编码方式的预处理结果确定选择具体哪一种编码方式为待处理帧进行编码。编码端选择目标编码方式之后,可按照指定信息发送方式将目标编码方式告知给解码端,以供解码端根据目标编码方式对应的解码方式对待处理视频数据进行解码处理,解码端无需自行判断,可提高解码端对编码方式的判断的准确性。编码端还可根据预先生成的待处理帧对应的参考帧列表,根据目标编码方式对待处理帧进行编码,提高了待处理视频的编码视频 质量,增强了视频数据处理的用户体验。
参见图4,是本发明实施例提供的视频数据的编码方法的第三实施例流程示意图。本发明实施例中所描述的视频数据的编码方法,包括步骤:
S301,获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种。
在一些可行的实施方式中,本发明实施例中所描述的编码端获取待处理帧的指定信息的具体实现过程可参见上述第一实施例中的步骤S101,在此不再赘述。
S302,若所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得耗费指定编码数据量大小的情况下的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理得到的所述视频数据的第一质量指标。
S303,按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得耗费所述指定编码数据量大小的情况下的视频数据,其中,所述第二编码方式的预处理结果包括所述第二视频质量处理得到的所述视频数据的第二质量指标。
在一些可行的实施方式中,本发明实施例中所描述的编码端按照第一编码方式和第二编码方式对待处理帧进行预处理的具体实现过程可参见上述第一实施例中的步骤S102以及第二实施例中的步骤S202和S203,在此不再赘述。
进一步的,编码端可按照第一编码方式对所述待处理帧进行第一视频质量处理,以获得耗费指定编码数据量大小的情况下的视频数据。进一步的,编码端还可确定按照第一编码方式对待处理帧进行第一视频质量处理之后所得到的视频数据的质量指标(即第一质量指标)。其中,上述第一视频质量处理得到的视频数据的第一质量指标即为第一编码方式对待处理帧进行预处理的预处理结果。此外,编码端还可按照第二编码方式对待处理帧进行第二视频质量处理,以获得耗费上述指定编码数据量大小的情况下的视频数据,其中,第二编码方式的预处理结果包括第二视频质量处理得到的所述视频数据的第二质量指标。其中,上述质量指标可包括客观质量指标和主观质量指标,具体可参 见上述第二实施例,在此不再赘述。
S304,判断所述第一质量指标是否高于所述第二质量指标,若判断结果为是,则执行步骤S305,否则,执行步骤S306。
S305,将所述第一编码方式选择为目标编码方式。
S306,将所述第二编码方式选择为目标编码方式。
在一些可行的实施方式中,编码端按照第一编码方式和第二编码方式对待处理帧进行预处理之后,则可将第一编码方式的预处理结果中包括第一质量指标,与第二编码方式的预处理结果中包括的第二质量指标进行比对,根据比对结果从第一编码方式和第二编码方式中选择目标编码方式。具体的,编码端可判断第一质量指标是否高于第二质量指标,若判断结果为是,则可确定耗费相同编码数据量大小的情况下,第一编码方式对待处理帧进行处理得到的视频质量较高,即第一编码方式的处理性能优于第二编码方式,进而可将第一编码方式选择为目标编码方式。若第一质量指标低于第二质量指标,则可将第二编码方式的处理性能优于第一编码方式,进而可将第二编码方式确定为目标编码方式。
在一些可行的实施方式中,编码端从第一编码方式和第二编码方式中选择目标编码方式时,还可根据第一编码数据量大小和第二编码数据量大小,以及第一质量指标和第二质量指标进行综合判断。编码端可从第一编码方式和第二编码方式的预处理结果中,获取上述第一质量指标和第二质量指标,以及第一编码数据量大小和第二编码数据量大小,进而可确定第一质量指标和第一编码数据量大小的比值,以及,第二质量指标和第二编码数据量大小的比值。当编码端判断得知第一质量指标和第一编码数据量大小的比值高于第二质量指标和第二编码数据量大小的比值时,则可将第一编码方式确定为待处理帧的目标编码方式,否则,则将第二编码方式确定为待处理帧的目标编码方式。
进一步的,编码端从第一编码方式和第二编码方式中选择目标编码方式时,还可根据待处理帧的具体应用场景进行选择。若待处理帧为指定应用场景的视频数据,则可强制采用保证视频质量的编码方式进行编码,即可指定具体某一个编码方式为指定应用场景的视频数据的编码方式。具体的,编码端可判断上述待处理帧是否为监控视频数据或者特写视频数据中的视频帧。若上述待处理 帧为监控视频数据或者特写视频数据中的视频帧,则可使用更高质量的编码方式对上述待处理帧进行处理。例如,对于监控视频,可根据第一编码方式的预处理结果中包含的第一质量指标和第二编码方式的预处理结果中包含的第二质量指标选择目标编码方式。若第一质量指标高于第二质量指标,则选择第一编码方式作为监控视频的目标编码方式,否则,选择第二编码方式作为监控视频的目标编码方式。
S307,根据所述目标编码方式对所述待处理帧进行编码。
具体实现中,编码端使用目标编码方式对待处理帧进行编码的具体实现过程可参见第一实施例中的步骤S103所描述的实现方式,在此不再赘述。
S308,判断所述目标编码方式是否为视频编码标准技术,若判断结果为是,则执行步骤S309。
S309,将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
具体实现中,上述步骤S308和S309的具体实现过程可参见第二实施例中的步骤S208和S209所描述的实现方式,在此不再赘述。
在本发明实施例中编码端可根据待处理视频数据的帧率或者时间复杂度、空间复杂度等信息判断是否采用多种编码方式对待处理视频中的待处理帧进行处理,或者按照视频编解码标准所规定的一般编码方式对待处理帧进行处理。若待处理视频数据的帧率或者时间复杂度等指定信息满足预设条件,则可采用第一编码方式和第二编码方式分别对待处理视频数据中的待处理帧进行预处理,进而可根据上述第一编码方式和第二编码方式的预处理结果确定选择具体哪一种编码方式为待处理帧进行编码。编码端选择目标编码方式之后,可按照指定信息发送方式将目标编码方式告知给解码端,以供解码端根据目标编码方式对应的解码方式对待处理视频数据进行解码处理,解码端无需自行判断,可提高解码端对编码方式的判断的准确性。编码端还可根据预先生成的待处理帧对应的参考帧列表,根据目标编码方式对待处理帧进行编码,提高了待处理视频的编码视频质量,增强了视频数据处理的用户体验。
参见图5,是本发明实施例提供的视频数据的解码方法的第一实施例流程 示意图。本发明实施例中所描述的视频数据的解码方法包括步骤:
S401,获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种。
在一些可行的实施方式中,本发明实施例所描述的解码端的实现过程和上述编码端的实现过程互为逆过程,即解码端所描述的实现过程是上述编码端的实现过程的逆过程。本发明实施例中所描述的视频数据的待处理帧的指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息等。其中,上述待处理视频数据的时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;上述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息等。具体实现中,本发明实施例中所描述的解码端获取待处理帧的指定信息,判断上述指定信息是否满足启动目标解码方式处理待处理帧的预设条件的具体实现过程可参见上述编码端实施例所描述的实现方式,在此不再赘述。
S402,若所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件,则根据所述待处理帧的码流信息中携带的标识信息,确定所述待处理帧的目标解码方式。
在一些可行的实施方式中,当解码端判断得知上述指定信息满足预设条件时,则根据待处理帧的码流信息中携带的标识信息确定编码端对待处理帧进行编码所使用的目标编码方式,进而可根据解码端与编码端预先协议的方式确定待处理帧的目标解码方式。具体的,解码端可接收编码端传送的码流信息,对码流信息进行解码,根据码流信息中携带的信息确定编码端所采用的目标编码方式。当解码端接收到的标识信息为编码方式的索引信息时,解码端可根据索引信息的编码方式结合码流信息中携带的编码信息确定目标编码方式,进而可根据编码端和解码端预先协议确定的编码方式和解码方式的对应关系,确定目标编码方式对应的目标解码方式。当解码端接收到的标识信息为编码方式对应的图像显示信息等控制信息时,解码端可根据规定的图像显示信息赋予方式结合码流信息中携带的图像显示信息确定目标编码方式。当解码端对待处理帧的码流信息进行解码,获取得到码流信息中携带的标识信息中包含图像显示信息或者时间戳,则可确定目标编码方式为视频编码标准技术,进而可按照预设的 编码方式和解码方式的对应关系确定目标编码方式对应的目标解码方式。若解码端对待处理帧的码流信息进行解码,获取得到码流信息中携带的标识信息中中没有图像显示信息或者时间戳,则确定目标编码方式为所述帧速率上转换技术或者所述分辨率缩放技术,进而可按照预设的编码方式和解码方式的对应关系,确定所述帧速率上转换技术对应的目标解码方式,或者所述分辨率缩放技术对应的目标解码方式。
例如,解码端可与编码端约定目标编码方式的索引信息的编码方式,比如,若有两种编码方式,可规定第一编码方式编码为0,第二编码方式编码为1,则解码端接收到码流信息之后,则可对码流信息进行解析,根据约定方式确定码流中携带的目标编码信息。或者,解码端可与编码端约定目标编码方式的控制信息与图像显示信息的对应关系,比如,若有两种编码方式,则可规定第一编码方式可赋予“图像显示信息”,第二编码方式不赋予“图像显示信息”。解码端接收到控制信息之后,若上述控制信息中包含“图像显示信息”则可确定目标编码方式为第一编码方式。若上述控制信息中不包含“图像显示信息”,则可确定目标编码方式为第二编码方式。具体实现中上述确定目标编码方式的方式仅是举例,具体可参见上述编码端所描述的实现方式,在此不做限制。
在一些可行的实施方式中,若上述指定信息不满足预设条件,解码端则可按照一般解码方式对待处理视频数据进行解码处理。其中,上述一般解码方式为视频编解码标准所规定的混合结构解码方式,上述混合架构解码方式的具体实现方式可参见视频数据编解码标准中规定的执行方式,在此不再赘述。
S403,根据所述目标解码方式确定对所述待处理帧进行解码的辅助信息,根据所述目标解码方式和所述辅助信息解码所述待处理帧。
在一些可行的实施方式中,解码端确定了编码端所采用的目标编码方式之后,则可根据目标编码方式对应的目标解码方式对待处理视频数据中的待处理帧进行解码。具体的,当解码端对待处理帧进行解码时,可根据其与编码端预先协议的各个编码方式对应的信息确定方式,确定上述编码端采用的目标编码方式对应的指定信息,进而可从待处理视频数据中获取上述指定信息,根据上述指定信息对待处理视频数据进行解码,得到视频数据。具体实现中,若上述目标解码方式为视频编码标准技术对应的解码方式时,解码端则可获取对待处 理帧进行解码的辅助信息,其中,上述辅助信息为待处理帧对应的残差数据信息和控制头信息。当目标解码方式为帧速率上转换技术对应的解码方式时,解码端则无需获取对待处理帧进行处理的辅助信息,即,对所述待处理帧进行解码的辅助信息为空。当目标解码方式为分辨率缩放技术对应的解码方式时,获取对待处理帧进行解码的辅助信息,其中,上述辅助信息为待处理帧进行缩放处理对应的残差数据信息和控制头信息。例如,若编码端对待处理帧进行编码采用的是视频编解码标准所规定的视频编码标准技术,则解码端确定上述目标编码方式对应的解码方式之后需要获取完整的残差数据信息和控制头信息对待处理视频进行解码。若编码端对待处理帧进行编码采用的是帧速率转换技术,则解码端不需要获取任何数据信息,只需要按照帧速率转换技术对应的解码方式进行解码即可。若编码端对待处理帧进行编码采用的是分辨率缩放技术,则解码端需要获取缩小后的残差数据信息和控制头信息对待处理视频进行解码。进一步的,编码端也可采用其他的编码方式,需要传递的信息还可包括:滤波系数信息或者修正信息等,在此不做限制。
在一些可行的实施方式中,解码端根据目标解码方式和获取到的辅助信息解码待处理帧,解码端还可根据待处理帧的解码方式确定待处理帧是否可作为下一个待处理帧的参考帧。具体的,解码端可判断目标解码方式是否为视频编码标准技术对应的解码方式,若目标解码方式为视频编码标准技术对应的解码方式,则将处理得到的待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。具体实现中,解码端生成待处理帧的参考帧列表的具体实现方式可参见编码端实施例所描述的实现方式,在此不再赘述。
在本发明实施例中,解码端可根据待处理视频数据确定启动视频编解码标准中规定的解码方式对待处理视频数据进行解码,还可根据编码端发送的标识信息确定编码端对待处理视频数据进行编码的目标解码方式,进而根据目标解码方式对待处理帧进行解码。解码端无需根据自适应准则自行确定解码方式,减少了待处理视频数据编码的编码方式的误判性,增强了待处理帧视频数据解码的准确性,提高了视频数据解码的质量。
参见图6,是本发明实施例提供的视频数据的编码装置的第一实施例结构 示意图。本发明实施例所描述的编码装置,包括:
获取模块10,用于获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种。
其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息中的至少一种。
预处理模块20,用于在所述获取模块获取的所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件时,按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,其中,所述第一编码方式和所述第二编码方式是不同的编码方式。
处理模块30,用于根据所述预处理模块处理的所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,并根据所述目标编码方式对所述待处理帧进行编码。
在一些可行的实施方式中,上述指定信息为帧率信息;
上述预处理模块20,具体用于:
判断所述帧率信息所指示的帧率是否大于预设的帧率阈值,若判断结果为是,则确定所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件。
在一些可行的实施方式中,上述指定信息为时间复杂度信息;
上述预处理模块20,具体用于:
判断所述时间复杂度信息所指示的时间复杂度是否大于预设的时间复杂度阈值,若判断结果为是,则确定所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件。
在一些可行的实施方式中,上述定信息为空间复杂度信息;
上述预处理模块20,具体用于:
判断所述空间复杂度信息所指示的空间复杂度是否大于预设空间复杂度阈值,若判断结果为是,则确定所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件。
具体实现中,本发明实施例中所描述的编码装置即为本发明实施例提供的视频数据的编码方法的执行主体,即为上述编码方法的实施例中所描述的编码端。本发明实施例中所描述的编码装置可通过其获取模块10、预处理模块20和处理模块30执行本发明实施例提供的视频数据的编码方法的第一实施例中所描述的实现方式,具体实现过程可参见上述视频数据的编码方法的第一实施例中各个步骤(步骤S101至S103)所描述的实现方式,在此不再赘述。
在本发明实施例中,编码装置可根据视频数据的待处理帧的帧率信息或者时间复杂度信息或者空间复杂度信息等待处理帧的指定信息判断是否采用多种编码方式对待处理视频中的待处理帧进行处理,或者按照视频编解码标准所规定的一般编码方式对待处理帧进行处理。若待处理视频数据的帧率或者时间复杂度等指定信息符合启动多种编码方式进行处理的预设条件,则可采用第一编码方式和第二编码方式分别对视频数据中的待处理帧进行预处理,进而可根据上述第一编码方式和第二编码方式的预处理结果确定选择具体哪一种编码方式为待处理帧进行编码。编码装置选择目标编码方式之后,可按照指定信息发送方式将目标编码方式告知给解码装置,以供解码装置根据目标编码方式对应的解码方式对待处理视频数据进行解码处理。本发明实施例所描述的编码装置可从多种编码方式中选择具体一种编码方式对待处理帧进行编码处理,提高了视频数据的待处理帧的视频处理质量,增强了视频数据处理的用户体验。
参见图7,是本发明实施例提供的视频数据的编码装置的第二实施例结构示意图。本发明实施例所描述的编码装置,包括:
获取模块10,用于获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种。
其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息中的至少一种。
具体实现中,上述获取模块10可执行上述编码装置的第一实施例中的获取模块10所执行的实现方式,具体实现过程可参见上述视频数据的编码方法的第一实施例的步骤S101所描述的实现方式,在此不再赘述。
预处理模块21,用于在所述获取模块获取的所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件时,按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,其中,所述第一编码方式和所述第二编码方式是不同的编码方式。
具体实现中,上述预处理模块21可执行上述编码装置的第一实施例中的预处理模块20所执行的实现方式,进一步的,还可执行如下操作:
在一些可行的实施方式中,上述预处理模块21,具体用于:
按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得满足指定视频质量指标的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理所耗费的第一编码数据量大小;
按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得满足所述指定视频质量指标的视频数据,其中,所述第二编码方式的预处理结果包括所述第二视频质量处理所耗费的第二编码数据量大小。
处理模块31,用于根据所述预处理模块处理的所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,并根据所述目标编码方式对所述待处理帧进行编码。
具体实现中,本发明实施例中所描述的处理模块31可执行上述编码装置的第一实施例中的处理模块30所执行的实现方式,进一步的,还可执行如下操作:
在一些可行的实施方式中,上述处理模块31,具体用于:
判断所述预处理模块处理得到的所述第一编码数据量大小是否小于所述第二编码数据量大小,若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
在一些可行的实施方式中,本发明实施例中所描述的编码装置还包括标记模块40,上述标记模块40用于:
采用索引的方式对所述目标编码方式进行标记,对所述目标编码方式的索引信息进行编码以得到所述目标编码方式的标识信息,并将所述标识信息以码流的形式传递给解码端;或者
采用表征时域信息的物理量对所述目标编码方式进行标记以得到所述目标编码方式的标识信息,并将所述目标编码方式的标识信息作为控制信息传递给解码端;
其中,所述表征时域信息的物理量包括:图像显示信息或者时间戳。
在一些可行的实施方式中,本发明实施例中所描述的编码装置还包括:
参考帧判断模块50,用于判断所述处理模块选择的所述目标编码方式是否为视频编码标准技术,若所述目标编码方式为所述视频编码标准技术,则将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
具体实现中,本发明实施例提供的编码装置具体可为本发明实施例提供的视频数据的编码方法的执行主体,即本发明实施例提供的视频数据的编码方法的实施例中所描述的编码端,具体实现中,编码装置可通过其内置的各个模块(包括获取模块10、预处理模块21、处理模块31、标记模块40和参考帧判断模块50)执行上述视频数据的编码方法的第一实施例和第二实施例中所描述的实现方式,具体实现过程可参见上述视频数据的编码方法的第一实施例和第二实施例中各个步骤所描述的实现方式,在此不再赘述。
在本发明实施例中编码装置可根据待处理视频数据的帧率或者时间复杂度等信息判断是否采用多种编码方式对待处理视频中的待处理帧进行处理,或者按照视频编解码标准所规定的一般编码方式对待处理帧进行处理。若待处理视频数据的帧率或者时间复杂度等指定信息满足预设条件,则可采用第一编码方式和第二编码方式分别对待处理视频数据中的待处理帧进行预处理,进而可根据上述第一编码方式和第二编码方式的预处理结果确定选择具体哪一种编码方式为待处理帧进行编码。编码装置选择目标编码方式之后,可按照指定信息发送方式将目标编码方式告知给解码装置,以供解码装置根据目标编码方式对应的解码方式对待处理视频数据进行解码处理,解码装置无需自行判断,可提高解码装置对编码方式的判断的准确性。编码装置还可根据预先生成的待处理帧对应的参考帧列表,根据目标编码方式对待处理帧进行编码,提高了待处理视频的编码视频质量,增强了视频数据处理的用户体验。
参见图8,是本发明实施例提供的视频数据的编码装置的第三实施例结构示意图。本发明实施例所描述的编码装置,包括:
获取模块10,用于获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种。
其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息中的至少一种。
具体实现中,上述获取模块10的具体实现过程可参见上述视频数据的编码方法的第一实施例的步骤S101所描述的实现方式,在此不再赘述。
预处理模块22,用于在所述获取模块获取的所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件时,按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,其中,所述第一编码方式和所述第二编码方式是不同的编码方式。
具体实现中,上述预处理模块22可执行上述编码装置的第一实施例中的预处理模块20以及上述编码装置的第二实施例中的预处理模块21所执行的实现方式,进一步的,还可执行如下操作:
在一些可行的实施方式中,上述预处理模块22,具体用于:
按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得耗费指定编码数据量大小的情况下的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理得到的所述视频数据的第一质量指标;
按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得耗费所述指定编码数据量大小的情况下的视频数据,其中,所述第二编码方式的预处理结果包括所述第二视频质量处理得到的所述视频数据的第二质量指标。
处理模块32,用于根据所述预处理模块处理的所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,并根据所述目标编码方式对所述待处理帧进行编码。
具体实现中,本发明实施例中所描述的处理模块32可执行上述编码装置的第一实施例中的处理模块30以及第二实施例中的处理模块31所执行的实现 方式,进一步的,还可执行如下操作:
在一些可行的实施方式中,上述处理模块32,具体用于:
判断所述预处理模块处理得到的所述第一质量指标是否高于所述第二质量指标,若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
在一些可行的实施方式中,上述处理模块32还可具体用于:
获取所述预处理模块处理的所述第一编码数据量大小和第二编码数据量大小,以及所述第一质量指标和所述第二质量指标;
判断所述第一质量指标与所述第一编码数据量大小的比值,是否高于所述第二质量指标与所述第二编码数据量大小的比值;
若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
在一些可行的实施方式中,上述处理模块32还可具体用于:
判断所述待处理帧是否为监控视频数据或者特写视频数据中的视频帧;
若判断结果为是,则获取所述预处理模块处理的所述第一质量指标和所述第二质量指标;
判断所述第一质量指标是否高于所述第二质量指标,若判断结果为是,则将所述第一编码方式选择为目标编码方式。
在一些可行的实施方式中,本发明实施例中所描述的编码装置还包括标记模块40,上述标记模块40用于:
采用索引的方式对所述目标编码方式进行标记,对所述目标编码方式的索引信息进行编码以得到所述目标编码方式的标识信息,并将所述标识信息以码流的形式传递给解码端;或者
采用表征时域信息的物理量对所述目标编码方式进行标记以得到所述目标编码方式的标识信息,并将所述目标编码方式的标识信息作为控制信息传递给解码端;
其中,所述表征时域信息的物理量包括:图像显示信息或者时间戳。
在一些可行的实施方式中,本发明实施例中所描述的编码装置还包括:
参考帧判断模块50,用于判断所述处理模块选择的所述目标编码方式是否 为视频编码标准技术,若所述目标编码方式为所述视频编码标准技术,则将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
具体实现中,本发明实施例提供的编码装置具体可为本发明实施例提供的视频数据的编码方法的执行主体,即本发明实施例提供的视频数据的编码方法的实施例中所描述的编码端,具体实现中,编码装置可通过其内置的各个模块(包括获取模块10、预处理模块22、处理模块32、标记模块40和参考帧判断模块50)执行上述视频数据的编码方法的第一实施例和第二实施例中所描述的实现方式,具体实现过程可参见上述视频数据的编码方法的第一实施例和第二实施例中各个步骤所描述的实现方式,在此不再赘述。
在本发明实施例中编码装置可根据待处理视频数据的帧率或者时间复杂度、空间复杂度等信息判断是否采用多种编码方式对待处理视频中的待处理帧进行处理,或者按照视频编解码标准所规定的一般编码方式对待处理帧进行处理。若待处理视频数据的帧率或者时间复杂度等指定信息满足预设条件,则可采用第一编码方式和第二编码方式分别对待处理视频数据中的待处理帧进行预处理,进而可根据上述第一编码方式和第二编码方式的预处理结果确定选择具体哪一种编码方式为待处理帧进行编码。编码装置选择目标编码方式之后,可按照指定信息发送方式将目标编码方式告知给解码装置,以供解码装置根据目标编码方式对应的解码方式对待处理视频数据进行解码处理,解码装置无需自行判断,可提高解码装置对编码方式的判断的准确性。编码装置还可根据预先生成的待处理帧对应的参考帧列表,根据目标编码方式对待处理帧进行编码,提高了待处理视频的编码视频质量,增强了视频数据处理的用户体验。
参见图9,是本发明实施例提供的视频数据的解码装置的实施例结构示意图。本发明实施例所描述的解码装置,包括:
获取模块60,用于获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种。
其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息 以及图像编码模式信息中的至少一种。
确定模块70,用于在所述获取模块获取的所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件时,根据所述待处理帧的码流信息中携带的标识信息,确定所述待处理帧的目标解码方式。
处理模块80,用于根据所述确定模块确定的所述目标解码方式确定对所述待处理帧进行解码的辅助信息,根据所述目标解码方式和所述辅助信息解码所述待处理帧。
在一些可行的实施方式中,上述指定信息为帧率信息;
上述确定模块70,具体用于:
判断所述帧率信息所指示的帧率是否大于预设的帧率阈值,若判断结果为是,则确定所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件。
在一些可行的实施方式中,上述指定信息为时间复杂度信息;
上述确定模块70,具体用于:
判断所述时间复杂度信息所指示的时间复杂度是否大于预设的时间复杂度阈值,若判断结果为是,则确定所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件。
在一些可行的实施方式中,上述指定信息为空间复杂度信息;
上述确定模块70,具体用于:
判断所述空间复杂度信息所指示的空间复杂度是否大于预设空间复杂度阈值,若判断结果为是,则确定所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件。
在一些可行的实施方式中,上述确定模块70具体用于:
对所述待处理帧的码流信息进行解码,获取所述码流信息中携带的用于标记目标编码方式的索引信息,根据所述索引信息确定所述目标编码方式;
按照预设的编码方式和解码方式的对应关系,结合所述目标编码方式确定所述待处理帧的目标解码方式。
在一些可行的实施方式中,上述确定模块70具体用于:
对所述待处理帧的码流信息进行解码,获取所述码流信息中携带的标识信 息是否包含图像显示信息或者时间戳;
若所述标识信息中包含图像显示信息或者时间戳,则确定所述目标编码方式为所述视频编码标准技术,并按照预设的编码方式和解码方式的对应关系,确定所述视频编码标准技术对应的目标解码方式;
若所述标识信息中没有图像显示信息或者时间戳,则确定所述目标编码方式为所述帧速率上转换技术或者所述分辨率缩放技术,并按照预设的编码方式和解码方式的对应关系,确定所述帧速率上转换技术对应的目标解码方式,或者所述分辨率缩放技术对应的目标解码方式。
在一些可行的实施方式中,上述处理模块80,具体用于:
当所述确定模块确定的所述目标解码方式为所述视频编码标准技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为所述待处理帧对应的残差数据信息和控制头信息;或者
当所述确定模块确定的所述目标解码方式为帧速率上转换技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为空;
当所述确定模块确定的所述目标解码方式为分辨率缩放技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为所述待处理帧进行缩放处理对应的残差数据信息和控制头信息。
在一些可行的实施方式中,本发明实施例中所描述的解码装置(如图10)还包括:
参考帧判断模块90,用于判断所述确定模块确定的所述目标解码方式是否为所述视频编码标准技术对应的解码方式;
若所述目标解码方式为所述视频编码标准技术对应的解码方式,则将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
具体实现中,本发明实施例提供的解码装置为本发明实施例提供的视频数据的解码方法的执行主体,即本发明实施例提供的视频数据的解码方法的实施例中所描述的解码端。解码装置可通过可获取模块、确定模块、处理模块和参考帧判断模块等执行本发明实施例提供的视频数据的解码方法的实施例中所描述的实现方式,具体实现过程可参见上述视频数据的解码方法的实施例,在 此不再赘述。
在本发明实施例中,解码装置可根据待处理视频数据确定启动视频编解码标准中规定的解码方式对待处理视频数据进行解码,还可根据编码装置发送的标识信息确定编码装置对待处理视频数据进行编码的目标解码方式,进而根据目标解码方式对待处理帧进行解码。解码装置无需根据自适应准则自行确定解码方式,减少了待处理视频数据编码的编码方式的误判性,增强了待处理帧视频数据解码的准确性,提高了视频数据解码的质量。
参见图11,是本发明实施例提供的视频数据的编解码系统的实施例结构示意图,包括:本发明实施例提供的编码装置1000和解码装置2000。
具体实现中,上述编码装置和解码装置的具体实现过程可参见上述各个实施例的各个步骤所描述的实现方式,在此不再赘述。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。
以上所揭露的仅为本发明较佳实施例而已,当然不能以此来限定本发明之权利范围,因此依本发明权利要求所作的等同变化,仍属本发明所涵盖的范围。

Claims (41)

  1. 一种视频数据的编码方法,其特征在于,包括:
    获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种;
    其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息中的至少一种;
    若所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,则按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,其中,所述第一编码方式和所述第二编码方式是不同的编码方式;
    根据所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,并根据所述目标编码方式对所述待处理帧进行编码。
  2. 如权利要求1所述的方法,其特征在于,所述指定信息为帧率信息;
    所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,包括:
    所述帧率信息所指示的帧率大于预设的帧率阈值。
  3. 如权利要求1所述的方法,其特征在于,所述指定信息为时间复杂度信息;
    所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,包括:
    所述时间复杂度信息所指示的时间复杂度大于预设的时间复杂度阈值。
  4. 如权利要求1所述的方法,其特征在于,所述指定信息为空间复杂度信息;
    所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件,包 括:
    所述空间复杂度信息所指示的空间复杂度大于预设空间复杂度阈值。
  5. 如权利要求1-4任一项所述的方法,其特征在于,所述按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,包括:
    按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得满足指定视频质量指标的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理所耗费的第一编码数据量大小;
    按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得满足所述指定视频质量指标的视频数据,其中,所述第二编码方式的预处理结果包括所述第二视频质量处理所耗费的第二编码数据量大小。
  6. 如权利要求5所述的方法,其特征在于,所述根据所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,包括:
    判断所述第一编码数据量大小是否小于所述第二编码数据量大小,若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
  7. 如权利要求1-4任一项所述的方法,其特征在于,所述按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,包括:
    按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得耗费指定编码数据量大小的情况下的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理得到的所述视频数据的第一质量指标;
    按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得耗费所述指定编码数据量大小的情况下的视频数据,其中,所述第二编码方式的预处理结果包括所述第二视频质量处理得到的所述视频数据的第二质量指标。
  8. 如权利要求7所述的方法,其特征在于,所述根据所述第一编码方式 的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,包括:
    判断所述第一质量指标是否高于所述第二质量指标,若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
  9. 如权利要求5和7所述的方法,其特征在于,所述根据所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,包括:
    获取所述第一编码数据量大小和第二编码数据量大小,以及所述第一质量指标和所述第二质量指标;
    判断所述第一质量指标与所述第一编码数据量大小的比值,是否高于所述第二质量指标与所述第二编码数据量大小的比值;
    若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
  10. 如权利要求7所述的方法,其特征在于,所述根据所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,包括:
    判断所述待处理帧是否为监控视频数据或者特写视频数据中的视频帧;
    若判断结果为是,则获取所述第一质量指标和所述第二质量指标;
    判断所述第一质量指标是否高于所述第二质量指标,若判断结果为是,则将所述第一编码方式选择为目标编码方式。
  11. 如权利要求1所述的方法,其特征在于,所述从所述第一编码方式和所述第二编码方式中选择目标编码方式之后,所述方法还包括:
    采用索引的方式对所述目标编码方式进行标记,对所述目标编码方式的索引信息进行编码以得到所述目标编码方式的标识信息,并将所述标识信息以码流的形式传递给解码端;或者
    采用表征时域信息的物理量对所述目标编码方式进行标记以得到所述目标编码方式的标识信息,并将所述目标编码方式的标识信息作为控制信息传递给解码端;
    其中,所述表征时域信息的物理量包括:图像显示信息或者时间戳。
  12. 如权利要求11所述的方法,其特征在于,所述根据所述目标编码方式对所述待处理帧进行编码之后,所述方法还包括:
    判断所述目标编码方式是否为视频编码标准技术;
    若所述目标编码方式为所述视频编码标准技术,则将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
  13. 一种视频数据的解码方法,其特征在于,包括:
    获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种;
    其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息中的至少一种;
    若所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件,则根据所述待处理帧的码流信息中携带的标识信息,确定所述待处理帧的目标解码方式;
    根据所述目标解码方式确定对所述待处理帧进行解码的辅助信息,根据所述目标解码方式和所述辅助信息解码所述待处理帧。
  14. 如权利要求13所述的方法,其特征在于,所述指定信息为帧率信息;
    所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件,包括:
    所述帧率信息所指示的帧率大于预设的帧率阈值。
  15. 如权利要求13所述的方法,其特征在于,所述指定信息为时间复杂 度信息;
    所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件,包括:
    所述时间复杂度信息所指示的时间复杂度大于预设的时间复杂度阈值。
  16. 如权利要求13所述的方法,其特征在于,所述指定信息为空间复杂度信息;
    所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件,包括:
    所述空间复杂度信息所指示的空间复杂度大于预设空间复杂度阈值。
  17. 如权利要求13-16任一项所述的方法,其特征在于,所述根据所述待处理帧的码流信息中携带的标识信息,确定所述待处理帧的目标解码方式,包括:
    对所述待处理帧的码流信息进行解码,获取所述码流信息中携带的用于标记目标编码方式的索引信息,根据所述索引信息确定所述目标编码方式;
    按照预设的编码方式和解码方式的对应关系,结合所述目标编码方式确定所述待处理帧的目标解码方式。
  18. 如权利要求13-16任一项所述的方法,其特征在于,所述根据所述待处理帧的码流信息中携带的标识信息,确定所述待处理帧的目标解码方式,包括:
    对所述待处理帧的码流信息进行解码,获取所述码流信息中携带的标识信息是否包含图像显示信息或者时间戳;
    若所述标识信息中包含图像显示信息或者时间戳,则确定所述目标编码方式为所述视频编码标准技术,并按照预设的编码方式和解码方式的对应关系,确定所述视频编码标准技术对应的目标解码方式;
    若所述标识信息中没有图像显示信息或者时间戳,则确定所述目标编码方式为所述帧速率上转换技术或者所述分辨率缩放技术,并按照预设的编码方式 和解码方式的对应关系,确定所述帧速率上转换技术对应的目标解码方式,或者所述分辨率缩放技术对应的目标解码方式。
  19. 如权利要求17或18所述的方法,其特征在于,所述根据所述目标解码方式确定对所述待处理帧进行解码的辅助信息,包括:
    当所述目标解码方式为所述视频编码标准技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为所述待处理帧对应的残差数据信息和控制头信息;
    当所述目标解码方式为帧速率上转换技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为空;
    当所述目标解码方式为分辨率缩放技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为所述待处理帧进行缩放处理对应的残差数据信息和控制头信息。
  20. 如权利要求19所述的方法,其特征在于,所述根据所述目标解码方式确定对所述待处理帧进行解码的辅助信息,根据所述目标解码方式和所述辅助信息解码所述待处理帧之后,所述方法还包括:
    判断所述目标解码方式是否为所述视频编码标准技术对应的解码方式;
    若所述目标解码方式为所述视频编码标准技术对应的解码方式,则将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
  21. 一种视频数据的编码装置,其特征在于,包括:
    获取模块,用于获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种;
    其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息中的至少一种;
    预处理模块,用于在所述获取模块获取的所述指定信息符合启动多种编码 方式处理所述待处理帧的预设条件时,按照第一编码方式和第二编码方式分别对所述待处理帧进行预处理,其中,所述第一编码方式和所述第二编码方式是不同的编码方式;
    处理模块,用于根据所述预处理模块处理的所述第一编码方式的预处理结果和所述第二编码方式的预处理结果,从所述第一编码方式和所述第二编码方式中选择目标编码方式,并根据所述目标编码方式对所述待处理帧进行编码。
  22. 如权利要求21所述的编码装置,其特征在于,所述指定信息为帧率信息;
    所述预处理模块,具体用于:
    判断所述帧率信息所指示的帧率是否大于预设的帧率阈值,若判断结果为是,则确定所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件。
  23. 如权利要求21所述的编码装置,其特征在于,所述指定信息为时间复杂度信息;
    所述预处理模块,具体用于:
    判断所述时间复杂度信息所指示的时间复杂度是否大于预设的时间复杂度阈值,若判断结果为是,则确定所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件。
  24. 如权利要求21所述的编码装置,其特征在于,所述指定信息为空间复杂度信息;
    所述预处理模块,具体用于:
    判断所述空间复杂度信息所指示的空间复杂度是否大于预设空间复杂度阈值,若判断结果为是,则确定所述指定信息符合启动多种编码方式处理所述待处理帧的预设条件。
  25. 如权利要求21-24任一项所述的编码装置,其特征在于,所述预处理 模块,具体用于:
    按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得满足指定视频质量指标的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理所耗费的第一编码数据量大小;
    按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得满足所述指定视频质量指标的视频数据,其中,所述第二编码方式的预处理结果包括所述第二视频质量处理所耗费的第二编码数据量大小。
  26. 如权利要求25所述的编码装置,其特征在于,所述处理模块,具体用于:
    判断所述预处理模块处理得到的所述第一编码数据量大小是否小于所述第二编码数据量大小,若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
  27. 如权利要求21-24任一项所述的编码装置,其特征在于,所述预处理模块,具体用于:
    按照所述第一编码方式对所述待处理帧进行第一视频质量处理以获得耗费指定编码数据量大小的情况下的视频数据,其中,所述第一编码方式的预处理结果包括所述第一视频质量处理得到的所述视频数据的第一质量指标;
    按照所述第二编码方式对所述待处理帧进行第二视频质量处理以获得耗费所述指定编码数据量大小的情况下的视频数据,其中,所述第二编码方式的预处理结果包括所述第二视频质量处理得到的所述视频数据的第二质量指标。
  28. 如权利要求27所述的编码装置,其特征在于,所述处理模块,具体用于:
    判断所述预处理模块处理得到的所述第一质量指标是否高于所述第二质量指标,若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
  29. 如权利要求25和27所述的编码装置,其特征在于,所述处理模块,具体用于:
    获取所述预处理模块处理的所述第一编码数据量大小和第二编码数据量大小,以及所述第一质量指标和所述第二质量指标;
    判断所述第一质量指标与所述第一编码数据量大小的比值,是否高于所述第二质量指标与所述第二编码数据量大小的比值;
    若判断结果为是,则将所述第一编码方式选择为目标编码方式,若判断结果为否,则将所述第二编码方式选择为目标编码方式。
  30. 如权利要求27所述的编码装置,其特征在于,所述处理模块,具体用于:
    判断所述待处理帧是否为监控视频数据或者特写视频数据中的视频帧;
    若判断结果为是,则获取所述预处理模块处理的所述第一质量指标和所述第二质量指标;
    判断所述第一质量指标是否高于所述第二质量指标,若判断结果为是,则将所述第一编码方式选择为目标编码方式。
  31. 如权利要求21所述的编码装置,其特征在于,所述编码装置还包括标记模块,所述标记模块用于:
    采用索引的方式对所述目标编码方式进行标记,对所述目标编码方式的索引信息进行编码以得到所述目标编码方式的标识信息,并将所述标识信息以码流的形式传递给解码端;或者
    采用表征时域信息的物理量对所述目标编码方式进行标记以得到所述目标编码方式的标识信息,并将所述目标编码方式的标识信息作为控制信息传递给解码端;
    其中,所述表征时域信息的物理量包括:图像显示信息或者时间戳。
  32. 如权利要求31所述的编码装置,其特征在于,所述编码装置,还包括:
    参考帧判断模块,用于判断所述处理模块选择的所述目标编码方式是否为视频编码标准技术,若所述目标编码方式为所述视频编码标准技术,则将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
  33. 一种视频数据的解码装置,其特征在于,包括:
    获取模块,用于获取视频数据中的待处理帧的指定信息,所述指定信息包括:帧率信息、时间复杂度信息以及空间复杂度信息中的至少一种;
    其中,所述时间复杂度信息包括:运动矢量的长度信息,或者参考帧的索引信息;所述空间复杂度信息包括:图像色度的变化范围信息、图像纹理信息以及图像编码模式信息中的至少一种;
    确定模块,用于在所述获取模块获取的所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件时,根据所述待处理帧的码流信息中携带的标识信息,确定所述待处理帧的目标解码方式;
    处理模块,用于根据所述确定模块确定的所述目标解码方式确定对所述待处理帧进行解码的辅助信息,根据所述目标解码方式和所述辅助信息解码所述待处理帧。
  34. 如权利要求33所述的解码装置,其特征在于,所述指定信息为帧率信息;
    所述确定模块,具体用于:
    判断所述帧率信息所指示的帧率是否大于预设的帧率阈值,若判断结果为是,则确定所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件。
  35. 如权利要求33所述的解码装置,其特征在于,所述指定信息为时间复杂度信息;
    所述确定模块,具体用于:
    判断所述时间复杂度信息所指示的时间复杂度是否大于预设的时间复杂 度阈值,若判断结果为是,则确定所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件。
  36. 如权利要求33所述的解码装置,其特征在于,所述指定信息为空间复杂度信息;
    所述确定模块,具体用于:
    判断所述空间复杂度信息所指示的空间复杂度是否大于预设空间复杂度阈值,若判断结果为是,则确定所述指定信息符合启动目标解码方式处理所述待处理帧的预设条件。
  37. 如权利要求33-36任一项所述的解码装置,其特征在于,所述确定模块,具体用于:
    对所述待处理帧的码流信息进行解码,获取所述码流信息中携带的用于标记目标编码方式的索引信息,根据所述索引信息确定所述目标编码方式;
    按照预设的编码方式和解码方式的对应关系,结合所述目标编码方式确定所述待处理帧的目标解码方式。
  38. 如权利要求33-36任一项所述的解码装置,其特征在于,所述确定模块,具体用于:
    对所述待处理帧的码流信息进行解码,获取所述码流信息中携带的标识信息是否包含图像显示信息或者时间戳;
    若所述标识信息中包含图像显示信息或者时间戳,则确定所述目标编码方式为所述视频编码标准技术,并按照预设的编码方式和解码方式的对应关系,确定所述视频编码标准技术对应的目标解码方式;
    若所述标识信息中没有图像显示信息或者时间戳,则确定所述目标编码方式为所述帧速率上转换技术或者所述分辨率缩放技术,并按照预设的编码方式和解码方式的对应关系,确定所述帧速率上转换技术对应的目标解码方式,或者所述分辨率缩放技术对应的目标解码方式。
  39. 如权利要求37或38所述的解码装置,其特征在于,所述处理模块,具体用于:
    当所述确定模块确定的所述目标解码方式为所述视频编码标准技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为所述待处理帧对应的残差数据信息和控制头信息;
    当所述确定模块确定的所述目标解码方式为帧速率上转换技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为空;
    当所述确定模块确定的所述目标解码方式为分辨率缩放技术对应的解码方式时,获取对所述待处理帧进行解码的辅助信息,所述辅助信息为所述待处理帧进行缩放处理对应的残差数据信息和控制头信息。
  40. 如权利要求39所述的解码装置,其特征在于,所述解码装置还包括:
    参考帧判断模块,用于判断所述确定模块确定的所述目标解码方式是否为所述视频编码标准技术对应的解码方式;
    若所述目标解码方式为所述视频编码标准技术对应的解码方式,则将处理得到的所述待处理帧加入所述参考帧列表,以生成下一个待处理帧对应的参考帧列表。
  41. 一种视频数据的编解码系统,其特征在于,包括:如权利要求21-32任一项所述的编码装置,以及如权利要求33-40任一项所述的解码装置。
PCT/CN2016/079034 2015-04-16 2016-04-12 一种视频数据的编解码方法及装置 WO2016165603A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510180497.4 2015-04-16
CN201510180497.4A CN104811722B (zh) 2015-04-16 2015-04-16 一种视频数据的编解码方法及装置

Publications (1)

Publication Number Publication Date
WO2016165603A1 true WO2016165603A1 (zh) 2016-10-20

Family

ID=53696151

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/079034 WO2016165603A1 (zh) 2015-04-16 2016-04-12 一种视频数据的编解码方法及装置

Country Status (2)

Country Link
CN (1) CN104811722B (zh)
WO (1) WO2016165603A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110139104A (zh) * 2018-02-09 2019-08-16 腾讯科技(深圳)有限公司 视频解码方法、装置、计算机设备和存储介质

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104811722B (zh) * 2015-04-16 2019-05-07 华为技术有限公司 一种视频数据的编解码方法及装置
CN107343208B (zh) * 2016-04-29 2019-10-11 掌赢信息科技(上海)有限公司 一种控制视频码率方法及电子设备
CN105959700B (zh) * 2016-05-31 2020-04-14 腾讯科技(深圳)有限公司 视频图像编码的方法、装置、存储介质和终端设备
CN107635142B (zh) * 2016-07-18 2020-06-26 浙江大学 一种视频数据的处理方法及装置
EP3474225B1 (en) * 2017-10-18 2019-09-25 Axis AB Method and encoder for encoding a video stream in a video coding format supporting auxiliary frames
CN107682675A (zh) * 2017-10-19 2018-02-09 佛山市章扬科技有限公司 一种采用多种压缩方式录制视频的方法
CN108960384B (zh) * 2018-06-07 2020-04-28 阿里巴巴集团控股有限公司 一种图形码的解码方法及客户端
CN111726616B (zh) * 2019-03-19 2024-03-01 华为技术有限公司 点云编码方法、点云解码方法、装置及存储介质
CN110740317B (zh) * 2019-09-18 2021-10-15 浙江大华技术股份有限公司 子块运动预测、编码方法、编码器及存储装置
CN114827723B (zh) * 2022-04-25 2024-04-09 阿里巴巴(中国)有限公司 视频处理方法、装置、电子设备及存储介质
CN117294683A (zh) * 2022-06-16 2023-12-26 中兴通讯股份有限公司 视频处理方法、发送端、接收端、存储介质和程序产品
CN116233438B (zh) * 2023-03-09 2023-08-29 上海华期信息技术有限责任公司 利用加权算法的数据预测采集系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009093879A2 (ko) * 2008-01-24 2009-07-30 Sk Telecom Co., Ltd. 시공간적 복잡도를 이용한 부호화 모드 결정 방법 및 장치
CN101615910A (zh) * 2009-05-31 2009-12-30 华为技术有限公司 压缩编码的方法、装置和设备以及压缩解码方法
CN103458237A (zh) * 2012-05-29 2013-12-18 北京数码视讯科技股份有限公司 视频编码方式的确定方法和装置以及视频编码方法和装置
CN104410861A (zh) * 2014-11-24 2015-03-11 华为技术有限公司 视频编码方法及装置
CN104519368A (zh) * 2013-09-30 2015-04-15 华为技术有限公司 图像编码、解码重构处理方法及装置
CN104811722A (zh) * 2015-04-16 2015-07-29 华为技术有限公司 一种视频数据的编解码方法及装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3501213B2 (ja) * 1999-07-13 2004-03-02 日本電気株式会社 ビデオ装置およびそれに使用される再符号化器
JP4618436B2 (ja) * 2006-02-10 2011-01-26 富士ゼロックス株式会社 符号化装置、復号化装置、符号化方法、復号化方法、及びプログラム
CN104052992B (zh) * 2014-06-09 2018-02-27 联想(北京)有限公司 一种图像处理方法及电子设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009093879A2 (ko) * 2008-01-24 2009-07-30 Sk Telecom Co., Ltd. 시공간적 복잡도를 이용한 부호화 모드 결정 방법 및 장치
CN101615910A (zh) * 2009-05-31 2009-12-30 华为技术有限公司 压缩编码的方法、装置和设备以及压缩解码方法
CN103458237A (zh) * 2012-05-29 2013-12-18 北京数码视讯科技股份有限公司 视频编码方式的确定方法和装置以及视频编码方法和装置
CN104519368A (zh) * 2013-09-30 2015-04-15 华为技术有限公司 图像编码、解码重构处理方法及装置
CN104410861A (zh) * 2014-11-24 2015-03-11 华为技术有限公司 视频编码方法及装置
CN104811722A (zh) * 2015-04-16 2015-07-29 华为技术有限公司 一种视频数据的编解码方法及装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110139104A (zh) * 2018-02-09 2019-08-16 腾讯科技(深圳)有限公司 视频解码方法、装置、计算机设备和存储介质
CN110139104B (zh) * 2018-02-09 2023-02-28 腾讯科技(深圳)有限公司 视频解码方法、装置、计算机设备和存储介质

Also Published As

Publication number Publication date
CN104811722B (zh) 2019-05-07
CN104811722A (zh) 2015-07-29

Similar Documents

Publication Publication Date Title
WO2016165603A1 (zh) 一种视频数据的编解码方法及装置
US10805644B2 (en) Device and method for entropy encoding and decoding
US20230056351A1 (en) Coded-block-flag coding and derivation
US9906789B2 (en) Encoding or decoding method and apparatus
US10554974B2 (en) Method and apparatus enabling adaptive multiple transform for chroma transport blocks using control flags
US10750169B2 (en) Method and apparatus for intra chroma coding in image and video coding
US10582217B2 (en) Methods and apparatuses for coding and decoding depth map
US9699468B2 (en) Adaptive screen and video coding scheme
JP2017521980A (ja) デジタル画像のコーディング方法、デコーディング方法、関連する装置およびコンピュータプログラム
US20200236359A1 (en) Apparatus and method for image coding with boundary partition processing
US11122284B2 (en) Picture coding device, picture coding method, and picture coding program, and picture decoding device, picture decoding method, and picture decoding program
CN114467306A (zh) 图像预测方法、编码器、解码器以及存储介质
CN111432213B (zh) 用于视频和图像压缩的贴片数据大小编码的方法和装置
CN110149515B (zh) 数据传输方法及装置
CN111447453B (zh) 图像处理方法及装置
EP3987801A1 (en) Method and apparatus for non-separable transform selection in an encoder and decoder
CN116233452A (zh) 视频发送方法、视频接收方法及相关装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16779578

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16779578

Country of ref document: EP

Kind code of ref document: A1