WO2024109701A1

WO2024109701A1 - Video encoding/decoding method and apparatus, electronic device, and medium

Info

Publication number: WO2024109701A1
Application number: PCT/CN2023/132683
Authority: WO
Inventors: 侯方超
Original assignee: 维沃移动通信有限公司
Priority date: 2022-11-24
Filing date: 2023-11-20
Publication date: 2024-05-30
Also published as: CN115834889A

Abstract

The present application relates to the technical field of video encoding/decoding, and discloses a video encoding/decoding method and apparatus, an electronic device, and a medium. The video encoding/decoding method comprises: encoding first image data as a first key video frame into a video code stream; acquiring second image data; and when third image data and the second image data meet a target condition, encoding the second image data as a second key video frame into the video code stream, wherein the third image data comprises either of the first image data and fourth image data, the fourth image data is image data obtained on the basis of target data, and the target data is used for indicating brightness change information of pixel points in a first sensor of an electronic device.

Description

Video encoding and decoding method, device, electronic equipment and medium

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to Chinese Patent Application No. 202211484822.2 filed in China on November 24, 2022, the entire contents of which are incorporated herein by reference.

Technical Field

The present application belongs to the technical field of video data processing, and specifically relates to a video encoding and decoding method, device, electronic equipment and medium.

Background technique

Usually, the IPB algorithm can be used to compress the original video. Specifically, several frames of images can be divided into a group of pictures (Group of Pictures, GOP), with I frame as the base frame, I frame predicts P frame, and then I frame and P frame predict B frame, and finally the difference information between I frame data and prediction is stored and transmitted.

However, since the encoding and decoding frame rate in the IPB algorithm is fixed, if the GOP is set to a larger number of frames, it means that a higher compression rate can be achieved on the I frame, but when there are more objects in the shooting scene moving, the video playback is prone to image freezes and is not smooth; if the GOP is set to a smaller number of frames, when there is no obvious movement of objects in the shooting scene, invalid redundant data will continue to be output, resulting in a waste of storage space and encoding and decoding computing power.

Summary of the invention

The purpose of the embodiments of the present application is to provide a video encoding and decoding method, which can solve the problem of waste of storage space and decoding computing power in the process of video data encoding and decoding of electronic devices under the premise of ensuring image quality.

In a first aspect, an embodiment of the present application provides a video encoding and decoding method, the method comprising: encoding first image data as a first key video frame into a video code stream; obtaining second image data; when a target condition is met between the third image data and the second image data, encoding the second image data as a second key video frame into the video code stream; wherein the third image data comprises any one of the following: first image data, fourth image data; the fourth image data is: image data obtained based on target data; the target data is used to indicate brightness change information of pixel points in a first sensor of the electronic device.

In a second aspect, an embodiment of the present application provides a video encoding and decoding device, which includes: an encoding module and an acquisition module. The encoding module is used to encode the first image data as a first key video frame into a video code stream. The acquisition module is used to acquire the second image data. The encoding module is also used to encode the second image data as a second key video frame into the video code stream when the target condition is met between the third image data and the second image data acquired by the acquisition module. The third image data includes any one of the following: the first image data, the fourth image data; the fourth image data is: image data obtained based on the target data; the target data is used to indicate the brightness change information of the pixel points in the first sensor of the electronic device.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

In the embodiment of the present application, the electronic device can encode the first image data as the first key video frame into the video frequency code stream; and obtain the second image data, and then, if the target condition is met between the third image data (the third image data includes any of the following: the first image data, the fourth image data) and the second image data, encode the second image data as the second key video frame into the video code stream; wherein the fourth image data is: image data obtained based on the target data (the target data is used to indicate the brightness change information of the pixel point in the first sensor of the electronic device). Since the electronic device can first encode the first image data as the first key video frame into the video code stream; and only if the target condition is met between the third image data and the second image data, the second image data will be encoded into the video code stream as the second key video frame, thereby avoiding the output of invalid redundant data, resulting in the waste of storage space and encoding and decoding computing power of the electronic device, and the electronic device can encode more key video frames into the video code stream when the target condition is met between the third image data and the second image data, so that the quality of the decoded video can be improved. Therefore, the storage space and encoding and decoding computing power of the electronic device in the video data encoding and decoding process can be saved under the premise of ensuring the image quality.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of a video encoding and decoding method according to an embodiment of the present invention;

FIG2 is a second flow chart of a video encoding and decoding method provided in an embodiment of the present application;

FIG3 is a third flow chart of a video encoding and decoding method provided in an embodiment of the present application;

FIG4 is a schematic diagram of a video code stream provided in an embodiment of the present application;

FIG5 is a fourth flow chart of a video encoding and decoding method provided in an embodiment of the present application;

FIG6 is a fifth flow chart of a video encoding and decoding method provided in an embodiment of the present application;

FIG7 is a sixth flow chart of a video encoding and decoding method provided in an embodiment of the present application;

FIG8 is a seventh flow chart of a video encoding and decoding method provided in an embodiment of the present application;

FIG9 is a flowchart of a video encoding and decoding method according to an embodiment of the present application;

FIG10 is a ninth flowchart of a video encoding and decoding method according to an embodiment of the present application;

FIG11 is a schematic diagram of the structure of a video encoding and decoding device provided in an embodiment of the present application;

FIG12 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

FIG. 13 is a schematic diagram of the hardware structure of the electronic device provided in an embodiment of the present application.

Detailed ways

The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

The terms "first", "second", etc. in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and/or" in the specification and claims represents at least one of the connected objects, and the character "/" generally indicates that the objects associated with each other are in an "or" relationship.

The video encoding and decoding method, device, electronic device and medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

Fig. 1 shows a flow chart of a video encoding and decoding method provided by an embodiment of the present application. As shown in Fig. 1, a video encoding and decoding method provided by an embodiment of the present application may include the following steps 101 to 103.

Step 101: The electronic device encodes first image data as a first key video frame into a video code stream.

Optionally, in the embodiment of the present application, after the video recording function in the electronic device is triggered and turned on, at least one image sensor in the electronic device starts to output pixel point information with light intensity changes and real-time acquisition of video images in real time. At the same time, the electronic device uses the first frame of the video image collected by the image sensor as the first video key frame, encodes the first image data corresponding to the first video key frame, and writes it into the video code stream.

Further optionally, in the embodiment of the present application, the first image data may specifically be three primary color (Red, Green, Blue, RGB) data collected by the image sensor.

Further optionally, in an embodiment of the present application, when the at least one image sensor includes one image sensor, the one image sensor may specifically be a two-in-one image sensor of a dynamic vision sensor (DVS) and a metal oxide semiconductor sensor (CMOS).

Further optionally, in an embodiment of the present application, when the at least one image sensor includes two image sensors, one of the image sensors may be a dynamic vision sensor (Dynamic Vision Sensor, DVS), and the other image sensor may be a complementary metal-oxide semiconductor sensor (Complementary Metal-Oxide Semiconductor, CMOS).

Optionally, in an embodiment of the present application, the above-mentioned video code stream can be stored in a cache encoder, and the electronic device can decode and display the video code stream as needed.

Optionally, in an embodiment of the present application, after the electronic device encodes the first image data as the first key video frame into the video code stream, the time for acquiring the image data is initialized and a preset time interval (such as the first threshold described below) is set. The preset time interval is used to determine whether to encode the acquired video image data.

Exemplarily, the electronic device can use the first frame of RGB data collected by the CMOS sensor as the first key frame (i.e., I frame), and encode the first image data (such as RGB data) corresponding to the first key frame, write it into the video code stream, and store it in the cache encoder. Then, the time when the encoded data of the first key frame is currently obtained is initialized to zero, and a preset time interval T is set, that is, every interval T, it is determined whether to encode the image data sent by the image sensor.

Optionally, in an embodiment of the present application, after the electronic device encodes the first image data as the first key video frame into a video code stream, the first image data may also be decoded and written into a cache decoder.

Step 102: The electronic device obtains second image data.

It can be understood that when an electronic device includes two image sensors, due to the different frame rates of the two image sensors, the electronic device may not necessarily obtain image data collected by the two sensors at the same time. At a certain time, it may only obtain image data collected by the first sensor or only obtain image data collected by the second sensor, or it may simultaneously obtain image data collected by both sensors.

Optionally, in an embodiment of the present application, the second image data may be image data corresponding to a next frame image after the first image data is captured. Specifically, the second image data may be image data corresponding to a next frame image of the first image data captured by the CMOS sensor at a preset frame rate. The preset frame rate may be determined based on user settings for the electronic device, and the present application does not impose any restrictions thereon.

Step 103: When the third image data and the second image data meet a target condition, the electronic device encodes the second image data as a second key video frame into a video code stream.

Optionally, in an embodiment of the present application, the electronic device can determine whether the third image data and the second image data meet a target condition, and the target condition may include at least one of the following: the time interval between the acquisition time of the second image data and the encoding time of the first image data (such as the first time interval described below) is greater than or equal to a preset time interval (such as the first threshold described below), and the brightness change information of the pixel points between the third image data and the second image data is greater than or equal to a preset threshold (such as the second threshold described below).

In the embodiment of the present application, the third image data includes any one of the following: first image data and fourth image data.

Optionally, in the embodiment of the present application, after acquiring the second image data, the electronic device may determine the acquisition time of the second image data, and read the third image data from the cache decoder, and store the third image data in the second image data. The brightness change information of corresponding pixels between image data is compared.

Exemplarily, assuming that the first pixel point can be the pixel point of the first row and first column in the third image data, and the second pixel point is the pixel point of the first row and first column in the second image data, the first pixel point and the second pixel point correspond to each other, and the difference between the brightness value of the first pixel point and the brightness value of the second pixel point can obtain the absolute value of the brightness change value of the two pixels. Similarly, the absolute value sum of the brightness change values of all corresponding pixels in the third image data and the second image data can be obtained, so that the absolute value sum can be compared with the preset threshold.

It can be understood that when the third image data is the first image data, the electronic device compares the brightness change information of the pixels between the first image data and the second image data; when the third image data is the fourth image data, the electronic device compares the brightness change information of the pixels between the fourth image data and the second image data.

In the embodiment of the present application, the fourth image data is: image data obtained based on target data; the target data is used to indicate brightness change information of pixel points in the first sensor of the electronic device.

Optionally, in an embodiment of the present application, the above-mentioned first sensor may specifically be a DVS sensor, and the above-mentioned target data may be image data output by the first sensor of the electronic device when the brightness change received by a pixel point in the sensor exceeds a threshold value. The target data may indicate pixel point information whose brightness has changed in the first sensor, and the pixel point information includes the coordinate position of the pixel point and brightness change information.

Optionally, in an embodiment of the present application, the above-mentioned target data can also be image data output by a composite sensor of an electronic device when a brightness change received by a pixel point in the sensor exceeds a threshold value. The target data can indicate pixel point information whose brightness has changed in the composite sensor, and the pixel point information includes the coordinate position of the pixel point and brightness change information.

Optionally, in an embodiment of the present application, when the electronic device obtains target data collected by the first sensor before obtaining the second image data, it can reconstruct and generate fourth image data based on the target data and cache data in the cache decoder.

Optionally, in an embodiment of the present application, when the time when the electronic device acquires the second image data satisfies a preset time interval and the data difference between the third image data and the second image data satisfies a preset threshold, the image frame currently captured by the second sensor is used as the second key video frame, and the second image data corresponding to the second video key frame is encoded and written into the video code stream.

Optionally, in an embodiment of the present application, in combination with FIG. 1 , as shown in FIG. 2 , after the above step 102 , a video encoding and decoding method provided in an embodiment of the present application further includes the following step 201 .

Step 201: When a target condition is satisfied between third image data and second image data, the electronic device updates first image data cached in a cache decoder to second image data.

Optionally, in an embodiment of the present application, when the target condition is met between the third image data and the second image data, the electronic device encodes the second image data as a second key video frame into the video code stream, reinitializes the time for acquiring the second image data, and decodes the second image data and writes it into the cache decoder to update the first image data in the cache decoder.

It can be seen that after the electronic device encodes the second image data as the second key video frame into the video code stream, it decodes the second image data and writes it into the cache decoder to update the first image data in the cache decoder, and initializes the receiving time of the second image data again, thereby preventing the cumulative errors caused by the reconstruction algorithm from causing poor video image effect during decoding, and thus improving the image quality of the video shot by the electronic device.

Optionally, in an embodiment of the present application, when the time interval between the moment when the electronic device acquires the second image data and the moment when the first image data is encoded is greater than or equal to a preset time interval and the electronic device has not acquired the target data, if the brightness change information of the pixel points between the third image data and the second image data is less than a preset threshold, the third image data is written into the cache decoder.

Optionally, in the embodiment of the present application, the time interval between the moment when the electronic device acquires the second image data and the moment when the first image data is encoded is greater than or equal to the preset time interval and the electronic device acquires the target image data at the same time. In the case of a third image data, if the brightness change information of the pixel points between the third image data and the second image data is less than a preset threshold, the target data currently collected by the first sensor is encoded into the video bitstream as a first non-key video frame and the fourth image data obtained based on the target data is written into the cache decoder.

Optionally, in an embodiment of the present application, when the time interval between the moment when the electronic device acquires the second image data and the moment when the first image data is encoded is less than a preset time interval and the electronic device has not acquired the target data, no action is taken and it continues to wait for the next image data.

Optionally, in the embodiment of the present application, when the time interval between the moment when the electronic device acquires the second image data and the moment when the first image data is encoded is less than the preset time interval and the electronic device acquires the target data, the target data is encoded into the video code stream as the first non-key video frame and the fourth image data obtained based on the target data is written into the cache decoder. Optionally, in the embodiment of the present application, when the electronic device does not acquire any data stream, no action is taken to continue waiting for the next image data.

Optionally, in an embodiment of the present application, after the electronic device completes the video encoding process, the video code stream in the cache encoder can be encapsulated into a video format and the image data in the cache decoder can be released.

Optionally, in an embodiment of the present application, in combination with FIG. 1 , as shown in FIG. 3 , after the above step 103 , a video encoding and decoding method provided in an embodiment of the present application further includes the following steps 301 and 302 .

Step 301: The electronic device decodes the third key video frame in the video code stream to obtain fifth image data.

Optionally, in an embodiment of the present application, the electronic device can read a video stream encapsulated in a video format and decode the video stream.

Optionally, in an embodiment of the present application, the third key video frame may be a video frame corresponding to the first image data in the video code stream, and the electronic device decodes the third key video frame to obtain fifth image data.

Step 302: The electronic device reconstructs sixth image data according to the fifth image data and the second non-key video frame.

In the embodiment of the present application, the second non-key video frame is: a non-key video frame associated with the third key video frame.

Optionally, in the embodiment of the present application, the second non-key video frame may be a video frame corresponding to target data acquired by the first sensor or the composite image sensor obtained by the electronic device.

It should be noted that the above-mentioned “non-key video frame associated with the third key video frame” can be understood as: a video frame located after the third key video frame and before the next key video frame in the video code stream.

Optionally, in an embodiment of the present application, the electronic device may adopt a reconstruction algorithm to obtain sixth image data based on the fifth image data and the second non-critical video frame. The reconstruction algorithm is an algorithm that can regenerate new decoded data based on the data obtained by decoding the key video frame and the decoded data of the non-critical video frame. The reconstruction algorithm may be any one of the following: a deep learning algorithm, an interpolation algorithm, etc., which is not limited by the present application.

For example, after the electronic device completes the video encoding process, the video code stream in the cache encoder is encapsulated into a video format, as shown in FIG4 , the video frames in the video code stream are arranged as: I frame, DVS data, DVS data, DVS data…I frame, DVS data, DVS data…I frame, DVS data, DVS data, DVS data…. The electronic device first decodes the third key video frame (i.e., the first I frame) in the video code stream to obtain the fifth image data RGB_Decoder; and uses a reconstruction algorithm to reconstruct the fifth image data RGB_Decoder and the second non-key video frame (the video frame corresponding to the DVS after the first I frame and before the second I frame) to obtain the sixth image data (reconstructed image data RGB_Decoder), and replaces the previous fifth image data with the sixth image data, and so on, to decode the video code stream in the cache encoder.

It can be seen that since the electronic device can first decode the third key video frame in the video code stream to obtain the fifth image data, and use a reconstruction algorithm, it is only necessary to reconstruct the sixth image data based on the fifth image data and the second non-key video frame, thereby avoiding the complex decoding operations of the traditional method, and thus saving the storage space and decoding computing power of the electronic device during the video data decoding process.

Optionally, in an embodiment of the present application, in combination with Figure 3, as shown in Figure 5, after the above step 301, a video encoding and decoding method provided in an embodiment of the present application further includes the following steps 401 and 402, and the above step 302 can be specifically implemented by the following step 302a.

Step 401: The electronic device determines a second time interval according to a preset decoding frame rate.

Optionally, in an embodiment of the present application, the above-mentioned preset decoding frame rate can be determined according to the refresh rate of the display end. When the refresh rate of the display end is low, the decoding frame rate is set to adapt to a smaller decoding frame rate. When the refresh rate of the display end is high, the decoding frame rate is set to adapt to a larger decoding frame rate.

Optionally, in an embodiment of the present application, the electronic device may determine the second time interval according to an inverse relationship between a preset decoding frame rate and the second time interval.

Exemplarily, assuming that the preset decoding frame rate is 1000 frames per second, the second time interval can be determined to be 1 millisecond.

Step 402: The electronic device determines a target decoding time according to the decoding time of the third key video frame and the second time interval.

Optionally, in an embodiment of the present application, the target decoding time is the time when the electronic device decodes the video code stream.

Optionally, in an embodiment of the present application, the electronic device takes the decoding time of the third key video frame as the initial time, and determines a target decoding time every second time interval.

Exemplarily, assuming that the second time interval is 1 millisecond, the decoding time of the third key video frame is the 1st millisecond, and the target decoding time is the 2nd millisecond, the 3rd millisecond, the 4th millisecond, and so on.

Step 302a: At the target decoding time, the electronic device reconstructs the sixth image data according to the fifth image data and the second non-critical video frame.

Optionally, in an embodiment of the present application, the electronic device determines a decoding algorithm according to a data type of the video stream at a target decoding time.

If the data to be decoded in the video code stream at the target decoding time is a key video frame, the key video frame is directly decoded and updated to cover the cache decoder; if the data to be decoded in the video code stream at the target decoding time is a non-key video frame, the fifth image data and the data corresponding to the second non-key video frame are input into the reconstruction algorithm to reconstruct the sixth image data, and the data is updated to cover the cache decoder.

It can be seen that since the electronic device can first determine the second time interval and the target decoding time according to the preset decoding frame rate, and use different methods to decode according to the data type of the video stream at the target decoding time, it avoids a large amount of redundant data calculations and saves computing power.

In the video encoding and decoding method provided by the embodiment of the present application, the electronic device can encode the first image data as the first key video frame into the video code stream; and obtain the second image data, and then encode the second image data as the second key video frame into the video code stream when the target condition is met between the third image data (the third image data includes any of the following: the first image data, the fourth image data) and the second image data; wherein the fourth image data is: image data obtained based on the target data (the target data is used to indicate the brightness change information of the pixel point in the first sensor of the electronic device). Since the electronic device can first encode the first image data as the first key video frame into the video code stream; and only when the target condition is met between the third image data and the second image data, the second image data will be encoded into the video code stream as the second key video frame, thereby avoiding the output of invalid redundant data, resulting in the waste of storage space and encoding and decoding computing power of the electronic device, and the electronic device can encode more key video frames into the video code stream when the target condition is met between the third image data and the second image data, so that the quality of the decoded video can be improved. Therefore, the storage space and encoding and decoding computing power of the electronic device in the video data encoding and decoding process can be saved under the premise of ensuring the image quality.

The following specifically describes the process of how the electronic device determines whether the third image data and the second image data meet the target condition.

Optionally, in the embodiment of the present application, in combination with FIG. 1 , as shown in FIG. 6 , the above step 103 may be specifically implemented by the following step 103a.

Step 103a: When the first time interval is greater than or equal to the first threshold and the brightness change information of the pixels between the third image data and the second image data is greater than or equal to the second threshold, the electronic device encodes the second image data as a second key video frame into the video bitstream.

In the embodiment of the present application, the first time interval is the time interval between the first moment and the second moment, the first moment is the moment of acquiring the second image data, and the second moment is the moment of encoding the first image data.

Optionally, in an embodiment of the present application, after the electronic device encodes the first image data and writes the video code stream into the cache encoder, the encoding time of the first image data is initialized to zero, and the above-mentioned first time interval can be the time interval from the acquisition time of the second image data to zero.

Optionally, in the embodiment of the present application, the first threshold may be a time interval automatically set by the electronic device, or may be a time interval set by the user.

Optionally, in the embodiment of the present application, the electronic device may perform difference processing on the third image data and the second image data to compare difference information between brightness change information of pixels indicated by the third image data and the second image data.

Exemplarily, assuming that both the third image data and the second image data include brightness information of N pixels, the third image data and the second image data are subjected to difference processing to obtain the absolute values of the brightness change values of the N pixels, and the N absolute values are added to obtain an absolute total value, which can then be compared with the second threshold.

Optionally, in an embodiment of the present application, when the time interval from the time when the electronic device acquires the second image data to the encoding time of the first image data is greater than or equal to a first threshold, if the difference between the brightness change information of the pixel points indicated by the third image data and the second image data is greater than or equal to a second threshold, the image frame currently captured by the second sensor is used as the second key video frame, and the second image data corresponding to the second video key frame is encoded and written into the video code stream.

It can be seen that since the time interval from the time when the electronic device acquires the second image data to the encoding time of the first image data is greater than or equal to the first threshold, the second image data will be encoded into the video code stream as the second key video frame only if the difference in brightness change information of the pixel points between the third image data and the second image data is greater than or equal to the second threshold. Therefore, the electronic device can encode only the image data with large brightness changes (that is, the image data collected by the second sensor when the objects in the shooting scene undergo complex movements) into the video code stream at the first time, thereby realizing dynamic acquisition of key video frames, ensuring image quality and saving storage space and decoding computing power of the electronic device during the video data encoding process.

Optionally, in an embodiment of the present application, in combination with Figure 6, as shown in Figure 7, before the above-mentioned step 103a, a video encoding and decoding method provided in an embodiment of the present application also includes the following step 501, and after the above-mentioned step 103a, a video encoding and decoding method provided in an embodiment of the present application also includes the following step 601.

Step 501: The electronic device obtains third image data from a cache decoder of the electronic device.

Optionally, in an embodiment of the present application, when the electronic device obtains the second image data, it is necessary to first obtain the third image data from a cache decoder of the electronic device before determining whether the third image data and the second image data satisfy a target condition.

The third image data obtained by the electronic device from the cache decoder may be the first data or the fourth data.

In one example, the electronic device does not obtain the target data before obtaining the second image data, and does not reconstruct and generate the fourth image data based on the target data, so that the cache decoder does not store the fourth image data but only stores the first image data.

In another example, the electronic device has acquired the target data before acquiring the second image data. The electronic device reconstructs and generates fourth image data based on the target data and stores the fourth image data in a cache decoder.

Step 601: The electronic device updates the third image data in the cache decoder to the second image data.

Optionally, in an embodiment of the present application, after the electronic device encodes the second image data as the second key video frame into the video code stream, the second image data is also decoded and written into a cache decoder to replace the previous third image data.

It can be understood that the cache decoder of the electronic device always only stores the decoded data of one video frame.

Thus, it can be known that, when the electronic device obtains the second image data, before determining whether the third image data and the second image data meet the target condition, the third image data is first obtained from the cache decoder of the electronic device, and after the second image data is encoded into the video code stream as the second key video frame, the second image data is decoded and written into the cache decoder to update the previous third image data. Therefore, the cache decoder of the electronic device always stores only the decoded data of the latest video frame, so the data space of the decoding cache of the electronic device can be saved.

The following specifically describes a process in which the electronic device obtains the fourth image data in response to a situation in which the third image data includes the fourth image data.

Optionally, in an embodiment of the present application, the third image data includes fourth image data. In combination with FIG. 1 , as shown in FIG. 8 , after the above step 102 , a video encoding and decoding method provided in an embodiment of the present application further includes the following steps 701 and 702 .

Step 701: The electronic device obtains first image data from a cache decoder of the electronic device, and obtains target data through a first sensor.

Optionally, in an embodiment of the present application, the first sensor of the electronic device outputs target data when a brightness change received by a pixel point in the sensor exceeds a threshold value. The target data may indicate pixel point information in the first sensor where brightness has changed, and the pixel point information includes the coordinate position of the pixel point and brightness change information.

Optionally, in an embodiment of the present application, the electronic device obtains target data collected by the first sensor, and obtains the first image data written at a previous moment from the cache decoder.

Optionally, in an embodiment of the present application, the third image data includes fourth image data. In combination with FIG. 8 , as shown in FIG. 9 , after the above step 102 , a video encoding and decoding method provided in an embodiment of the present application further includes the following steps 801 and 802 .

Step 801: The electronic device obtains target data through a first sensor.

Optionally, in an embodiment of the present application, target data is output when pixel brightness change information received by a pixel point in the first sensor within a time period exceeds a threshold value. The target data may indicate pixel point information in the sensor whose brightness has changed, and the pixel point information includes the coordinate position of the pixel point and brightness change information.

Step 802: The electronic device encodes the target data as a first non-key video frame into a video code stream.

Optionally, in an embodiment of the present application, after the electronic device obtains the target data, it encodes the image frame corresponding to the target data as a non-key video frame into a video code stream and stores it in a cache encoder.

It can be seen that after the electronic device obtains the first image data and the target data, it will also encode the target data as the first non-critical video frame into the video code stream, so that the electronic device can collect information indicating the movement of objects in the shooting scene in real time, thereby improving the image quality of the video shot by the electronic device.

Step 702: The electronic device reconstructs and generates fourth image data according to the first image data and the target data.

Optionally, in an embodiment of the present application, the electronic device inputs the acquired first image data and target data into a reconstruction algorithm to reconstruct and generate fourth image data.

It can be understood that since the first sensor can output pixel information with light intensity changes in real time, it can effectively extract the motion information of the moving object, so the target data output by the first sensor itself contains the motion information of the moving object in the shooting scene, and the target data includes the coordinate position and brightness change information of the pixel points with brightness changes in the first sensor. Therefore, according to the first image data and the target data, the image of the corresponding pixel points in the two data is converted into The pixel information is reconstructed and calculated to generate image data of the current image frame.

Thus, it can be seen that since the electronic device can first obtain the first image data from the cache decoder of the electronic device, and obtain the target data through the first sensor when the object in the shooting scene moves, it can reconstruct and generate the fourth image data based on the two image data. Therefore, the electronic device can collect information indicating the movement of the object in the shooting scene in real time, thereby improving the image quality of the video shot by the electronic device.

Optionally, in an embodiment of the present application, when the electronic device only acquires target data, the target data is written into the cache encoder, and after the electronic device reads the third image data from the cache decoder, the currently acquired target data and the third image data can be input into the reconstruction algorithm to generate reconstructed image data, and the image data can be used to overwrite the original image data of the cache decoder.

Optionally, in the embodiment of the present application, when the electronic device does not acquire any image data, it does not take any action and continues to wait for the next image data.

The following examples specifically illustrate the video encoding and decoding method provided in the embodiments of the present application.

For example, as shown in FIG10, the electronic device includes a first sensor and a second sensor. After the electronic device is triggered to turn on, the first sensor (taking the DVS sensor as an example) collects DVS data, and the second sensor collects RGB data. The electronic device uses the first frame collected by the second sensor as the first key frame (i.e., I frame), and encodes the first image data corresponding to the first key frame into the video code stream and stores it in the cache encoder. When the time when the encoded data of the first key frame is currently obtained is initialized to zero, a first threshold value (e.g., time interval T) is set. At the same time, the electronic device decodes the first image data (i.e., RGB_Decoder_pre in the figure) and writes it into the cache decoder. Assuming that the time when the electronic device obtains the image data is t, the electronic device has the following processing methods for the obtained image data:

If only DVS data is obtained at time t, the DVS data is written into the cache encoder, and the first image data (i.e., RGB_Decoder_pre) is read from the cache decoder. The electronic device inputs the DVS data and the first image data at time t into the reconstruction algorithm, reconstructs and generates the fourth image data at the current moment (i.e., the reconstructed RGB_Decoder_pre), and overwrites the original image data of the cache decoder.

There is only RGB data at time t. If the time interval from time t to the initialization time is less than the first threshold, no action is taken and the next image data is continued to be waited.

At time t, there are DVS data and RGB data (i.e., second image data). If the time interval from time t to the initialization time is less than the first threshold, the DVS data is written into the cache encoder, and the fourth image data (i.e., RGB_Decoder_pre in the cache decoder before time t) is read from the cache decoder. The electronic device inputs the DVS data and the fourth image data at time t into the reconstruction algorithm, reconstructs and generates the image data at the current time (i.e., the reconstructed RGB_Decoder_pre), and writes and overwrites the original image data of the cache decoder.

At time t, there are DVS data and RGB data (i.e., the second image data). If the time interval from time t to the initialization time is greater than the first threshold, the DVS data is written into the cache encoder, and the fourth image data (i.e., RGB_Decoder_pre in the cache decoder before time t) is read from the cache decoder. The electronic device inputs the DVS data and the fourth image data at time t into the reconstruction algorithm, reconstructs and generates the reconstructed image data at the current moment, and compares the reconstructed image data with the second image data. If the brightness change information of the pixel points between the reconstructed image data and the second image data is greater than or equal to the second threshold, the second image data is encoded into the video bitstream as the second key video frame, and the second image data is decoded and written to overwrite the original fourth image data of the cache decoder; if the brightness change information of the pixel points between the reconstructed image data and the second image data is less than the second threshold, the reconstructed image data is written to overwrite the original fourth image data of the cache decoder.

At time t, there is only RGB data (i.e., the second image data). If the time interval from time t to the initialization time is greater than the first threshold, the electronic device reads the fourth image data from the cache decoder (i.e., the RGB_Decoder_pre in the cache decoder before time t). If the brightness change information of the pixel points between the fourth image data (the third data is the fourth image data at this time) and the second image data is greater than or equal to the second threshold, the second image data is used as The second key video frame is encoded into the video code stream, and the second image data is decoded and written to overwrite the original fourth image data of the cache decoder; if the brightness change information of the pixel points between the fourth image data and the second image data is less than the second threshold, the fourth image data is rewritten into the cache decoder.

There is no image data at time t, so no action is taken and the system continues to wait for the next image data.

The video encoding and decoding method provided in the embodiment of the present application can be executed by a device. In the embodiment of the present application, the video encoding and decoding device provided in the embodiment of the present application is described by taking the device execution method as an example.

FIG11 shows a video encoding and decoding device 60 involved in the above-mentioned embodiment, and the video encoding and decoding device 60 includes: an encoding module 61 and an acquisition module 62. The encoding module 61 is used to encode the first image data as a first key video frame into a video code stream. The acquisition module 62 is used to acquire the second image data. The encoding module 61 is also used to encode the second image data as a second key video frame into a video code stream when the target condition is met between the third image data and the second image data acquired by the acquisition module. The third image data includes any one of the following: the first image data, the fourth image data; the fourth image data is: image data obtained based on the target data; the target data is used to indicate the brightness change information of the pixel points in the first sensor of the electronic device.

In a possible implementation, the video encoding and decoding device 60 further includes: a reconstruction module. The acquisition module is further configured to acquire the first image data from a cache decoder of the electronic device and acquire the target data through the first sensor. The reconstruction module is configured to reconstruct and generate the fourth image data based on the first image data and the target data acquired by the acquisition module.

In a possible implementation, the video encoding and decoding device 60 further includes an updating module, wherein the updating module is configured to update the first image data cached in the cache decoder to the second image data when the third image data and the second image data meet a target condition.

In a possible implementation, the acquisition module is further configured to acquire target data through a first sensor. The encoding module is further configured to encode the target data as a first non-key video frame into a video bit stream.

In a possible implementation, the encoding module is specifically used to encode the second image data as a second key video frame into the video code stream when the first time interval is greater than or equal to the first threshold and the brightness change information of the pixel points between the third image data and the second image data is greater than or equal to the second threshold. The first time interval is the time interval between the first moment and the second moment, the first moment is the acquisition moment of the second image data, and the second moment is the encoding moment of the first image data.

In a possible implementation, the video codec device 60 further includes an updating module, wherein the acquiring module is further configured to acquire the third image data from the cache decoder of the video codec device, and the updating module is configured to update the third image data in the cache decoder acquired by the acquiring module to the second image data.

In a possible implementation, the video encoding and decoding device 60 further includes: a decoding module and a reconstruction module. The decoding module is used to decode the third key video frame in the video code stream to obtain fifth image data. The reconstruction module is used to reconstruct the sixth image data according to the fifth image data and the second non-key video frame decoded by the decoding module. The second non-key video frame is: a non-key video frame associated with the third key video frame.

In a possible implementation, the video encoding and decoding device further includes: a determination module. The determination module is used to determine the second time interval according to a preset decoding frame rate; and determine the target decoding time according to the decoding time of the third key video frame and the second time interval. The reconstruction module is specifically used to reconstruct the sixth image data according to the fifth image data and the second non-key video frame at the target decoding time determined by the determination module.

The video codec device provided by the embodiment of the present application can first encode the first image data as the first key video frame into the video code stream; and only when the target condition is met between the third image data and the second image data, the second image data is encoded into the video code stream as the second key video frame, thereby avoiding outputting invalid redundant data and causing waste of storage space and coding and decoding computing power of the video codec device. Moreover, when the target condition is met between the third image data and the second image data, the video codec device More key video frames can be encoded into the video code stream, so that the quality of the decoded video can be improved. Therefore, the storage space and encoding and decoding computing power of the video encoding and decoding device in the video data encoding and decoding process can be saved while ensuring the image quality.

The video encoding and decoding device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car-mounted electronic device, a mobile internet device (mobile internet device, MID), an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (network attached storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application is not specifically limited.

The video encoding and decoding device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

The video encoding and decoding device provided in the embodiment of the present application can implement each process implemented by the method embodiments of Figures 1 to 10. To avoid repetition, they will not be described here.

Optionally, in an embodiment of the present application, as shown in Figure 12, the embodiment of the present application also provides an electronic device 80, including a processor 81 and a memory 82, and the memory 82 stores a program or instruction that can be executed on the processor 81. When the program or instruction is executed by the processor 81, the various process steps of the above-mentioned method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

FIG. 13 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 100 includes but is not limited to components such as a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 110.

Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 110 through a power management system, so that the power management system can manage charging, discharging, and power consumption. The electronic device structure shown in FIG13 does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange components differently, which will not be described in detail here.

Among them, the processor 110 is specifically used to encode the first image data as a first key video frame into a video code stream; obtain the second image data; when the target condition is met between the third image data and the second image data, encode the second image data as a second key video frame into the video code stream; wherein the third image data includes any one of the following: the first image data, the fourth image data; the fourth image data is: image data obtained based on the target data; the target data is used to indicate the brightness change information of the pixel points in the first sensor of the electronic device.

The electronic device provided by the embodiment of the present application can first encode the first image data as the first key video frame into the video code stream; and only when the target condition is met between the third image data and the second image data, the second image data will be encoded into the video code stream as the second key video frame, thereby avoiding the output of invalid redundant data, resulting in a waste of storage space and encoding and decoding computing power of the electronic device, and the electronic device can encode more key video frames into the video code stream when the target condition is met between the third image data and the second image data, so that the quality of the decoded video can be improved. Therefore, the storage space and encoding and decoding computing power of the electronic device in the video data encoding and decoding process can be saved under the premise of ensuring the image quality.

Optionally, in an embodiment of the present application, the processor 110 is specifically used to obtain first image data from a cache decoder of the electronic device, and obtain target data through a first sensor; and reconstruct and generate fourth image data based on the first image data and the target data.

Optionally, in the embodiment of the present application, the processor 110 is specifically configured to update the first image data cached in the cache decoder to the second image data when a target condition is satisfied between the third image data and the second image data.

It can be seen that after the electronic device encodes the second image data as the second key video frame into the video code stream, it decodes the second image data and writes it into the cache decoder to update the first image data in the cache decoder, and initializes the image data receiving time again, thereby preventing the cumulative errors generated by the reconstruction algorithm from causing poor video image reconstruction during decoding, thereby improving the image quality of the video shot by the electronic device.

Optionally, in an embodiment of the present application, the processor 110 is specifically configured to acquire target data through a first sensor; and encode the target data as a first non-critical video frame into a video bitstream.

Optionally, in an embodiment of the present application, the processor 110 is specifically used to encode the second image data as a second key video frame into the video code stream when the first time interval is greater than or equal to a first threshold and the brightness change information of the pixel points between the third image data and the second image data is greater than or equal to a second threshold; wherein the first time interval is the time interval between the first moment and the second moment, the first moment is the moment of acquiring the second image data, and the second moment is the moment of encoding the first image data.

Optionally, in the embodiment of the present application, the processor 110 is specifically configured to obtain third image data from a cache decoder of the electronic device; and update the third image data in the cache decoder to the second image data.

Optionally, in an embodiment of the present application, the processor 110 is specifically used to decode the third key video frame in the video code stream to obtain fifth image data; reconstruct the sixth image data based on the fifth image data and the second non-key video frame; wherein the second non-key video frame is: a non-key video frame associated with the third key video frame.

Thus, it can be seen that since the electronic device can first decode the third key video frame in the video code stream to obtain the fifth image data, and adopt the reconstruction algorithm, it only needs to be based on the fifth image data and the second non-key video frame. The sixth image data can be reconstructed, thereby avoiding the complex decoding operations of the traditional method, thereby saving the storage space and decoding computing power of the electronic device during the video data decoding process.

Optionally, in an embodiment of the present application, the processor 110 is specifically configured to determine the second time interval according to a preset decoding frame rate; determine the target decoding time according to the decoding time of the third key video frame and the second time interval; and reconstruct the sixth image data at the target decoding time according to the fifth image data and the second non-key video frame. As can be seen, since the electronic device can first determine the target time interval and the target decoding time according to the preset decoding frame rate, and use different methods to decode according to the data type of the video code stream at the target decoding time, a large amount of calculations on redundant data are avoided, saving calculation power consumption.

It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processing unit (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static RAM (SRAM), a dynamic RAM (DRAM), a synchronous DRAM (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct RAM bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.

It should be noted that, in this article, the terms "comprises", "includes" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device that includes a series of elements includes not only those elements, but also includes other elements that are not explicitly listed, or also includes elements that are inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a..." does not exclude the presence of other identical elements in the process, method, article or device that includes the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, but may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved. For example, the described method may be performed in an order different from that described, and may also be added. Various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

A video encoding and decoding method, the method comprising:

Encoding the first image data as a first key video frame into a video bitstream;

acquiring second image data;

When the third image data and the second image data satisfy a target condition, encoding the second image data as a second key video frame into the video code stream;

Among them, the third image data includes any one of the following: the first image data and the fourth image data; the fourth image data is: image data obtained based on target data; the target data is used to indicate brightness change information of pixel points in the first sensor of the electronic device.
The method according to claim 1, wherein the third image data includes the fourth image data;

After acquiring the second image data, the method further includes:

Acquire the first image data from a cache decoder of the electronic device, and acquire the target data through the first sensor;

The fourth image data is reconstructed and generated based on the first image data and the target data.
The method according to claim 2, wherein after acquiring the second image data, the method further comprises:

When the target condition is satisfied between the third image data and the second image data, the first image data cached in the cache decoder is updated to the second image data.
The method according to claim 1, wherein the third image data includes the fourth image data, and after acquiring the second image data, the method further comprises:

Acquiring the target data through the first sensor;

The target data is encoded into the video code stream as a first non-key video frame.
The method according to claim 1, wherein, when the third image data and the second image data meet a target condition, encoding the second image data as a second key video frame into the video bitstream comprises:

When the first time interval is greater than or equal to a first threshold and the brightness change information of the pixel points between the third image data and the second image data is greater than or equal to a second threshold, encoding the second image data as the second key video frame into the video bitstream;

The first time interval is the time interval between a first moment and a second moment, the first moment is the moment of acquiring the second image data, and the second moment is the moment of encoding the first image data.
The method according to claim 5, wherein, before encoding the second image data as a second key video frame into the video code stream, the method further comprises:

Acquire the third image data from a cache decoder of the electronic device;

After encoding the second image data as a second key video frame into the video code stream, the method further includes:

The third image data in the cache decoder is updated to the second image data.
The method according to claim 1, wherein, after encoding the second image data as a second key video frame into the video bitstream, the method further comprises:

Decoding the third key video frame in the video code stream to obtain fifth image data;

Reconstructing sixth image data according to the fifth image data and the second non-key video frame;

The second non-key video frame is a non-key video frame associated with the third key video frame.
The method according to claim 7, wherein, in the step of converting the third key video in the video code stream After decoding the video frame to obtain fifth image data, the method further includes:

Determining a second time interval according to a preset decoding frame rate;

Determining a target decoding time according to the decoding time of the third key video frame and the second time interval;

Reconstructing the sixth image data according to the fifth image data and the second non-key video frame includes:

At the target decoding time, the sixth image data is reconstructed based on the fifth image data and the second non-critical video frame.
A video encoding and decoding device, the device comprising: an encoding module and an acquisition module;

The encoding module is used to encode the first image data as a first key video frame into a video code stream;

The acquisition module is used to acquire second image data;

The encoding module is further configured to encode the second image data as a second key video frame into the video code stream when the third image data and the second image data acquired by the acquisition module meet a target condition;

Among them, the third image data includes any one of the following: the first image data and the fourth image data; the fourth image data is: image data obtained based on target data; the target data is used to indicate brightness change information of pixel points in the first sensor of the electronic device.
The video encoding and decoding device according to claim 9, wherein the video encoding and decoding device further comprises: a reconstruction module;

The acquisition module is further used to acquire the first image data from a cache decoder of the electronic device, and acquire the target data through the first sensor;

The reconstruction module is used to reconstruct and generate the fourth image data based on the first image data acquired by the acquisition module and the target data.
The video encoding and decoding device according to claim 9, wherein:

The encoding module is specifically configured to encode the second image data as the second key video frame into the video bitstream when the first time interval is greater than or equal to a first threshold and the brightness change information of the pixel points between the third image data and the second image data is greater than or equal to a second threshold;

The first time interval is the time interval between a first moment and a second moment, the first moment is the moment of acquiring the second image data, and the second moment is the moment of encoding the first image data.
The video encoding and decoding device according to claim 9, wherein the video encoding and decoding device further comprises: a decoding module and a reconstruction module;

The decoding module is used to decode the third key video frame in the video code stream to obtain fifth image data;

The reconstruction module is used to reconstruct the sixth image data according to the fifth image data and the second non-key video frame decoded by the decoding module;

The second non-key video frame is a non-key video frame associated with the third key video frame.
An electronic device comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the video encoding and decoding method as described in any one of claims 1 to 8 are implemented.
A readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the video encoding and decoding method according to any one of claims 1 to 8 are implemented.
A chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the steps of the video encoding and decoding method according to any one of claims 1 to 8.
A computer program product, wherein the program product is executed by at least one processor to implement the steps of the video encoding and decoding method according to any one of claims 1 to 8.