WO2020125649A1

WO2020125649A1 - Data processing method and apparatus, and storage medium

Info

Publication number: WO2020125649A1
Application number: PCT/CN2019/126075
Authority: WO
Inventors: 徐科; 宋剑军; 肖杰伟; 王洪; 孔德辉; 杨维
Original assignee: 深圳市中兴微电子技术有限公司
Priority date: 2018-12-17
Filing date: 2019-12-17
Publication date: 2020-06-25
Also published as: CN111327895A; CN111327895B

Abstract

Provided are a data processing method and apparatus, and a storage medium. The method comprises: acquiring, according to an output result of a reference frame image, a motion vector parameter of a current frame image corresponding to the reference frame image; determining, according to the motion vector parameter, a motion level corresponding to a target area in the current frame image; and when the motion level satisfies a coding adjustment policy, adjusting a coding parameter of the current frame image.

Description

Data processing method, device and storage medium

This application requires the priority of the Chinese patent application with the application number 201811541533.5 submitted to the China Patent Office on December 17, 2018. The entire contents of the above applications are incorporated by reference in this application.

Technical field

The present disclosure relates to data processing technology, for example, to a data processing method, device, and storage medium.

Background technique

With the rapid development of the video industry, the video resolution and video bitstream are also expanding. As the most important part to control the picture quality in video coding, the video stream is the same. At the same video resolution, the larger the video stream, the smaller the video compression ratio, the higher the picture quality, and the greater the network bandwidth required. This is bound to bring great pressure on the network bandwidth. Therefore, without increasing the network bandwidth, how to improve the encoding quality of video files by adjusting the video stream becomes very important. However, the related art can only improve the coding quality of video streams with still and small motion scenes through coding control algorithms, but cannot improve the coding quality of video streams with medium motion characteristics.

Summary of the invention

Embodiments of the present invention are expected to provide a data processing method, device, and storage medium, which can improve the encoding quality of a video bitstream.

An embodiment of the present invention provides a data processing method. The method includes:

Acquiring the motion vector parameters of the current frame image corresponding to the reference frame image according to the output result of the reference frame image;

Determine the motion level corresponding to the target area in the current frame image according to the motion vector parameter;

When the motion level satisfies the coding adjustment strategy, the coding parameters of the current frame image are adjusted.

An embodiment of the present invention provides a data processing device. The device includes:

An obtaining unit configured to obtain the motion vector parameters of the current frame image corresponding to the reference frame image according to the output result of the reference frame image;

A determining unit, configured to determine the motion level corresponding to the target area in the current frame image according to the motion vector parameter;

The adjusting unit is configured to adjust the encoding parameters of the current frame image when the motion level meets the encoding adjustment strategy.

An embodiment of the present invention provides a data processing apparatus. The apparatus includes: a memory and a processor;

Wherein, the memory is configured to store a computer program that can run on the processor;

The processor is configured to execute the steps of the above data processing method when running the computer program.

An embodiment of the present invention also provides a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are used to perform the steps of the foregoing data processing method.

Embodiments of the present invention provide a data processing method, device, and storage medium. By acquiring the motion vector information of the current frame image from the output result of the reference frame image, the implementation complexity of the hardware can be reduced; When the motion vector parameter determines that the motion level corresponding to the target area in the current frame image meets the coding adjustment strategy, adjusting the coding parameters of the current frame image can significantly improve the coding quality of the current frame image with little bandwidth increase.

BRIEF DESCRIPTION

FIG. 1 is a schematic flowchart of a data processing method in an embodiment of the present invention;

2 is a schematic diagram of the overall process of the data processing method in the embodiment of the present invention;

3 is a schematic flowchart of adjusting frame-level parameters of an image of a current frame in an embodiment of the present invention;

4 is a schematic flowchart of adjusting CTU (Coding Tree Unit) level parameters of a current frame image in an embodiment of the present invention;

FIG. 5 is a schematic flow chart of collaborative adjustment of the frame-level parameters and CTU-level parameters of the current frame image in the embodiment of the present invention;

FIG. 6 is a first schematic diagram of the structural composition of a data processing device in an embodiment of the present invention;

FIG. 7 is a second schematic diagram of the structural composition of the data processing device in the embodiment of the present invention.

detailed description

The specific embodiments of the present disclosure will be described in detail below with reference to the drawings. It should be understood that the specific embodiments described herein are only used to illustrate and explain the present disclosure, and are not intended to limit the present disclosure.

FIG. 1 is a schematic flowchart of a data processing method in an embodiment of the present invention. As shown in FIG. 1, the method includes:

Step 101: Obtain the motion vector parameters of the current frame image corresponding to the reference frame image according to the output result of the reference frame image;

In the embodiment of the present invention, the method is mainly applicable to an electronic device with a video image encoding function. When processing the image signal of the current frame image, the electronic device usually divides the current frame image into multiples according to a preset image division unit Coding Tree Unit (CTU), the size of each CTU can be 64x64. Then, use the coding region corresponding to at least one CTU as the region A in the current frame image, and search for the region A′ that matches the content of the region A in the reference frame image corresponding to the current frame image according to the content of the region A, and The location of the area A'is determined as the best matching position of the area A in the reference frame image, and the motion statistical information corresponding to the area A'is used as the output result of the reference frame image.

Here, the motion statistical information may be the offset of the area A and the area A′ in the horizontal and vertical directions. Among them, the matching of the area A and the area A′ means that the error between the area A and the area A′ is the smallest, and the error may be the sum of squared errors (Sum of Squared Error, SSE), absolute Sum of errors (Sum of Absolute Difference, SAD) or sum of absolute transformation differences (Sum of Absolute Transformed Difference, SATD), etc.

After the electronic device obtains the output result of the reference frame image, it uses the output result to perform motion estimation (Vector Estimator, VE) on the area A of the current frame image to obtain the motion vector parameter of the area A.

Here, the motion vector parameters include the offset of the motion estimation value of the area A in the horizontal direction and the offset of the motion estimation value in the vertical direction. In addition, the numerical values of the offset of the motion estimation value in the horizontal direction and the offset of the motion estimation value in the vertical direction of the area A are not in the unit of pixel size, but in the image signal processing module (Image) Processing (ISP) The internally set size is in units.

The offset of the motion estimation value of the area A in the horizontal direction can be expressed as offset_x, and the VE value of the area A in the vertical direction can be expressed as: offset_y.

In the embodiment of the present invention, the entire coding region corresponding to the current frame image may also be used as the region A.

When the electronic device regards the entire coding region as the region A, the region A may include multiple CTUs, and the size of each CTU is equal. The motion vector parameter of the region A may include motion vector parameter components corresponding to multiple CTUs.

Step 102: Determine the motion level corresponding to the target area in the current frame image according to the motion vector parameter;

In the embodiment of the present invention, the coding region corresponding to at least one CTU among the multiple CTUs of the current frame image may be determined as the target region, or the entire coding region corresponding to the current frame image may be determined as the target region.

Here, when the electronic device determines the coding region corresponding to at least one CTU in the current frame image as the target region, the motion vector parameter includes the motion vector parameter component corresponding to at least one CTU, and the motion vector parameter corresponding to the at least one CTU may be A preset motion vector parameter is compared with a second preset motion vector parameter to obtain a first comparison result, where the first preset motion vector parameter is greater than the second preset motion vector parameter; then, based on the first comparison result, it is determined At least one CTU corresponds to the exercise level. Among them, the first preset motion vector parameter and the second preset motion vector parameter value are values customized before encoding, and are generally set according to the scene type and experience value used, or obtained by training.

For example, according to the first comparison result, when it is determined that the motion vector parameter corresponding to at least one CTU is less than the second preset motion vector parameter, it is determined that the motion level corresponding to the at least one CTU is a smaller motion; if, according to the first comparison result, it is determined When the motion vector parameter corresponding to at least one CTU is greater than the first preset motion vector parameter, it is determined that the motion level corresponding to the at least one CTU is excessive motion; if, according to the first comparison result, it is determined that the motion vector parameter corresponding to the at least one CTU is less than Or equal to the first preset motion vector parameter and greater than or equal to the second preset motion vector parameter, it is determined that the motion level corresponding to at least one CTU is medium motion. In this way, the coding parameters of a certain CTU in the current frame image can be fine-tuned by determining the motion level corresponding to a certain CTU of the current frame image.

Here, when the electronic device determines the entire coding region corresponding to the current frame image as the target region, the motion vector parameter includes the motion vector parameter component corresponding to each CTU among the multiple CTUs of the current frame image, and each of the multiple CTUs The motion vector parameter components corresponding to the CTU are compared with the first preset motion vector parameter and the second preset motion vector parameter respectively to obtain a second comparison result; then, according to the second comparison result, the first preset motion will be less than or equal to The vector parameter and the CTU corresponding to the target motion vector parameter greater than or equal to the second preset motion vector parameter is determined to be the target CTU in the current frame image that meets the coding adjustment strategy; then the target CTU is accounted for by all CTUs in the current frame image The ratio is compared with the preset ratio to obtain a third comparison result; and according to the third comparison result, the motion level corresponding to the target area in the current frame image is determined.

For example, when the third comparison result indicates that the proportion of the total number of CTUs with medium motion characteristics in the total number of all CTUs in the current frame image is greater than the preset threshold for the proportion of medium motion characteristics, the motion level of the current frame image is considered to be medium motion; If the third comparison result indicates that the proportion of the total number of CTUs with excessive motion characteristics in the current frame image is greater than the preset threshold for the proportion of excessive motion characteristics, the motion level of the current frame image is considered to be excessive. Large motion; when the third comparison result indicates that the proportion of the total number of CTUs with smaller motion characteristics in the current frame image is greater than the preset threshold for the proportion of smaller motion characteristics, the motion level of the current frame image is considered to be Less movement. In this way, the encoding parameters of the current frame image can be fine-tuned by determining the motion level of the current frame image.

Step 103: When the motion level meets the coding adjustment strategy, adjust the coding parameters of the current frame image.

In the embodiment of the present invention, the coding adjustment strategy may be: when the motion level is a higher motion characteristic or a smaller motion characteristic, the coding parameters of the current frame image are not adjusted; when the motion level is a medium motion characteristic, Adjust the image encoding parameters of the current frame.

For example, when the first comparison result corresponding to the motion level represents that the motion vector parameter component corresponding to at least one CTU in the current frame image is less than or equal to the first preset motion vector parameter and greater than or equal to the second preset motion vector parameter, It is determined that the exercise level satisfies the coding adjustment strategy. At this time, the encoding parameters of the current frame image can be adjusted in at least one of the following ways: increase the number of second encoding bits corresponding to the target CTU in the current frame image and decrease the QP (Quantization Parameters) corresponding to the target CTU, quantization parameter )value.

For example, the motion vector parameter component of the current CTU in the current frame image is: Motion_cur, according to the frame type, pixel distribution area, image scene and other conditions of the current frame image, two first preset motions indicating the size of the current CTU motion vector are set Vector parameter: Motion_Thred_High and the second preset motion vector parameter: Motion_Thred_Low. Wherein, the first preset motion vector parameter and the second preset motion vector parameter respectively record the quantized value of the motion vector. Here, the default Motion_Thred_High=2500 and Motion_Thred_Low=200, and then compare the current CTU motion vector parameter (Motion_cur) with the first preset motion vector parameter (Motion_Thred_High) and the second preset motion vector parameter (Motion_Thred_Low) to get the first Comparing results. When the first comparison result characterizes: Motion_cur<Motion_Thred_Low, it is considered that the current CTU motion level belongs to a smaller motion, and the current CTU encoding parameters of the current frame image do not need to be adjusted, and still can be encoded according to the conventional encoding parameters. This is because for frame images with smaller motion characteristics, the conventional coding control algorithm can already do better, so there is no need to re-encode and adjust video streams with smaller motion characteristics. If the first comparison result signifies: Motion_cur>Motion_Thred_High, it is considered that the current CTU motion level belongs to excessive motion, and there is no need to adjust the current CTU level coding parameters of the current frame image, and it can still be coded according to conventional coding parameters. This is because for frame images with excessive motion characteristics, due to the charge-coupled device (CCD) or complementary metal oxide semiconductor (Complementary Metal Oxide Semiconductor (CMOS)) chip in the image sensor, the corresponding The accurate motion vector parameters are obtained in the reference frame image of, so it is of little significance to improve the encoding quality of the distorted image. If the first comparison result characterizes: Motion_Thred_Low<=Motion_cur<=Motion_Thred_High, it is considered that the current motion level of the CTU belongs to medium motion. At this time, the image sensor in the electronic device can obtain a more accurate result from the reference frame image corresponding to the current frame image Motion vector parameters, therefore, the coding parameters of the current CTU of the current frame image can be adjusted.

In the embodiment of the present invention, when the third comparison result corresponding to the motion level indicates that the ratio of all CTUs in the current frame image of the target CTU is greater than the preset ratio, it may be determined that the motion level meets the coding adjustment strategy. At this time, the encoding parameters of the current frame image can be adjusted in at least one of the following ways: increase the number of first encoded bits corresponding to the current frame image and decrease the QP value corresponding to the current frame image.

For example, according to the frame type, pixel distribution area, image scene and other conditions of the current frame image, set three thresholds representing the proportion of each CTU in the current frame image among all CTUs: Frame_High, Frame_Mid, and Frame_Low. The percentage thresholds respectively record the percentages of the CTUs whose motion levels are "excessive motion, medium motion, and small motion" in all CTUs in the current frame image, and the recording range of this percentage can be 0 to 1. The three proportion thresholds can be set to different values according to the frame type, distribution area, scene and other conditions of the current frame image, where the default Frame_High=0.5, Frame_Mid=0.5, Frame_Low=0.5.

Here, before calculating the ratio of the CTU of each motion characteristic in the current frame image to all CTUs, the motion characteristic of each CTU in the current frame image needs to be calculated first. For example, the current frame image can be obtained by comparing the motion vector parameter component (Motion_cur) of the current CTU in the current frame image with the first preset motion vector parameter (Motion_Thred_High) and the second preset motion vector parameter (Motion_Thred_Low) Movement characteristics of each CTU.

For example, the motion vector parameter component of the current CTU is: Motion_cur, and two first preset motion vector parameters representing the size of the current CTU motion vector are set according to the frame type, pixel distribution area, image scene, and other conditions of the current frame image: Motion_Thred_High and The second preset motion vector parameter: Motion_Thred_Low, wherein the first preset motion vector parameter and the second preset motion vector parameter respectively record the quantized values of the motion vector. Here, the default Motion_Thred_High=2500, Motion_Thred_Low=200, and then compare the motion vector parameter (Motion_cur) of the current CTU with the first preset motion vector parameter (Motion_Thred_High) and the second preset motion vector parameter (Motion_Thred_Low) to obtain the second Comparing results. If the second comparison result characterizes the motion vector parameter component of the current CTU (Motion_cur)<the second preset motion vector parameter (Motion_Thred_Low), the motion level of the current CTU is considered to be a smaller motion; if the second comparison result characterizes: the current CTU’s motion level Motion vector parameter component (Motion_cur)>First preset motion vector parameter (Motion_Thred_High), then the current CTU motion level is considered to be excessive motion; if the second comparison result is characterized: second preset motion vector parameter (Motion_Thred_Low)<=current The motion vector parameter component (Motion_cur) of the CTU <= the first preset motion vector parameter (Motion_Thred_High), it is considered that the current CTU motion level belongs to medium motion.

Then, compare the proportion of the total number of CTUs whose motion level belongs to excessive motion characteristics in the current frame image with the ratio threshold (Frame_High), and compare the total number of CTUs whose motion level belongs to moderate motion characteristics in the current frame image The proportion of the total number of CTUs is compared with the proportion threshold (Frame_Mid), and the proportion of the total number of CTUs whose motion level belongs to the smaller motion characteristics in the current frame image is compared with the proportion threshold (Frame_Low) to obtain the third Comparing results. If the third comparison result indicates that the total number of CTUs whose motion level belongs to the smaller motion characteristics in the current frame accounts for the proportion of the total number of all CTUs in the current frame image> ratio threshold (Frame_Low), then the motion level of the current frame image is basically at rest , Small motion, the encoding parameters of the current frame image are not adjusted. This is because for frame images with smaller motion characteristics, the conventional coding control algorithm can already do better, so there is no need to re-encode and adjust video streams with smaller motion characteristics. If the third comparison result indicates that the total number of CTUs whose motion level belongs to excessive motion characteristics in the current frame accounts for the proportion of the total number of all CTUs in the current frame image> ratio threshold (Frame_High), then the current frame motion is considered to be very violent Adjust the encoding parameters of the frame image. This is because for frame images with excessive motion characteristics, due to the charge-coupled device (CCD) or complementary metal oxide semiconductor (Complementary Metal Oxide Semiconductor (CMOS)) chip in the image sensor, the corresponding The accurate motion vector parameters are obtained in the reference frame image of, so it is of little significance to improve the encoding quality of the distorted image. If the third comparison result indicates that the total number of CTUs in the current frame whose motion level belongs to moderate motion characteristics accounts for the total number of all CTUs in the current frame image> ratio threshold (Frame_Mid), it means that the image sensor in the electronic device can start from the current frame image More accurate motion vector parameters are obtained in the corresponding reference frame image, then the encoding parameters of the current frame image are considered suitable for adjustment.

For example, the number of all CTUs in the current frame image is 100. By comparing the motion vector parameter components of each CTU with preset thresholds (Motion_Thred_High and Motion_Thred_Low), it is determined that there are 51 CTUs in the current frame image The level of motion belongs to medium sports, and then, by comparing the proportion of all CTUs in the current frame image of the 51 CTUs with Frame_Mid, the proportion of all CTUs in the current frame image of the 51 CTUs is greater than the threshold of Frame_Mid , You can adjust the coding parameters corresponding to the 51 CTUs in the current frame image.

In the embodiment of the present invention, in order to encounter scenes with greatly varying motion characteristics between two adjacent frame images, it is possible to provide more code words for the current frame image in real time, and also to determine the motion level of the current frame image. When the time when the code adjustment strategy is not satisfied reaches the preset time, it is determined that the motion level meets the code adjustment strategy. At this time, the encoding parameters of the current frame image can be adjusted in at least one of the following ways: increasing the number of first encoded bits corresponding to the current frame image, decreasing the QP value corresponding to the current frame image, and increasing the current frame image The number of second coded bits corresponding to the target CTU, and decreasing the QP value corresponding to the target CTU.

For example, when the motion level of the current frame image is in small motion or excessive motion for 10 minutes, the encoding parameters of the current frame image can be adjusted in at least one of the following ways: increase the first corresponding to the current frame image The number of coded bits, decrease the QP value corresponding to the current frame image, increase the number of second coded bits corresponding to the target CTU in the current frame image, and decrease the QP value corresponding to the target CTU.

In the embodiment of the present invention, when the electronic device adjusts the encoding parameters of the current frame image by reducing the QP value corresponding to the current frame image, the electronic device may be based on the target encoding bit number allocated to the current frame image and the current frame image. The number of CTUs increases the number of second encoded bits corresponding to each CTU in the current frame image; then, decreases the QP value corresponding to the current frame image according to the increased number of second encoded bits.

In the embodiment of the present invention, when adjusting the number of first encoded bits corresponding to the current frame image, the electronic device may adjust the codeword allocated to the current frame image according to the motion level of the current frame image.

For example, the electronic device may calculate the target bit number corresponding to each frame image in the video image according to the target bit rate set by the user on the video image. In the code rate control algorithm, since the number of bits corresponding to the I-frame image is usually more than that of the P-frame image, the number of bits in the I-frame image is equivalent to the average number of bits of all the frame images and needs to be multiplied by a single digit N, where N is greater than 1. Adjust the size of the N value to change the code word assigned to the current frame image. If the current frame image belongs to a medium motion level, the codeword assigned to the current frame image can be increased to ensure the subjective quality of the current frame image, and N can be increased by 1; if the current video frame sequence has no motion level or the motion level is When the motion is small, the previous frame image of the current frame image needs to consume less codewords, and the codeword of the current frame image can be appropriately increased, especially the I frame, then N can be increased by 1 on the original basis; When the scene is bursty, the encoding parameters of the current frame image can also be adjusted in real time, especially the P frame, to avoid the lag of the conventional control algorithm.

Here, the I-frame image refers to an image whose primary_pic_type (basic frame type) value is 0; the P-frame image refers to an image whose primary_pic_type value is 1. A video frame sequence is a collection of frame images that contains more than one frame image. The video frame sequence can be from the first frame image to the Mth frame image, M is greater than 1, or from the 100th frame image to the Mth frame image, M Greater than 100; you can also customize the video frame sequence without considering the codeword required for the adjustment of the frame image after the current frame image.

In the embodiment of the present invention, when adjusting the QP value corresponding to the current frame image, the electronic device may obtain the average value of each pixel in the current frame image by dividing the target bit number obtained by the current frame image by the resolution of the current frame image The target bit (BitsPerPerPixel, BPP), here, the target bit obtained by each pixel refers to the number of bits used to store each pixel, is used to measure the resolution of the image, also known as the pixel of the image depth. The Lagrangian factor corresponding to the current frame image is calculated from the target bits obtained by averaging each pixel in the current frame image, so that the QP value of the current frame image is calculated according to the calculated Lagrange factor.

For example, the following formula 1) calculates the target BPP obtained by averaging each pixel in the current frame image:

Among them, Target Bits refers to the target number of bits obtained by averaging each frame of the image in the current image sequence. The target bits are obtained by dividing the total number of bits per second by the total number of frames per second. N is a custom multiple, W is the width of the current frame image, and H is the height of the current frame image. If the current frame image is not the first frame image, the values of W and H can be input by the front-level module corresponding to the current frame image. If the current frame image is the first frame image, the values of W and H are input by the system.

Then, according to the calculated target BPP obtained by averaging each pixel, calculate the Lagrangian factor λ corresponding to the current frame image according to the following formula 2);

λ=α×BPP ^β 2)

Among them, α and β are model parameters, and the values of α and β will be continuously updated according to the actual encoding result of the previous frame image of the current frame image, after obtaining λ, the QP of the current frame image is calculated according to the following formula 3).

The calculation method of the QP of the current frame image is:

QP=4.2005×ln(λ)+13.7122+0.5 3)

In the embodiment of the present invention, when adjusting the number of first encoded bits corresponding to the current frame image, the electronic device may also adjust the QP value of the current frame image according to the motion level of the current frame image.

For example, if it is found that the motion level of the current frame image belongs to medium motion, or the motion level of a CTU in the current frame image belongs to moderate motion, it means that the current frame image can also be added by a small amount of codewords through more refined processing To significantly improve the subjective quality, then it is necessary to reduce the QP value of the current frame image calculated above. Conversely, if the overall motion level of the current frame image belongs to smaller motion or excessive motion, it means that the subjective quality of the current frame image cannot be significantly improved by more fine-grained processing by adding a small number of codewords, then there is no need Adjust the QP value of the current frame image calculated above.

In the embodiment of the present invention, in order to ensure that the subjective quality of the current frame image does not fluctuate greatly and improve the robustness of the code rate algorithm control, the QP value of the current frame image is only fine-tuned. The initial value of the quantization parameter of the current frame image can be obtained from the above three formulas. If the current frame image is to be adjusted for encoding parameters, the QP value of the current frame image can be reduced by 1 on the original basis, otherwise, the QP value of the current frame image constant.

In the embodiment of the present invention, the electronic device adjusts at least one of the second coded bit number corresponding to the target CTU of the current frame image and the QP value corresponding to the target CTU in the current frame image in the same manner as the current frame. The method of adjusting the number of first encoded bits corresponding to the image is the same as the method of adjusting at least one of the QP values corresponding to the current frame image. It is also appropriate to increase the target when the motion level of the target CTU in the current frame image belongs to moderate motion The target bit number of the CTU, the QP value of the target CTU can be reduced by 1 on the original basis; if the motion level of the target CTU in the current frame image belongs to a small motion or an excessive motion, the target bit number and QP value of the target CTU are not used Adjustment.

In the embodiment of the present invention, in order to avoid an excessive difference between the actual code rate and the target code rate, it is possible to choose to adjust only the first encoded bit number of the current frame image and the QP of the current frame image, or only adjust the first CTU of the current frame image. Two coded bits and the QP value of the target CTU.

In this way, through the data processing method provided by the embodiment of the present invention, when the motion level of the current frame image or the CTU in the current frame image is medium motion, the coding parameters of the current frame image or the CTU in the current frame image can be adjusted. It can significantly improve the encoding quality of the current frame image with little bandwidth increase.

FIG. 2 is a schematic flowchart of a data processing method in an embodiment of the present invention. As shown in Figure 2, the process is as follows:

Step 201, the pre-level module outputs data;

Here, the preceding module may be an image signal processing (ISP) module of a reference frame image corresponding to the current frame image. The output data of the pre-module includes data information of the video image and global motion statistics information of the video image. The global motion statistics information may be motion information corresponding to all frame images in the video image.

Step 202: After saving the relevant data in the output data, start encoding the current frame image;

Here, the current frame image is divided into multiple custom-sized CTU regions according to the preset image division unit, and the global motion statistics information output by the previous module is filtered according to the content of each CTU to obtain the The content matches the target area. The motion statistical information corresponding to the target area is used to perform motion estimation on the corresponding CTU in the current frame image to obtain the motion vector parameter of the CTU.

For example, the current frame image is the nth frame in the video sequence, and the reference frame image corresponding to the current frame image is the n-1th frame in the video sequence. Among them, there is an area A′ in the n-1th frame that matches the content of the area A in the nth frame. Here, the content matching means that the error between the content of the area A and the content of the area A'is less than the preset threshold.

Step 203: Determine whether the motion characteristic of the target area in the current frame image is medium motion;

Here, the target area may be one or more CTUs in the current frame image, or may be the current frame image, or may be one or more slices in the current frame image.

Here, the coding area corresponding to at least one CTU in the current frame image may be determined as the target area, or the entire coding area corresponding to the current frame image may be determined as the target area, or the current frame image may be divided into slices, and one slice contains one slice (segment) or a series of slices beginning with an independent slice (segment), a slice is composed of a series of coding trees (coding tree units), referred to as CTU (equivalent to the previous macroblock concept). In other words, the coding area corresponding to a slice is determined as the target area.

When the electronic device determines the coding region corresponding to at least one CTU in the current frame image as the target region, the motion vector parameter corresponding to the at least one CTU may be compared with the first preset motion vector parameter and the second preset motion vector parameter, respectively To obtain a first comparison result, where the first preset motion vector parameter is greater than the second preset motion vector parameter; when the first comparison result indicates that the motion vector parameter corresponding to at least one CTU in the current frame image is less than or equal to the first preset When the motion vector parameter is greater than or equal to the second preset motion vector parameter, and it is determined that the motion characteristic of the coding region corresponding to the current CTU in the current frame image is medium motion, step 205 is performed; otherwise, step 204 is performed.

Here, when the electronic device determines the overall coding region corresponding to the current frame image as the target region, the motion vector parameter component corresponding to each CTU may be compared with the first preset motion vector parameter and the second preset motion vector parameter, respectively To obtain the second comparison result; then, according to the second comparison result, the CTU corresponding to the target motion vector parameter less than or equal to the first preset motion vector parameter and greater than or equal to the second preset motion vector parameter is determined as the current The target CTU in the frame image that meets the coding adjustment strategy; then compare the proportion of the target CTU in the current frame image with all preset CTUs to obtain the third comparison result; when the third comparison result represents the motion level in the current frame When the ratio of the total number of CTUs belonging to medium motion characteristics to the total number of all CTUs in the current frame image> the ratio threshold (Frame_Mid), it means that the image sensor in the electronic device can get more accurate motion from the reference frame image corresponding to the current frame image For vector parameters, then the encoding parameters of the current frame image are considered suitable for adjustment, step 205 is performed, otherwise, step 204 is performed.

In step 204, the target number of bits in the current area remains unchanged.

Step 205: Adjust the target number of bits in the current area.

For example, the encoding parameter of the current frame image can be adjusted in at least one of the following ways: increase the number of second encoding bits corresponding to the target CTU in the current frame image and decrease the QP value corresponding to the target CTU.

Alternatively, the encoding parameters of the current frame image can also be adjusted in at least one of the following ways: increase the number of first encoded bits corresponding to the current frame image and decrease the QP value corresponding to the current frame image.

Step 206: Calculate, adjust and limit the QP value of the current area;

Here, the limiting range of the QP value of the current region is usually 0-51. In one embodiment, the limiting range can be customized between 16-48. When the number of target bits increases, the QP value will decrease or stay the same.

In order to ensure that the subjective quality of the current frame image does not appear to fluctuate greatly and improve the robustness of the code rate algorithm control, the QP value is only fine-tuned. Therefore, after obtaining the adjusted QP value, it is also necessary to compare the adjusted QP value with the QP value before adjustment, and judge whether the adjusted QP value is within the preset adjustment amplitude according to the comparison result. When the adjusted QP value is not within the preset adjustment amplitude, the adjusted QP value needs to be adjusted to the preset adjustment amplitude.

Here, in order to make more detailed adjustments to the current area, the electronic device also calculates the adjusted QP value. When the current QP value is determined by the calculation result, it can be adjusted in one step. The QP value of the current frame image can be based on the original Decrease by one, otherwise, the QP value of the current frame image does not change. The method of calculating the QP value can refer to the above formula 1, formula 2 and formula 3).

For example, when the QP value of the current frame image is adjusted according to the motion level of the current frame image, if the motion level of the current frame image is found to be moderate motion, or the motion level of a CTU in the current frame image is moderate motion, it indicates that the current frame The image can also be improved through more refined processing to add a small number of codewords to significantly improve the subjective quality, then it is necessary to reduce the QP value of the current frame image calculated above. Conversely, if the overall motion level of the current frame image belongs to smaller motion or excessive motion, it means that the subjective quality of the current frame image cannot be significantly improved by more fine-grained processing by adding a small number of codewords, then there is no need Adjust the QP value of the current frame image calculated above.

Step 207, encode the target area of the current frame image;

Step 208: Determine whether the encoding of the current frame image ends;

When it is determined that the encoding of the current frame image ends, step 209 is performed; when it is determined that the encoding of the current frame image has not ended, step 210 is performed.

Step 209: Determine whether the encoding of the current frame sequence ends;

When it is determined that the encoding of the current frame sequence ends, step 211 is performed; when it is determined that the encoding of the current frame sequence has not ended, step 212 is performed;

Step 210: Encode the next region in the current frame image;

Here, when the next region in the current frame image is encoded, steps 203-208 are performed again.

Step 211, end the process;

In step 212, the encoding process of the next frame image is started.

FIG. 3 is a schematic flowchart of adjusting frame-level parameters of a current frame image in an embodiment of the present invention. As shown in Figure 3, it includes the following steps:

Step 301, the pre-module outputs data;

Here, the pre-stage module may be an ISP module of the reference frame image corresponding to the current frame image. The output data of the pre-module includes data information of the video image and global motion statistics information of the video image. The global motion statistics information may be motion information corresponding to all frame images in the video image.

Step 302: After saving the relevant data in the output data, start encoding the current frame image;

Here, the current frame image is divided into multiple custom-sized CTU areas according to the preset image division unit, and the global motion statistical information output by the preceding module is filtered according to the content of each CTU to obtain the The content matches the target area. The motion statistical information corresponding to the target area is used to perform motion estimation on the corresponding CTU in the current frame image to obtain the motion vector parameter of the CTU.

Step 303: Determine whether the motion characteristic of the current frame image is medium motion;

Here, the current frame image may be first divided into multiple CTUs of equal size, and then, the motion vector parameter components corresponding to each CTU are compared with the first preset motion vector parameter and the second preset motion vector parameter, respectively, to obtain The second comparison result; then, according to the second comparison result, the CTU corresponding to the target motion vector parameter less than or equal to the first preset motion vector parameter and greater than or equal to the second preset motion vector parameter is determined as the current frame image Meet the target CTU of the coding adjustment strategy; then compare the proportion of the target CTU in the current frame image with all preset CTUs to obtain the third comparison result; when the third comparison result indicates that the motion level in the current frame is medium When the ratio of the total number of CTUs of the motion characteristics to the total number of all CTUs in the current frame image> the ratio threshold (Frame_Mid), it means that the image sensor in the electronic device can obtain more accurate motion vector parameters from the reference frame image corresponding to the current frame image , Then it is considered that the encoding parameters of the current frame image are suitable for adjustment, then step 305 is performed; when the third comparison result indicates that the total number of CTUs whose motion level in the current frame belongs to moderate motion characteristics accounts for less than/equal to the total number of CTUs in the current frame image When the ratio threshold (Frame_Mid) is reached, step 304 is executed.

Step 304, the target bit number of the current frame image is unchanged.

Step 305: Adjust the target bit number of the current frame image.

For example, the encoding parameter of the current frame image can be adjusted in at least one of the following ways: increase the number of first encoded bits corresponding to the current frame image and decrease the QP value corresponding to the current frame image.

Step 306, the calculation, adjustment and limiting of the QP value of the frame image;

Here, the limit range of the QP value of the frame image is usually 0-51. In one embodiment, the limit range of the frame image can be customized between 16-48. When the number of target bits increases, the QP value will decrease or stay the same.

Here, in order to make more detailed adjustments to the current frame image, the electronic device also calculates the adjusted QP value. When the current QP value is determined by the calculation result, it can be further adjusted. The QP value of the current frame image can be in the original On the basis of minus 1, otherwise, the QP value of the current frame image is unchanged. The method of calculating the QP value can refer to the above formula 1, formula 2 and formula 3).

Step 307, encode the current frame image;

Step 308: Determine whether the encoding of the current frame image ends;

When it is determined that the encoding of the current frame image ends, step 309 is performed; when it is determined that the encoding of the current frame image has not ended, step 309 is continued.

Step 309: Determine whether the encoding of the current frame sequence ends;

When it is determined that the encoding of the current frame sequence ends, step 310 is performed; when it is determined that the encoding of the current frame sequence has not ended, step 311 is performed;

Step 310, end the process;

In step 311, the encoding process of the next frame image is started.

FIG. 4 is a schematic flowchart of adjusting the CTU performance parameter of the current frame image in the embodiment of the present invention. As shown in Figure 4, it includes the following steps:

Step 401, the pre-module outputs data;

Step 402: After saving the relevant data in the output data, start encoding the current frame image;

Step 403: Determine whether the motion characteristic of each CTU in the current frame image is medium motion;

Here, the current frame image may be divided into multiple CTUs of equal size, and then, the motion vector parameters corresponding to at least one CTU are compared with the first preset motion vector parameter and the second preset motion vector parameter, respectively, to obtain the first A comparison result, where the first preset motion vector parameter is greater than the second preset motion vector parameter; when the first comparison result indicates that the motion vector parameter corresponding to at least one CTU in the current frame image is less than or equal to the first preset motion vector parameter , And greater than or equal to the second preset motion vector parameter, it is determined that the motion characteristic of the coding region corresponding to the current CTU in the current frame image is medium motion, then step 405 is performed; when the first comparison result represents at least one CTU in the current frame image When the corresponding motion vector parameter is greater than the first preset motion vector parameter and less than the second preset motion vector parameter, it is determined that the motion characteristic of the coding region corresponding to the current CTU in the current frame image is not moderate motion, and step 404 is executed.

In step 404, the current CTU target bit number remains unchanged.

Step 405: Adjust the current CTU target bit number.

For example, the encoding parameter of the current CTU may be adjusted in at least one of the following ways: increase the number of second encoded bits corresponding to the current CTU and decrease the QP value corresponding to the current CTU.

Step 406: Calculate, adjust, and limit the QP value of the current CTU;

Here, the limiting range of the current QP value of the CTU is usually 0-51. In one embodiment, the limiting range can usually be customized between 16-48. When the number of target bits increases, the QP value will decrease or stay the same.

Here, in order to make more detailed adjustments to the current CTU, the electronic device also calculates the adjusted QP value. When the current QP value can be adjusted through the calculation result, the current CTU QP value can be adjusted on the original basis. Decrease by one, otherwise, the current QP value of CTU remains unchanged. The method of calculating the QP value can refer to the above formula 1, formula 2 and formula 3).

For example, when the QP value of the current CTU is adjusted according to the current CTU's sports level, if the current CTU's sports level is found to be medium-level sports, or if the current CTU's sports level belongs to medium-level sports, it indicates that the current CTU can also be changed Refined processing to add a small number of codewords can significantly improve the subjective quality, then it is necessary to adjust the QP value of the current CTU calculated above to be small. On the contrary, if the current overall motion level of the CTU belongs to a smaller motion or an excessive motion, it means that the subjective quality of the current CTU cannot be significantly improved by adding a small number of codewords through more elaborate processing, so there is no need to adjust the above The calculated QP value of the current CTU.

Step 407, encoding the current CTU;

Step 408: Determine whether the current CTU encoding is ended;

When it is determined that the encoding of the current CTU is completed, step 409 is performed; when it is determined that the encoding of the current CTU is not ended, step 410 is performed.

Step 409: Determine whether the encoding of the current frame sequence ends;

When it is determined that the encoding of the current frame sequence ends, step 411 is performed; when it is determined that the encoding of the current frame sequence has not ended, step 412 is performed;

Step 410, start coding the next CTU in the current frame image;

Here, when starting to encode the next CTU in the current frame image, steps 403-408 are repeatedly performed.

Step 411, end the process;

In step 412, the encoding process of the next frame image is started.

FIG. 5 is a schematic flow chart of collaborative adjustment of the frame-level parameters and CTU-level parameters of the current frame image in the embodiment of the present invention. As shown in Figure 5, it includes the following steps:

Step 501, the pre-module outputs data;

Here, the pre-stage module may be an ISP module of the reference frame image corresponding to the current frame image. The output data of the previous module includes the data information of the video image and the global motion statistics of the video image. The global motion statistics information may be motion information corresponding to all frame images in the video image.

Step 502: After saving the relevant data in the output data, start encoding the current frame image;

Step 503: Determine whether the motion characteristic of the current frame image is medium motion;

Here, the current frame image may be first divided into multiple CTUs of equal size, and then, the motion vector parameter components corresponding to each CTU are compared with the first preset motion vector parameter and the second preset motion vector parameter, respectively, to obtain The second comparison result; according to the second comparison result, the CTU corresponding to the target motion vector parameter less than or equal to the first preset motion vector parameter and greater than or equal to the second preset motion vector parameter is determined to be satisfied in the current frame image The target CTU of the coding adjustment strategy; then compare the proportion of all CTUs in the current frame image of the target CTU with the preset ratio to obtain the third comparison result; when the third comparison result indicates that the motion level in the current frame belongs to the medium motion characteristic When the ratio of the total number of CTUs in the current frame image to the total number of all CTUs> frame threshold (Frame_Mid), it means that the image sensor in the electronic device can get more accurate motion vector parameters from the reference frame image corresponding to the current frame image, then If it is considered that the encoding parameters of the current frame image are suitable for adjustment, step 305 is performed; when the third comparison result indicates that the total number of CTUs in the current frame whose motion level belongs to moderate motion characteristics accounts for less than/equal to the total number of all CTUs in the current frame image When the threshold (Frame_Mid) is reached, step 504 is executed.

Step 504, the target bit number of the current frame image is unchanged.

Step 505: Adjust the target bit number of the current frame image.

Step 506: Calculate, adjust and limit the QP value of the current frame image;

Here, the limiting range of the QP value is usually 0-51. In an embodiment, the limiting range can usually be customized between 16-48. When the number of target bits increases, the QP value will decrease or stay the same.

Step 507: Determine whether the motion characteristic of each CTU in the current frame image is medium motion;

Here, the current frame image may also be locally fine-tuned according to the motion characteristics of each CTU in the current frame image, that is, the coding region corresponding to the CTU whose motion characteristics are medium motion may be adjusted.

For example, you can first divide the current frame image into multiple CTUs of equal size, and then compare the motion vector parameters corresponding to at least one CTU with the first preset motion vector parameter and the second preset motion vector parameter, respectively, to obtain the first A comparison result, where the first preset motion vector parameter is greater than the second preset motion vector parameter; when the first comparison result indicates that the motion vector parameter corresponding to at least one CTU in the current frame image is less than or equal to the first preset motion vector parameter , And greater than or equal to the second preset motion vector parameter, it is determined that the motion characteristic of the coding region corresponding to the current CTU in the current frame image is medium motion, then step 509 is performed; when the first comparison result represents at least one CTU in the current frame image When the corresponding motion vector parameter is greater than the first preset motion vector parameter and less than the second preset motion vector parameter, it is determined that the motion characteristic of the coding region corresponding to the current CTU in the current frame image is not moderate motion, and step 508 is executed.

In step 508, the current CTU target bit number remains unchanged.

Step 509: Adjust the target bit number of the current CTU.

Step 510, the calculation, adjustment and limiting of the current CTU QP value;

In order to ensure that the subjective quality of the current frame image does not fluctuate greatly and improve the robustness of the code rate algorithm control, the current CTU QP value is only fine-tuned. Therefore, after obtaining the adjusted QP value, it is also necessary to compare the adjusted QP value with the QP value before adjustment, and judge whether the adjusted QP value is within the preset adjustment amplitude according to the comparison result. When the adjusted QP value is not within the preset adjustment amplitude, the adjusted QP value needs to be adjusted to the preset adjustment amplitude.

Step 511, and encode the current CTU;

Step 512: Determine whether the current CTU encoding is ended;

When it is determined that the encoding of the current CTU is completed, step 513 is performed; when it is determined that the encoding of the current CTU is not ended, step 514 is performed.

Step 513: Determine whether the encoding of the current frame sequence ends;

When it is determined that the encoding of the current frame sequence ends, step 515 is performed; when it is determined that the encoding of the current frame sequence has not ended, step 516 is performed;

Step 514, start coding the next CTU in the current frame image;

Here, when starting to encode the next CTU in the current frame image, steps 507-512 are repeatedly performed.

Step 515, end the process;

In step 516, the encoding process of the next frame image is started.

FIG. 6 is a first schematic diagram of the structural composition of a data processing device in an embodiment of the present invention. As shown in FIG. 6, the device includes:

The obtaining unit 601 is configured to obtain the motion vector parameters of the current frame image corresponding to the reference frame image according to the output result of the reference frame image;

The determining unit 602 is set to determine the motion level corresponding to the target area in the current frame image according to the motion vector parameter;

The adjusting unit 603 is configured to adjust the encoding parameters of the current frame image when the motion level meets the encoding adjustment strategy.

In the embodiment of the present invention, the device may be a device with video encoding processing capabilities, and the device further includes:

The dividing unit 604 is configured to divide the current frame image into multiple CTUs according to a preset image division unit, and the size of each CTU is the same.

The determining unit 602 is further configured to determine at least one CTU of the plurality of CTUs as the target area, or determine the entire coding area corresponding to the current frame image as the target area.

In the embodiment of the present invention, the determining unit 602 is set to when the target region is a coding region corresponding to at least one CTU among the plurality of CTUs, the motion vector parameter includes a motion vector corresponding to the at least one CTU Parameter component, determining the at least one CTU according to a first comparison result obtained by comparing the motion vector parameter component corresponding to the at least one CTU with a first preset motion vector parameter and a second preset motion vector parameter respectively Corresponding motion level; or, when the target area is the overall coding area corresponding to the current frame image, the motion vector parameter includes a motion vector parameter component corresponding to each CTU among the multiple CTUs of the current frame image , According to the second comparison result obtained by comparing the motion vector parameter component corresponding to each CTU in the plurality of CTUs with the first preset motion vector parameter and the second preset motion vector parameter=comparison , Determining the CTU corresponding to the target motion vector parameter that is less than or equal to the first preset motion vector parameter and greater than or equal to the second preset motion vector parameter as the one that satisfies the coding adjustment strategy in the current frame image The target CTU, and a third comparison result obtained by comparing the proportions of all CTUs in the current frame image of the target CTU with the preset ratio, to determine the motion level corresponding to the target area in the current frame image.

The device further includes a comparison unit 605 configured to compare the motion vector parameters corresponding to the at least one CTU with the first preset motion vector parameter and the second preset motion vector parameter, respectively, to obtain A first comparison result, the first preset motion vector parameter is greater than the second preset motion vector parameter; or, the motion vector parameter components corresponding to each CTU of the plurality of CTUs are respectively compared with the first Comparing a preset motion vector parameter with the second preset motion vector parameter to obtain a second comparison result; and comparing the ratio of all CTUs of the target CTU in the current frame image to the preset ratio To get the third comparison result.

Here, the motion level satisfies the coding adjustment strategy, including at least one of the following conditions:

The first comparison result corresponding to the motion level characterizes that the motion vector parameter component corresponding to the at least one CTU is less than or equal to the motion vector parameter component and greater than or equal to the second motion vector parameter; The third comparison result corresponding to the motion level indicates that the ratio of all CTUs of the target CTU in the current frame image is greater than the preset ratio; and the time when the motion level does not meet the coding adjustment strategy is reached Preset time.

In the embodiment of the present invention, the adjusting unit 603 is set to adjust the encoding parameter of the current frame image by at least one of the following ways: increasing the number of first encoding bits corresponding to the current frame image, and decreasing the current QP value of the quantization parameter corresponding to the frame image, increasing the number of second encoded bits corresponding to the target CTU in the current frame image, and decreasing the QP value corresponding to the target CTU.

In the embodiment of the present invention, when reducing the QP value of the quantization parameter corresponding to the current frame image, the adjustment unit 603 is further set according to the number of target encoding bits allocated to the current frame image and the current frame image. The number of CTUs increases the number of second encoded bits corresponding to each CTU among the multiple CTUs of the current frame image; according to the number of second encoded bits, decreases the number of second encoded bits corresponding to the current frame image QP value.

It should be noted that when adjusting the encoding parameters of the current frame image, the data processing device provided in the above embodiment is only exemplified by the division of each program module. In practical applications, the above processing can be allocated as needed Different program modules are completed, that is, the internal structure of the data processing device is divided into different program modules to complete all or part of the processing described above. In addition, the data processing apparatus provided in the foregoing embodiment and the foregoing data processing method embodiment belong to the same concept, and the implementation process thereof is described in detail in the method embodiment, and will not be repeated here.

FIG. 7 is a second schematic diagram of the structure of the data processing device in the embodiment of the present invention. As shown in FIG. 7, the data processing device 700 may be a mobile phone, a computer, a digital broadcasting terminal, an information transceiving device, a game console, a tablet device, or an individual. Digital assistant, information push server, content server, etc. The data processing apparatus 700 shown in FIG. 7 includes: at least one processor 701, a memory 702, at least one network interface 704, and a user interface 703. Each component in the data processing apparatus 700 is coupled together through a bus system 705. It can be understood that the bus system 705 is used to implement connection and communication between these components. In addition to the data bus, the bus system 705 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, each type of bus is marked as the bus system 705 in FIG. 7.

The user interface 703 may include a display, a keyboard, a mouse, a trackball, a click wheel, buttons, buttons, a touch panel, or a touch screen.

It can be understood that the memory 702 may be a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memory. Among them, the non-volatile memory can be read-only memory (Read Only Memory, ROM), programmable read-only memory (Programmable Read-Only Memory, PROM), erasable programmable read-only memory (Erasable Programmable Read-Only Memory , EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Ferromagnetic Random Access Memory (FRAM), Flash Memory (Flash Memory), Magnetic Surface Memory , Compact disc, or read-only compact disc (Compact Disc Read-Only Memory, CD-ROM); the magnetic surface memory can be a disk storage or a tape storage. The volatile memory may be a random access memory (Random Access Memory, RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as Static Random Access Memory (Static Random Access Memory, SRAM), Synchronous Static Random Access Memory (Synchronous Static Random Access Memory, SSRAM), Dynamic Random Access Memory (Dynamic Random Access Memory, DRAM), Synchronous Dynamic Random Access Memory (Synchronous Dynamic Random Access Memory, SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (Double Data Rate Synchronous Dynamic Random Access Memory, DDRSDRAM), enhanced Synchronous dynamic random access memory (Enhanced Synchronous Dynamic Random Access Memory, ESDRAM), synchronous link dynamic random access memory (SyncLink Dynamic Random Access Memory, SLDRAM), direct memory bus random access memory (Direct Rambus Random Access Memory, DRRAM ). The memory 702 described in this embodiment of the present invention is intended to include, but is not limited to, these and any other suitable types of memory.

The memory 702 in the embodiment of the present invention is configured to store various types of data to support the operation of the data processing apparatus 700. Examples of these data include: any computer program for operating on the data processing device 700, such as an operating system 7021 and an application program 7022; music data; animation data; book information; video, etc. Among them, the operating system 7021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks. The application program 7022 may include various application programs, such as a media player (Media Player), a browser (Browser), etc., for implementing various application services. The program for implementing the method of the embodiment of the present invention may be included in the application program 7022.

The method disclosed in the foregoing embodiment of the present invention may be applied to the processor 701, or implemented by the processor 701. The processor 701 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 701 or instructions in the form of software. The foregoing processor 701 may be a general-purpose processor, a digital signal processor (DSP, Digital Processor), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, and the like. The processor 701 may implement or execute the disclosed methods, steps, and logical block diagrams in the embodiments of the present invention. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the embodiments of the present invention may be directly implemented and completed by a hardware decoding processor, or may be implemented and completed by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium. The storage medium is located in the memory 702. The processor 701 reads the information in the memory 702 and completes the steps of the foregoing method in combination with its hardware.

In an exemplary embodiment, the data processing apparatus 700 may be composed of one or more application specific integrated circuits (Application Specific Integrated Circuit (ASIC), DSP, programmable logic device (Programmable Logic Device, PLD), complex programmable logic device ( Complex Programmable Logic Device (CPLD), Field-Programmable Gate Array (FPGA), general-purpose processor, controller, microcontroller (Micro Controller), microprocessor (Microprocessor), or other Electronic components are implemented to perform the aforementioned method.

When the processor 701 runs the computer program, it executes: acquiring the motion vector parameters of the current frame image corresponding to the reference frame image according to the output result of the reference frame image; determining the current according to the motion vector parameters The motion level corresponding to the target area in the frame image; when the motion level meets the coding adjustment strategy, adjust the coding parameters of the current frame image.

When the processor 701 runs the computer program, it also executes: dividing the current frame image into a plurality of coding tree unit CTUs according to a preset image division unit; dividing the coding region corresponding to at least one CTU among the plurality of CTUs It is determined to be the target area, or the entire coding area corresponding to the current frame image is determined to be the target area.

When the processor 701 runs the computer program, it also executes: when the target area is an encoding area corresponding to at least one CTU of the plurality of CTUs, the motion vector parameter includes motion corresponding to the at least one CTU Vector parameter component, comparing the motion vector parameter component corresponding to the at least one CTU with a first preset motion vector parameter and a second preset motion vector parameter respectively to obtain a first comparison result, the first preset The motion vector parameter is greater than the second preset motion vector parameter; according to the first comparison result, the motion level corresponding to the at least one CTU is determined; when the target area is the overall coding area corresponding to the current frame image , The motion vector parameter includes a motion vector parameter component corresponding to each CTU among multiple CTUs of the current frame image, and the motion vector parameter component corresponding to each CTU among the multiple CTUs is A preset motion vector parameter is compared with the second preset motion vector parameter to obtain a second comparison result; according to the second comparison result, the first preset motion vector parameter is less than or equal to and greater than or equal to The CTU corresponding to the target motion vector parameter of the second preset motion vector parameter is determined as the target CTU in the current frame image that satisfies the coding adjustment strategy; the ratio of the target CTU to all CTUs in the current frame image Comparing with the preset ratio to obtain a third comparison result; according to the third comparison result, determining the motion level corresponding to the target area in the current frame image.

The exercise level satisfies the coding adjustment strategy, including at least one of the following conditions:

When the processor 701 runs the computer program, it also executes at least one of the following: increasing the number of first encoded bits corresponding to the current frame image, decreasing the quantization parameter QP value corresponding to the current frame image, increasing The number of second encoded bits corresponding to the target CTU in the current frame image, and reducing the QP value corresponding to the target CTU.

When the processor 701 runs the computer program, it also executes: according to the number of target encoding bits allocated to the current frame image and the number of CTUs in the current frame image, increase the number of the current frame image The second coded bit number corresponding to each CTU in the CTU; according to the second coded bit number, the QP value corresponding to the current frame image is reduced.

In an exemplary embodiment, an embodiment of the present invention further provides a computer-readable storage medium, for example, a memory 702 including a computer program, which can be executed by the processor 701 of the data processing apparatus 700 to complete the foregoing method step. The computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface memory, optical disk, or CD-ROM; it may also be various devices including one or any combination of the above memories, such as Mobile phones, computers, tablet devices, personal digital assistants, etc.

A computer-readable storage medium on which a computer program is stored, which when executed by a processor, executes: according to the output result of a reference frame image, obtains motion vector parameters of a current frame image corresponding to the reference frame image Determine the motion level corresponding to the target area in the current frame image according to the motion vector parameters; when the motion level meets the coding adjustment strategy, adjust the coding parameters of the current frame image.

When the computer program is executed by the processor, it also executes: dividing the current frame image into a plurality of coding tree unit CTUs according to a preset image division unit; determining the coding region corresponding to at least one CTU among the plurality of CTUs as the The target area, or the entire coding area corresponding to the current frame image is determined as the target area.

When the computer program is executed by the processor, it also executes: when the target area is an encoding area corresponding to at least one CTU of the plurality of CTUs, the motion vector parameter includes a motion vector parameter component corresponding to the at least one CTU , Comparing the motion vector parameter components corresponding to the at least one CTU with the first preset motion vector parameter and the second preset motion vector parameter respectively to obtain a first comparison result, the first preset motion vector parameter Greater than the second preset motion vector parameter; determining the motion level corresponding to the at least one CTU according to the first comparison result; when the target area is the overall coding area corresponding to the current frame image, the The motion vector parameter includes a motion vector parameter component corresponding to each CTU of the plurality of CTUs of the current frame image, and the motion vector parameter component corresponding to each CTU of the plurality of CTUs is respectively compared with the first preset The motion vector parameter is compared with the second preset motion vector parameter to obtain a second comparison result; according to the second comparison result, the first preset motion vector parameter is less than or equal to and greater than or equal to the second The CTU corresponding to the target motion vector parameter of the preset motion vector parameter is determined to be the target CTU that satisfies the encoding adjustment strategy in the current frame image; the ratio of the target CTU to all CTUs in the current frame image and the preset The proportions are compared to obtain a third comparison result; according to the third comparison result, the motion level corresponding to the target area in the current frame image is determined.

When the computer program is executed by the processor, it also executes at least one of the following: increasing the number of first encoded bits corresponding to the current frame image, decreasing the quantization parameter QP value corresponding to the current frame image, and increasing the current The number of second encoded bits corresponding to the target CTU in the frame image, and reducing the QP value corresponding to the target CTU.

When the computer program is run by the processor, it also executes: increasing each of the multiple CTUs of the current frame image according to the number of target coded bits allocated for the current frame image and the number of CTUs in the current frame image The number of second encoded bits corresponding to each CTU; according to the number of second encoded bits, decrease the QP value corresponding to the current frame image.

Claims

A data processing method, including:

Acquiring the motion vector parameters of the current frame image corresponding to the reference frame image according to the output result of the reference frame image;

Determine the motion level corresponding to the target area in the current frame image according to the motion vector parameter;

When the motion level satisfies the coding adjustment strategy, the coding parameters of the current frame image are adjusted.
The method according to claim 1, wherein before the determining the motion level corresponding to the target region in the current frame image according to the motion vector parameter, the method further comprises:

Divide the current frame image into multiple coding tree units CTU according to a preset image division unit;

The coding region corresponding to at least one CTU of the plurality of CTUs is determined as the target region, or the entire coding region corresponding to the current frame image is determined as the target region.
The method according to claim 2, wherein, when the target region is a coding region corresponding to at least one CTU of the plurality of CTUs, the motion vector parameter includes a motion vector parameter component corresponding to the at least one CTU;

The determining the motion level corresponding to the target area in the current frame image according to the motion vector parameter includes:

Comparing the motion vector parameter components corresponding to the at least one CTU with the first preset motion vector parameter and the second preset motion vector parameter respectively to obtain a first comparison result, the first preset motion vector parameter is greater than The second preset motion vector parameter;

According to the first comparison result, the exercise level corresponding to the at least one CTU is determined.
The method according to claim 2 or 3, wherein when the target area is an overall coding area corresponding to the current frame image, the motion vector parameter includes each CTU of the plurality of CTUs of the current frame image Corresponding motion vector parameter components;

The determining the motion level corresponding to the target area in the current frame image according to the motion vector parameter includes:

Comparing the motion vector parameter component corresponding to each CTU of the plurality of CTUs with the first preset motion vector parameter and the second preset motion vector parameter, respectively, to obtain a second comparison result;

According to the second comparison result, determine the CTU corresponding to the motion vector parameter component that is less than or equal to the first preset motion vector parameter and greater than or equal to the second preset motion vector parameter as the current frame The target CTU in the image that meets the coding adjustment strategy;

Comparing the ratio of all CTUs of the target CTU in the current frame image with a preset ratio to obtain a third comparison result;

According to the third comparison result, the motion level corresponding to the target area in the current frame image is determined.
The method according to claim 3 or 4, wherein the motion level satisfies the coding adjustment strategy, including at least one of the following conditions:

The first comparison result corresponding to the motion level characterizes that the motion vector parameter component corresponding to the at least one CTU is less than or equal to the first preset motion vector parameter and greater than or equal to the second preset motion Vector parameter

The third comparison result corresponding to the motion level indicates that the target CTU accounts for more than all the CTUs in the current frame image than the preset ratio; and

The time when the exercise level does not satisfy the coding adjustment strategy reaches a preset time.
The method according to claim 1 or 4, wherein the adjusting the encoding parameters of the current frame image includes at least one of the following:

Increase the number of first encoded bits corresponding to the current frame image;

Reducing the QP value of the quantization parameter corresponding to the current frame image; increasing the number of second encoded bits corresponding to the target CTU in the current frame image; and

Reduce the QP value corresponding to the target CTU.
The method according to claim 6, wherein before reducing the QP value corresponding to the current frame image, the method further comprises:

Increase the number of second encoded bits corresponding to each CTU among the multiple CTUs of the current frame image according to the number of target coded bits allocated for the current frame image and the number of CTUs in the current frame image;

According to the second coded bit number, the QP value corresponding to the current frame image is reduced.
A data processing device, including:

An obtaining unit configured to obtain the motion vector parameters of the current frame image corresponding to the reference frame image according to the output result of the reference frame image;

A determining unit, configured to determine the motion level corresponding to the target area in the current frame image according to the motion vector parameter;

The adjusting unit is configured to adjust the encoding parameters of the current frame image when the motion level meets the encoding adjustment strategy.
The apparatus according to claim 8, further comprising a division unit configured to divide the current frame image into a plurality of coding tree units CTU according to a preset image division unit;

The determining unit is further configured to determine at least one CTU of the plurality of CTUs as the target area, or determine the entire coding area corresponding to the current frame image as the target area.
The device according to claim 9, wherein

The determining unit is configured to, when the target region is a coding region corresponding to at least one CTU of the plurality of CTUs, the motion vector parameter includes a motion vector parameter component corresponding to the at least one CTU, according to the at least one A first comparison result obtained by comparing the motion vector parameter components corresponding to one CTU with the first preset motion vector parameter and the second preset motion vector parameter to determine the motion level corresponding to the at least one CTU; or, When the target area is the overall coding area corresponding to the current frame image, the motion vector parameter includes a motion vector parameter component corresponding to each CTU among multiple CTUs of the current frame image, according to the multiple CTUs A second comparison result obtained by comparing the motion vector parameter components corresponding to each CTU in the first preset motion vector parameter and the second preset motion vector parameter respectively will be less than or equal to the first A preset motion vector parameter and a CTU corresponding to a motion vector parameter component greater than or equal to the second preset motion vector parameter, determined as the target CTU in the current frame image that satisfies the encoding adjustment strategy, and according to the target A third comparison result obtained by comparing the proportion of all CTUs in the current frame image with the preset proportion in the current frame image to determine the motion level corresponding to the target area in the current frame image;

The device further includes a comparison unit configured to compare the motion vector parameters corresponding to the at least one CTU with a first preset motion vector parameter and a second preset motion vector parameter, respectively, to obtain a first A comparison result, the first preset motion vector parameter is greater than the second preset motion vector parameter; or, the motion vector parameter component corresponding to each CTU of the plurality of CTUs is respectively Set the motion vector parameter and the second preset motion vector parameter for comparison to obtain a second comparison result, and compare the ratio of all CTUs of the target CTU in the current frame image with the preset ratio to obtain The third comparison result.
A data processing device, including: a memory and a processor;

Wherein, the memory is configured to store a computer program that can run on the processor;

The processor is configured to execute the steps of the method according to any one of claims 1 to 7 when running the computer program.
A computer-readable storage medium storing computer-executable instructions for performing the steps of the method according to any one of claims 1-7.