CN117676148A

CN117676148A - Video recoding method, device, computer readable storage medium and terminal equipment

Info

Publication number: CN117676148A
Application number: CN202311716327.4A
Authority: CN
Inventors: 马晓婷
Original assignee: Hangzhou Lianji Technology Co ltd
Current assignee: Hangzhou Lianji Technology Co ltd
Priority date: 2023-12-13
Filing date: 2023-12-13
Publication date: 2024-03-08

Abstract

The application belongs to the technical field of image processing, and particularly relates to a video recoding method, a video recoding device, a computer readable storage medium and terminal equipment. The method comprises the following steps: acquiring a target video to be encoded and corresponding encoding configuration information; determining a target coding grade corresponding to the target video according to the coding configuration information; determining a target coding strategy set corresponding to the target coding grade; the target coding strategy set comprises preset coding strategies of all dimensions; and decoding and recoding the target video according to the coding strategies of each dimension in the target coding strategy set to obtain recoded video. By the method, corresponding coding strategy sets can be set for different coding grades; the coding strategy set can comprise coding strategies of each dimension; accordingly, a proper coding strategy set can be provided according to the requirements of users, the flexibility of video coding is improved, and the storage space is saved on the basis of guaranteeing the user experience.

Description

Video recoding method, device, computer readable storage medium and terminal equipment

Technical Field

The application belongs to the technical field of image processing, and particularly relates to a video recoding method, a video recoding device, a computer readable storage medium and terminal equipment.

Background

With the increasing popularity of security industry, streaming media live broadcast and other applications in daily life, the demands of people for high-quality video are also increasingly remarkable. But the data volume of high quality video is very large, creating a great pressure on the storage and transmission of video. However, in the existing video encoding methods, most of the encoding methods of the front-end camera are considered from the viewpoint of real-time performance, and there is no related scheme for improving the video compression rate through the back-end recoding. And the recoding of the rear end has richer information, so that the code rate can be saved from more angles, a proper coding strategy can be provided according to the actual demands of users, and the comprehensive demands of image quality and compression rate are met.

Disclosure of Invention

In view of this, the embodiments of the present application provide a video recoding method, apparatus, computer readable storage medium, and terminal device, so as to solve the problem that most of the existing video coding methods are coding methods of front-end cameras from the viewpoint of real-time, there is no related scheme for improving video compression rate through back-end recoding, and back-end recoding has richer information, so that code rate can be saved from more angles, a suitable coding strategy can be provided according to actual demands of users, and comprehensive demands of image quality and compression rate can be satisfied.

A first aspect of an embodiment of the present application provides a video recoding method, which may include:

acquiring a target video to be encoded and corresponding encoding configuration information;

determining a target coding grade corresponding to the target video according to the coding configuration information;

determining a target coding strategy set corresponding to the target coding grade; the target coding strategy set comprises preset coding strategies of all dimensions;

and decoding and recoding the target video according to the coding strategies of each dimension in the target coding strategy set to obtain recoded video.

In a specific implementation manner of the first aspect, before determining the target encoding policy set corresponding to the target encoding level, the method may further include:

acquiring coding grade configuration information;

establishing a coding grade corresponding relation according to the coding grade configuration information; the corresponding relation of the coding grades comprises a one-to-one corresponding relation between each coding grade and each coding strategy set;

accordingly, the determining the target coding strategy set corresponding to the target coding level includes:

and determining the target coding strategy set corresponding to the target coding grade according to the corresponding relation of the coding grade.

In a specific implementation manner of the first aspect, the establishing a coding level correspondence according to the coding level configuration information may include:

establishing a corresponding relation between the first coding grade and the first coding strategy set; the first coding grade is the coding grade with the highest coding quality and the lowest compression rate, and the first coding strategy set is the coding strategy set with the highest video coding quality and the lowest compression rate;

establishing a corresponding relation between the second coding grade and the second coding strategy set; the second coding grade is the coding grade with the next highest coding quality and the next lowest compression rate, and the second coding strategy set is the coding strategy set with the next highest video coding quality and the next lowest compression rate;

establishing a corresponding relation between the third coding grade and a third coding strategy set; the third coding grade is the coding grade with the lowest coding quality and the highest compression rate, and the third coding strategy set is the coding strategy set with the lowest video coding quality and the highest compression rate.

In a specific implementation manner of the first aspect, the coding configuration information may be custom coding configuration information;

After obtaining the target video to be encoded and the corresponding encoding configuration information, the method may further include:

extracting each coding configuration item from the custom coding configuration information; wherein each code configuration entry corresponds to a dimension of the code strategy;

determining a custom coding strategy set according to each coding configuration item; the custom coding strategy set comprises preset coding strategies of all dimensions;

and decoding and recoding the target video according to the coding strategies of each dimension in the custom coding strategy set to obtain recoded video.

In a specific implementation manner of the first aspect, before decoding and recoding the target video according to the coding strategies of each dimension in the custom coding strategy set, the method may further include:

determining a compression rate corresponding to the custom coding strategy set;

generating corresponding prompt information according to the compression rate, and displaying the prompt information through a preset interactive interface;

acquiring feedback information corresponding to the prompt information through the interactive interface;

and if the feedback information is the confirmation information, decoding and recoding the target video according to the coding strategies of each dimension in the custom coding strategy set.

In a specific implementation manner of the first aspect, the obtaining a target video to be encoded may include:

acquiring the target video and detection information from a preset video storage medium;

correspondingly, after decoding and recoding the target video according to the coding strategies of each dimension in the target coding strategy set to obtain recoded video, the method further comprises the steps of:

storing the recoded video and the detection information into the video storage medium.

In a specific implementation manner of the first aspect, the coding strategies of each dimension may include: b-frame coding strategy, group of pictures length dynamic adjustment strategy, dynamic region compensation strategy, frame rate adjustment strategy, resolution adjustment strategy and/or rate control strategy.

A second aspect of embodiments of the present application provides a video recoding apparatus, which may include:

the coding configuration information acquisition module is used for acquiring the target video to be coded and the corresponding coding configuration information;

the target coding grade determining module is used for determining a target coding grade corresponding to the target video according to the coding configuration information;

the target coding strategy set determining module is used for determining a target coding strategy set corresponding to the target coding grade; the target coding strategy set comprises preset coding strategies of all dimensions;

The target video decoding module is used for decoding the target video to obtain a decoded target video;

and the target video coding module is used for recoding the decoded target video according to the coding strategies of each dimension in the target coding strategy set to obtain recoded video.

In a specific implementation manner of the second aspect, the video recoding apparatus may further include:

the code level configuration information acquisition module is used for acquiring code level configuration information;

the coding grade corresponding relation establishing module is used for establishing a coding grade corresponding relation according to the coding grade configuration information; the corresponding relation of the coding grades comprises a one-to-one corresponding relation between each coding grade and each coding strategy set;

accordingly, the target encoding policy set determining module may include:

and the target coding strategy set determining submodule is used for determining the target coding strategy set corresponding to the target coding grade according to the corresponding relation of the coding grade.

In a specific implementation manner of the second aspect, the coding level correspondence establishing module may include:

The first corresponding relation establishing sub-module is used for establishing a corresponding relation between the first coding grade and the first coding strategy set; the first coding grade is the coding grade with highest image quality and lowest compression rate, and the first coding strategy set is the coding strategy set with highest video coding quality and lowest compression rate;

the second corresponding relation establishing sub-module is used for establishing a corresponding relation between the second coding grade and the second coding strategy set; the second coding grade is the coding grade with the image quality being low and the compression rate being high, and the second coding strategy set is the coding strategy set with the video coding quality being high and the compression rate being low;

the third corresponding relation establishing sub-module is used for establishing a corresponding relation between a third coding grade and a third coding strategy set; the third coding level is the coding level with the lowest image quality and the highest compression rate, and the third coding strategy set is the coding strategy set with the lowest video coding quality and the highest compression rate.

In a specific implementation manner of the second aspect, the coding configuration information may be custom coding configuration information;

The video recoding apparatus may further include:

the code configuration item extraction module is used for extracting each code configuration item from the custom code configuration information; wherein each code configuration entry corresponds to a dimension of the code strategy;

the custom coding strategy set determining module is used for determining a custom coding strategy set according to each coding configuration item; the custom coding strategy set comprises preset coding strategies of all dimensions;

further, the target video encoding module may be further configured to re-encode the decoded target video according to the encoding policies of each dimension in the custom encoding policy set, to obtain a re-encoded video.

the compression rate determining module is used for determining the compression rate corresponding to the custom coding strategy set;

the prompt information generation module is used for generating corresponding prompt information according to the compression rate and displaying the prompt information through a preset interactive interface;

the feedback information acquisition module is used for acquiring feedback information corresponding to the prompt information through the interactive interface;

Further, the target video encoding module may be further configured to re-encode the decoded target video according to the encoding policies of each dimension in the custom encoding policy set if the feedback information is acknowledgement information.

In a specific implementation manner of the second aspect, the code configuration information obtaining module may include:

the target video and detection information acquisition sub-module is used for acquiring the target video and detection information from a preset video storage medium;

and the target video and detection information storage sub-module is used for storing the recoded video and the detection information into the video storage medium.

In a specific implementation manner of the second aspect, the coding strategy of each dimension includes: b-frame coding strategy, group of pictures length dynamic adjustment strategy, dynamic region compensation strategy, frame rate adjustment strategy, resolution adjustment strategy and/or rate control strategy.

A third aspect of the embodiments of the present application provides a computer-readable storage medium storing a computer program which, when executed by a processor, implements the steps of any one of the video re-encoding methods described above.

A fourth aspect of the embodiments of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of any one of the video recoding methods described above when the processor executes the computer program.

A fifth aspect of the embodiments of the present application provides a computer program product for, when run on a terminal device, causing the terminal device to perform the steps of any one of the video re-encoding methods described above.

Compared with the prior art, the embodiment of the application has the beneficial effects that: the method comprises the steps of obtaining a target video to be coded and corresponding coding configuration information; determining a target coding grade corresponding to the target video according to the coding configuration information; determining a target coding strategy set corresponding to the target coding grade; the target coding strategy set comprises preset coding strategies of all dimensions; and decoding and recoding the target video according to the coding strategies of each dimension in the target coding strategy set to obtain recoded video. By the embodiment of the application, corresponding coding strategy sets can be set for different coding grades; the coding strategy set can comprise coding strategies of each dimension; therefore, a proper coding strategy set can be provided according to the requirements of users, the flexibility of video recoding is improved, the storage space is saved, and the user experience is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following description will briefly introduce the drawings that are needed in the embodiments or the description of the prior art, it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram of a process of storing a video stream of a video front-end IPC to a back-end device;

FIG. 2 is a schematic diagram of a video backend recoding process according to an embodiment of the present application;

FIG. 3 is a flow chart of one embodiment of a method for video recoding in an embodiment of the present application;

FIG. 4 is a schematic diagram of a coding level and a corresponding coding strategy set according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a B-frame pyramid;

FIG. 6 is a schematic diagram of an interactive interface in a custom mode;

FIG. 7 is a schematic diagram of a custom encoding strategy set;

FIG. 8 is a block diagram of one embodiment of a video recoding apparatus in an embodiment of the present application;

fig. 9 is a schematic block diagram of a terminal device in an embodiment of the present application.

Detailed Description

In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the embodiments described below are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.

It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It is also to be understood that the terminology used in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

It should be further understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.

As used in this specification and the appended claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a [ described condition or event ]" or "in response to detection of a [ described condition or event ]".

In addition, in the description of the present application, the terms "first," "second," "third," etc. are used merely to distinguish between descriptions and are not to be construed as indicating or implying relative importance.

With the increasing popularity of security industry, streaming media live broadcast and other applications in daily life, the demands of people for high-quality video are also increasingly remarkable. But the data volume of high quality video is very large and often requires encoding and compression for storage and transmission. However, most of the existing video coding methods are front-end IPC coding methods from the viewpoint of real-time performance, no related scheme for improving the video compression rate through back-end recoding is adopted, the back-end recoding has richer information, the code rate can be saved from more angles, a proper coding strategy can be provided according to the actual demands of users, and the comprehensive demands of the image quality and the compression rate are met.

In view of this, the embodiments of the present application provide a video recoding method, apparatus, computer readable storage medium, and terminal device, so as to solve the problem that most of the existing video coding methods are front-end IPC coding methods from the viewpoint of real-time, there is no related scheme for improving video compression rate through back-end recoding, and back-end recoding has more abundant information, so that code rate can be saved from more angles, a suitable coding strategy can be provided according to actual demands of users, and comprehensive demands of image quality and compression rate can be satisfied.

It should be noted that, the execution body of the method of the present application may be a terminal device, specifically, a terminal device with a codec capability, including but not limited to a terminal device such as a network video server (Network Video Server, NVR), a network video recorder (Network Video Recorder, NVR), and the like.

The method can be applied to various application scenes, such as security application scenes, streaming media live broadcast application scenes and the like, taking the security application scenes as an example, referring to fig. 1, video recorded by a network Camera (IP Camera, IPC) and some detection information (such as movement detection information) can be managed through NVS or NVR, and stored on a preset video storage medium (such as a hard disk); however, with the increase of the use time, the data volume of the historical video is gradually huge, and more storage space is occupied, thus bringing a huge burden to the video storage medium. Therefore, the method can set a flexible back-end recoding strategy, and can re-read video content for decoding and recoding after the front-end coding and storage of the video are completed, and then the obtained coded video and detection information are stored in a video storage medium, as shown in fig. 2.

Referring to fig. 3, an embodiment of a video recoding method in an embodiment of the present application may include:

step S301, obtaining a target video to be encoded and corresponding encoding configuration information.

In order to improve flexibility of video coding, in a recommended mode of video coding, different coding levels can be set for video coding, and each coding level can correspond to a different coding strategy of each dimension. When in actual use, a user can select a corresponding coding grade for a target video to be coded on a preset interactive interface of the terminal equipment, and accordingly, the terminal equipment can generate corresponding coding configuration information; wherein the encoding configuration information may be used to indicate an encoding level of the video; the terminal device may then perform a subsequent video re-encoding process according to the encoding configuration information.

In a specific implementation manner, a user can select to enter a recommendation mode on an interactive interface of the terminal equipment; then, the selection item corresponding to the coding level can be displayed on the interactive interface, and the user can select the coding level by selecting the selection item corresponding to a certain coding level. Corresponding code configuration information may be generated according to the code level selected by the user.

In this embodiment of the present application, specifically, a target video to be encoded may be obtained from a preset video storage medium, and encoding configuration information selected by a user on a preset interactive interface may be obtained.

Furthermore, the detection information corresponding to the target video can be obtained from the video storage medium and applied to the subsequent recoding process of the target video, and the auxiliary effect can be better provided due to the fact that the detection information has more priori knowledge, so that the overall recoding efficiency is effectively improved.

Step S302, determining a target coding level corresponding to the target video according to the coding configuration information.

In the embodiment of the application, the target coding grade identifier in the coding configuration information can be extracted, and the target coding grade corresponding to the target video can be determined according to the target coding grade identifier; each coding level can correspond to one coding level identifier, and each coding level can be distinguished according to the coding level identifier.

The number of coding levels can be specified and set according to actual needs, and the number of coding levels is not limited in the application.

For example, 3 coding levels may be set, namely a first coding level, a second coding level and a third coding level; the code level identifier corresponding to the first code level is identifier 1, the code level identifier corresponding to the second code level is identifier 2, and the code level identifier corresponding to the third code level is identifier 3; if the target coding level identifier in the extracted coding configuration information is the identifier 1, the target coding level may be determined to be the first coding level.

Step S303, a target coding strategy set corresponding to the target coding level is determined.

In this embodiment of the present application, each coding level may correspond to a coding policy set, where the coding policy set may include preset coding policies of each dimension. Specifically, the coding strategies of each dimension can be set according to actual needs, which is not limited in the application; preferably, the coding strategies of the respective dimensions may include a B-frame coding strategy, a group of pictures (Group of Pictures, GOP) length dynamic adjustment strategy, a dynamic region compensation strategy, a frame rate adjustment strategy, a resolution adjustment strategy, and/or a rate control strategy.

In this embodiment of the present application, 3 coding levels may be specifically set, which are a first coding level, a second coding level, and a third coding level, respectively; the first coding level is the coding level with the highest coding quality and the lowest compression rate, the second coding level is the coding level with the next highest coding quality and the next lowest compression rate, and the third coding level is the coding level with the lowest coding quality and the highest compression rate. And, can dispose the correspondent code strategy set of each code grade; for the first coding level, a corresponding coding strategy set can be configured as a first coding strategy set, and accordingly, the first coding strategy set can be a coding strategy set with highest video coding quality and lowest compression rate; for the second coding level, the corresponding coding strategy set can be configured as a second coding strategy set, and correspondingly, the second coding strategy set can be a coding strategy set with the video coding quality being next highest and the compression rate being next lowest; for the third coding level, the corresponding coding strategy set can be configured as a third coding strategy set, and correspondingly, the third coding strategy set can be the coding strategy set with the lowest video coding quality and highest compression rate; accordingly, corresponding encoding level configuration information may be generated.

By acquiring the configuration information of the coding grades, the corresponding relation of the coding grades can be established; the coding level correspondence may include a one-to-one correspondence between each coding level and each coding policy set.

Specifically, referring to fig. 4, a correspondence between the first coding level and the first coding policy set may be established. For the first coding strategy set, the B frame coding strategy may be enabling B frame coding, the group of pictures length dynamic adjustment strategy may be disabling GOP dynamic adjustment, the dynamic region compensation strategy may be enabling dynamic region compensation, the frame rate adjustment strategy may be keeping the frame rate unchanged, the resolution adjustment strategy may be keeping the resolution unchanged, and the code rate control strategy may be a high standard code rate; for the second coding strategy set, the B frame coding strategy may be enabling B frame coding, the group of pictures length dynamic adjustment strategy may be disabling GOP dynamic adjustment, the dynamic region compensation strategy may be enabling dynamic region compensation, the frame rate adjustment strategy may be keeping the frame rate unchanged, the resolution adjustment strategy may be keeping the resolution unchanged, and the code rate control strategy may be standard code rate; for the third coding policy set, the B frame coding policy may be B frame coding enabled, the group of pictures length dynamic adjustment policy may be GOP dynamic adjustment enabled, the dynamic region compensation policy may be GOP dynamic region compensation enabled, the frame rate adjustment policy may be frame rate degradation, the resolution adjustment policy may be resolution degradation, and the code rate control policy may be low standard code rate.

According to the corresponding relation of the coding grades, a target coding strategy set corresponding to the target coding grade can be determined. For example, if the target coding level is the first coding level, it may be determined that the target coding policy set corresponding to the first coding level is the first coding policy set according to the coding level correspondence.

In practical application, different coding grades and corresponding coding strategy sets can be set according to practical requirements so as to meet personalized requirements of users, and the setting of the coding grades and the corresponding coding strategy sets is not particularly limited.

And step S304, decoding and recoding the target video according to the coding strategies of each dimension in the target coding strategy set to obtain the recoded video.

Coding strategies of each dimension in the embodiment of the present application will be described below.

In the embodiment of the application, a B-frame coding strategy may be adopted to improve the coding compression rate. Specifically, during the video encoding process, the P frame may record the difference from the previous frame, and the B frame may record the difference between the previous frame and the next frame, and reference may be made to the B frame pyramid schematic diagram shown in fig. 5; because the front end coding of the video needs to be coded in real time, future information (follow-up information) cannot be acquired in the process, and only the difference between the P frame record and the previous frame can be used as a forward reference; and the rear end coding of the video can acquire all information of the video, so that a B frame coding strategy can be used in the process, B frames are introduced, and the difference between the previous frame and the next frame is recorded and used as forward reference and backward reference, thereby improving the compression rate.

In addition, a dynamic region compensation strategy can be adopted to improve the image quality of the dynamic region. Specifically, a dynamic region with more frequent change may exist in the video, and dynamic region information can be obtained through some detection algorithms; in the embodiment of the application, the dynamic area can be determined according to the position information of the moving area in the moving scene recorded by the IPC, the dynamic area is set with higher image quality during encoding, more data are distributed for description, and the dynamic area is compensated to improve the image quality of the dynamic area. Because the acquired position information is the existing detection information, the processing complexity of the dynamic region compensation strategy in the embodiment of the application is smaller, and the image quality can be improved as much as possible on the basis of not increasing the complexity.

In the embodiment of the application, the frame rate adjustment strategy can be flexibly set according to the requirements of different coding grades on video coding quality; specifically, if the target coding level is the first coding level or the second coding level, the user can be considered to have higher requirements on video coding quality and lower requirements on storage space consumption, and the frame rate can be kept unchanged at this time; if the target coding level is the third coding level, the user can be considered to have lower requirements on video coding quality and higher requirements on storage space consumption, and the frame rate can be properly reduced at the moment so as to save the storage space.

Similarly, according to the embodiment of the application, the resolution adjustment strategy can be flexibly set according to the requirements of different coding grades on video coding quality; specifically, if the target coding level is the first coding level or the second coding level, the user can be considered to have higher requirements on video coding quality and lower requirements on storage space consumption, and the resolution can be kept unchanged at this time; if the target coding level is the third coding level, the user can be considered to have lower requirements on video coding quality and higher requirements on storage space consumption, and at the moment, the resolution can be properly reduced so as to save the storage space.

In addition, according to the embodiment of the application, the code rate control strategies with different standards can be flexibly set according to the requirements of different coding grades on video coding quality. For the first coding level, a high standard rate control strategy may be employed; for the second coding level, a standard rate control strategy may be employed; for the third coding level, a low standard rate control strategy may be employed. Specifically, at each encoding level, a quantization parameter (Quantization Parameter, QP) and a data amount of the video frame may be determined according to scene complexity and motion level of the video frame; and the underlying encoder may encode based on the target QP and the target amount of data for the video frame. Here, a quality standard correspondence between both scene complexity and motion level of video frames at different encoding levels and QP values may be established; the scene complexity of the video frame can be measured by the gradient of the video frame, the motion degree of the video frame can be measured by the motion area of the video frame, the motion area of the video frame can be determined according to the IPC motion detection result at the front end of the video, and if the motion area of a certain video frame is larger, the motion degree of the video frame can be considered to be larger; the smaller the motion area of a certain video frame, the smaller the motion degree can be considered.

In the embodiment of the present application, a first quality standard correspondence between the QP value and both the scene complexity and the motion degree of the video frame at the first encoding level, a second quality standard correspondence between the QP value and both the scene complexity and the motion degree of the video frame at the second encoding level, and a third quality standard correspondence between the QP value and both the scene complexity and the motion degree of the video frame at the third encoding level may be established, respectively.

Note that, QP values are quantization indexes of image quality, and different QP values correspond to different image qualities; if the QP value is greater, the image quality of the video is lower; the smaller the QP value, the higher the image quality of the video. And different coding grades have different requirements on video coding quality, and for a certain video frame, different QP values can be determined according to the established corresponding quality standard corresponding relation under different coding grades so as to meet the different requirements on the video coding quality of different coding grades. For example, the first encoding level may require higher quality for video encoding than the second encoding level, and for the same video frame, the QP value determined according to the first quality criterion correspondence may be smaller than the QP value determined according to the second quality criterion correspondence.

When video coding is performed, the QP value corresponding to the specific scene complexity and the motion degree can be determined through the quality standard corresponding relation corresponding to the target coding level. According to the determined QP value, the data volume of the video frame can be determined; for the same picture, there is a logarithmic relationship between the QP value and the number of Bits Per Pixel (BPP) as follows:

QP＝a·log ₂ BPP+b

where a and b are two different coefficients of the scene model, respectively. According to the above equation, the data amount of the video can be determined after the QP value is determined.

According to the QP value and the data quantity of the video frame, the bottom layer encoder can be configured to regulate and control the code rate, so that reasonable code rate distribution can be realized.

In the embodiment of the present application, a GOP dynamic adjustment policy may also be enabled in the third encoding policy set; the GOP is data between two I frames, and since the I frames record data in a complete YUV data format, the amount of data in the I frames is generally relatively large, so that setting a GOP with a suitable length is a way to save the amount of data and improve the compression rate. In general, the longer GOP has less influence on the image quality of the static scene, and the default larger GOP length can be set according to actual needs; however, in the case of a dynamic scene, since the requirement for the image quality is high, it is necessary to set a GOP of an appropriate length to minimize the influence on the image quality of the dynamic scene.

Here, GOP length correspondence may be established; the GOP length corresponding relation is the corresponding relation between the motion area and the GOP length; specifically, data of a typical scene can be collected, the data amount of video frames under different GOP lengths is tested, and a GOP length corresponding relation between a motion area and the GOP length is established under the condition that the data amount of the video frames is minimum.

When video coding is performed, whether the currently coded video frame is in a dynamic scene or not can be determined according to the motion detection information, if the currently coded video frame is in the dynamic scene, the motion area of the currently coded video frame can be calculated, and the GOP length corresponding to the current scene is obtained according to the established GOP length corresponding relation.

For ease of understanding, the above-described video recoding method will be described below in connection with an actual application scenario.

In a recommendation mode of video coding, a user can select a proper coding grade for a target video on a preset interactive interface according to actual needs; the terminal equipment can acquire the corresponding coding configuration information and determine a target coding grade according to the coding configuration information, so that a target coding strategy set corresponding to the target coding grade can be determined; and according to the coding strategies of each dimension in the target coding strategy set, the target video can be coded.

For example, the target coding level may be determined to be a third coding level, and the set of coding strategies corresponding to the third coding level may be determined to be the third set of coding strategies. For the third coding strategy set, the B frame coding strategy may be enabling B frame coding, the image group length dynamic adjustment strategy may be enabling GOP dynamic adjustment, the dynamic region compensation strategy may be enabling dynamic region compensation, the frame rate adjustment strategy may be frame rate reduction, the resolution adjustment strategy may be resolution reduction, and the code rate control strategy may be low standard code rate; when video coding is carried out, a video frame (which can be marked as a current video frame) with a time stamp t can be read, and a piece of motion detection information with the earliest storage time is read; wherein, the timestamp range of the mobile detection information can be marked as [ t1, t2]; if t is less than t1, the earliest mobile detection information recording time is considered to be later than the recording time of the current video frame, namely the current video frame is in a static scene; at this time, the bottom layer encoder may be configured according to configuration information of a default GOP length, frame rate, and resolution in a static scene; if t is in the range of [ t1, t2], the current video frame can be considered to be in a dynamic scene, the gradient and the motion area of the current video frame can be calculated at the moment, and then the GOP length required by the current scene can be determined through the GOP length corresponding relation; and the QP value corresponding to the current video frame can be determined through the third quality standard corresponding relation, so that the data volume of the current video frame can be determined; the parameters required by the bottom layer encoder can be configured according to the enabling B frame coding, the frame rate reduction and the resolution reduction which are set in the coding strategy set; if t > t2, the read mobile detection information is considered to be invalid information, and the next piece of mobile detection information can be read at the moment, and the process is repeatedly executed; when the motion detection information is read, the next video frame can be read continuously, and the process is repeated until the video coding is completed.

In the embodiment of the application, in order to improve user experience, a user-defined mode may also be set; specifically, the user can select to enter a custom mode on the interactive interface of the terminal equipment, and select a proper coding strategy according to own requirements.

For example, the user may choose whether to enable B-frame encoding, whether to enable dynamic region compensation, whether to reduce resolution, whether to reduce frame rate, whether to enable GOP dynamic adjustment, high standard code control, medium standard code control, and low standard code control, as shown in fig. 6.

According to each coding strategy selected by a user on the interactive interface, corresponding custom coding configuration information can be generated; after the custom code configuration information is obtained, each code configuration item can be extracted from the custom code configuration information; wherein, each code configuration item can correspond to a dimension code strategy; accordingly, a custom encoding policy set may be determined, which may include encoding policies for each dimension selected by the user; recoding the decoded target video according to the coding strategies of each dimension selected by the user to obtain recoded video; the specific encoding process may refer to the description of the related content, and will not be repeated here.

In a specific implementation manner, before decoding and recoding the target video, the compression rate corresponding to the custom coding strategy set can be determined; specifically, in a typical dynamic scene, the corresponding compression rate may be r1, and in a typical static scene, the corresponding compression rate may be r2, and then the estimation formula of the compression rate may be:

r1*(tm/tv)+r2*(1-tm/tv)

where tm is the total duration of the motion detection, and tv is the total duration of the target video. Accordingly, the compression rate corresponding to the custom coding strategy set can be estimated; corresponding prompt information can be generated according to the compression rate, and the prompt information can be displayed through an interactive interface. The user can confirm the prompt information or reselect according to the actual demand; if the user confirms the prompt information, corresponding feedback information can be generated to indicate that the user confirms the prompt information. The server can acquire feedback information corresponding to the prompt information through the interactive interface, and if the feedback information is confirmation information, the target video can be decoded and recoded according to the coding strategies of each dimension in the custom coding strategy set.

For example, in the custom mode, the user selects enabling B-frame encoding, enabling dynamic region compensation, resolution reduction, frame rate reduction, enabling GOP dynamic adjustment, and low standard code rate on the interactive interface, as shown in fig. 7, according to this, the corresponding compression rate can be calculated and corresponding prompt information can be displayed on the interactive interface, and if the user confirms the prompt information, the target video can be decoded and recoded according to the encoding strategies of each dimension in the custom encoding strategy set, so as to obtain the recoded video.

In addition, in the recommended mode, the compression rate corresponding to the target encoding strategy set can be calculated by referring to the process, corresponding prompt information is generated, and if the prompt information is confirmed by a user, the target video can be decoded and recoded according to the encoding strategies of each dimension in the target encoding strategy set.

After the recoded video is obtained, the recoded video and the detection information can be stored in a video storage medium to replace the original target video.

In summary, the embodiment of the present application obtains the target video to be encoded and the corresponding encoding configuration information; determining a target coding grade corresponding to the target video according to the coding configuration information; determining a target coding strategy set corresponding to the target coding grade; the target coding strategy set comprises preset coding strategies of all dimensions; and decoding the target video according to the coding strategies of each dimension in the target coding strategy set, and then coding the target video to obtain the recoded video. By the embodiment of the application, corresponding coding strategy sets can be set for different coding grades; the coding strategy set can comprise coding strategies of each dimension; accordingly, a proper coding strategy set can be provided according to the requirements of users, flexibility of video coding is improved, and user experience is improved.

It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic of each process, and should not limit the implementation process of the embodiment of the present application in any way.

Fig. 8 shows a block diagram of an embodiment of a video recoding apparatus according to an embodiment of the present application, corresponding to a video recoding method described in the above embodiment.

In an embodiment of the present application, a video recoding apparatus may include:

the coding configuration information obtaining module 801 is configured to obtain a target video to be coded and corresponding coding configuration information;

a target coding level determining module 802, configured to determine a target coding level corresponding to the target video according to the coding configuration information;

a target coding policy set determining module 803, configured to determine a target coding policy set corresponding to the target coding level; the target coding strategy set comprises preset coding strategies of all dimensions;

the target video decoding module 804 is configured to decode a target video to obtain a decoded target video;

and the target video encoding module 805 is configured to re-encode the decoded target video according to the encoding policies of each dimension in the target encoding policy set, to obtain a re-encoded video.

In a specific implementation manner of the embodiment of the present application, the video recoding apparatus may further include:

accordingly, the target encoding policy set determining module may include:

In a specific implementation manner of the embodiment of the present application, the encoding level correspondence establishing module may include:

In a specific implementation manner of the embodiment of the present application, the coding configuration information may be custom coding configuration information;

the video recoding apparatus may further include:

In a specific implementation manner of the embodiment of the present application, the code configuration information obtaining module may include:

In a specific implementation manner of the embodiment of the present application, the coding strategies of each dimension include: b-frame coding strategy, group of pictures length dynamic adjustment strategy, dynamic region compensation strategy, frame rate adjustment strategy, resolution adjustment strategy and/or rate control strategy.

It will be clearly understood by those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described apparatus, modules and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.

Fig. 9 shows a schematic block diagram of a terminal device provided in an embodiment of the present application, and for convenience of explanation, only a portion relevant to the embodiment of the present application is shown.

As shown in fig. 9, the terminal device 9 of this embodiment includes: a processor 90, a memory 91 and a computer program 92 stored in said memory 91 and executable on said processor 90. The processor 90, when executing the computer program 92, implements the steps of the various video recoding method embodiments described above, such as steps S301 to S304 shown in fig. 3. Alternatively, the processor 90 may implement the functions of the modules/units in the above-described device embodiments when executing the computer program 92, for example, the functions of the modules 801 to 805 shown in fig. 8.

By way of example, the computer program 92 may be partitioned into one or more modules/units that are stored in the memory 91 and executed by the processor 90 to complete the present application. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions describing the execution of the computer program 92 in the terminal device 9.

It will be appreciated by those skilled in the art that fig. 9 is merely an example of the terminal device 9 and does not constitute a limitation of the terminal device 9, and may include more or less components than illustrated, or may combine certain components, or different components, e.g., the terminal device 9 may further include an input-output device, a network access device, a bus, etc.

The processor 90 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory 91 may be an internal storage unit of the terminal device 9, such as a hard disk or a memory of the terminal device 9. The memory 91 may also be an external storage device of the terminal device 9, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the terminal device 9. Further, the memory 91 may also include both an internal storage unit and an external storage device of the terminal device 9. The memory 91 is used for storing the computer program as well as other programs and data required by the terminal device 9. The memory 91 may also be used for temporarily storing data that has been output or is to be output.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other manners. For example, the apparatus/terminal device embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical function division, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated modules/units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each method embodiment described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable storage medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the computer readable storage medium may include content that is subject to appropriate increases and decreases as required by jurisdictions and by jurisdictions in which such computer readable storage medium does not include electrical carrier signals and telecommunications signals.

The above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.

Claims

1. A method of video recoding, comprising:

2. The video recoding method according to claim 1, further comprising, before determining a target encoding strategy set corresponding to the target encoding level:

Acquiring coding grade configuration information;

3. The video recoding method according to claim 2, wherein the establishing of the coding level correspondence according to the coding level configuration information includes:

4. The video recoding method of claim 1, wherein the coding configuration information is custom coding configuration information;

after obtaining the target video to be encoded and the corresponding encoding configuration information, the method further comprises the following steps:

5. The method of video recoding according to claim 4, further comprising, before decoding and recoding the target video according to the coding strategies of each dimension in the set of custom coding strategies:

Determining a compression rate corresponding to the custom coding strategy set;

6. The video recoding method according to claim 1, wherein the acquiring the target video to be coded includes:

7. The video recoding method of any one of claims 1 to 6, wherein the coding strategies of the respective dimensions include: b-frame coding strategy, group of pictures length dynamic adjustment strategy, dynamic region compensation strategy, frame rate adjustment strategy, resolution adjustment strategy and/or rate control strategy.

8. A video recoding apparatus, comprising:

9. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the video re-encoding method according to any one of claims 1 to 7.

10. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the video re-encoding method according to any one of claims 1 to 7 when the computer program is executed by the processor.