CN114501017A - Video coding adaptation method, device, equipment and storage medium - Google Patents

Video coding adaptation method, device, equipment and storage medium Download PDF

Info

Publication number
CN114501017A
CN114501017A CN202210214074.XA CN202210214074A CN114501017A CN 114501017 A CN114501017 A CN 114501017A CN 202210214074 A CN202210214074 A CN 202210214074A CN 114501017 A CN114501017 A CN 114501017A
Authority
CN
China
Prior art keywords
coding
hard
video
quality information
quality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210214074.XA
Other languages
Chinese (zh)
Inventor
刘晓娟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bigo Technology Singapore Pte Ltd
Original Assignee
Bigo Technology Singapore Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bigo Technology Singapore Pte Ltd filed Critical Bigo Technology Singapore Pte Ltd
Priority to CN202210214074.XA priority Critical patent/CN114501017A/en
Publication of CN114501017A publication Critical patent/CN114501017A/en
Priority to PCT/CN2023/079478 priority patent/WO2023165590A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter

Abstract

The embodiment of the application provides a video coding adaptation method, a video coding adaptation device, video coding adaptation equipment and a storage medium. According to the technical scheme provided by the embodiment of the application, hard coding quality information corresponding to different equipment type information is recorded in the server, a quality query request is sent to the server according to the equipment type information, when the hard coding quality information corresponding to the equipment type information is recorded in the server, the hard coding quality information of the equipment type is directly obtained from the server, hard coding quality detection is not needed according to a test video file, if the hard coding quality information corresponding to the equipment type information is not recorded in the server, the hard coding quality information is obtained by using the test video file to perform hard coding quality detection, and then a video coding mode is determined according to the obtained hard coding quality information, so that the adaptation efficiency of the video coding mode is effectively improved, and the video coding quality and user experience are guaranteed.

Description

Video coding adaptation method, device, equipment and storage medium
Technical Field
The embodiment of the application relates to the technical field of video processing, in particular to a video coding adaptation method, a video coding adaptation device, video coding adaptation equipment and a storage medium.
Background
When encoding video, the common encoding methods include hard encoding and soft encoding. The hard coding of the video mainly depends on a graphic processor, and the hard coding has the advantages of high speed, low power consumption and the like, but the hardware encoder is an encoder integrated by hardware manufacturers at the bottom layer, the compression performance is poorer than that of soft coding, different hardware manufacturers adopt different coding solutions, and if the hard coding is directly adopted, the same coding configuration can be generated, the video coding definition difference is larger, the watching experience of the video is influenced, and the hard coding can be started only when certain coding quality conditions are met.
The coding quality of the video can be measured by objective quality indicators PSNR (peak signal-to-noise ratio), SSIM (structural similarity), VMAF (video multi-method evaluation and fusion), etc., but in real-time video coding, if the coding quality of the video is measured by directly calculating the objective quality in the real-time video coding of the mobile device, more cpu and memory are occupied, and the cost of coding quality calculation is large.
Disclosure of Invention
The embodiment of the application provides a video coding adaptation method, a video coding adaptation device, a video coding adaptation equipment and a storage medium, which are used for solving the technical problems that the coding quality of a video is measured in a mode of directly calculating the objective quality in real-time video coding of mobile equipment in the prior art, and the overhead of coding quality calculation is high, and effectively improving the adaptation efficiency of a coding mode.
In a first aspect, an embodiment of the present application provides a video coding adaptation method, including:
sending a quality query request to a server according to the equipment type information to query whether the server stores hard coding quality information corresponding to the equipment type information;
determining to acquire hard coding quality information from the server based on a quality query result returned by the server, or performing hard coding quality detection according to a test video file to acquire hard coding quality information;
and determining a video coding mode according to the hard coding quality information.
In a second aspect, an embodiment of the present application provides a video coding adaptation apparatus, including a quality query module, an information acquisition module, and a coding adaptation module, where:
the quality query module is used for sending a quality query request to a server according to the equipment type information so as to query whether the server stores the hard coding quality information corresponding to the equipment type information;
the information acquisition module is used for determining to acquire hard coding quality information from the server based on a quality query result returned by the server, or performing hard coding quality detection according to a test video file to acquire hard coding quality information;
and the coding adaptation module is used for determining a video coding mode according to the hard coding quality information.
In a third aspect, an embodiment of the present application provides a video coding adaptation apparatus, including: a memory and one or more processors;
the memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the video coding adaptation method as described in the first aspect.
In a fourth aspect, embodiments of the present application provide a storage medium storing computer-executable instructions for performing the video coding adaptation method according to the first aspect when executed by a computer processor.
In a fifth aspect, the present application provides a computer program product, the computer program product comprising a computer program, the computer program being stored in a computer-readable storage medium, and at least one processor of the device reading from the computer-readable storage medium and executing the computer program, so as to make the device execute the video coding adaptation method according to the first aspect.
According to the method and the device, the hard coding quality information corresponding to different device type information is recorded in the server, the quality query request is sent to the server according to the device type information, when the hard coding quality information corresponding to the device type information is recorded in the server, the hard coding quality information of the device type is directly obtained from the server, hard coding quality detection does not need to be carried out according to a test video file, if the hard coding quality information corresponding to the device type information is not recorded in the server, the hard coding quality information is obtained by carrying out hard coding quality detection on the test video file, and then the video coding mode is determined according to the obtained hard coding quality information, so that the adaptation efficiency of the video coding mode is effectively improved, and the video coding quality and the user experience are guaranteed.
Drawings
Fig. 1 is a flowchart of a video coding adaptation method provided in an embodiment of the present application;
fig. 2 is a flowchart of another video coding adaptation method provided in an embodiment of the present application;
FIG. 3 is a schematic diagram of a hard coding quality detection process provided by an embodiment of the present application;
fig. 4 is a schematic diagram illustrating a video encoding mode determining process according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an apparatus for adapting video coding according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a video coding adaptation apparatus according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, specific embodiments of the present application will be described in detail with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some but not all of the matters relating to the present application are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The above process may be terminated when its operations are completed, but may have additional steps not included in the figures. The processes described above may correspond to methods, functions, procedures, subroutines, and the like.
Fig. 1 is a flowchart of a video coding adaptation method provided by an embodiment of the present application, where the video coding adaptation method provided by the embodiment of the present application may be executed by a video coding adaptation apparatus, which may be implemented by hardware and/or software and integrated in a video coding adaptation device (e.g., a mobile phone, a tablet, a computer, etc.).
The following description will be given taking as an example a video encoding adaptation method performed by a video encoding adaptation apparatus. Referring to fig. 1, the video coding adaptation method includes:
s101: and sending a quality query request to the server according to the equipment type information so as to query whether the server stores the hard coding quality information corresponding to the equipment type information.
The device type information provided by this embodiment is used to indicate a device type corresponding to the video coding adaptation apparatus, and the device type information may be one or a combination of multiple types of device models, processing chips, operating systems, and system versions. Generally, different video coding adapting devices with the same device type information have similar coding processing capabilities to the same video file due to the consistency of one or more combinations of the device type, the processing chip, the operating system and the system version, and can reflect the hard coding quality information obtained by the hard coding quality detection of the current video coding adapting device to the test video file through the hard coding quality information obtained by the hard coding quality detection of the test video file by the video coding adapting devices corresponding to other same device type information.
The hard coding quality information recorded in the server can be obtained by hard coding quality detection of a test video file by a tester based on different types of equipment, or can be obtained by hard coding quality detection of the test video file by other video coding adapting devices and uploading.
Optionally, the hard-coded quality information may be recorded in the form of a map, that is, the hard-coded quality information and the device type information are encapsulated in a key-value pair manner by using the device type information as a key and using the corresponding hard-coded quality information as a value. After receiving the quality query request sent by the video coding adapting device, the server matches the same key in the recording file of the hard coding quality information by taking the equipment type information carried by the quality query request as a key, thereby searching the hard coding quality information corresponding to the equipment type information.
Illustratively, when hard coding quality information is required to be requested to a server to determine a video coding mode, determining device type information corresponding to a current video coding adaptation device, and generating a quality query request according to the device type information.
After receiving a quality query request sent by a video coding adaptation device, a server determines device type information carried by the quality query request, queries whether hardware code quality information corresponding to the device type information is stored in a recording file of the hardware coding quality information, and returns a corresponding quality query result to the video coding adaptation device.
For example, when the server queries the hard coding quality information of the same device type information, the server returns a quality query result indicating that the query is successful to the video coding adaptation device, and when the hard coding quality information of the same device type information is not queried, the server returns a quality query result indicating that the query is failed to the video coding adaptation device.
S102: and determining to acquire hard coding quality information from the server based on a quality query result returned by the server, or performing hard coding quality detection according to the test video file to acquire the hard coding quality information.
Illustratively, after receiving a quality query result returned by the server, determining an acquisition mode of hardware coding quality according to the quality query result, that is, determining to acquire hard coding quality information from the server or to perform hard coding quality detection according to a test video file to obtain the hard coding quality information.
For example, when the quality query result indicates that the query is successful, it is determined to obtain the hardcoded quality information from the server. In one embodiment, if the quality query result indicates that the query is successful, the direct query result may carry corresponding hard-coded quality information. And when the quality query result indicates that the query fails, determining to perform hard coding quality detection according to the test video file to obtain hard coding quality information. The test video files can be test files provided by a server or test files stored in the local by the video coding adapting devices in advance, the test video files used by different video coding adapting devices for hard coding quality detection are the same test files, the test video files with the same content are selected for coding, evaluation of video hard coding quality is not affected by content difference, and consistency and objectivity of hard coding test results among different video coding adapting devices are guaranteed.
S103: and determining a video coding mode according to the hard coding quality information.
Illustratively, after obtaining the hard-coding quality information, the video coding method used when coding the video is determined according to the hard-coding quality information. The video coding mode comprises a hard coding mode for coding by a hardware coder and a soft coding mode for coding by a software coder. It can be understood that, in real-time encoding, the hard encoding is faster than the soft encoding, the power consumption is lower, the encoding frame rate is higher, the playing of the picture is smoother, the hardware performance is allowed or sufficient, and on the premise that the video encoding quality can be ensured, the encoding effect of the hard encoding mode is better than that of the soft encoding mode, and when the hard encoding quality information indicates that the set condition is reached, the hard encoding mode is preferentially adopted, so that the video encoding frame rate is improved, the energy consumption of encoding is reduced, and the user experience is improved.
In one embodiment, after the video coding mode is determined, when the video needs to be encoded (for example, when the anchor device needs to upload a video stream generated in a live broadcast process to the server), the video is encoded according to the determined video coding mode. Optionally, after the video coding mode is determined, the determined video coding mode may be recorded, and when the corresponding application program is restarted subsequently, the video coding mode determined previously according to the hard coding quality information may be used, or when a change (for example, a hardware or system version update) in the device type information is detected, the video coding mode that is clearly recorded and/or the hard coding quality detection is performed again according to the test video file, or the determined video coding mode may not be recorded, and when the corresponding application program is restarted each time, the video coding mode is determined again according to the hard coding quality information.
The hard coding quality information corresponding to different equipment type information is recorded in the server, the quality query request is sent to the server according to the equipment type information, when the hard coding quality information corresponding to the equipment type information is recorded in the server, the hard coding quality information of the equipment type is directly obtained from the server, hard coding quality detection does not need to be carried out according to a test video file, if the hard coding quality information corresponding to the equipment type information is not recorded in the server, the hard coding quality information is obtained by carrying out the hard coding quality detection on the test video file, and then the video coding mode is determined according to the obtained hard coding quality information, so that the adaptation efficiency of the video coding mode is effectively improved, and the video coding quality and the user experience are ensured.
On the basis of the foregoing embodiments, fig. 2 is a flowchart of another video coding adaptation method provided in an embodiment of the present application, which is an embodiment of the foregoing video coding adaptation method. Referring to fig. 2, the video coding adaptation method includes:
s201: it is determined whether hard coded quality information is stored locally.
The video coding adaptation device provided by this embodiment performs video coding through an installed application program (for example, live video software), and determines a video coding mode at an appropriate time after the video coding adaptation device starts the application program. For example, when the application program is started for a set time (for example, 5s), or when a functional module requiring video encoding is started (for example, a main broadcast is opened to a live broadcast function), it is determined that the video encoding mode needs to be determined by the hard encoding quality information.
The present embodiment preferentially adopts the hard coding quality information stored locally in the video coding adaptation device, and requests the hard coding quality information from the server when the hard coding quality information is not stored locally. Illustratively, when the video coding mode needs to be determined, the hard coding quality information is searched locally, if the hard coding quality information exists locally, the step goes to step S202, and if the hard coding quality information does not exist locally, the step goes to step S203.
In one embodiment, the locally stored hard-coded quality information may be associated with device type information. Subsequently, when determining whether hard coding quality information is locally stored, the hard coding quality information can be verified based on the latest device type information of the video coding adapting device, if the latest device type information is consistent with the device type information corresponding to the found hard coding quality information, it is determined that the hard coding quality information is locally stored, and if the latest device type information is inconsistent with the device type information corresponding to the found hard coding quality information (for example, the video coding adapting device changes the hardware or system version through maintenance or upgrading, so that the device type information is inconsistent), it is considered that the hard coding quality information is not locally stored, and the wrong hard coding quality information is deleted.
S202: and responding to the hard coding quality information stored locally, and determining the video coding mode directly according to the hard coding quality information.
For example, when the hard coding quality information is locally stored, the determination method of the video coding mode can be determined to be the determination of the video coding mode directly according to the local hard coding quality information, and the hard coding quality information does not need to be requested from a server or the hard coding quality detection is carried out on the test video file. The method comprises the steps of comparing locally stored hard coding quality information with a coding quality threshold, determining that a video coding mode is a hard coding mode when the hard coding quality information reaches the coding quality threshold, and determining that the video coding mode is a soft coding mode when the hard coding quality information does not reach the coding quality threshold. When it is determined that the video encoding mode is determined directly based on the hard coding quality information, it jumps to step S208.
The hard coding quality information stored locally may be hard coding quality information obtained from a server when the video coding adaptation device determines the video coding mode last time, or hard coding quality information obtained by performing hard coding quality detection on a test video file, or hard coding quality information actively issued by the server according to the device type information of the video coding adaptation device.
S203: and responding to the hard coding quality information which is not stored locally, and determining to send a quality inquiry request to the server according to the equipment type information.
Illustratively, when the hard coding quality information is not stored locally, a quality query request needs to be sent to the server according to the device type information of the hard coding quality information, so as to determine whether to acquire the hard coding quality information from the server or to acquire the hard coding quality information according to a hard coding quality detection mode of the test video file.
S204: and sending a quality query request to the server according to the equipment type information so as to query whether the server stores the hard coding quality information corresponding to the equipment type information.
S205: and responding to the quality query result of the server returning successful query, and acquiring the queried hard-coded quality information from the server.
Illustratively, when the server returns the quality query result of successful query, the quality query hard-coded quality information corresponding to the device type information is directly obtained from the server, and the process goes to step S208, and the video coding mode is directly determined according to the hard-coded quality information returned by the server.
S206: and responding to a quality query result of the server returning the query failure, acquiring the test video file from the server, and carrying out hard coding quality detection on the test video file to obtain hard coding quality information.
Illustratively, when the server returns a quality query result of a query failure, that is, a video coding adaptation apparatus that does not previously have the same device type performs hard coding quality detection based on a test video file and uploads corresponding hard coding quality information, in order to ensure video coding quality, the hard coding quality detection needs to be performed locally.
As shown in the schematic diagram of the hard coding quality detection process provided in fig. 3, when performing hard coding quality detection on a test video file to obtain hard coding quality information, the method specifically includes:
s2061: and coding the test video file according to a hard coding mode to obtain a video coding result.
S2062: and calculating hard coding quality information for hard coding the test video file according to the video coding result.
Illustratively, a test video file is downloaded according to a video file address provided by a server, a local hardware encoder is used for encoding the test video file according to a hard coding mode to obtain a video encoding result, and hard coding quality information for hard coding the test video file is calculated according to the video encoding result.
Furthermore, after hard coding quality information of hard coding is carried out on the test video file, the hard coding quality information is stored locally, and when a corresponding application program is started subsequently, a video coding mode can be directly determined according to the hard coding quality information recorded locally, so that the adaptation efficiency of the video coding mode is improved.
S207: the hard coded quality information is saved to a server based on the device type information.
Illustratively, after hard coding quality information of hard coding is carried out on a test video file, the hard coding quality information obtained by local calculation is uploaded to a server based on the equipment type information of the current video coding adapting device, and the hard coding quality information is stored by the server based on the equipment type information so that other video coding adapting devices of the same type can obtain the hard coding quality information to adapt to a video coding mode based on the same equipment type information.
In a possible embodiment, the hard-coded quality information and the corresponding device type information are recorded in the form of map, that is, after the hard-coded quality information is obtained through calculation, the device type information is used as a key, the hard-coded quality information is used as a value to construct a key value pair, the key value pair is packaged into the form of map and is uploaded to the server, the server can record the corresponding relation between the hard-coded quality information and the device type information conveniently, and the query matching efficiency of the hard-coded quality information and the device type information is improved.
S208: and determining a video coding mode according to the hard coding quality information.
In one possible embodiment, the video encoding mode used may be determined according to the comparison result of the hard-coded quality information and the preset encoding quality threshold. Based on this, as shown in a schematic diagram of a video coding method determination flow provided in fig. 4, when determining a video coding method according to hard coding quality information, the method specifically includes:
s2081: the hard-coded quality information is compared to a coding quality threshold.
S2082: and determining that the video coding mode is the hard coding mode in response to the comparison result that the hard coding quality information reaches the coding quality threshold.
S2083: and determining that the video coding mode is a soft coding mode in response to the comparison result that the hard coding quality information does not reach the coding quality threshold value.
Illustratively, after obtaining the corresponding hard coding quality information under the current device type information, the hard coding quality information is compared with the coding quality threshold, and a corresponding comparison result is obtained.
Further, when the comparison result indicates that the hard coding quality information reaches the coding quality threshold, it is determined that the coding quality of the video subjected to hard coding under the current hardware configuration can reach the set coding quality requirement, and the video coding mode is determined to be the hard coding mode.
And when the comparison result indicates that the hard coding quality information does not reach the coding quality threshold, determining that the coding quality of the hard coding of the video under the current hardware configuration does not reach the set coding quality requirement, and determining the video coding mode as a soft coding mode in order to ensure the coding effect of the video.
In one embodiment, the hard-coded quality information is one or more of peak signal-to-noise ratio (PSNR), Structural Similarity (SSIM), and video multi-method assessment fusion (VMAF). Correspondingly, the coding quality threshold is also configured to be one or a combination of more of a peak signal-to-noise ratio threshold, a structural similarity threshold, a video multi-method evaluation fusion threshold and other objective quality index thresholds.
By taking a video coding adaptive device configured on live broadcast equipment (video coding adaptive device) such as a mobile phone and a tablet used by a main broadcast as an example, assuming that a video live broadcast program is installed on the live broadcast equipment, when the video live broadcast program is started to reach a set time length (for example, 3 to 5 seconds), the live broadcast equipment firstly judges whether hard coding quality information is locally stored, if the hard coding quality information is locally stored, the hard coding quality information is directly compared with a coding quality threshold, if the hard coding quality information reaches a comparison result of the coding quality threshold, a video coding mode of the live broadcast program is set to be a hard coding mode, and if the hard coding quality information does not reach the comparison result of the coding quality threshold, the video coding mode of the live broadcast program is configured to be a soft coding mode.
And if the hard coding quality information is not stored locally, initiating a quality query request to the server according to the equipment type information of the live broadcast equipment. And if the server returns a quality query result indicating that the query is successful, acquiring hard coding quality information corresponding to the equipment type information from the server, comparing the hard coding quality information with a coding quality threshold, setting the video coding mode of the live program to be a hard coding mode if the hard coding quality information reaches the comparison result of the coding quality threshold, and configuring the video coding mode of the live program to be a soft coding mode if the hard coding quality information does not reach the comparison result of the coding quality threshold.
And when the server returns a quality query result indicating that the query fails, sending a video file address provided by the server to a live program, downloading a test video file by the live program based on the video file address, carrying out hard coding on the test video file by the live program by using a hardware encoder to obtain a video coding result, calculating hard coding quality information according to the video coding result, storing the hard coding quality information to the local, and packaging the hard coding quality information and the equipment type information into a map form to be uploaded to the server for storage. Further, the hard coding quality information stored locally is compared with a coding quality threshold, if the hard coding quality information reaches the comparison result of the coding quality threshold, the video coding mode of the live program is set to be the hard coding mode, and if the hard coding quality information does not reach the comparison result of the coding quality threshold, the video coding mode of the live program is configured to be the soft coding mode.
When the video live broadcast function of the live broadcast program is started by the subsequent anchor, the live broadcast program codes the video information acquired by the camera based on the determined video coding mode to obtain coded video information, uploads the coded video information to a corresponding server, and the server sends the coded video information to the audience equipment. After receiving the encoded video information, the viewer device may decode the encoded video information and play the corresponding video.
The hard coding quality information corresponding to different equipment type information is recorded in the server, the quality query request is sent to the server according to the equipment type information, when the hard coding quality information corresponding to the equipment type information is recorded in the server, the hard coding quality information of the equipment type is directly obtained from the server, hard coding quality detection does not need to be carried out according to a test video file, if the hard coding quality information corresponding to the equipment type information is not recorded in the server, the hard coding quality information is obtained by carrying out the hard coding quality detection on the test video file, and then the video coding mode is determined according to the obtained hard coding quality information, so that the adaptation efficiency of the video coding mode is effectively improved, and the video coding quality and the user experience are ensured. Meanwhile, when the server inquires the hard coding quality information of the same equipment type information, the hard coding information can be directly requested from the server, the hard coding quality detection of the test video file is not needed to be carried out locally, and the video coding adaptation efficiency is improved. After the hard coding quality information is obtained by locally carrying out hard coding quality detection on the test video file, the hard coding quality information is uploaded to the server based on the corresponding equipment type information, and when other equipment with the same type needs to determine the video coding mode, the corresponding hard coding quality information can be directly obtained from the server to adapt to the video coding mode, so that the video coding adaptation efficiency is further improved.
Fig. 5 is a schematic structural diagram of an apparatus for adapting video coding according to an embodiment of the present application. Referring to fig. 5, the video coding adaptation apparatus includes a quality query module 51, an information acquisition module 52, and a coding adaptation module 53.
The quality query module 51 is configured to send a quality query request to the server according to the device type information, so as to query whether the server stores hard coding quality information corresponding to the device type information; the information acquisition module 52 is configured to determine to acquire hard code quality information from the server based on a quality query result returned by the server, or perform hard code quality detection according to the test video file to obtain hard code quality information; and the coding adaptation module 53 is configured to determine a video coding mode according to the hard coding quality information.
The hard coding quality information corresponding to different equipment type information is recorded in the server, the quality query request is sent to the server according to the equipment type information, when the hard coding quality information corresponding to the equipment type information is recorded in the server, the hard coding quality information of the equipment type is directly obtained from the server, hard coding quality detection does not need to be carried out according to a test video file, if the hard coding quality information corresponding to the equipment type information is not recorded in the server, the hard coding quality information is obtained by carrying out the hard coding quality detection on the test video file, and then the video coding mode is determined according to the obtained hard coding quality information, so that the adaptation efficiency of the video coding mode is effectively improved, and the video coding quality and the user experience are ensured.
In a possible embodiment, the information obtaining module 52 is specifically configured to:
responding to a quality query result of successful query returned by the server, and acquiring the queried hard coding quality information from the server;
and responding to a quality query result of the server returning the query failure, acquiring the test video file from the server, and carrying out hard coding quality detection on the test video file to obtain hard coding quality information.
In a possible embodiment, when performing hard coding quality detection on the test video file to obtain hard coding quality information, the information obtaining module 52 includes:
coding the test video file according to a hard coding mode to obtain a video coding result;
and calculating hard coding quality information for hard coding the test video file according to the video coding result.
In a possible embodiment, the information obtaining module 52 is further configured to save the hard-coded quality information to the server based on the device type information after the hard-coded quality information is obtained by performing the hard-coded quality detection on the test video file
In a possible embodiment, the code adaptation module 53 is specifically configured to:
comparing the hard coded quality information to a coding quality threshold;
determining that the video coding mode is a hard coding mode in response to a comparison result that the hard coding quality information reaches a coding quality threshold;
and determining that the video coding mode is a soft coding mode in response to the comparison result that the hard coding quality information does not reach the coding quality threshold value.
In a possible embodiment, the video coding adaptation apparatus further comprises a local query module, configured to, before the quality query module 51 sends the quality query request to the server according to the device type information:
determining whether hard coding quality information is stored locally;
in response to the hard coding quality information stored locally, determining a video coding mode directly according to the hard coding quality information;
determining to send a quality query request to a server based on device type information in response to not having locally stored hardcoded quality information
In a possible embodiment, the hard-coded quality information is a combination of one or more of peak signal-to-noise ratio, structural similarity, and video multi-method evaluation fusion.
The embodiment of the present application further provides a video coding adaptation apparatus, which can integrate the video coding adaptation device provided by the embodiment of the present application. Fig. 6 is a schematic structural diagram of a video coding adaptation apparatus according to an embodiment of the present application. Referring to fig. 6, the video encoding adaptation apparatus includes: an input device 63, an output device 64, a memory 62, and one or more processors 61; a memory 62 for storing one or more programs; when executed by the one or more processors 61, the one or more programs cause the one or more processors 61 to implement the video coding adaptation method as provided in the embodiments above. The video coding adaptation device, the video coding adaptation equipment and the video coding adaptation computer provided by the above embodiments can be used for executing the video coding adaptation method provided by any of the above embodiments, and have corresponding functions and beneficial effects.
Embodiments of the present application also provide a storage medium storing computer-executable instructions, which when executed by a computer processor, are used to perform the video coding adaptation method provided in the above embodiments. Of course, the storage medium storing computer-executable instructions provided in the embodiments of the present application is not limited to the video coding adaptation method provided above, and may also perform related operations in the video coding adaptation method provided in any embodiment of the present application. The video coding adaptation device, the video coding adaptation apparatus, and the storage medium provided in the foregoing embodiments may perform the video coding adaptation method provided in any embodiment of the present application, and refer to the video coding adaptation method provided in any embodiment of the present application without detailed technical details described in the foregoing embodiments.
In some possible embodiments, various aspects of the methods provided by the present disclosure may also be implemented in a form of a program product including program code for causing a computer device to perform the steps of the methods according to various exemplary embodiments of the present disclosure described above in this specification when the program product is run on the computer device, for example, the computer device may perform the real-time gesture detection method described in the embodiments of the present disclosure.

Claims (11)

1. A video coding adaptation method, comprising:
sending a quality query request to a server according to the equipment type information to query whether the server stores hard coding quality information corresponding to the equipment type information;
determining to acquire hard coding quality information from the server based on a quality query result returned by the server, or performing hard coding quality detection according to a test video file to acquire hard coding quality information;
and determining a video coding mode according to the hard coding quality information.
2. The video coding adaptation method according to claim 1, wherein the determining to obtain the hard coding quality information from the server based on the quality query result returned by the server or the hard coding quality information obtained by performing hard coding quality detection according to the test video file comprises:
responding to a quality query result of successful query returned by the server, and acquiring queried hard coding quality information from the server;
and responding to a quality query result of the server returning query failure, acquiring a test video file from the server, and carrying out hard coding quality detection on the test video file to obtain hard coding quality information.
3. The video coding adaptation method of claim 2, wherein the performing hard coding quality detection on the test video file to obtain hard coding quality information comprises:
coding the test video file according to a hard coding mode to obtain a video coding result;
and calculating hard coding quality information for hard coding the test video file according to the video coding result.
4. The video coding adaptation method of claim 2, wherein after the hard-coding quality detection of the test video file to obtain hard-coding quality information, further comprising:
saving the hard coded quality information to the server based on the device type information.
5. The method of claim 1, wherein determining the video coding scheme according to the hard coding quality information comprises:
comparing the hard-coded quality information to a coding quality threshold;
determining that the video coding mode is a hard coding mode in response to the comparison result that the hard coding quality information reaches the coding quality threshold;
and determining that the video coding mode is a soft coding mode in response to the comparison result that the hard coding quality information does not reach the coding quality threshold value.
6. The video coding adaptation method according to claim 1, wherein before sending the quality query request to the server according to the device type information, further comprising:
determining whether hard coding quality information is stored locally;
in response to the hard coding quality information stored locally, determining a video coding mode directly according to the hard coding quality information;
and responding to the hard coding quality information which is not stored locally, and determining to send a quality inquiry request to the server according to the equipment type information.
7. The video coding adaptation method of claim 1, wherein the hard coding quality information is a combination of one or more of peak signal-to-noise ratio, structural similarity, and video multi-method estimation fusion.
8. A video coding adaptation device is characterized by comprising a quality query module, an information acquisition module and a coding adaptation module, wherein:
the quality query module is used for sending a quality query request to a server according to the equipment type information so as to query whether the server stores the hard coding quality information corresponding to the equipment type information;
the information acquisition module is used for determining to acquire hard coding quality information from the server based on a quality query result returned by the server, or performing hard coding quality detection according to a test video file to acquire hard coding quality information;
and the coding adaptation module is used for determining a video coding mode according to the hard coding quality information.
9. A video coding adaptation device, comprising: a memory and one or more processors;
the memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the video coding adaptation method of any of claims 1-7.
10. A storage medium storing computer-executable instructions for performing the video coding adaptation method of any one of claims 1-7 when executed by a computer processor.
11. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, implements the video coding adaptation method of any of claims 1-14.
CN202210214074.XA 2022-03-04 2022-03-04 Video coding adaptation method, device, equipment and storage medium Pending CN114501017A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202210214074.XA CN114501017A (en) 2022-03-04 2022-03-04 Video coding adaptation method, device, equipment and storage medium
PCT/CN2023/079478 WO2023165590A1 (en) 2022-03-04 2023-03-03 Video coding adaptation method and apparatus, device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210214074.XA CN114501017A (en) 2022-03-04 2022-03-04 Video coding adaptation method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114501017A true CN114501017A (en) 2022-05-13

Family

ID=81486901

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210214074.XA Pending CN114501017A (en) 2022-03-04 2022-03-04 Video coding adaptation method, device, equipment and storage medium

Country Status (2)

Country Link
CN (1) CN114501017A (en)
WO (1) WO2023165590A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023165590A1 (en) * 2022-03-04 2023-09-07 百果园技术(新加坡)有限公司 Video coding adaptation method and apparatus, device, and storage medium

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9942580B2 (en) * 2011-11-18 2018-04-10 At&T Intellecutal Property I, L.P. System and method for automatically selecting encoding/decoding for streaming media
US9179144B2 (en) * 2012-11-28 2015-11-03 Cisco Technology, Inc. Fast switching hybrid video decoder
CN104159113B (en) * 2014-06-30 2018-08-10 北京奇艺世纪科技有限公司 The selection method and device of Video coding mode in Android system
CN106331765B (en) * 2015-06-30 2020-06-05 腾讯科技(深圳)有限公司 Hard solution testing method, terminal, server and computer readable storage medium
CN106375789B (en) * 2016-09-05 2019-02-26 腾讯科技(深圳)有限公司 Medium living broadcast method and apparatus
CN107948660A (en) * 2017-11-16 2018-04-20 北京小米移动软件有限公司 The method and device of Video coding adaptation
CN107948683A (en) * 2017-11-28 2018-04-20 北京潘达互娱科技有限公司 Network direct broadcasting media stream compatibility method, network main broadcaster end and client
CN110198427B (en) * 2018-07-05 2021-09-21 腾讯科技(深圳)有限公司 Video call method and device
WO2020118601A1 (en) * 2018-12-13 2020-06-18 深圳市欢太科技有限公司 Method, apparatus, electronic device, and storage medium for video encoding
CN111385563B (en) * 2018-12-29 2022-03-01 广州市百果园信息技术有限公司 Hardware encoder detection method and device and terminal
CN110740313B (en) * 2019-10-25 2021-12-10 腾讯科技(深圳)有限公司 Hardware coding capability detection method and device
CN112003976B (en) * 2020-07-31 2022-04-29 北京达佳互联信息技术有限公司 Hard-coding and hard-decoding test method and device
CN114501017A (en) * 2022-03-04 2022-05-13 百果园技术(新加坡)有限公司 Video coding adaptation method, device, equipment and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023165590A1 (en) * 2022-03-04 2023-09-07 百果园技术(新加坡)有限公司 Video coding adaptation method and apparatus, device, and storage medium

Also Published As

Publication number Publication date
WO2023165590A1 (en) 2023-09-07

Similar Documents

Publication Publication Date Title
CN111436004B (en) Video playing method, device and equipment and computer readable storage medium
US10476928B2 (en) Network video playback method and apparatus
CN108076377B (en) Video storage and playing method and device, electronic equipment and storage medium
EP3099074A1 (en) Systems, devices and methods for video coding
CN110662017B (en) Video playing quality detection method and device
CN105138376A (en) Mixed model application, webpage resource upgrading method thereof, mobile terminal and system
CN105763960A (en) Method and apparatus for network video playing
WO2023165590A1 (en) Video coding adaptation method and apparatus, device, and storage medium
CN111669577A (en) Hardware decoding detection method and device, electronic equipment and storage medium
CN112003976B (en) Hard-coding and hard-decoding test method and device
CN110401858B (en) Video playing method and device, electronic equipment and storage medium
CN112134908B (en) Application adaptation method, server, medium and vehicle-mounted multimedia system
US11395002B2 (en) Prediction direction selection method and apparatus in image encoding, and storage medium
WO2015021753A1 (en) Data compression method, computer system and device
CN111263162B (en) Video compression method, device, equipment and storage medium
CN102984282B (en) Intelligent terminal obtains the method and apparatus of the media data of cloud storage file
CN115941972A (en) Image transmission method, device, equipment and storage medium
CN115633191A (en) Video playing method, device, system, electronic equipment and readable storage medium
CN112449209B (en) Video storage method and device, cloud server and computer readable storage medium
CN111988667B (en) Intelligent terminal media player management method and system
CN113507624B (en) Video information recommendation method and system
CN113938690B (en) Video encoding method, video encoding device, electronic equipment and storage medium
CN113297145B (en) Migration report generation method and device, electronic equipment and computer storage medium
US20210235084A1 (en) Picture block splitting method and apparatus
Gao et al. Video object detection program design under two different client-server organizations

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination