WO2020107168A1

WO2020107168A1 - Video decoding method and device, electronic apparatus, and computer-readable storage medium

Info

Publication number: WO2020107168A1
Application number: PCT/CN2018/117478
Authority: WO
Inventors: 胡小朋
Original assignee: 深圳市欢太科技有限公司; Oppo广东移动通信有限公司
Priority date: 2018-11-26
Filing date: 2018-11-26
Publication date: 2020-06-04
Also published as: CN112823519A; CN112823519B

Abstract

A video decoding method comprises: acquiring a video file to be processed and a first file format and a second file format corresponding thereto; acquiring a target parser identifier from a parser identifier set corresponding to the first file format, and using a parser corresponding to the target parser identifier to parse the video file so as to obtain an audio and video stream; and acquiring a target decoder identifier from a decoder identifier set corresponding to the second file format, and using a decoder corresponding to the target decoder identifier to decode the audio and video stream.

Description

Video decoding method, device, electronic equipment, computer readable storage medium

Technical field

The present application relates to the field of computer technology, and in particular, to a video decoding method, device, electronic device, and computer-readable storage medium.

Background technique

Electronic devices can display pictures, play music, and also play videos. Generally, when a video file to be processed is generated, different encoding methods are used, and a video file to be processed in a different format is generated. Before playing the encoded video file to be processed, the video file to be processed needs to be decoded. Therefore, when playing to-be-processed video files in different formats, the decoding methods adopted are also different.

Summary of the invention

Embodiments of the present application provide a video decoding method, device, electronic device, and computer-readable storage medium.

A video decoding method, including:

Acquiring a to-be-processed video file, and acquiring a first file format and a second file format corresponding to the to-be-processed video file, the first file format is used to represent the format of the to-be-processed video file, and the second file format It is used to indicate the format of the audio and video stream in the to-be-processed video file;

Obtaining a set of resolution identifiers corresponding to the first file format;

Obtaining the target resolution identifier with the strongest resolution performance from the set of resolution identifiers, and parsing the to-be-processed video file through a parser corresponding to the target resolution identifier to obtain an audio and video stream, wherein the resolution performance Used to indicate the performance of the parser corresponding to the parsing identifier;

Obtaining a set of decoding identifiers corresponding to the second file format; and

Obtain the target decoding identifier with the strongest decoding performance from the set of decoding identifiers, and perform decoding processing on the audio and video stream by a decoder corresponding to the target decoding identifier to obtain a decoded audio and video stream, wherein, the The decoding performance is used to indicate the performance of the decoder corresponding to the decoding identifier.

A video decoding device, including:

A file obtaining module, configured to obtain a to-be-processed video file, and obtain a first file format and a second file format corresponding to the to-be-processed video file, the first file format is used to represent the format of the to-be-processed video file, The second file format is used to represent the format of the audio and video stream in the video file to be processed;

A parsing set acquisition module, used to acquire a parsing identification set corresponding to the first file format;

A parsing processing module, configured to obtain a target parsing identifier with the strongest parsing performance from the parsing identifier set, and parsing the to-be-processed video file through a parser corresponding to the target parsing identifier to obtain an audio and video stream Wherein, the parsing performance is used to indicate the performance of the parser corresponding to the parsing identifier;

A decoding set acquisition module, for acquiring a decoding identification set corresponding to the second file format; and

A decoding processing module, configured to obtain a target decoding identifier with the strongest decoding performance from the set of decoding identifiers, and perform decoding processing on the audio and video stream by a decoder corresponding to the target decoding identifier to obtain decoded audio and video Stream, where the decoding performance is used to indicate the performance of the decoder corresponding to the decoding identifier.

An electronic device includes a memory and a processor. A computer program is stored in the memory. When the computer program is executed by the processor, the processor causes the processor to perform the steps of the video decoding method.

A computer-readable storage medium on which a computer program is stored, which when executed by a processor implements the steps of the above video decoding method.

After obtaining the video file to be processed and the corresponding first file format and second file format, the above video decoding method, device, electronic device, and computer-readable storage medium may obtain the corresponding set of resolution identifiers according to the first file format, And obtain the target resolution identifier with the strongest resolution performance from the resolution identifier set, and analyze and process the video file to be processed by the parser corresponding to the target resolution identifier to obtain the audio and video stream. Then, the corresponding decoding identifier set is obtained according to the second file format, and the target decoding identifier with the strongest decoding performance is obtained from the decoding identifier set. Finally, the decoder corresponding to the target decoding identifier decodes the audio and video stream to obtain the decoded audio and video stream. In this way, the parser and decoder can be accurately selected according to the format of the video file to be processed, and the decoding efficiency of the video file is improved.

BRIEF DESCRIPTION

In order to more clearly explain the embodiments of the present application or the technical solutions in the prior art, the following will briefly introduce the drawings required in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, without paying any creative work, other drawings can be obtained based on these drawings.

FIG. 1 is a flowchart of a video decoding method in an embodiment;

2 is a flowchart of a video decoding method in another embodiment;

3 is a schematic diagram of decoding a video file to be processed in an embodiment;

4 is a flowchart of a video decoding method in yet another embodiment;

5 is a flowchart of a video decoding method in yet another embodiment;

6 is a flowchart of a video decoding method in yet another embodiment;

7 is a schematic structural diagram of a video decoding device in an embodiment;

8 is a block diagram of a partial structure of a mobile phone related to an electronic device provided by an embodiment of the present application.

detailed description

In order to make the purpose, technical solutions and advantages of the present application more clear, the present application will be described in further detail in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.

It can be understood that the terms “first”, “second”, etc. used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish the first element from another element. For example, without departing from the scope of the present application, the first file format may be referred to as the second file format, and similarly, the second file format may be referred to as the first file format. Both the first file format and the second file format are file formats, but they are not the same file format.

FIG. 1 is a flowchart of a video decoding method in an embodiment. As shown in FIG. 1, the video decoding method includes steps 102 to 110. among them:

Step 102: Obtain a video file to be processed, and obtain a first file format and a second file format corresponding to the video file to be processed. The first file format is used to indicate the format of the video file to be processed, and the second file format is used to indicate the to-be-processed The format of the audio and video streams in the video file.

In one embodiment, the electronic device may encode the video file, and there are various encoding methods, and different encoding methods encode the video file in different file formats. For example, common video encoding formats are WMV (Windows Media Video, Media Video Format), MPEG (Moving Pictures Experts Group, Motion Picture Experts Group), MP4 (Moving Pictures Experts Group 4, Motion Picture Experts Group 4) FFMPEG ( Fast, Forward, Moving Pictures, Experts Group).

Specifically, the main function of encoding is to compress video pixel data and audio data into a code stream, thereby reducing the amount of data in the video file. The audio and video stream is a code stream into which video pixel data and audio data are compressed, and may specifically include an audio stream and a video stream. The electronic device may obtain a video file stored locally or a video file sent by another electronic device, which is not limited herein. For example, a user may start a third-party application in the terminal, and initiate a video file acquisition instruction through the third-party application, and then the terminal may initiate an acquisition request to acquire a video file to the server according to the acquisition instruction. After the server receives the acquisition request, Send the corresponding video file to the terminal.

After obtaining the to-be-processed video file, the file bytes of the to-be-processed video file can be read. After reading the bytes at the beginning of the video file, the file format of the video file can be obtained according to the read bytes. The file format of the video file to be processed includes a first file format and a second file format. The first file format is used to represent the format of the video file to be processed, and the second file format is used to represent the audio and video stream in the video file to be processed. Format.

For example, the first file format may be the file ID of the video file to be processed, and the second file format may include the Mimetype (Multipurpose Internet Mail Extensions) of the audio stream and the Chumktype (file encapsulation type) of the video stream One or more of Codec ID (Codec Identification) of audio stream, Mimetype of audio stream, Codec ID of audio stream, Chumktype of audio stream, etc.

Step 104: Acquire a set of resolution identifiers corresponding to the first file format.

In the embodiment provided by the present application, the electronic device may store the resolution identification set, and a correspondence relationship between the resolution identification set and the first file format is established in advance. After the first file format is obtained, the analysis identifier set corresponding to the first file format can be obtained according to the corresponding relationship between the analysis identifier set and the first file format.

Specifically, the set of parsing identifiers includes at least one parsing identifier, and the parsing identifier is used to indicate a parser that parses the video file. The parser corresponding to the parsing identifier included in the parsing identifier set may be used to parse the corresponding video file in the first file format.

For example, the first file format of the to-be-processed video file is the file ID of the to-be-processed video file. If the file ID of the to-be-processed video file is "video/mp4", it can parse the video file with the file ID of "video/mp4" There are MPEG4Extractor parser, ffmpeg parser, MP4 parser. The set of parsing identifiers corresponding to "video/mp4" stored in the electronic device may include parsing identifiers corresponding to the MPEG4Extractor parser, ffmpeg parser, and MP4 parser.

Step 106: Obtain the target resolution identifier with the strongest resolution performance from the set of resolution identifiers. The parser corresponding to the target resolution identifier analyzes the video file to be processed to obtain an audio and video stream. The resolution performance is used to indicate the resolution corresponding to the resolution identifier. Performance.

After the resolution identification set is obtained, the target resolution identification with the strongest resolution performance can be obtained from the resolution identification set. The parsing performance is used to indicate the performance of the parser corresponding to the parsing logo. Specifically, the parsing performance may be obtained according to one or more of the stability, speed, compatibility, and error rate of parsing the video file by the parser, and is not limited to this.

In one embodiment, the analysis identifiers included in the analysis identifier set may be provided with analysis performance tags, and according to the analysis performance tags, it is possible to determine the strength of the analysis performance of the corresponding resolver, so as to filter out the target analysis identification with the strongest analysis performance. You can also sort the analysis tags according to the strength of the analysis performance. The higher the order of the analysis tags in the analysis identification set, the stronger the analysis performance of the video file in the first file format. According to the sorting, you can filter out the most analytical performance Strong target resolution identification. It can be understood that the target resolution identifier may be filtered according to other methods, which is not limited herein.

After the target parsing identifier is obtained, the parser corresponding to the target parsing identifier can be processed for parsing. After parsing the video file to be processed, you can obtain the attribute information of the video file to be processed and the audio and video streams. For example, by parsing the audio and video streams in the video file, you can also obtain attribute information such as the playback duration of the video stream, the size of the video image, and the audio format of the audio stream.

It can be understood that the electronic device can use its own integrated parser to parse the video file, or it can call the API (Application Programming Interface) of a third-party parsing platform to parse the video file, which is not limited here. .

In the embodiment provided by the present application, the above-mentioned resolution identification set may include at least one resolution identification sorted according to the resolution performance, and the step of obtaining the target resolution identification may specifically include: obtaining the resolution identification included in the resolution identification set according to the second file format In the first arrangement order, obtain the target resolution identifier from the resolution identifier set according to the first arrangement sequence.

Step 108: Acquire a set of decoding identifiers corresponding to the second file format.

The electronic device may store a set of decoding identifiers, and pre-establish a correspondence between the set of decoding identifiers and the second file format. After the second file format is obtained, the set of decoding identifiers corresponding to the second file format can be obtained according to the correspondence between the above set of decoding identifiers and the second file format. Specifically, the set of decoding identifiers includes at least one decoding identifier arranged in sequence, and the decoding identifier is used to indicate a decoder that decodes the video file. The decoder corresponding to the decoding identifier included in the decoding identifier set may be used to decode the corresponding video file in the second file format.

For example, the second file format is the Minetype of the video stream. If the Minetype of the video stream is "video/avc", the decoder that can decode the video stream with the Minetype of "video/avc" is Qualcomm AVC (Advanced Video Coding, Advanced video coding) Hard decoder, Google AVC soft decoder, ffmpeg AVC decoder. Then, when the Minetype is "video/avc", the corresponding decoding identification set contains the decoding identification corresponding to the Qualcomm AVC hard decoder, Google AVC soft decoder, and ffmpeg AVC decoder.

Step 110: Obtain the target decoding identifier with the strongest decoding performance from the set of decoding identifiers, and perform decoding processing on the audio and video stream through the decoder corresponding to the target decoding identifier to obtain a decoded audio and video stream, where the decoding performance is used to express The performance of the decoder corresponding to the decoding identifier.

After the decoding identifier set is obtained, the target decoding identifier can be obtained from the decoding identifier set. The decoding performance is used to indicate the performance of the decoder corresponding to the decoding identifier, and may specifically be obtained according to one or more of decoding stability, speed, compatibility, and error rate of the decoder, and is not limited thereto.

In one embodiment, the decoding identifiers included in the set of decoding identifiers may be provided with decoding performance flags, and according to the decoding performance flags, the decoding performance of the corresponding decoder may be judged, so as to filter out the target decoding identifier with the strongest decoding performance. You can also sort the decoding identifiers according to the strength of the decoding performance. The higher the ranking of the decoding identifiers in the decoding identifier set, the stronger the decoding performance of the audio and video streams. According to the ranking, the target decoding with the strongest decoding performance can be screened out. Logo. It can be understood that the target decoding identifier may also be selected according to other methods, which is not limited herein.

Specifically, the above set of decoding identifiers includes at least one decoding identifier sorted according to decoding performance, and the step of acquiring the target decoding identifier may specifically include: obtaining a second arrangement order of the decoding identifiers included in the set of decoding identifiers, according to the second arrangement order Obtain the target decoding identifier from the decoding identifier set.

After acquiring the target decoding identifier, the audio and video stream can be decoded by the decoder corresponding to the target decoding identifier. After decoding the audio and video stream, the obtained decoded audio and video stream can be played in the electronic device. Specifically, the audio and video stream includes an audio stream and a video stream, and the decoder corresponding to the target decoding identifier decodes the audio stream and the video stream respectively. The obtained decoded audio stream and decoded video stream can be passed through an electronic device To play.

The video decoding method provided in the above embodiment, after obtaining the to-be-processed video file and the corresponding first file format and second file format, may obtain the corresponding parsing identifier set according to the first file format and obtain from the parsing identifier set The target parsing mark with the strongest parsing performance is analyzed and processed by the parser corresponding to the target parsing mark to obtain the audio and video stream. Then, the corresponding decoding identifier set is obtained according to the second file format, and the target decoding identifier with the strongest decoding performance is obtained from the decoding identifier set. Finally, the decoder corresponding to the target decoding identifier decodes the audio and video stream to obtain the decoded audio and video stream. In this way, the parser and decoder can be accurately selected according to the format of the video file to be processed, and the decoding efficiency of the video file is improved.

2 is a flowchart of a video decoding method in another embodiment. As shown in FIG. 2, the video decoding method includes steps 202 to 220. among them:

Step 202: Send a file acquisition request to the server.

In one embodiment, the electronic device may be a terminal. When the terminal needs to play a video file to be processed, the terminal may send a request to the server to obtain the video file to be processed. For example, the terminal may display a playback link of the video file to be processed. When the user clicks the playback link displayed on the terminal, the terminal sends a file acquisition request to the server to acquire the video file to be processed for playback.

The file acquisition request sent by the terminal to the server may include information such as the terminal identification that initiated the file acquisition request, the file identification of the to-be-processed video file, the time when the request was initiated, and the server identification that received the request, which is not limited herein.

Step 204: The receiving server returns the to-be-processed video file according to the file acquisition request, and the first and second file formats corresponding to the to-be-processed video file.

After receiving the file acquisition request, the server may search for the corresponding video file to be processed according to the file identifier contained in the file acquisition request, and perform a preliminary analysis on the acquired video file to be processed to obtain the first file format of the video file to be processed and The second file format. After obtaining the to-be-processed video file and the corresponding first file format and second file format, the corresponding terminal can be searched for according to the terminal identifier included in the file acquisition request, and the to-be-processed video file and the corresponding first file format and The two file format is sent to the terminal corresponding to the terminal identification.

Step 206: Acquire a set of resolution identifiers corresponding to the first file format.

The video files in different formats have different parsers used in parsing, so different first file formats have different sets of parsing identifiers. The resolution identification set may be preset, and the resolution identification included in the resolution identification set may be adjusted during the operation of the electronic device, which is not limited herein. For example, the number of errors in parsing the video file when the parser corresponding to the parsing identifier in the parsing identifier set is counted, and the order of the parsing identifiers is adjusted according to the number of errors. If the number of errors exceeds the threshold, the parsing identifier is removed Resolve the logo collection.

Step 208: Acquire the first arrangement order of the analysis identifiers contained in the analysis identifier set according to the second file format, obtain the first target analysis identifier from the analysis identifier set according to the first arrangement order, and pass the analysis corresponding to the first target analysis identifier The processor performs the first parsing process on the video file to be processed.

In one embodiment, the parser included in the parsing identification set can parse the video file in the first file format, but different parsers have different parsing effects on video files in different second file formats. Therefore, the analysis identifiers in the analysis identifier set may be sorted according to the second file format in advance, and the analysis performance of the corresponding parser is determined according to the order. For example, according to the order of the analysis performance from strong to weak, the analysis identifiers are sorted. The higher the analysis identifier in the analysis identifier set, the stronger the analysis performance of the corresponding parser to process the video file.

The correspondence relationship between the second file format and the first arrangement order is pre-defined, and the first arrangement order corresponding to the second file format can be obtained according to the correspondence relationship between the second file format and the first arrangement order. If there is no first arrangement sequence corresponding to the second file format of the video file to be processed in the terminal, the default first arrangement sequence may be adopted to obtain the target resolution identifier.

Specifically, if the audio and video stream includes an audio stream and a video stream, the second file format may include an audio stream format and a video stream format. Then, the first arrangement order may be established according to the audio stream format, the video stream format, or the audio stream format and the video stream format. The above step of obtaining the first sorting order may include: obtaining the first sorting order of the resolution identifiers included in the resolution identifier set according to the audio stream format and/or the video stream format.

For example, the MPEG4Extractor parser does not support the parsing of MP4 video files with Chunk type ".mp3" and "ms02" of the audio stream, nor does it support the parsing of MP4 video files with Chunk type "mjpeg" or "sorenso" of the video stream. Therefore, when parsing the MP4 video file in the above-mentioned second file format, the ffmpeg parser with better compatibility for this type of MP4 video file will be selected for parsing, rather than the MPEG4Extractor parser.

Therefore, after the set of parsing identifiers is obtained, the first target parsing identifier can be obtained from the set of parsing identifiers according to the first arrangement order, and the parser corresponding to the first target parsing identifier can be subjected to the first parsing process. For example, the resolution identifiers in the resolution identifier set can be arranged in order from weakest to strongest in resolution performance, then the last-ordered resolution identifier in the resolution identifier set can be obtained as the first target resolution identifier, and then the first target resolution identifier can be resolved The corresponding parser performs the first parsing process on the video file to be processed.

Step 210: When the first parsing process reports an error, obtain first error reporting data obtained during the first parsing process, and obtain a second target parsing identifier from the parsing identifier set according to the first error reporting data.

When the parser corresponding to the first target parsing identifier performs the first parsing process on the video file to be processed, if the first parsing process does not report an error, the audio and video stream can be obtained directly according to the first parsing process; if the first parsing process reports an error, It means that the parser corresponding to the first target parsing identifier cannot parse the video file to be processed. When the first target parsing process reports an error, the first parsing process first error reporting data may also be obtained. The reason for the error in the first parsing process can be obtained through the first error report data.

When the parser corresponding to the first target parsing identifier performs the first parsing process and reports an error, the cause of the error may be obtained based on the first error reporting data, thereby accurately resolving the second target parsing identifier from the parsing identifier set based on the first error reporting data Then, the parser corresponding to the obtained second target parsing identifier is subjected to second parsing processing on the video file to be processed.

For example, the first error data can be expressed as "cannot parse the video stream whose Codec ID is'V_MS/VFW/FOURC'". According to the first error data, it can be known that the parsing process is because the above format video stream cannot be parsed Error, and then you can choose a parser that can parse the video stream in the above format.

Step 212: Perform a second parsing process on the video file to be processed through a parser corresponding to the second target parsing identifier to obtain an audio and video stream.

After the second target parsing identifier is selected, the parser corresponding to the second target parsing identifier can be subjected to second parsing processing to obtain the audio and video stream. Specifically, the to-be-processed video file may be composed of several bytes of data, for example, including data representing the attributes of the to-be-processed video, audio and video stream data, and data representing the attributes of the audio and video stream.

In the process of parsing the video file to be processed, you can read the data of several bytes contained in the video file to be processed and parse the read data to obtain the attributes of the video to be processed and the audio and video stream. Properties and audio and video streams. The parsed audio video stream only separates the data representing the audio and video stream from the video file to be processed, and cannot be directly played by the terminal. The audio and video stream needs to be decoded before it can be played by the terminal. Therefore, after the audio and video streams are obtained, the audio and video streams must be decoded.

Step 214: Acquire a set of decoding identifiers corresponding to the second file format.

In one embodiment, after decoding the video file to be processed to obtain the audio and video stream, the corresponding set of decoding identifiers may be obtained according to the second file format of the audio and video stream. The decoding identifier set may be preset, and the decoding identifier included in the decoding identifier set may be adjusted during the operation of the electronic device, which is not limited herein. For example, the number of errors in decoding the video file by the decoder corresponding to the decoding identifier in the decoding identifier set is counted, and the order of the decoding identifiers is adjusted according to the number of errors. If the number of errors exceeds the threshold, the decoding identifier is removed. Decode identification set.

Step 216: Acquire a second arrangement order of decoding identifiers included in the decoding identifier set, obtain a first target decoding identifier from the decoding identifier set according to the second arrangement order, and use the decoder to correspond to the audio and video stream corresponding to the first target decoding identifier The first decoding process is performed.

In one embodiment, the decoder included in the decoding identification set can decode the video file in the second file format, and can sort the decoding identifications in the decoding identification set according to the second file format in advance, and determine the corresponding decoding according to the order The decoding performance of the device is strong or weak. For example, the decoding identifiers are sorted in order from strongest to weakest decoding performance. The higher the decoding identifier in the decoding identifier set, the stronger the decoding performance of the corresponding decoder for the audio and video stream in the second file format.

After the decoding identifier set is obtained, the first target decoding identifier can be obtained from the decoding identifier set according to the second arrangement order, and the first decoding process is performed on the audio and video stream according to the decoder corresponding to the first target decoding identifier. For example, the decoding identifiers in the decoding identifier set may be arranged in order from weak to strong decoding performance, and then the last-ordered decoding identifier in the decoding identifier set may be obtained as the first target decoding identifier, and then the first target decoding identifier The corresponding decoder performs the first parsing process on the audio and video stream.

Step 218: When the first decoding process reports an error, obtain the second error reporting data obtained during the first decoding process, and obtain the second target decoding identifier from the decoding identification set according to the second error reporting data.

When performing the first decoding process on the audio and video stream by the decoder corresponding to the first target decoding identifier, if the first decoding process does not report an error, the audio and video stream can be directly obtained according to the first decoding process; if the first decoding process reports an error, It means that the decoder corresponding to the first target decoding identifier cannot decode the above audio and video stream. When an error is reported by the first target decoding process, the second error reported data of the first decoding process can also be obtained. The reason for the error in the first decoding process can be obtained through the second error report data.

When the decoder corresponding to the first target decoding identifier performs the first decoding process and reports an error, the cause of the error can be obtained based on the second error reporting data, so that the second target decoding identifier can be accurately found from the decoding identification set according to the second error reporting data And then perform a second decoding process on the audio and video stream according to the obtained decoder corresponding to the second target decoding identifier.

In the embodiment provided by the present application, step 216 may specifically further include: acquiring a second arrangement order of the decoding identifiers included in the decoding identifier set, sequentially obtaining the first target decoding identifier from the decoding identifier set according to the second arrangement order, and The first decoding process is performed on the audio and video stream by the decoder corresponding to the first target decoding identifier. Step 218 may further specifically include: when the first decoding process reports an error, count the number of error reports during the first decoding process on the audio and video stream; when the number of error reports is less than or equal to the threshold value, return to perform decoding Obtain the first target decoding identifier from the identifier set, and perform the first decoding processing step on the audio and video stream through the decoder corresponding to the first target decoding identifier; when the number of error reports is greater than the threshold number of times, obtain the first decoded result obtained during the first decoding process Second error data, and obtain the second target decoding identifier from the decoding identifier set according to the second error reporting data.

Step 220: Perform a second decoding process on the audio and video stream through the decoder corresponding to the second target decoding identifier to obtain the decoded audio and video stream.

By performing the second decoding process on the audio and video stream through the decoder corresponding to the second target decoding identifier, the audio and video stream can be decoded to generate an audio and video stream that can be played by the terminal, that is, the decoded audio and video stream obtained by the decoding process can be Played by the terminal. For example, audio and video streams are expressed in binary form, and the data in binary form can be converted into pictures and audio that can be played by the terminal through decoding processing.

FIG. 3 is a schematic diagram of decoding a video file to be processed in an embodiment. As shown in FIG. 3, the to-be-processed video file 302 contains several binary bytes of data. First, the data in the to-be-processed video file 302 can be parsed to obtain an audio stream 304 and a video stream 306. After the audio stream 304 and the video stream 306 are obtained, the audio stream 304 and the video stream 306 can be decoded separately. After decoding the audio stream 304, a decoded audio stream 308 is obtained. After decoding the video stream 306, a decoded video stream 310 is obtained. After the decoding is completed, the electronic device can play the decoded audio stream 308 and the decoded video stream 310.

The video decoding method provided in the above embodiment can accurately select the parser and decoder according to the format of the video file to be processed, thereby improving the decoding efficiency of the video file. At the same time, when an error is reported during the parsing or decoding of the video file to be processed, the cause of the error can be located according to the error data, and then the corresponding parser or decoder can be selected according to the cause of the error, thereby further improving the decoding accuracy of the video file and Decoding efficiency.

In one embodiment, as shown in FIG. 4, the method for obtaining the video file to be processed may specifically include:

Step 402: The receiving server returns the original video file according to the file acquisition request, and the first original file format and the second original file format corresponding to the original video file.

Specifically, when the server receives the file acquisition request, the server may acquire the corresponding original video file according to the file acquisition request. Then, the original video file is preliminarily parsed to obtain the first original file format and the second original file format of the original video file, and the original video file and the corresponding first original file format and second original file format are returned to the terminal. The first original file format is used to represent the format of the original video file, and the second original file format is used to represent the format of the audio and video stream in the original video file.

Step 404, when there is a set of parsing identifiers corresponding to the first original file format, the original video file is used as the video file to be processed, the first original file format is used as the first file format of the video to be processed, and the second original file format As the second file format of the video to be processed.

After receiving the original video file and the corresponding first original file format and second original file format, the terminal will search for the set of parsing identifiers corresponding to the first original file format. If there is a set of resolution identifiers corresponding to the first original file format in the terminal, the terminal can parse the video file in the first original file format. At this time, the original video file can be directly used as the to-be-processed video file, the first original file format as the first file format of the to-be-processed video, and the second original file format as the second file format of the to-be-processed video. The video file to be processed is parsed.

Step 406: When there is no set of resolution identifiers corresponding to the first original file format, send a format conversion request to the server.

If there is no set of parsing identifiers corresponding to the first original file format in the terminal, it means that the terminal cannot parse the video file in the first original file format. At this time, the terminal can send a format conversion request to the server, and the server performs format conversion on the original video file to generate a video file that can be parsed by the terminal.

Specifically, the format conversion request may include information such as the file identification of the original video file, the video file format supported by the terminal, the terminal identification that sends the format conversion request, and the server identification that receives the format conversion request. After receiving the format conversion request, the server can obtain the original video file corresponding to the file identifier, and then convert the obtained original video file into a file format to be processed that the terminal supports parsing.

In one embodiment, when there is no set of parsing identifiers corresponding to the first original file format, it can be further determined that the parser in the terminal can also be called to sequentially analyze the original video files in the first original file format. If all parsers in the terminal do not support parsing processing of the original video file, it means that the terminal does not support parsing processing of the original video file, you can send a format conversion request to the server; if there is a terminal that supports the original video file The parser for parsing processing means that the terminal supports parsing processing of the original video file, and you can obtain the original parser that supports parsing the original video file. According to the original parser, the parsing process of the original video file is performed, and according to the original The parsing identifier corresponding to the parser generates a parsing identifier set corresponding to the first original file format.

When there is a parser that supports parsing the original video file, the original video file can be directly used as the to-be-processed video file, and the first original file format can be used as the first file format of the to-be-processed video, and the second original The file format is used as the second file format of the video to be processed, and the video file to be processed is parsed in the terminal.

Step 408: Receive the to-be-processed video file obtained by format conversion of the original video file according to the format conversion request sent by the server, and the first file format and the second file format corresponding to the to-be-processed video file.

In the embodiment provided by the present application, after the server converts the original video file into a to-be-processed video file, it may perform a preliminary analysis on the to-be-processed video file to obtain a first file format and a second file format corresponding to the to-be-processed video file. Then the server sends the obtained video file to be processed and the corresponding first file format and second file format to the terminal.

In one embodiment, as shown in FIG. 5, the steps of parsing the video file to be processed may specifically include:

Step 502: Acquire the first target resolution identifier from the set of resolution identifiers according to the first order, and perform the first parsing process on the video file to be processed through the parser corresponding to the first target resolution identifier.

Specifically, in the process of performing the first parsing process on the video file to be processed, the first target parsing identifier may be obtained from the parsing identifier set in sequence according to the first order, and the parser corresponding to the obtained first target parsing identifier may be obtained The first parsing process of the video file to be processed is stopped until the first parsing process is completed for the first time to obtain the audio and video stream.

If an error is reported during the first parsing process, the number of errors reported by the video file to be processed in the first parsing process may be counted. If the number of error reports is relatively small, you can continue to obtain the next first target resolution identifier according to the order of the resolution identifiers in the resolution identifier set, and perform the first resolution process on the video file to be processed according to the next first target resolution identifier. If the number of error reports is relatively small, the second target resolution identifier can be obtained according to the error report data, and the second resolution process can be performed according to the second target resolution identifier corresponding to the video file to be processed.

Step 504: When the first parsing process reports an error, count the number of error reports in the first parsing process of the video file to be processed.

Specifically, the first target resolution identifier is sequentially read from the set of resolution identifiers, and the first parsing process is performed on the video file to be processed according to the parser corresponding to the read first target resolution identifier. When an error is reported in the first parsing process, the number of error reports in the first parsing process can be counted.

For example, the set of parsing identifiers includes sequentially arranged identifiers A, B, and C. First, the identifier A is read, and the first parsing process is performed according to the parser corresponding to the identifier A. If the parser corresponding to the identifier A performs the first parsing process and obtains the audio and video streams in the to-be-processed video file, the execution is stopped. If the first parsing process reports an error according to the parser corresponding to the identifier A, the number of error reports in the first parsing process obtained by statistics is 1, and the next identifier B may be continuously read. Similarly, if the first parsing process according to the identifier B is successful, the execution stops. If the first parsing process reports an error according to the identifier B, the number of error reports in the first parsing process obtained by statistics is 2.

Step 506: When the number of error reports is less than or equal to the threshold of number of times, return to execute to obtain the first target parsing identifier from the set of parsing identifiers according to the first ranking order, and perform the first processing of the video file to be processed by the parser corresponding to the first target parsing identifier Analytical processing steps.

When the number of error reports is less than or equal to the threshold number of times, you can continue to read the next first target parsing identifier from the set of parsing identifiers in sequence according to the first sort order, and perform the first process on the video file to be processed according to the read first target parsing identifier Resolution processing.

Step 508: When the number of error reports is greater than the threshold number of times, obtain first error report data obtained during the first parsing process.

When the number of error reports is greater than the threshold number of times, the first error report data obtained during the first analysis process can be used, and then the second target analysis tag that can be parsed can be accurately selected from the set of analysis tags according to the first error report data. The first error report data may be error report data obtained when the first analysis process is performed for the last time, or may be error report data obtained when the first analysis process is performed for any one time, which is not limited herein.

In the embodiment provided by the present application, as shown in FIG. 6, the steps of decoding the audio and video specifically include:

Step 602: Acquire an audio decoding identifier set corresponding to an audio stream format, and acquire a video decoding identifier set corresponding to a video stream format.

In one embodiment, the parsed audio and video streams include audio streams and video streams, the second file format includes the audio stream format corresponding to the audio stream and the video stream format corresponding to the video stream, and the decoding identification set includes the audio decoding identification set and video Decode identification set. In the process of decoding the audio and video streams, the audio and video streams can be decoded separately.

Step 604: Acquire the target audio decoding identifier with the strongest audio decoding performance from the set of audio decoding identifiers, and perform decoding processing on the audio stream through the audio decoder corresponding to the target audio decoding identifier to obtain the decoded audio stream.

Specifically, according to the audio decoding identifier set corresponding to the audio stream format, the video decoding identifier set corresponding to the video stream format is obtained. The set of audio decoding identifiers includes at least one audio decoding identifier arranged in sequence, and the set of video decoding identifiers includes at least one video decoding identifier arranged in sequence.

After the audio decoding identifier set corresponding to the audio stream format is obtained, the target audio decoding identifier with the strongest audio decoding performance can be obtained from the audio decoding identifier set. The audio decoding performance represents the performance of the decoder corresponding to the audio decoding identifier, and the audio stream is decoded according to the obtained target audio decoding identifier with the strongest audio decoding performance. Specifically, the method for obtaining the target audio decoding identifier from the audio decoding identifier set is not limited. For example, the audio decoding identifiers in the audio decoding identifier set may be sorted according to the strength of the audio decoding performance, and then the target audio decoding identifier with the strongest audio decoding performance in the audio decoding identifier set may be obtained according to the ranking.

Step 606: Obtain the target video decoding identifier with the strongest video decoding performance from the video decoding identifier set, and perform decoding processing on the video stream through the video decoder corresponding to the target video decoding identifier to obtain the decoded video stream.

Similarly, according to the video decoding identifier set corresponding to the video stream format, the video decoding identifier set corresponding to the video stream format is obtained. The set of video decoding identifiers includes at least one video decoding identifier arranged in sequence, and the set of video decoding identifiers includes at least one video decoding identifier arranged in sequence.

After the video decoding identifier set corresponding to the video stream format is obtained, the target video decoding identifier with the strongest video decoding performance can be obtained from the video decoding identifier set. The video decoding performance indicates the performance of the decoder corresponding to the video decoding identifier, and the video stream is decoded according to the obtained target video decoding identifier with the strongest video decoding performance. Specifically, the method for obtaining the target video decoding identifier from the video decoding identifier set is not limited. For example, the video decoding identifiers in the video decoding identifier set may be sorted according to the strength of the video decoding performance, and then the target video decoding identifier with the strongest video decoding performance in the video decoding identifier set may be obtained according to the ranking.

It should be understood that although the steps in the flowcharts of FIGS. 1, 2, 4, 5, and 6 are displayed in order according to the arrows, the steps are not necessarily executed in the order indicated by the arrows. Unless clearly stated in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least some of the steps in FIGS. 1, 2, 4, 5, and 6 may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times The execution order of these sub-steps or stages is not necessarily sequential, but may be executed in turn or alternately with at least a part of other steps or sub-steps or stages of other steps.

In the embodiment provided by the present application, the above video decoding method may further specifically include:

(1) Send a file acquisition request to the server.

(2) The original video file returned by the receiving server according to the file acquisition request, and the first original file format and the second original file format corresponding to the original video file.

(3) When there is a set of parsing identifiers corresponding to the first original file format, the original video file is used as the video file to be processed, the first original file format is used as the first file format of the video to be processed, and the second original file format As the second file format of the video to be processed.

(4) When there is no set of resolution identifiers corresponding to the first original file format, send a format conversion request to the server.

(5) Receive the video file to be processed which is obtained by format conversion of the original video file according to the format conversion request sent by the server, and the first file format and the second file format corresponding to the video file to be processed, wherein the second file format includes audio Streaming format and video streaming format.

(6) Acquire the set of resolution identifiers corresponding to the first file format.

(7) According to the second file format, obtain the first arrangement order of the analysis marks contained in the analysis mark set, obtain the first target analysis mark from the analysis mark set according to the first arrangement order, and correspond to the first target analysis mark The parser performs the first parsing process on the video file to be processed.

(8) When the first parsing process reports an error, count the number of errors reported in the first parsing process of the video file to be processed.

(9) When the number of error reports is less than or equal to the threshold number of times, return to execute and obtain the first target resolution identifier from the set of resolution identifiers in order, and perform the first parsing process on the video file to be processed through the parser corresponding to the first target resolution identifier step.

(10) When the number of error reports is greater than the threshold number of times, acquire the first error report data obtained during the first analysis process, and obtain the second target analysis identifier from the analysis identifier set according to the first error report data.

(11) Perform a second parsing process on the video file to be processed by a parser corresponding to the second target parsing identifier to obtain an audio and video stream.

(12) Acquire the audio decoding identifier set corresponding to the audio stream format.

(13) Acquire the second audio arrangement order of the audio decoding identifiers included in the audio decoding identifier set, obtain the first target audio decoding identifier from the audio decoding identifier set according to the second audio arrangement order, and correspond to the first target audio decoding identifier Of the decoder performs the first audio decoding process on the audio stream.

(14) When the first audio decoding process reports an error, obtain the second audio error reporting data obtained during the first audio decoding process, and obtain the second target audio decoding identification from the audio decoding identification set according to the second audio error reporting data.

(15) Perform a second audio decoding process on the audio stream by the decoder corresponding to the second target audio decoding identifier to obtain the decoded audio stream.

(16) Obtain the second video arrangement order of the video decoding identifiers contained in the video decoding identifier set, obtain the first target video decoding identifier from the video decoding identifier set according to the second video arrangement order, and correspond to the first target video decoding identifier Of the decoder performs the first video decoding process on the video stream.

(17) When the first video decoding process reports an error, obtain second video error reporting data obtained during the first video decoding process, and obtain the second target video decoding identification from the video decoding identification set according to the second video error reporting data.

(18) Perform a second video decoding process on the video stream by the decoder corresponding to the second target video decoding identifier to obtain the decoded video stream.

The video decoding method provided in the above embodiment can accurately select the parser and decoder according to the format of the video file to be processed, thereby improving the decoding efficiency of the video file. At the same time, when an error is reported during the parsing or decoding of the video file to be processed, the cause of the error can be located according to the error data, and then the corresponding parser or decoder can be selected according to the cause of the error, thereby further improving the decoding efficiency of the video file.

7 is a schematic structural diagram of a video decoding device in an embodiment. As shown in FIG. 7, the video decoding apparatus 700 includes a file acquisition module 702, an analysis set acquisition module 704, an analysis processing module 706, a decoding set module 708, and a decoding processing module 710. among them:

The file obtaining module 702 is used to obtain a to-be-processed video file and obtain a first file format and a second file format corresponding to the to-be-processed video file. The first file format is used to represent the format of the to-be-processed video file, and the second file format is used Is used to indicate the format of audio and video streams in the video file to be processed.

The parsing set obtaining module 704 is used to obtain a parsing identification set corresponding to the first file format.

The parsing and processing module 706 is used to obtain the target parsing identifier with the strongest parsing performance from the parsing identifier set, and parsing the video file to be processed through the parser corresponding to the target parsing identifier to obtain an audio and video stream. Represents the performance of the parser corresponding to the parsing identifier;

The decoding set obtaining module 708 is used to obtain a decoding identification set corresponding to the second file format.

The decoding processing module 710 is used to obtain the target decoding identifier with the strongest decoding performance from the set of decoding identifiers, and perform decoding processing on the audio and video stream through the decoder corresponding to the target decoding identifier to obtain the decoded audio and video stream, wherein, decoding Performance is used to indicate the performance of the decoder corresponding to the decoding identifier.

After obtaining the to-be-processed video file and the corresponding first file format and second file format, the video decoding device provided in the above embodiment may obtain the corresponding resolution identification set according to the first file format and obtain from the resolution identification set The target parsing mark, through the parser corresponding to the target parsing mark, analyzes the video file to be processed to obtain an audio and video stream. Then, the corresponding decoding identifier set is obtained according to the second file format, and the target decoding identifier is obtained from the decoding identifier set. Finally, the decoder corresponding to the target decoding identifier decodes the audio and video stream to obtain the decoded audio and video stream. In this way, the parser and decoder can be accurately selected according to the format of the video file to be processed, and the decoding efficiency of the video file is improved.

In one embodiment, the above-mentioned file obtaining module 702 is further configured to send a file obtaining request to the server; receiving the video file to be processed returned by the server according to the file obtaining request, and the first file format and the second file format corresponding to the video file to be processed .

In one embodiment, the above file obtaining module 702 is further used to receive the original video file returned by the server according to the file obtaining request, and the first original file format and the second original file format corresponding to the original video file; when the first original file exists When parsing the identification set corresponding to the format, the original video file is used as the video file to be processed, the first original file format is used as the first file format of the video to be processed, and the second original file format is used as the second file format of the video to be processed ; When there is no set of parsing identifiers corresponding to the first original file format, send a format conversion request to the server; receive the to-be-processed video file and the to-be-processed video file obtained by format conversion of the original video file according to the format conversion request sent by the server Corresponding first file format and second file format.

In one embodiment, the resolution identification set includes at least one resolution identification sorted according to resolution performance. The above-mentioned resolution processing module 706 is further used to obtain the first arrangement order of the resolution identifications included in the resolution identification set according to the second file format, according to The first sorting order obtains the target resolution identifier from the resolution identifier set.

In one embodiment, the parsing processing module 706 is further configured to obtain the first target parsing identifier from the set of parsing identifiers according to the first sort order, and perform the first parsing processing on the video file to be processed through the parser corresponding to the first target parsing identifier ; When the first parsing process reports an error, obtain the first error reporting data obtained during the first parsing process, and obtain the second target parsing identification from the parsing identification set according to the first error reporting data; through the parser corresponding to the second target parsing identification Perform a second parsing process on the video file to be processed to obtain an audio and video stream.

In one embodiment, the parsing processing module 706 is further configured to count the number of errors reported during the first parsing process of the video file to be processed when the first parsing process reports an error; when the number of reported errors is less than or equal to the threshold number of times, return to execute The first sorting sequence obtains the first target resolution identifier from the set of resolution identifiers, and performs the first resolution processing step on the video file to be processed through the parser corresponding to the first target resolution identifier; when the number of error reports is greater than the threshold value, the first resolution is obtained The first error data obtained during processing.

In an embodiment, the set of decoding identifiers includes at least one decoding identifier sorted according to decoding performance, and the above-mentioned decoding processing module 710 is further used to obtain a second arrangement order of the decoding identifiers included in the set of decoding identifiers, from Obtain the target decoding identifier from the decoding identifier set.

In one embodiment, the above-mentioned decoding processing module 710 is further configured to obtain the first target decoding identifier from the set of decoding identifiers according to the second arrangement order, and perform the first decoding of the audio and video stream by the decoder corresponding to the first target decoding identifier Processing; when the first decoding process reports an error, obtain the second error reporting data obtained during the first decoding process, and obtain the second target decoding identifier from the decoding identification set according to the second error reporting data; The decoder performs a second decoding process on the audio and video stream to obtain the decoded audio and video stream.

In one embodiment, the audio and video stream includes an audio stream and a video stream, and the second file format includes an audio stream format and a video stream format; the above-mentioned decoding processing module 710 is further used to obtain an audio decoding identifier set corresponding to the audio stream format and obtain The video decoding identifier set corresponding to the video stream format; obtain the target audio decoding identifier with the strongest audio decoding performance from the audio decoding identifier set, and perform decoding processing on the audio stream through the audio decoder corresponding to the target audio decoding identifier to obtain the decoded Audio stream; and obtain the target video decoding identifier with the strongest video decoding performance from the video decoding identifier set, and decode the video stream through the video decoder corresponding to the target video decoding identifier to obtain the decoded video stream.

The division of each module in the above video decoding device is for illustration only. In other embodiments, the video decoding device may be divided into different modules as needed to complete all or part of the functions of the above video decoding device.

For specific definitions of the video decoding device, reference may be made to the above definition of the video decoding method, and details are not described herein again. Each module in the above video decoding device may be implemented in whole or in part by software, hardware, or a combination thereof. The above modules may be embedded in the hardware or independent of the processor in the computer device, or may be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

An embodiment of the present application also provides an electronic device. As shown in FIG. 8, for ease of description, only parts related to the embodiments of the present application are shown, and specific technical details are not disclosed, please refer to the method part of the embodiments of the present application. The electronic device may be any terminal device including a mobile phone, tablet computer, PDA (Personal Digital Assistant), POS (Point of Sales), in-vehicle computer, wearable device, etc. Taking the electronic device as a mobile phone for example :

8 is a block diagram of a partial structure of a mobile phone related to an electronic device provided by an embodiment of the present application. 8, the mobile phone includes: a radio frequency (Radio Frequency) circuit 810, a memory 820, an input unit 830, a display unit 840, a sensor 850, an audio circuit 860, a wireless fidelity (WiFi) module 870, and a processor 880 , And power supply 890 and other components. Those skilled in the art may understand that the structure of the mobile phone shown in FIG. 8 does not constitute a limitation on the mobile phone, and may include more or fewer components than those shown in the figure, or a combination of certain components, or a different component arrangement.

Among them, the RF circuit 810 can be used to receive and send signals during the sending and receiving of information or during a call. It can receive the downlink information of the base station and process it to the processor 880; it can also send the uplink data to the base station. Generally, RF circuits include but are not limited to antennas, at least one amplifier, transceiver, coupler, low noise amplifier (Low Noise Amplifier, LNA), duplexer, and so on. In addition, the RF circuit 810 can also communicate with other devices through a wireless communication network. The above wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile (GSM), General Packet Radio Service (GPRS), and Code Division Multiple Access (Code Division) Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), e-mail, Short Message Service (SMS), etc.

The memory 820 may be used to store software programs and modules. The processor 880 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 820. The memory 820 may mainly include a program storage area and a data storage area, where the program storage area may store an operating system and at least one function-required application program (such as a sound playback function application program, an image playback function application program, etc.), etc.; The data storage area can store data (such as audio data, address book, etc.) created according to the use of the mobile phone. In addition, the memory 820 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

The input unit 830 may be used to receive input numeric or character information, and generate key signal input related to user settings and function control of the mobile phone 800. Specifically, the input unit 830 may include a touch panel 831 and other input devices 832. The touch panel 831, also known as a touch screen, can collect user's touch operations on or near it (such as the user using any finger, stylus, or any other suitable object or accessory on or near the touch panel 831 Operation), and drive the corresponding connection device according to the preset program. In one embodiment, the touch panel 831 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates To the processor 880, and can receive the command sent by the processor 880 and execute it. In addition, the touch panel 831 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 831, the input unit 830 may also include other input devices 832. Specifically, other input devices 832 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), and the like.

The display unit 840 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 840 may include a display panel 841. In one embodiment, the display panel 841 may be configured in the form of a liquid crystal display (Liquid Crystal) (LCD), an organic light emitting diode (Organic Light-Emitting Diode, OLED), or the like. In one embodiment, the touch panel 831 may cover the display panel 841, and when the touch panel 831 detects a touch operation on or near it, it is transmitted to the processor 880 to determine the type of touch event, and then the processor 880 according to The type of touch event provides a corresponding visual output on the display panel 841. Although in FIG. 8, the touch panel 831 and the display panel 841 are implemented as two independent components to realize the input and input functions of the mobile phone, in some embodiments, the touch panel 831 and the display panel 841 may be integrated and Realize the input and output functions of the mobile phone.

The mobile phone 800 may further include at least one sensor 850, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 841 according to the brightness of the ambient light, and the proximity sensor may close the display panel 841 and/or when the mobile phone moves to the ear Or backlight. The motion sensor may include an acceleration sensor. The acceleration sensor can detect the magnitude of acceleration in various directions, and can detect the magnitude and direction of gravity when at rest. Pedometer, percussion), etc. In addition, the mobile phone can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor and so on.

The audio circuit 860, the speaker 861, and the microphone 862 may provide an audio interface between the user and the mobile phone. The audio circuit 860 can transmit the converted electrical signal of the received audio data to the speaker 861, and the speaker 861 converts it into a sound signal output; on the other hand, the microphone 862 converts the collected sound signal into an electrical signal, which is converted by the audio circuit 860 After receiving, it is converted into audio data, and then processed by the audio data output processor 880, and then sent to another mobile phone via the RF circuit 810, or the audio data is output to the memory 820 for subsequent processing.

WiFi is a short-range wireless transmission technology. The mobile phone can help users send and receive e-mails, browse web pages, and access streaming media through the WiFi module 870. It provides users with wireless broadband Internet access. Although FIG. 8 shows the WiFi module 870, it can be understood that it is not a necessary component of the mobile phone 800, and may be omitted as needed.

The processor 880 is the control center of the mobile phone, connects various parts of the entire mobile phone with various interfaces and lines, executes or executes the software programs and/or modules stored in the memory 820, and calls the data stored in the memory 820 to execute Various functions and processing data of the mobile phone, so as to monitor the mobile phone as a whole. In one embodiment, the processor 880 may include one or more processing units. In one embodiment, the processor 880 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, user interface, application programs, and the like; the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 880.

The mobile phone 800 further includes a power supply 890 (such as a battery) that supplies power to various components. Preferably, the power supply can be logically connected to the processor 880 through a power management system, so as to realize functions such as charging, discharging, and power management through the power management system.

In one embodiment, the mobile phone 800 may further include a camera, a Bluetooth module, and the like.

In the embodiment of the present application, when the processor 880 included in the electronic device executes the computer program stored in the memory, the steps of the video decoding method provided in the foregoing embodiment are implemented.

The embodiments of the present application also provide a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, causing the processors to execute the video decoding method provided by the foregoing embodiments step.

A computer program product containing instructions, when it runs on a computer, causes the computer to execute the video decoding method provided by the above embodiment.

Any references to memory, storage, databases, or other media used in this application may include non-volatile and/or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR) SDRAM, enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The above-mentioned embodiments only express several implementation manners of the present application, and their descriptions are more specific and detailed, but they should not be construed as limiting the patent scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which all fall within the protection scope of the present application. Therefore, the protection scope of the patent of this application shall be subject to the appended claims.

Claims

A video decoding method, including:

Acquiring a to-be-processed video file, and acquiring a first file format and a second file format corresponding to the to-be-processed video file, the first file format is used to represent the format of the to-be-processed video file, and the second file format It is used to indicate the format of the audio and video stream in the to-be-processed video file;

Obtaining a set of resolution identifiers corresponding to the first file format;

Obtaining the target resolution identifier with the strongest resolution performance from the set of resolution identifiers, and parsing the to-be-processed video file through a parser corresponding to the target resolution identifier to obtain an audio and video stream, wherein the resolution performance Used to indicate the performance of the parser corresponding to the parsing identifier;

Obtaining a set of decoding identifiers corresponding to the second file format; and

Obtain the target decoding identifier with the strongest decoding performance from the set of decoding identifiers, and perform decoding processing on the audio and video stream by a decoder corresponding to the target decoding identifier to obtain a decoded audio and video stream, wherein, the The decoding performance is used to indicate the performance of the decoder corresponding to the decoding identifier.
The method according to claim 1, wherein the acquiring the to-be-processed video file and acquiring the first and second file formats corresponding to the to-be-processed video file include:

Send a file acquisition request to the server;

Receiving the to-be-processed video file returned by the server according to the file acquisition request, and the first and second file formats corresponding to the to-be-processed video file.
The method according to claim 2, wherein the receiving is to process the video file returned by the server according to the file acquisition request, and the first file format and the second file format corresponding to the video file to be processed ,include:

Receiving the original video file returned by the server according to the file acquisition request, and the first original file format and the second original file format corresponding to the original video file;

When there is a set of parsing identifiers corresponding to the first original file format, use the original video file as the to-be-processed video file, and use the first original file format as the first file format of the to-be-processed video, The second original file format is used as the second file format of the video to be processed;

When there is no set of resolution identifiers corresponding to the first original file format, send a format conversion request to the server;

Receiving a to-be-processed video file obtained by format conversion of the original video file according to the format conversion request sent by the server, and a first file format and a second file format corresponding to the to-be-processed video file.
The method according to claim 1, wherein the set of analysis identifiers includes at least one analysis identifier sorted according to analysis performance, and obtaining the target analysis identifier with the strongest analysis performance from the set of analysis identifiers includes: :

Obtaining a first arrangement order of the analysis identifiers contained in the analysis identifier set according to the second file format, and obtaining a target analysis identifier from the analysis identifier set according to the first arrangement order.
The method according to claim 4, wherein the target resolution identifier with the strongest resolution performance is obtained from the set of resolution identifiers, and the to-be-processed video file is processed by a parser corresponding to the target resolution identifier Analyze and get audio and video streams, including:

Obtaining a first target resolution identifier from the set of resolution identifiers according to the first sorting order, and performing first parsing processing on the to-be-processed video file through a parser corresponding to the first target resolution identifier;

When the first parsing process reports an error, obtain first error reporting data obtained during the first parsing process, and obtain a second target parsing identification from the parsing identification set according to the first error reporting data;

Perform a second parsing process on the video file to be processed by a parser corresponding to the second target parsing identifier to obtain an audio and video stream.
The method according to claim 5, wherein when the first parsing process reports an error, the first error reporting data obtained during the first parsing process is acquired, and the Obtaining the second target resolution identifier from the resolution identifier set includes:

When the first parsing process reports an error, count the number of error reports during the first parsing process on the video file to be processed;

When the number of error reports is less than or equal to the threshold number of times, return to execute the first target resolution identifier from the set of resolution identifiers according to the first sort order, and pass the parser corresponding to the first target resolution identifier Performing a first parsing process step on the to-be-processed video file;

When the number of error reports is greater than the threshold number of times, the first error report data obtained during the first parsing process is acquired.
The method according to any one of claims 1 to 6, wherein the set of decoding identifiers includes at least one decoding identifier sorted according to decoding performance, and the strongest decoding performance is obtained from the set of decoding identifiers The target decoding identifier, including:

Acquiring a second arrangement order of decoding identifiers included in the set of decoding identifiers, and obtaining a target decoding identifier from the set of decoding identifiers according to the second arrangement order.
The method according to claim 7, wherein the target decoding identifier with the strongest decoding performance is obtained from the set of decoding identifiers, and the audio and video stream is processed by a decoder corresponding to the target decoding identifier Decoding process to get the decoded audio and video stream, including:

Acquiring a first target decoding identifier from the set of decoding identifiers according to the second arrangement order, and performing a first decoding process on the audio and video stream through a decoder corresponding to the first target decoding identifier;

When the first decoding process reports an error, obtain second error reporting data obtained during the first decoding process, and obtain a second target decoding identifier from the decoding identification set according to the second error reporting data;

The decoder corresponding to the second target decoding identifier performs a second decoding process on the audio and video stream to obtain a decoded audio and video stream.
The method according to any one of claims 1 to 6, wherein the audio and video stream includes an audio stream and a video stream, and the second file format includes an audio stream format and a video stream format;

The acquiring the set of decoding identifiers corresponding to the second file format includes:

Acquiring an audio decoding identifier set corresponding to the audio stream format, and acquiring a video decoding identifier set corresponding to the video stream format;

Obtaining the target decoding identifier with the strongest decoding performance from the set of decoding identifiers, and decoding the audio and video stream through a decoder corresponding to the target decoding identifier to obtain the decoded audio and video stream, including:

Obtaining the target audio decoding identifier with the strongest audio decoding performance from the set of audio decoding identifiers, and decoding the audio stream through an audio decoder corresponding to the target audio decoding identifier to obtain a decoded audio stream; and

Obtain the target video decoding identifier with the strongest video decoding performance from the video decoding identifier set, and perform decoding processing on the video stream by a video decoder corresponding to the target video decoding identifier to obtain a decoded video stream.
A video decoding device, including:

A file obtaining module, configured to obtain a to-be-processed video file, and obtain a first file format and a second file format corresponding to the to-be-processed video file, the first file format is used to represent the format of the to-be-processed video file, The second file format is used to represent the format of the audio and video stream in the video file to be processed;

A parsing set acquisition module, used to acquire a parsing identification set corresponding to the first file format;

A parsing processing module, configured to obtain a target parsing identifier with the strongest parsing performance from the parsing identifier set, and parsing the to-be-processed video file through a parser corresponding to the target parsing identifier to obtain an audio and video stream Wherein, the parsing performance is used to indicate the performance of the parser corresponding to the parsing identifier;

A decoding set acquisition module, for acquiring a decoding identification set corresponding to the second file format; and

A decoding processing module, configured to obtain a target decoding identifier with the strongest decoding performance from the set of decoding identifiers, and perform decoding processing on the audio and video stream by a decoder corresponding to the target decoding identifier to obtain decoded audio and video Stream, where the decoding performance is used to indicate the performance of the decoder corresponding to the decoding identifier.
An electronic device includes a memory and a processor, and a computer program is stored in the memory, and when the computer program is executed by the processor, the processor is executed as described in any one of claims 1 to 9. Steps of the method.
A computer-readable storage medium on which a computer program is stored, characterized in that when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are realized.