CN110855619B - Processing method and device for playing audio and video data, storage medium and terminal equipment - Google Patents
Processing method and device for playing audio and video data, storage medium and terminal equipment Download PDFInfo
- Publication number
- CN110855619B CN110855619B CN201910980359.2A CN201910980359A CN110855619B CN 110855619 B CN110855619 B CN 110855619B CN 201910980359 A CN201910980359 A CN 201910980359A CN 110855619 B CN110855619 B CN 110855619B
- Authority
- CN
- China
- Prior art keywords
- audio
- decoding
- video data
- played
- playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 26
- 238000012545 processing Methods 0.000 claims abstract description 34
- 241000700605 Viruses Species 0.000 claims description 16
- 230000015654 memory Effects 0.000 claims description 13
- 238000001514 detection method Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 4
- 238000000034 method Methods 0.000 abstract description 20
- 230000000694 effects Effects 0.000 abstract description 4
- 230000005540 biological transmission Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/764—Media network packet handling at the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a processing method, a device, a storage medium and a terminal playing device for playing audio and video data, wherein the method further detects whether the initial coding and decoding format of the audio and video data to be played meets the requirement of the preset coding and decoding format by adding the preset coding and decoding formats of various standard types in advance, and under the condition that the initial coding and decoding format of the audio and video data to be played meets the requirement of the preset coding and decoding format, the decoding playing is quickly realized, transcoding switching is not required to be carried out back and forth, the transcoding switching time of the audio and video data is saved, the playing efficiency is improved, the delay rate of the audio and video playing is further reduced, the CPU processing speed of the first terminal playing device is improved, and the effect of reducing the packet loss phenomenon of the audio and video data to be played is.
Description
Technical Field
The invention relates to the technical field of audio and video data processing, in particular to a processing method and device for playing audio and video data, a storage medium and terminal equipment.
Background
With the development of network technology, audio and video data are driven to be widely applied and rapidly developed in various industries such as security, traffic, finance, education and the like, so that the audio and video data processing technology plays an important role in internet communication, is further processed in the transmission process of the audio and video data, and is favorable for recording or live broadcasting or releasing of the audio and video data.
At present, in the process of playing or releasing audio and video data, the audio and video data are played or released after being mutually transmitted through a plurality of terminals, and because the types of the terminals are often different, the coding and decoding formats of an audio and video acquisition terminal are usually different from the coding and decoding formats of an audio and video playing terminal, namely the coding and decoding formats of the audio and video data acquired by the audio and video acquisition terminal are not matched with the coding and decoding formats of the corresponding audio and video playing terminal, in order to normally play the audio and video data, all the coding and decoding formats of the audio and video data need to be transcoded to adapt to the coding and decoding formats of the audio and video playing terminal, so that the audio and video data are played.
Obviously, in the process of frequently transcoding the audio/video data in the encoding and decoding format, the audio/video playing or distribution of the audio/video data is delayed, or the audio/video data cannot be played due to unsuccessful transcoding, and then, if the audio/video data is too large, the processing speed of a processor of the audio/video playing terminal is also affected, and then, in the process of processing the audio/video data, if the audio/video data is subjected to multiple decoding processing, the audio/video data is lost.
Disclosure of Invention
In view of this, an embodiment of the present invention provides a processing method for playing audio and video data, so as to solve the problems that audio and video playing or distribution of the audio and video data is delayed, a processing speed of a processor of an audio and video playing terminal is affected, and the audio and video data is lost in a process of performing format transcoding on the audio and video data in the prior art.
According to a first aspect, an embodiment of the present invention provides a processing method for playing audio/video data, which is used for a first terminal playing device, and is characterized by including the following steps:
adding a plurality of standard types of preset coding and decoding formats;
receiving audio and video data to be played;
detecting whether the initial coding and decoding format of the audio and video data to be played conforms to a preset coding and decoding format or not;
and decoding and playing the audio and video data to be played according to the detection result.
With reference to the first aspect, in a first implementation manner of the first aspect, the step of decoding and playing the to-be-played audio/video data according to the detection result includes:
when the initial coding and decoding format of the audio and video data to be played conforms to the preset coding and decoding format, decoding and playing the audio and video data to be played;
and when the initial coding and decoding format of the audio and video data to be played does not accord with the preset coding and decoding format, acquiring a target coding and decoding format corresponding to the audio and video data to be played for decoding and playing.
With reference to the first embodiment of the first aspect, in the second embodiment of the first aspect, when the initial codec format of the audio/video data to be played does not conform to the preset codec format, the step of obtaining the target codec format corresponding to the audio/video data to be played for decoding and playing includes:
analyzing the initial coding and decoding format;
downloading a target coding and decoding format corresponding to the initial coding and decoding format;
storing the target coding and decoding format in a coding and decoding storage unit;
and according to the target coding and decoding format, directly carrying out decoding playing or sending the target coding and decoding format to second terminal playing equipment for decoding playing.
With reference to the first embodiment of the first aspect, in the third embodiment of the first aspect, when the initial codec format of the audio/video data to be played does not conform to the preset codec format, the step of obtaining the target codec format corresponding to the audio/video data to be played for decoding and playing includes:
and marking the coding and decoding identification and the decoding playing times of the decoding playing, and updating the preset coding and decoding format according to the coding and decoding identification or the decoding playing times.
With reference to the first embodiment of the first aspect, in the fourth embodiment of the first aspect, when the to-be-played audio/video data conforms to the preset encoding and decoding format, the step of decoding and playing the to-be-played audio/video data includes:
identifying the structure of audio and video data to be played;
according to the identification result, whether the audio and video data to be played has virus information is confirmed;
when the audio and video data to be played has virus information, deleting the virus information;
and directly decoding and playing the audio and video data to be played after the virus information is deleted or sending the decoded audio and video data to be played to a second terminal playing device for playing.
With reference to the first embodiment of the first aspect, in the fifth embodiment of the first aspect, when the to-be-played audio/video data conforms to a preset encoding and decoding format, the step of decoding and playing the to-be-played audio/video data includes:
identifying the structure of audio and video data to be played;
according to the identification result, whether the audio and video data to be played has packet loss data is confirmed;
when the audio and video data to be played has packet loss data, the audio and video data to be played is repaired;
determining whether the current code stream of the audio and video data to be played after the repair processing is less than or equal to a preset code stream;
and when the current code stream is less than or equal to the preset code stream, directly decoding and playing the repaired audio and video data to be played or sending the decoded audio and video data to be played to a second terminal playing device for playing.
With reference to the first aspect, in a sixth implementation manner of the first aspect, the step of detecting whether an initial codec format of the audio/video data to be played conforms to a preset codec format includes:
analyzing a compiling and resolving wharf of audio and video data to be played;
acquiring initial encoding and decoding format attributes of audio and video data to be played from an encoding and decoding wharf;
and detecting whether the initial coding and decoding format attribute belongs to the attribute contained in the preset coding and decoding format.
According to a second aspect, an embodiment of the present invention provides a processing apparatus for playing audio/video data, which is used for a first terminal playing device,
the adding module is used for adding preset coding and decoding formats of various standard types;
the receiving module is used for receiving audio and video data to be played;
the detection module is used for detecting whether the initial coding and decoding format of the audio and video data to be played conforms to a preset coding and decoding format;
and the decoding playing module is used for decoding and playing the audio and video data to be played according to the detection result.
According to a third aspect, an embodiment of the present invention provides a storage medium, on which computer instructions are stored, and the instructions, when executed by a processor, implement the steps of the processing method for playing audio and video data described in the first aspect or any implementation manner of the first aspect.
According to a fourth aspect, an embodiment of the present invention provides a terminal playing device, which includes a memory, a processor, and a computer program that is stored in the memory and is executable on the processor, where the processor implements the steps of the processing method for playing audio and video in the first aspect or any implementation manner of the first aspect when executing the program.
The technical scheme of the embodiment of the invention has the following advantages:
the embodiment of the invention provides a processing method, a device, a storage medium and a terminal playing device for playing audio and video data, wherein the method is used for a first terminal playing device and comprises the following steps: adding preset coding and decoding formats of multiple standard types into first terminal playing equipment; receiving audio and video data to be played, and detecting whether the initial coding and decoding format of the audio and video data to be played meets the requirement of a preset coding and decoding format; when the initial coding and decoding format of the audio and video data to be played meets the requirement of a preset coding and decoding format, decoding and playing the audio and video data to be played; when the initial coding and decoding format of the audio and video data to be played does not meet the requirement of the preset coding and decoding format, acquiring a target coding and decoding format corresponding to the audio and video data to be played for decoding and playing; the method comprises the steps of adding multiple standard types of preset coding and decoding formats in advance, further detecting whether the initial coding and decoding formats of the audio and video data to be played meet the requirements of the preset coding and decoding formats, and under the condition that the initial coding and decoding formats of the audio and video data to be played meet the requirements of the preset coding and decoding formats, quickly realizing decoding playing without performing transcoding switching back and forth, saving transcoding switching time of the audio and video data, improving playing efficiency, further reducing delay rate of the audio and video playing, achieving the purpose of improving CPU processing speed of first terminal playing equipment and playing the role of reducing packet loss of the audio and video data to be played.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a first flowchart of a processing method for playing audio/video data according to an embodiment of the present invention;
fig. 2 is a second flowchart of a processing method for playing audio/video data according to an embodiment of the present invention;
fig. 3 is a third flowchart of a processing method for playing audio/video data according to an embodiment of the present invention;
fig. 4 is a block diagram of a processing device for playing audio/video data according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a hardware structure in the embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1
The embodiment of the present invention provides a processing method for playing audio/video data, which is used for a first terminal playing device, where the first terminal playing device may be a mobile phone terminal device, or a mobile tablet terminal device, or a computer terminal device, and preferably selects the first terminal playing device as a server terminal, as shown in fig. 1, including the following steps:
step S1: adding a plurality of standard types of preset coding and decoding formats;
step S2: receiving audio and video data to be played;
step S3: detecting whether the initial coding and decoding format of the audio and video data to be played conforms to a preset coding and decoding format or not;
step S4: and decoding and playing the audio and video data to be played according to the detection result.
In the step S1, the first terminal playing device adds multiple standard types of preset codec formats, and since most terminal playing devices have limited supportable codec formats, most terminal playing devices usually have one or two supportable codec formats, and if the codec formats of the audio/video data to be played uploaded by the client are of two or more types, the first terminal playing device needs to transcode the audio/video data to be played to realize normal playing of the audio/video data.
In the embodiment, the preset encoding and decoding formats of multiple standard types are added into the first terminal playing device, so that the situation that the audio and video data to be played are in multiple encoding and decoding formats is prevented as much as possible, and at this moment, the first terminal playing device needs transcoding to cope with the situation, therefore, the first terminal playing device can avoid that the first terminal playing device transcodes the audio and video data to be played in the encoding and decoding formats which are not matched with the first terminal playing device by adding the preset encoding and decoding formats of multiple standard types in advance, so that the audio and video processing speed is increased, and the playing delay is reduced.
Specifically, the preset codec formats of the multiple standard types may be an H264 video codec format type and/or an H263 video codec format type and/or an H261 video codec format type and/or an H265 video codec format type and/or an MPEG-1 video codec format type and/or an mp3 audio codec format type and/or an aac audio codec format type and/or a g.711 audio codec format type.
In the step S2, the audio/video data to be played may be sent to the first terminal playing device in this embodiment through the audio/video collecting device, where the audio/video data to be played is used for the audio/video data to be played and watched.
In the step S3, detecting whether the initial codec format of the audio/video data to be played meets the requirement of the preset codec format, specifically, the first terminal playing device may start a detection program to detect the decoding playing standard of the audio/video data to be played; for example: when the type of the encoding and decoding of the initial encoding and decoding format is A, B, C, the type of the preset encoding and decoding format comprises A, B, C, D types, and the initial encoding and decoding format meets the requirements of the preset encoding and decoding format; for example: when the type of the codec of the initial codec format is A, B, C, D, E, the types of the preset codec format include A, B, C, D types, and the initial codec format does not meet the requirements of the codec format, according to the existing method, A, B, C, D, E needs to be transcoded into a, B, C, or D at the same time.
In this embodiment, the processing method for playing the audio/video data in the present invention is equivalent to lossless transparent transmission processing, and does not need to perform transcoding operations back and forth on all initial codec formats of the uploaded audio/video data to be played, specifically, by adding a plurality of standard types of preset codec formats in advance, it is further detected whether the initial codec formats of the audio/video data to be played meet the requirements of the preset codec formats, and under the condition that the initial codec formats of the audio/video data to be played meet the requirements of the preset codec formats, decoding playing is quickly achieved, transcoding switching back and forth is not needed, delay in audio/video playing can be reduced, CPU processing speed of the first terminal playing device is increased, and packet loss of the audio/video data to be played can be reduced.
Example 2
The embodiment of the invention provides a processing method for playing audio and video data, which further defines an implementation mode for detecting whether an initial coding and decoding format of the audio and video data to be played conforms to a preset coding and decoding format, and specifically comprises the following steps:
step S11: analyzing a compiling and resolving wharf of audio and video data to be played;
in step S11, the codec header corresponds to a tag of the audio/video data to be played, and further analyzes and identifies the content information recorded in the tag;
step S12: and acquiring the initial coding and decoding format attribute of the audio and video data to be played from the coding and decoding wharf.
In the above step S12, the initial codec format attribute includes a codec format type, an audio/video bitrate, an audio/video frame rate, an audio/video resolution, and the like, for example: the codec format type may be an H264 video codec format type and/or an H263 video codec format type and/or an H261 video codec format type and/or an H265 video codec format type and/or an MPEG-1 video codec format type and/or an mp3 audio codec format type and/or an aac audio codec format type and/or a g.711 audio codec format type.
Step S13: detecting whether the attribute of the initial codec format belongs to the attribute contained in the preset codec format, for example: the initial codec format type in the initial codec format attributes is H264 video codec format type, mp3 audio codec format type, and rate is 600kbps, and resolution is 1920 × 1080, and the codec format H264 video codec format type and/or H263 video codec format type and/or H261 video codec format type and/or H265 video codec format type and/or MPEG-1 video codec format type and/or mp3 audio codec format type and/or aac audio codec format type and/or g.711 audio codec format type, etc. are supported by the initial codec format attributes, and the rate supports 600kbps, 800kbps, 900kbps, resolution supports 1920 × 1080, 1080 × 720, 720 × 576, etc. therefore, the codec format attributes are among the attributes included in the preset codec format, otherwise, the attribute of the initial coding and decoding format is not in the attribute contained in the preset coding and decoding format; for example: the attribute contained in the preset encoding and decoding format comprises A, B, C, D, and the encoding and decoding format of the audio and video to be played is A, B, C, D, E; at this time, E does not belong to the attribute included in the preset codec format.
Example 3
In a specific implementation manner of this embodiment, the step S4 in the process of executing the processing method, as shown in fig. 2, may specifically include the following steps:
step S41: when the initial coding and decoding format of the audio and video data to be played conforms to the preset coding and decoding format, decoding and playing the audio and video data to be played;
step S42: and when the initial coding and decoding format of the audio and video data to be played does not accord with the preset coding and decoding format, acquiring a target coding and decoding format corresponding to the audio and video data to be played for decoding and playing.
In the above steps S41 to S42, by adding a plurality of standard types of preset codec formats in advance, it is further detected whether the initial codec format of the audio/video data to be played meets the requirement of the preset codec format, and under the condition that the initial codec format of the audio/video data to be played meets the requirement of the preset codec format, decoding playing is quickly achieved without transcoding switching back and forth, so that delay of audio/video playing can be reduced, the CPU processing speed of the first terminal playing device can be increased, and the packet loss phenomenon of the audio/video data to be played can be reduced.
Example 4
In a specific implementation manner of this embodiment, when the initial codec format of the audio/video data to be played conforms to the preset codec format, the step S41 of decoding and playing the audio/video data to be played includes the following steps in an execution process:
step S111: identifying the structure of the audio and video data to be played, and specifically analyzing the hierarchical topological structure of the audio and video data to be played, for example: for H264 video data, each layer of data information of the picture layer, the block layer, the macroblock layer, and the block layer may be identified from top to bottom.
Step S112: and according to the identification result, determining whether the audio and video data to be played has virus information, and deleting the virus information to ensure that safe and high-quality audio and video playing data are provided for a user when the audio and video data to be played has the virus information, so that the user experience is enhanced.
Step S114: the audio and video data to be played after the virus information is deleted is directly decoded and played or the decoded audio and video data to be played is sent to the second terminal playing device to be played, the audio and video data to be played can be directly decoded and played locally through the first terminal playing device, and in order to achieve communication among the plurality of terminal playing devices, the audio and video data to be played after the first terminal playing device is decoded can be issued to the second terminal playing device to be played, so that the playing efficiency can be improved, and the playing delay is reduced.
Example 5
In fig. 2, in a specific implementation manner of this embodiment, when the initial codec format of the audio/video data to be played conforms to a preset codec format, the step S41 of decoding and playing the audio/video data to be played includes the following steps in an execution process:
step S211: identifying the structure of the audio and video data to be played, and specifically analyzing the hierarchical topological structure of the audio and video data to be played, for example: for H264 video data, each layer of data information of the picture layer, the block layer, the macroblock layer, and the block layer may be identified from top to bottom.
Step S212: according to the identification result, whether the audio and video data to be played have packet loss data or not is determined, and the phenomenon of packet loss data can cause the integrity of the audio and video data to be played, influence the audio and video playing effect and further influence the viewing interest of users.
Step S213: when the audio and video data to be played has packet loss data, the audio and video data to be played is repaired, the normal and complete audio and video data can be compared with the audio and video data to be played, and the packet loss data is supplemented and repaired.
Step S214: and determining whether the current code stream of the repaired audio/video data to be played is less than or equal to a preset code stream, wherein in order to improve the definition of an audio/video picture, if the code rate of the audio/video data to be played is improved, at the moment, the transmission efficiency of the audio/video data to be played is influenced, and in order to ensure a better audio/video playing effect, a high-quality audio/video playing file can be presented to a user under the condition that the audio/video data to be played has a higher code rate, so that the preset code stream is set to prevent the influence on the playing quality of the audio/video to be played due to overh.
Step S215: when the current code stream is less than or equal to the preset code stream, the audio and video data to be played after restoration processing is directly decoded and played or the decoded audio and video data to be played is sent to a second terminal playing device for playing.
Example 6
In fig. 2, in a specific implementation manner of this embodiment, when the initial codec format of the audio/video data to be played does not conform to the preset codec format, the step S42 of obtaining the target codec format corresponding to the audio/video data to be played for decoding and playing may specifically include the following steps, as shown in fig. 3, in an execution process:
step S421: analyzing the initial coding and decoding format, and analyzing the initial coding and decoding format to obtain the type of the initial coding and decoding format;
step S422: downloading a target coding and decoding format corresponding to the initial coding and decoding format, wherein the target coding and decoding format is matched with the initial coding and decoding format; by downloading the target codec format, it is prevented that the downloaded target codec format can be directly used for decoding under the condition that the initial codec format does not conform to the preset codec format, for example: the type of the preset codec format includes A, B, C, D, E, and the type of the initial codec format of the audio/video data to be played includes A, B, C, D, E, F, at this time, for F, the target codec format corresponding to F may be downloaded for decoding.
Step S423: and storing the target coding and decoding formats in a coding and decoding storage unit, wherein the coding and decoding storage unit is used for storing each downloaded target coding and decoding format to prevent the target coding and decoding formats from being lost.
Step S424: and according to the target coding and decoding format, directly carrying out decoding playing or sending the target coding and decoding format to the second terminal playing device for decoding playing, wherein according to the target coding and decoding format, the first terminal playing device can directly carry out decoding playing locally, or sending the target coding and decoding format to the second terminal playing device for decoding playing.
Therefore, under the condition that the initial coding and decoding format of the audio and video data to be played does not meet the requirement of the preset coding and decoding format, the target coding and decoding format corresponding to the initial coding and decoding format can be directly downloaded for decoding and playing, and the playing efficiency is further improved.
Example 7
In fig. 3, a preferred implementation manner of this embodiment of the present invention is that, after the process executed in step S424, the directly performing decoding playing according to the target coding and decoding format or sending the target coding and decoding format to the second terminal playing device for decoding playing, the method further includes: step S425: and marking the coding and decoding identification and the decoding playing times of the decoding playing, and updating the preset coding and decoding format according to the coding and decoding identification or the decoding playing times.
In the above step S425, the codec identifier and the decoding playing frequency for marking the decoding playing may record the playing processing state of the audio/video data to be played, specifically, the preset codec format is updated according to the codec identifier or the decoding playing frequency, for example: when the initial coding and decoding identification which frequently appears or has more decoding playing times is not contained in the preset coding and decoding format, the frequently appearing initial coding and decoding format can be added into the first terminal playing device so as to adapt to audio and video playing data to be played in more types of coding and decoding formats, so that a faster playing effect is realized, and the playing delay is reduced.
Example 8
The embodiment of the invention provides a processing device for playing audio and video data, which is used for a first terminal playing device and comprises the following modules as shown in fig. 4:
an adding module 41, configured to add multiple standard types of preset encoding and decoding formats;
the receiving module 42 is configured to receive audio/video data to be played;
the detection module 43 is configured to detect whether an initial codec format of the audio/video data to be played conforms to a preset codec format;
and the decoding playing module 44 is used for decoding and playing the audio and video data to be played according to the detection result.
In fig. 4, the processing device for playing audio/video data according to the embodiment of the present invention includes a detection module 43:
the analysis submodule 431 is used for analyzing an editing and decoding wharf of the audio and video data to be played;
the obtaining submodule 432 is used for obtaining the initial coding and decoding format attribute of the audio and video data to be played from the coding and decoding wharf;
the detecting submodule 433 is configured to detect whether the initial codec format attribute belongs to an attribute included in a preset codec format.
In fig. 4, the decoding playing module 44 of the processing device for playing audio/video data in the embodiment of the present invention includes:
the first decoding playing submodule 441 is configured to decode and play the audio/video data to be played when the initial encoding and decoding format of the audio/video data to be played conforms to a preset encoding and decoding format;
the second decoding playing sub-module 442 is configured to, when the initial codec format of the audio/video data to be played does not conform to the preset codec format, acquire a target codec format corresponding to the audio/video data to be played for decoding playing.
In the processing apparatus for playing audio/video data in the embodiment of the present invention, the first decoding playing sub-module 441 includes:
the first identification unit is used for identifying the structure of the audio and video data to be played;
the first confirming unit is used for confirming whether the audio and video data to be played has virus information according to the identification result;
the deleting subunit is used for deleting the virus information when the audio and video data to be played has the virus information;
and the first decoding playing unit is used for directly decoding and playing the audio and video data to be played after the virus information is deleted or sending the decoded audio and video data to be played to the second terminal playing device for playing.
In the processing apparatus for playing audio/video data in the embodiment of the present invention, the first decoding playing sub-module 441 includes:
the second identification unit is used for identifying the structure of the audio and video data to be played;
the second confirming unit is used for confirming whether the audio and video data to be played has packet loss data according to the identification result;
the repair processing subunit is used for performing repair processing on the audio and video data to be played when packet loss data exists in the audio and video data to be played;
the third confirming unit is used for confirming whether the current code stream of the audio and video data to be played after the repair processing is smaller than or equal to the preset code stream;
and the second decoding playing unit is used for directly decoding and playing the repaired audio and video data to be played or sending the decoded audio and video data to be played to the second terminal playing device for playing when the current code stream is less than or equal to the preset code stream.
In the processing apparatus for playing audio/video data according to the embodiment of the present invention, the second decoding playing sub-module 442 includes:
the analysis unit is used for analyzing the initial coding and decoding format;
a downloading unit for downloading a target codec format corresponding to the initial codec format;
the storage unit is used for storing the target coding and decoding format in the coding and decoding storage unit;
and the sending unit is used for directly carrying out decoding playing according to the target coding and decoding format or sending the target coding and decoding format to the second terminal playing device for decoding playing.
In the processing device for playing audio/video data in the embodiment of the present invention, the second decoding playing sub-module 34 further includes:
and the marking unit is used for marking the coding and decoding identification and the decoding playing times of the decoding playing and updating the preset coding and decoding format according to the coding and decoding identification or the decoding playing times.
The processing device for playing the audio and video data in the embodiment of the invention is equivalent to lossless transparent transmission processing, and transcoding operation does not need to be carried out to and fro on all initial coding and decoding formats of the uploaded audio and video data to be played. Specifically, by adding multiple standard types of preset encoding and decoding formats in advance, whether the initial encoding and decoding format of the audio and video data to be played meets the requirement of the preset encoding and decoding format is further detected, decoding playing is quickly realized under the condition that the initial encoding and decoding format of the audio and video data to be played meets the requirement of the preset encoding and decoding format, transcoding switching is not needed to be carried out back and forth, delay of audio and video playing can be reduced, the CPU processing speed of first terminal playing equipment can be increased, and the phenomenon of packet loss of the audio and video data to be played can be reduced. In addition, under the condition that the initial coding and decoding format of the audio and video data to be played does not meet the requirement of the preset coding and decoding format, the target coding and decoding format corresponding to the initial coding and decoding format can be directly downloaded for decoding and playing, and the playing efficiency is further improved.
Example 9
Embodiments of the present invention provide a storage medium having stored thereon computer instructions, which when executed by a processor, implement the steps of the method for processing playing audio and video data of embodiment 1. The storage medium is also stored with a preset coding and decoding format, an initial coding and decoding format, a target coding and decoding format and the like. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD) or a Solid State Drive (SSD), etc.; the storage medium may also comprise a combination of memories of the kind described above.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware related to instructions of a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a Random Access Memory (RAM), or the like.
Example 10
An embodiment of the present invention provides a terminal playing device, which may represent the first terminal playing device in embodiment 1, as shown in fig. 5, including a memory 520, a processor 510, and a computer program stored in the memory 520 and capable of running on the processor 510, where the processor 510 implements the steps of the method in embodiment 1 when executing the program.
Fig. 5 is a schematic diagram of a hardware structure of a terminal playback device for executing a processing method for list item operations according to an embodiment of the present invention, as shown in fig. 5, the terminal playback device includes one or more processors 510 and a memory 520, where one processor 510 is taken as an example in fig. 5.
The terminal playing device executing the processing method of the list item operation may further include: an input device 530 and an output device 550.
The processor 510, the memory 520, the input device 530, and the output device 550 may be connected by a bus or other means, and fig. 5 illustrates an example of a connection by a bus.
It should be understood that the above examples are only for clarity of illustration and are not intended to limit the embodiments. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. And obvious variations or modifications therefrom are within the scope of the invention.
Claims (8)
1. A processing method for playing audio and video data is used for a first terminal playing device, and is characterized by comprising the following steps:
adding a plurality of standard types of preset coding and decoding formats;
receiving audio and video data to be played;
detecting whether the initial coding and decoding format of the audio and video data to be played conforms to the preset coding and decoding format or not;
decoding and playing the audio and video data to be played according to the detection result;
the step of decoding and playing the audio and video data to be played according to the detection result comprises the following steps:
when the initial coding and decoding format of the audio and video data to be played conforms to a preset coding and decoding format, decoding and playing the audio and video data to be played;
when the initial coding and decoding format of the audio and video data to be played does not accord with the preset coding and decoding format, acquiring a target coding and decoding format corresponding to the audio and video data to be played for decoding and playing;
when the initial coding and decoding format of the audio and video data to be played does not conform to the preset coding and decoding format, the step of acquiring a target coding and decoding format corresponding to the audio and video data to be played for decoding and playing comprises the following steps:
analyzing the initial coding and decoding format;
downloading a target coding and decoding format corresponding to the initial coding and decoding format;
storing the target coding and decoding format in a coding and decoding storage unit;
and according to the target coding and decoding format, directly carrying out decoding playing or sending the target coding and decoding format to second terminal playing equipment for decoding playing.
2. The processing method for playing audio/video data according to claim 1, wherein after the step of playing the audio/video data to be played by decoding when the audio/video data to be played does not conform to a preset encoding/decoding format, the processing method comprises:
and marking the coding and decoding identification and the decoding playing times of the decoding playing, and updating the preset coding and decoding format according to the coding and decoding identification or the decoding playing times.
3. The processing method for playing audio/video data according to claim 1, wherein when the audio/video data to be played conforms to a preset encoding/decoding format, the step of decoding and playing the audio/video data to be played comprises:
identifying the structure of the audio and video data to be played;
according to the identification result, whether virus information exists in the audio and video data to be played is confirmed;
when the audio and video data to be played has virus information, deleting the virus information;
and directly decoding and playing the audio and video data to be played after the virus information is deleted or sending the decoded audio and video data to be played to a second terminal playing device for playing.
4. The processing method for playing audio/video data according to claim 1, wherein when the audio/video data to be played conforms to a preset encoding and decoding format, the step of decoding and playing the audio/video data to be played comprises:
identifying the structure of the audio and video data to be played;
according to the identification result, whether the audio and video data to be played has packet loss data is confirmed;
when the audio and video data to be played has packet loss data, the audio and video data to be played is repaired;
determining whether the current code stream of the audio and video data to be played after the repair processing is less than or equal to a preset code stream;
and when the current code stream is less than or equal to a preset code stream, directly decoding and playing the repaired audio and video data to be played or sending the decoded audio and video data to be played to a second terminal playing device for playing.
5. The processing method for playing audio/video data according to claim 1, wherein the step of detecting whether the initial codec format of the audio/video data to be played conforms to the preset codec format comprises:
analyzing the editing and decoding wharf of the audio and video data to be played;
acquiring the initial encoding and decoding format attribute of the audio and video data to be played from the encoding and decoding wharf;
and detecting whether the initial coding and decoding format attribute belongs to the attribute contained in the preset coding and decoding format.
6. A processing device for playing audio and video data is used for a first terminal playing device and is characterized in that,
the adding module is used for adding preset coding and decoding formats of various standard types;
the receiving module is used for receiving audio and video data to be played;
the detection module is used for detecting whether the initial coding and decoding format of the audio and video data to be played conforms to the preset coding and decoding format;
and the decoding playing module is used for decoding and playing the audio and video data to be played according to the detection result, wherein the decoding playing module comprises: when the initial coding and decoding format of the audio and video data to be played conforms to a preset coding and decoding format, decoding and playing the audio and video data to be played;
when the initial coding and decoding format of the audio and video data to be played does not accord with the preset coding and decoding format, acquiring a target coding and decoding format corresponding to the audio and video data to be played for decoding and playing;
when the initial coding and decoding format of the audio and video data to be played does not conform to the preset coding and decoding format, the step of acquiring a target coding and decoding format corresponding to the audio and video data to be played for decoding and playing comprises the following steps:
analyzing the initial coding and decoding format;
downloading a target coding and decoding format corresponding to the initial coding and decoding format;
storing the target coding and decoding format in a coding and decoding storage unit;
and according to the target coding and decoding format, directly carrying out decoding playing or sending the target coding and decoding format to second terminal playing equipment for decoding playing.
7. A storage medium having stored thereon computer instructions, characterized in that the instructions, when executed by a processor, implement the steps of a processing method of playing audio-visual data according to any one of claims 1 to 5.
8. A terminal playing device comprising a memory, a processor and a computer program stored on the memory and operable on the processor, wherein the processor implements the steps of the processing method for playing audio and video according to any one of claims 1 to 5 when executing the program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910980359.2A CN110855619B (en) | 2019-10-12 | 2019-10-12 | Processing method and device for playing audio and video data, storage medium and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910980359.2A CN110855619B (en) | 2019-10-12 | 2019-10-12 | Processing method and device for playing audio and video data, storage medium and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110855619A CN110855619A (en) | 2020-02-28 |
| CN110855619B true CN110855619B (en) | 2021-03-23 |
Family
ID=69597553
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910980359.2A Active CN110855619B (en) | 2019-10-12 | 2019-10-12 | Processing method and device for playing audio and video data, storage medium and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110855619B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114745600B (en) * | 2022-06-10 | 2022-09-27 | 中国传媒大学 | Video label labeling method and device based on SEI |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1947407A (en) * | 2004-04-09 | 2007-04-11 | 日本电气株式会社 | Audio communication method and device |
| CN108881916A (en) * | 2018-06-21 | 2018-11-23 | 深圳市斯迈龙科技有限公司 | The video optimized processing method and processing device of remote desktop |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI556656B (en) * | 2014-04-30 | 2016-11-01 | 微晶片科技公司 | Audio player with bluetooth function and audio playing method thereof |
-
2019
- 2019-10-12 CN CN201910980359.2A patent/CN110855619B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1947407A (en) * | 2004-04-09 | 2007-04-11 | 日本电气株式会社 | Audio communication method and device |
| CN108881916A (en) * | 2018-06-21 | 2018-11-23 | 深圳市斯迈龙科技有限公司 | The video optimized processing method and processing device of remote desktop |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110855619A (en) | 2020-02-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9961398B2 (en) | Method and device for switching video streams | |
| CN110933490B (en) | Automatic adjustment method for picture quality and tone quality, smart television and storage medium | |
| CN107634930B (en) | Method and device for acquiring media data | |
| CN108833938B (en) | Method and apparatus for selecting video covers | |
| CN112653700B (en) | Website video communication method based on WEBRTC | |
| US9609338B2 (en) | Layered video encoding and decoding | |
| CN104702976A (en) | Video playing method and equipment | |
| CN111436004B (en) | Video playing method, device and equipment and computer readable storage medium | |
| US11438645B2 (en) | Media information processing method, related device, and computer storage medium | |
| CN111225171B (en) | Video recording method, device, terminal equipment and computer storage medium | |
| CN111263243B (en) | Video coding method and device, computer readable medium and electronic equipment | |
| US10819951B2 (en) | Recording video from a bitstream | |
| CN112165653B (en) | Video playing method, device and equipment | |
| CN112261377B (en) | Web edition monitoring video playing method, electronic equipment and storage medium | |
| CN109391585A (en) | Video data handling procedure, device, terminal and computer readable storage medium | |
| CN111669577A (en) | Hardware decoding detection method and device, electronic equipment and storage medium | |
| US20210409738A1 (en) | Video decoding method and apparatus, video encoding method and apparatus, storage medium, and electronic device | |
| CN112423140A (en) | Video playing method and device, electronic equipment and storage medium | |
| CN112954457A (en) | Video playing and displaying method, device and system | |
| CN112995698A (en) | Video playing method, client, service platform and intelligent conference system | |
| CN113596467B (en) | Transcoding service detection method and device, electronic equipment and storage medium | |
| CN111031032A (en) | Cloud video transcoding method and device, decoding method and device, and electronic device | |
| CN111343503B (en) | Video transcoding method and device, electronic equipment and storage medium | |
| CN113709447B (en) | Method and device for detecting playing performance of terminal equipment | |
| CN110855619B (en) | Processing method and device for playing audio and video data, storage medium and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Processing methods, devices, storage media, and terminal devices for playing audio and video data Granted publication date: 20210323 Pledgee: Anhui Jiangnan Industrial Concentration Zone Construction Investment Development (Group) Co.,Ltd. Pledgor: Anhui Wenxiang Information Technology Co.,Ltd. Registration number: Y2024980010826 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |