WO2022160743A1

WO2022160743A1 - Video file playing system, audio/video playing process, and storage medium

Info

Publication number: WO2022160743A1
Application number: PCT/CN2021/119404
Authority: WO
Inventors: 刘志杰; 林炳河
Original assignee: 稿定（厦门）科技有限公司
Priority date: 2021-01-29
Filing date: 2021-09-18
Publication date: 2022-08-04
Also published as: CN112969092B; CN112969092A

Abstract

Disclosed are a video file playing system, an audio/video playing process, and a storage medium. A material management module is used for managing material information selected by a user; an effect management module is used for managing effect information corresponding to a material selected by the user, wherein the material information and the effect information corresponding to the material information are provided with resource read-write locks, and in the resource read-write locks, resource read functions are not mutually exclusive, and resource read functions and resource write functions are mutually exclusive; an audio module is used for decoding and consuming audio data in the material information and effect data corresponding to the audio data, so as to complete playing of an audio; and a video module is used for decoding and rendering video data in the material information and effect data corresponding to the video data, so as to complete playing of a video. Therefore, the user can perform real-time addition and deletion of a material during the process of a player playing a video file, and there is no need to stop a player thread during the addition and deletion processes, thereby avoiding the loss of performance.

Description

Video file playback system, audio and video playback process, storage medium

This application claims the priority of the first Chinese patent application with the Chinese patent application number CN202110127821.1 filed on January 29, 2021 and the application name is "Video File Playing System", the entire contents of which are incorporated into this application by reference.

technical field

The invention relates to the technical field of video data processing, in particular to a video file playback system, a playback method and a storage medium.

Background technique

A player is a tool for playing video files; nowadays, in order to meet the needs of users, many players (for example, clipping, etc.) allow users to modify video files.

In the related art, when the user needs to add material during the process of video playback through the player, it is often necessary to completely stop the player thread, and restart the player thread after the user completes the addition of the material; and Failure to stop the player thread will cause the player to generate a concurrency error. In this way, the user cannot view the effect of the added material in real time; moreover, frequently terminating and restarting the player thread leads to a serious waste of resources.

SUMMARY OF THE INVENTION

The present invention aims to solve one of the technical problems in the above technologies at least to a certain extent. Therefore, an object of the present invention is to propose a video file playback system, so that the user can add or delete materials in real time during the process of playing the video file by the player, and the process of adding and deleting does not need to completely stop the player thread, Avoid performance loss.

To achieve the above purpose, an embodiment of the present invention proposes a video file playback system, including: an audio module, a video module, a material management module, and an effect management module; wherein, the material management module is used to store material information selected by a user, And according to the search request sent by the audio module or the video module, the corresponding material information is searched, and the material information is changed according to the user's change request; the effect management module is used to store the effect information corresponding to the material selected by the user, and according to the audio The search request sent by the module or the video module searches for the corresponding effect information, and changes the effect information according to the user's change request; the material information and the effect information corresponding to the material information are provided with a resource read-write lock, and the resource In the read-write lock, the resource reading function is not mutually exclusive, and the resource reading function and the resource writing function are mutually exclusive; the audio module is used to perform audio data in the material information and the effect data corresponding to the audio data. Decoding and consumption to complete audio playback; the video module is used for decoding and rendering the video data in the material information and the effect data corresponding to the video data to complete the video playback.

According to the video file playback system according to the embodiment of the present invention, the material management module is set to store the material information selected by the user, and the corresponding material information is searched according to the search request sent by the audio module or the video module, and according to the user's change request The material information is changed; the effect management module is used to store the effect information corresponding to the material selected by the user, search for the corresponding effect information according to the search request sent by the audio module or the video module, and change the effect information according to the user's change request; The material information and the effect information corresponding to the material information are provided with a resource read-write lock. In the resource read-write lock, the resource read functions are not mutually exclusive, and the resource read function and the resource write function are mutually exclusive; The audio module is used to decode and consume the audio data in the material information and the effect data corresponding to the audio data to complete the audio playback; the video module is used to decode and consume the video data in the material information and the effect data corresponding to the video data. Rendering to complete the video playback; enabling users to add and delete materials in real time during the process of playing video files on the player, and the process of adding and deleting does not need to completely stop the player thread to avoid performance loss.

In addition, the video file playback system proposed according to the above embodiments of the present invention may also have the following additional technical features:

Optionally, the audio module includes an audio decoding thread and an audio consumption thread, and the audio module is correspondingly provided with an audio lock, wherein the audio lock includes a first decoding block, a first recycling block and a search block, and the first A decoding block, the first recovery block and the search block are mutually exclusive in pairs.

Optionally, the audio module decodes the audio data in the material information and the effect data corresponding to the audio data, including: the audio decoding thread judges whether the resource reading function of the resource read-write lock is available, and when the judgment result is yes. , determine whether the first decoding block is available; if so, obtain the current play time, and obtain the corresponding audio data and the effect data corresponding to the audio data according to the current play time to decode, and store the decoded data in the first a buffer queue.

Optionally, the audio module plays the audio data in the material information and the effect data corresponding to the audio data, including: the audio consumption thread judges whether the resource reading function of the resource read-write lock is available, and when the judgment result is yes. , obtain the current play time, and query the first buffer queue according to the current play time to obtain the corresponding decoded audio data to play; after finishing the play of the decoded data, update the current play time.

Optionally, the video module includes a video decoding thread and a video consumption thread, and the video module is correspondingly provided with a video lock, wherein the video lock includes a second decoding block, a second recycling block and a rendering block, and the first The second recycling block is mutually exclusive with the second decoding block and the rendering block, and the decoding block and the rendering block are not mutually exclusive.

Optionally, the video module decodes the video data in the material information and the effect data corresponding to the video data, including: the video decoding thread judging whether the resource reading function of the resource read-write lock is available, and when the judgment result is: When it is, judge whether the second decoding block is available; if so, obtain the current play time, and obtain corresponding video data and the effect data corresponding to the video data according to the current play time to decode, and store the decoded data. into the second buffer queue.

Optionally, the video module plays the video data in the material information and the effect data corresponding to the video data, including: the video consumption thread judges whether the resource reading function of the resource read-write lock is available, and when the judgment result is yes. , obtain the current play time, and query the second cache queue according to the current play time to obtain corresponding decoded video data for playing.

Description of drawings

1 is a schematic block diagram of a video file playback system according to an embodiment of the present invention;

2 is a schematic diagram of an audio decoding process flow according to an embodiment of the present invention;

3 is a schematic diagram of an audio playback process according to an embodiment of the present invention;

4 is a schematic diagram of a video decoding process according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a video playback process according to an embodiment of the present invention.

Detailed ways

The following describes in detail the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to explain the present invention and should not be construed as limiting the present invention.

In the related art, when the user needs to add material during the process of video playback through the player, the player thread often needs to be completely stopped; the user cannot view the effect of the added material in real time; and, frequently Terminating and restarting the player thread leads to a serious waste of resources. According to the video file playback system according to the embodiment of the present invention, the material management module is set to store the material information selected by the user, and the corresponding material information is searched according to the search request sent by the audio module or the video module, and according to the user's change request The material information is changed; the effect management module is used to store the effect information corresponding to the material selected by the user, search for the corresponding effect information according to the search request sent by the audio module or the video module, and change the effect information according to the user's change request; The material information and the effect information corresponding to the material information are provided with a resource read-write lock. In the resource read-write lock, the resource read functions are not mutually exclusive, and the resource read function and the resource write function are mutually exclusive; The audio module is used to decode and consume the audio data in the material information and the effect data corresponding to the audio data to complete the audio playback; the video module is used to decode and consume the video data in the material information and the effect data corresponding to the video data. Rendering to complete the video playback; enabling users to add and delete materials in real time during the process of playing video files on the player, and the process of adding and deleting does not need to completely stop the player thread to avoid performance loss.

For better understanding of the above technical solutions, exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present invention will be more thoroughly understood, and will fully convey the scope of the present invention to those skilled in the art.

In order to better understand the above technical solutions, the above technical solutions will be described in detail below with reference to the accompanying drawings and specific embodiments.

1 is a schematic block diagram of a video file playback system according to an embodiment of the present invention; as shown in FIG.

Wherein, the material management module 30 is used to store the material information selected by the user, search for the corresponding material information according to the search request sent by the audio module 10 or the video module 20, and change the material information according to the user's change request;

The effect management module 40 is used for storing the effect information corresponding to the material selected by the user, and searches for the corresponding effect information according to the search request sent by the audio module 10 or the video module 20, and changes the effect information according to the user's change request;

That is, the material information (audio data or video data) and effect information (effects corresponding to audio data, such as voice changing, etc.; effects corresponding to video data, such as partial display, adding borders, etc.) are managed separately to avoid The problem of increased management complexity in a multi-threaded environment caused by the coupling of material information and effect information.

Among them, the management of the material information by the material management module includes: searching for the material according to the request, correspondingly adding, deleting and changing the material information according to the user's addition, deletion and change request, and changing the duration of the material according to the change of the material, And call back to inform the player to change the total duration according to the change result.

The management of the effect information by the effect management module includes: searching for effect information according to the request, and correspondingly adding, deleting and changing the effect information according to the user's addition, deletion and modification request.

A resource read-write lock is set for the effect information corresponding to the material information and the material information. In the resource read-write lock, the resource read function is not mutually exclusive, and the resource read function and the resource write function are mutually exclusive;

That is to say, when the player needs to perform a resource read operation or a resource write operation on the material information and the effect information corresponding to the material information, it needs to obtain the resource read-write lock first. Among them, the resource read functions are not mutually exclusive, that is, multiple resource read operations are allowed to be performed at the same time; the resource read function and the resource write function are mutually exclusive; that is, when there is a resource read operation While in progress; the operation of resource writing is not allowed; and when there is a resource writing operation (when the material or effect needs to be changed, such as adding, deleting, modifying, the material management module or the effect management module needs to perform a resource write lock (to make changes after acquiring a resource write lock) is in progress, resource read operations are not allowed.

The audio module 10 is used to decode and consume the audio data in the material information and the effect data corresponding to the audio data to complete the audio playback;

In other words, separate audio decoding and consumption from video decoding and consumption; to prevent unnecessary mutual waiting between audio and video; reduce performance loss; at the same time, reduce the complexity of audio and video synchronization management.

In some embodiments, the audio module includes an audio decoding thread and an audio consumption thread, and the audio module is correspondingly provided with an audio lock, wherein the audio lock includes a first decoding block, a first recycling block and a search block, the first decoding block, the first The reclaim block and the lookup block are mutually exclusive.

In other words, the audio decoding and consumption process is divided into two threads to further improve the audio processing efficiency; and the multi-threaded process is managed through the audio lock to prevent multi-threaded concurrent errors.

As an example, the audio module decodes the audio data in the material information and the effect data corresponding to the audio data, including: the audio decoding thread judges whether the resource reading function of the resource read-write lock is available, and when the judgment result is yes, Determine whether the first decoding block is available; if so, obtain the current play time, and obtain the corresponding audio data and the effect data corresponding to the audio data according to the current play time for decoding, and store the decoded data in the first buffer queue. middle.

As another example, the audio module plays the audio data in the material information and the effect data corresponding to the audio data, including: the audio consumption thread judges whether the resource reading function of the resource read-write lock is available, and when the judgment result is yes , obtain the current play time, and query the first buffer queue according to the current play time to obtain the corresponding decoded audio data to play; after finishing the play of the decoded data, update the current play time.

In a specific embodiment of the present invention, as shown in Figure 2, the decoding process of the audio decoding thread includes the following steps:

S201, the resource read lock is acquired.

S202, the first decoding block is acquired.

S203, obtaining the current play time.

S204: Acquire audio data and effect data corresponding to the current playback time for decoding.

S205: Store the decoded data in the first buffer queue.

S206: Store the audio data and effect data not corresponding to the current playing time in the first recycling queue.

S207, the first decoding block is released.

S208, the resource read lock is released.

S209, determine whether the current audio decoding task ends; if yes, execute step S210; if not, execute step S201.

S210, end.

As a specific embodiment of the present invention, as shown in Figure 3, the consumption process of the audio consumption thread includes the following steps:

S301, the resource read lock is acquired.

S302, obtain the current play time.

S303: Acquire the corresponding decoded audio data stored in the first buffer queue according to the current playback time and play it.

S304, update the current play time.

S305, acquiring the first reclaimed block.

S306, release the audio data in the first recycling queue.

S307, the first reclaimed block is released.

S308, the resource read lock is released.

S309, determine whether the current audio playing task ends; if yes, go to step S310; if not, go to step S301.

S310, end.

It can be seen from the above that by recycling resources after each round of consumption, the problem of repeated resource recycling caused by the production end being responsible for recycling can be effectively avoided; concurrency errors can be avoided. In addition, the audio consumption thread is used for time driving; it can prevent the synchronization inconvenience caused by scattered time modification permissions.

The video module 20 is configured to decode and render the video data in the material information and the effect data corresponding to the video data, so as to complete the playback of the video.

In some embodiments, the video module includes a video decoding thread and a video consumption thread, and the video module is correspondingly provided with a video lock, wherein the video lock includes a second decoding block, a second recycling block, and a rendering block, and the second recycling block and the second The decoding block and the rendering block are mutually exclusive, and the decoding block and the rendering block are not mutually exclusive.

As an example, the video module decodes the video data in the material information and the effect data corresponding to the video data, including: the video decoding thread judges whether the resource read function of the resource read-write lock is available, and when the judgment result is yes, Determine whether the second decoding block is available; if so, obtain the current play time, and obtain the corresponding video data and the effect data corresponding to the video data according to the current play time for decoding, and store the decoded data in the second cache queue. middle.

As another example, the video module plays the video data in the material information and the effect data corresponding to the video data, including: the video consumption thread judges whether the resource reading function of the resource read-write lock is available, and when the judgment result is yes , obtain the current play time, and query the second cache queue according to the current play time to obtain the corresponding decoded video data to play.

In a specific embodiment of the present invention, as shown in FIG. 4 , the decoding process of the video decoding thread includes the following steps:

S401, the resource read lock is acquired.

S402, the second decoding block is acquired.

S403, obtain the current play time.

S404: Acquire video data and video effects corresponding to the current playback time, and perform decoding.

S405, store the decoded video data in the second buffer queue.

S406: Store the video data and video effects of the non-current play time in the second recycling queue.

S407, the second decoding block is released.

S408, the resource read lock is released.

S409, determine whether the current video decoding task ends; if yes, execute step S410; if not, execute step S401.

S410, end.

In a specific embodiment of the present invention, as shown in FIG. 5 , the consumption process of the video consumption thread includes the following steps:

S501, the resource read lock is acquired.

S502, the rendering block is acquired.

S503, obtain the current play time.

S504: Acquire and play the decoded video data stored in the second buffer queue according to the current play time.

S505, the rendering block is released.

S506, the second reclaimed block is acquired.

S507: Release the video resources in the second recycling queue.

S508, the second reclaimed block is released.

S509, the resource read lock is released.

S510, determine whether the current video playing task ends; if yes, go to step S511; if not, go to step S501.

S511, end.

To sum up, according to the video file playback system of the embodiment of the present invention, the material management module is set to store the material information selected by the user, and the corresponding material information is searched according to the search request sent by the audio module or the video module. The user's change request changes the material information; the effect management module is used to store the effect information corresponding to the material selected by the user, and search for the corresponding effect information according to the search request sent by the audio module or the video module, and according to the user's change request. The effect information is changed; the material information and the effect information corresponding to the material information are provided with a resource read-write lock. In the resource read-write lock, the resource read functions are not mutually exclusive, and the resource read function and the resource write function are not mutually exclusive. mutually exclusive; the audio module is used to decode and consume the audio data in the material information and the effect data corresponding to the audio data to complete the audio playback; the video module is used to decode and consume the video data in the material information and the corresponding effect data of the video data. The effect data is decoded and rendered to complete the video playback; it enables the user to add and delete materials in real time while the player is playing the video file, and the process of adding and deleting does not need to completely stop the player thread to avoid performance loss. .

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

It should be noted that, in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not preclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names.

Although preferred embodiments of the present invention have been described, additional changes and modifications to these embodiments may occur to those skilled in the art once the basic inventive concepts are known. Therefore, the appended claims are intended to be construed to include the preferred embodiment and all changes and modifications that fall within the scope of the present invention.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit and scope of the invention. Thus, provided that these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

In the description of the present invention, it should be understood that the terms "first" and "second" are only used for description purposes, and cannot be interpreted as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature defined as "first" or "second" may expressly or implicitly include one or more of that feature. In the description of the present invention, "plurality" means two or more, unless otherwise expressly and specifically defined.

In the present invention, unless otherwise expressly specified and limited, the terms "installed", "connected", "connected", "fixed" and other terms should be understood in a broad sense, for example, it may be a fixed connection or a detachable connection , or integrated; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, and it can be the internal connection of the two elements or the interaction relationship between the two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.

In the present invention, unless otherwise expressly specified and limited, a first feature "on" or "under" a second feature may be in direct contact between the first and second features, or the first and second features indirectly through an intermediary touch. Also, the first feature being "above", "over" and "above" the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is level higher than the second feature. The first feature being "below", "below" and "below" the second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature has a lower level than the second feature.

In the description of this specification, description with reference to the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples", etc., mean specific features described in connection with the embodiment or example , structure, material or feature is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms should not be construed as necessarily referring to the same embodiment or example. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, those skilled in the art may combine and combine the different embodiments or examples described in this specification, as well as the features of the different embodiments or examples, without conflicting each other.

Although the embodiments of the present invention have been shown and described above, it should be understood that the above-mentioned embodiments are exemplary and should not be construed as limiting the present invention. Embodiments are subject to variations, modifications, substitutions and variations.

Claims

A video file playback system is characterized in that it includes an audio module, a video module, a material management module and an effect management module;

Wherein, the material management module is used to store the material information selected by the user, search for the corresponding material information according to the search request sent by the audio module or the video module, and change the material information according to the user's change request;

The effect management module is used to store the effect information corresponding to the material selected by the user, search for the corresponding effect information according to the search request sent by the audio module or the video module, and change the effect information according to the user's change request;

The material information and the effect information corresponding to the material information are provided with a resource read-write lock. In the resource read-write lock, the resource read functions are not mutually exclusive, and the resource read function and the resource write function are mutually exclusive. reprimand;

The audio module is used to decode and consume the audio data in the material information and the effect data corresponding to the audio data to complete the audio playback;

The video module is used for decoding and rendering the video data in the material information and the effect data corresponding to the video data, so as to complete the playing of the video.
The video file playback system according to claim 1, wherein the audio module comprises an audio decoding thread and an audio consumption thread, the audio module is correspondingly provided with an audio lock, wherein the audio lock comprises a first decoding block , a first recovery block and a search block, and the first decoding block, the first recovery block and the search block are mutually exclusive.
The video file playback system according to claim 2, wherein the audio module decodes the audio data in the material information and the effect data corresponding to the audio data, comprising:

The audio decoding thread judges whether the resource reading function of the resource read-write lock is available, and when the judgment result is yes, judges whether the first decoding block is available;

If yes, the current play time is acquired, and corresponding audio data and effect data corresponding to the audio data are acquired according to the current play time for decoding, and the decoded data is stored in the first buffer queue.
The video file playback system according to claim 2, wherein the audio module plays the audio data in the material information and the effect data corresponding to the audio data, comprising:

The audio consumption thread judges whether the resource read function of the resource read-write lock is available, and when the judgment result is yes, obtains the current play time, and queries the first cache queue according to the current play time to obtain the corresponding decoded audio data to play;

After the playback of the decoded data is completed, the current playback time is updated.
The video file playback system according to claim 1, wherein the video module comprises a video decoding thread and a video consumption thread, the video module is correspondingly provided with a video lock, wherein the video lock comprises a second decoding block , a second recycling block and a rendering block, the second recycling block and the second decoding block and the rendering block are mutually exclusive, and the decoding block and the rendering block are not mutually exclusive.
The video file playback system according to claim 5, wherein the video module decodes the video data in the material information and the effect data corresponding to the video data, comprising:

The video decoding thread judges whether the resource read function of the resource read-write lock is available, and when the judgment result is yes, judges whether the second decoding block is available;

If yes, obtain the current play time, obtain corresponding video data and effect data corresponding to the video data according to the current play time, decode the video data, and store the decoded data in the second buffer queue.
The video file playback system according to claim 6, wherein the video module plays the video data in the material information and the effect data corresponding to the video data, comprising:

The video consumption thread judges whether the resource read function of the resource read-write lock is available, and when the judgment result is yes, obtains the current play time, and queries the second cache queue according to the current play time to obtain the corresponding decoded video data for playback.
An audio decoding and consumption process, characterized in that it includes an audio decoding process and an audio consumption process;

The audio decoding process includes: acquiring the resource read-write lock, the first decoding block, and the current playing time, acquiring and decoding the audio data and effect data corresponding to the current playing time, storing the decoded data in the first buffer queue, and storing the decoded data in the first buffer queue. The audio data and effect data not corresponding to the current playback time are stored in the first recycling queue, and the first decoding block and the resource read-write lock are released;

The audio consumption process includes: acquiring the resource read-write lock and the current playback time, acquiring the corresponding decoded audio data stored in the first buffer queue according to the current playback time and playing and updating the current playback time, and releasing the audio data in the first recycling queue. Audio data, resource read-write lock.
A video decoding and consumption process, characterized in that a video decoding process and a video consumption process;

The video decoding process includes: acquiring a resource read-write lock, a second code block, and a current playback time, acquiring and decoding video data and video effects corresponding to the current playback time, and storing the decoded video data in a second cache queue, storing the video data and video effects of non-current playback time in the second recycling queue, releasing the second decoding block and resource read-write lock;

The video consumption process includes: acquiring resource read-write locks, rendering blocks, and current playback time, acquiring and playing the decoded video data stored in the second cache queue according to the current playback time, and releasing the rendering blocks and the data in the second recycling queue. Video resources, resource read-write locks.
A computer-readable storage medium storing a computer program, characterized in that, when the computer program is executed by a processor, the audio decoding and consumption process of claim 8 or the process of claim 9 is realized. Video decoding and consumption process.