CN117560544A

CN117560544A - Playing processing method, system, device, electronic equipment and storage medium

Info

Publication number: CN117560544A
Application number: CN202311508101.5A
Authority: CN
Inventors: 俞敏辉
Original assignee: Shuhang Technology Beijing Co ltd
Current assignee: Shuhang Technology Beijing Co ltd
Priority date: 2023-11-13
Filing date: 2023-11-13
Publication date: 2024-02-13

Abstract

The embodiment of the application discloses a play processing method, a system, a device, electronic equipment and a storage medium, wherein the method comprises the following steps: decoding the multimedia data to obtain decoded multimedia data; generating a resource acquisition request for an operating system of the terminal equipment according to the decoded multimedia data; in response to a resource acquisition request, determining a target system resource interface supported by an operating system from a system resource interface group, wherein the system resource interface group comprises at least two system resource interfaces supported by different operating systems; and calling multimedia data processing resources of the terminal equipment according to the target system resource interface, rendering the decoded multimedia data, and outputting multimedia content corresponding to the decoded multimedia data. The method and the device can play the multimedia data based on the platforms of different operating systems, fully utilize the multimedia data processing resources of the corresponding platforms, realize cross-platform multimedia playing processing and improve user experience.

Description

Playing processing method, system, device, electronic equipment and storage medium

Technical Field

The embodiment of the application relates to the field of computers, in particular to a playing processing method, a playing processing system, a playing processing device, electronic equipment and a storage medium, wherein the storage medium comprises a computer readable storage medium.

Background

The current multimedia player is mainly developed and designed for different operating system platforms, for example, the multimedia player for an Android platform or the multimedia player for an IOS platform, but the multimedia players are only applicable to the Android platform or the IOS platform, so that the multimedia player is only applicable to a single platform, and the current open source player frame is insufficient in cross-platform support of rendering related functions, so that the multimedia player cannot fully utilize processing resources of different platforms, the multimedia rendering effect is not ideal, and the user experience is poor.

Disclosure of Invention

The embodiment of the application provides a play processing method, a play processing system, a play processing device, electronic equipment and a storage medium, which can realize cross-platform multimedia play processing and improve user experience.

In a first aspect, an embodiment of the present application provides a play processing method, which is applied to a terminal device, where the method includes:

decoding the multimedia data to obtain decoded multimedia data;

generating a resource acquisition request for an operating system of the terminal equipment according to the decoded multimedia data;

Determining a target system resource interface supported by the operating system from a system resource interface group in response to the resource acquisition request, wherein the system resource interface group comprises at least two system resource interfaces supported by different operating systems;

and calling the multimedia data processing resource of the terminal equipment according to the target system resource interface, rendering the decoded multimedia data, and outputting the multimedia content corresponding to the decoded multimedia data.

In a second aspect, an embodiment of the present application further provides a play processing device, which is applied to a terminal device, where the device includes:

the decoding module is used for decoding the multimedia data to obtain decoded multimedia data;

the generation module is used for generating a resource acquisition request aiming at an operating system of the terminal equipment according to the decoded multimedia data;

a determining module, configured to determine, in response to the resource acquisition request, a target system resource interface supported by the operating system from a system resource interface group, where the system resource interface group includes at least two system resource interfaces supported by different operating systems;

and the output module is used for calling the multimedia data processing resource of the terminal equipment according to the target system resource interface, rendering the decoded multimedia data and outputting the multimedia content corresponding to the decoded multimedia data.

Optionally, in some embodiments of the present application, the determining module includes:

the analysis unit is used for analyzing the resource acquisition request to obtain a system identifier for identifying the operating system;

and the determining unit is used for setting the system resource interface matched with the system identifier in the system resource interface group as a target system resource interface.

Optionally, in some embodiments of the present application, the apparatus further includes a signal processing module, the signal processing module including:

the processing unit is used for calling the multimedia data processing resources of the terminal equipment according to the target system resource interface, and performing signal processing on the decoded multimedia data to obtain target multimedia data;

the output module includes:

and the rendering unit is used for performing signal rendering processing on the target multimedia data through the multimedia data processing resource and outputting multimedia content corresponding to the target multimedia data.

Optionally, in some embodiments of the present application, the processing unit includes:

an acquisition subunit, configured to acquire a play control request for the multimedia data, where the play control request includes play control information for indicating a play characteristic of the multimedia data;

A determining subunit, configured to determine, in response to the play control request, a target play control interface that matches the play control information from at least one play control interface of a play control interface group, where each play control interface corresponds to a modularized play control component;

a calling subunit, configured to call the target play control interface, and call a multimedia data processing resource of the terminal device by using the target system resource interface;

and the processing subunit is used for processing the signals of the decoded multimedia data through the multimedia data processing resource according to the play control component corresponding to the target play control interface to obtain target multimedia data.

Optionally, in some embodiments of the present application, the apparatus further includes an editing module, where the editing module includes:

the editing unit is used for responding to a component editing request aiming at the target playing control interface, editing the playing control component corresponding to the playing control interface and obtaining an updated playing control component;

the processing subunit is specifically configured to:

and performing signal processing on the decoded multimedia data according to the updated play control component corresponding to the target play control interface through the multimedia data processing resource to obtain target multimedia data.

Optionally, in some embodiments of the present application, the output module includes:

the identification unit is used for carrying out content identification on the decoded multimedia data to obtain media content information contained in the decoded multimedia data;

the first output unit is used for performing signal processing on the decoded multimedia data to obtain target multimedia data if the media content information meets preset conditions, performing rendering processing on the target multimedia data according to the multimedia data processing resources, and outputting multimedia content corresponding to the target multimedia data;

and the second output unit is used for rendering the decoded multimedia data according to the multimedia data processing resource and outputting the multimedia content corresponding to the decoded multimedia data if the media content information does not meet the preset condition.

Optionally, in some embodiments of the present application, the output module further includes a discriminating unit, where the discriminating unit includes:

the first judging subunit is configured to, if the media content information includes a target object or the content style of the media content information is an interaction type, enable the media content information to meet the preset condition;

And the second judging subunit is used for judging whether the media content information does not contain the target object or the content style type of the media content information is a non-interactive type or not according to the preset condition.

In a third aspect, an embodiment of the present application further provides a play processing system, where the system includes:

the player is used for decoding the multimedia data to obtain decoded multimedia data, generating a resource acquisition request aiming at an operating system of the terminal equipment according to the decoded multimedia data, and responding to the resource acquisition request, determining a target system resource interface supported by the operating system from a system resource interface group, wherein the system resource interface group comprises at least two system resource interfaces supported by different operating systems;

and the terminal equipment is used for rendering the decoded multimedia data according to the multimedia data processing resources determined by the target system resource interface from the terminal equipment and outputting multimedia content corresponding to the decoded multimedia data on the terminal equipment.

In a fourth aspect, an embodiment of the present application further provides an electronic device, where the electronic device includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the computer program when executed by the processor implements the steps in the playing processing method described above.

In a fifth aspect, embodiments of the present application further provide a computer readable storage medium, where a computer program is stored, where the computer program when executed by a processor implements the steps in the above-mentioned playback processing method.

In a sixth aspect, embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The computer instructions are read from the computer-readable storage medium by a processor of a computer device, and executed by the processor, cause the computer device to perform the methods provided in the various alternative implementations described in the embodiments of the present application.

As can be seen from the foregoing solutions, in the embodiments of the present application, in order to enable multimedia playing to adapt to platforms corresponding to different operating systems, system resource interfaces for different operating system platforms are pre-established, where each system resource interface may call multimedia data processing resources of terminal devices of the corresponding operating system platform.

The method comprises the steps of determining a target system resource interface supported by a current terminal equipment operating system, enabling a multimedia data processing resource of the terminal equipment to be called by the target system resource interface to play the multimedia data, and realizing playing of the multimedia data.

Correspondingly, based on the operating system of the terminal equipment according to which the multimedia data playing processing is performed, selecting a target system resource interface from the plurality of system resource interfaces, and performing the playing processing of the multimedia data by utilizing the selected target system resource interface, so that the multimedia data can be played based on platforms of different operating systems, the multimedia data processing resources of the corresponding platforms are fully utilized, the cross-platform multimedia playing processing is realized, and the user experience is improved.

Drawings

In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic view of a scenario of a play processing method provided in an embodiment of the present application;

fig. 2 is a flow chart of a play processing method provided in an embodiment of the present application;

fig. 3 is a diagram of a player architecture according to an embodiment of the present application;

FIG. 4 is another architecture diagram of a player provided in an embodiment of the present application;

Fig. 5 is a schematic diagram of creating a playback processing link according to an embodiment of the present application;

fig. 6 is another flow chart of the play processing method provided in the embodiment of the present application;

fig. 7 is a flowchart of live audio and video playing based on a playing processing method according to an embodiment of the present application;

fig. 8 is a schematic diagram of a playback processing system according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of a play processing device according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to fall within the scope of the invention.

The embodiment of the application provides a play processing method, a play processing system, a play processing device, electronic equipment and a storage medium. Specifically, the embodiment of the application provides a play processing device suitable for electronic equipment, wherein the electronic equipment comprises terminal equipment or a server. The terminal device may include a mobile phone, a tablet computer, a notebook computer, a desktop computer, a palm computer, a wearable device (such as an intelligent watch), an intelligent voice interaction device (such as an intelligent sound box), an intelligent home appliance, a vehicle-mounted terminal and other devices, where the server may be an independent physical server, may also be a server cluster or a distributed system formed by a plurality of physical servers, and may also be a cloud server for providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content distribution networks (CDN, content Delivery Network), big data and an artificial intelligent platform, and the servers may be directly or indirectly connected through wired or wireless communication modes.

In this embodiment of the present application, the playing processing method may be executed by the terminal device alone, or the playing processing method may be executed by the server alone, or the playing processing method may be executed by the terminal device and the server together, for example, please refer to fig. 1, fig. 1 is a schematic view of a scenario in which the playing processing method is executed by the terminal device provided in this embodiment of the present application, and the playing processing method may be executed by the server or by the terminal device and the server together, where a specific execution procedure of the playing processing method executed by the terminal device is as follows:

the terminal device 10 decodes the multimedia data to obtain decoded multimedia data, then generates a resource acquisition request for an operating system of the terminal device according to the decoded multimedia data, and responds to the resource acquisition request by the terminal device 10 to determine a target system resource interface supported by the operating system from a system resource interface group, wherein the system resource interface group comprises at least two system resource interfaces supported by different operating systems, and then invokes multimedia data processing resources of the terminal device according to the target system resource interface to render the decoded multimedia data and output multimedia content corresponding to the decoded multimedia data.

In this embodiment of the present application, the multimedia data may be obtained after the terminal device sends the multimedia data obtaining request to the server and the server responds to the multimedia data obtaining request, and the corresponding multimedia data may also be data stored locally in the terminal device.

In this embodiment of the present application, the playing processing method may be integrated into a player, where the player is installed on the terminal device, and by responding to a playing request, operations such as decoding the multimedia data, generating a resource acquisition request, selecting a target system resource interface, and calling a multimedia data processing resource to perform rendering processing on the decoded multimedia data are performed.

In summary, in order to enable multimedia playing to adapt to platforms corresponding to different operating systems, system resource interfaces for the different operating system platforms are pre-established, where each system resource interface may call multimedia data processing resources of terminal devices of the corresponding operating system platform.

In order to facilitate understanding of the embodiments of the present application, the following detailed description is provided. It should be noted that the following description order of embodiments is not a limitation of the priority order of embodiments.

Referring to fig. 2, fig. 2 is a flow chart of a play processing method according to an embodiment of the present application. The specific flow of the playing processing method is as follows:

101. and decoding the multimedia data to obtain decoded multimedia data.

It is understood that multimedia data is data that needs to be played, and may correspond to audio or video, where the multimedia data is encoded data corresponding to video displayed on a screen or encoded data of audio played through a speaker.

It will be appreciated that since multimedia data is typically compressed during transmission, storage and processing, file size or transmission bandwidth is reduced. The compressed multimedia data is called encoded data, which contains digital signals processed by a specific encoding algorithm. In order to visualize or audibly visualize these signals, the encoded data needs to be decoded into the original audio or video signal, i.e. decoded into decoded multimedia data.

The decoding of the multimedia data may be implemented by a decoder, for example, the decoder decodes the multimedia data to obtain decoded multimedia data, where the decoder performs an inverse operation on the encoded data according to a specific encoding algorithm and parameters, and restores the original form of the data. For example, an audio decoder may decode compressed audio encoded data, converting it to a continuous analog waveform, representing the change in sound over time. This allows the audio data to be amplified and processed to accommodate different output devices and ultimately converted to analog signals to drive the speaker to produce sound; the video decoder decodes the compressed video encoded data and converts it into a series of image frames representing the temporal changes in the image, which can be rendered onto a screen to present a continuous dynamic image, i.e., video.

In this embodiment of the present application, different decoders may be selected or created according to the characteristics of the multimedia data, for example, corresponding decoders may be selected for decoding based on the attribute of the image and the decoding mode. The decoding mode may include hard decoding and soft decoding, where hard decoding refers to a process of using a hardware accelerator to perform audio/video decoding. Modern terminal devices (e.g. computers, cell phones, televisions, etc.) are often equipped with specialized hardware decoders, such as GPUs (graphics processors) or specialized video decoding chips. The hardware decoder can quickly and effectively decode high-quality audio and video data, lighten the load of a CPU and provide smoother playing experience. Hard decoding has advantages in terms of decoding efficiency and performance, and is particularly suitable for high-resolution or high-bit-rate audio/video files. Soft decoding refers to a process of audio-video decoding using a software algorithm. Soft decoding is the decoding of encoded audio-video data into the original audio signal or video frame by the CPU executing a decoding algorithm. Soft decoding requires higher CPU requirements than hard decoding, requiring more computing resources. Soft decoding is typically applicable to lower resolution or lower bit rate audio video files, or decoding on devices without a hardware decoder.

In this embodiment of the present application, the decoded multimedia data obtained by decoding may be stored in a buffer, so that the decoded multimedia data is sequentially read from the buffer, thereby implementing orderly playing of the multimedia content.

102. And generating a resource acquisition request for an operating system of the terminal equipment according to the decoded multimedia data.

It will be appreciated that the resource acquisition request is a request for acquiring resources for processing the decoded multimedia data, and accordingly, the resource acquisition request is also a request for the operating system of the terminal device, i.e., a resource acquisition request matched with the operating system of the terminal device. For example, the resource acquisition request carries resolution, bit rate, decoding mode (such as algorithm and format of encoding and decoding) of the decoded multimedia data, and also carries identification information of an operating system. The aim is to acquire the multimedia data processing resources meeting the expectations through the resource acquisition request.

In this embodiment of the present application, the resource obtaining request may further include a play requirement parameter or a control parameter related to a user experience, for example, play smoothness or play definition.

It will be appreciated that by generating the resource acquisition request, the multimedia data processing resource of the terminal device may be acquired based on the resource acquisition request, so as to perform playback processing of the decoded multimedia data based on the processing resource.

103. And responding to the resource acquisition request, determining a target system resource interface supported by the operating system from a system resource interface group, wherein the system resource interface group comprises at least two system resource interfaces supported by different operating systems.

The operating system is one of core software of the terminal equipment and is used for managing and controlling hardware and software resources of the terminal equipment, and the operating system comprises Android, apples (IOS) and the like.

It can be understood that, in order to adapt to the playing processing requirements of different operating system platforms, the embodiments of the present application preconfigure the system resource interfaces for different operating systems to obtain a system resource interface group, and after receiving a resource acquisition request, determine a target system resource interface from the system resource interfaces corresponding to different operating systems based on the resource acquisition request.

The system resource interfaces are configured with acquisition examples, such as code components, of terminal equipment processing resources for different operating systems, and corresponding processing resources of the terminal equipment are called through target system resource interfaces matched with the operating systems of the terminal equipment. For example, the system resource interface may include an open graphics library (OpenGL), a graphics rendering and hardware acceleration library (Metal), a drawing application program (OpenGL), and other interfaces, where the open graphics library (OpenGL) and the graphics rendering and hardware acceleration library (Metal) may be selected to call a terminal device processing resource of the IOS operating system platform, and the open graphics library (OpenGL) and the drawing application program (OpenGL) may be selected to call a terminal device processing resource of the Android operating system platform.

It can be understood that by configuring system resource interfaces for different operating system platforms, a target system resource interface supported by the terminal device can be selected from a plurality of system resource interfaces according to the terminal device where the multimedia data playing process is located and an operating system applied by the terminal device, so that the playing process of the multimedia data can adapt to different operating system platforms, and the cross-platform capability of the multimedia data playing process is provided.

104. And calling the multimedia data processing resource of the terminal equipment according to the target system resource interface, rendering the decoded multimedia data, and outputting the multimedia content corresponding to the decoded multimedia data.

The multimedia data processing resources comprise software resources and hardware resources of the terminal equipment, wherein the software resources comprise application programs, pages and the like, and the hardware resources mainly comprise processor (such as a graphic processor) resources, memory and the like.

It can be understood that by calling the multimedia data processing resource of the terminal device, the decoded multimedia data can be rendered by the multimedia data processing resource, so as to realize the playing of the multimedia content corresponding to the multimedia data.

In the embodiment of the application, the rendering process may be implemented by a renderer, through which an audio or video signal is rendered to a screen or a speaker of the terminal.

In this embodiment of the present application, the playing processing method may be integrated into a player, where the player is installed on the terminal device, and by responding to a playing request, operations such as decoding the multimedia data, generating a resource acquisition request, selecting a target system resource interface, and calling a multimedia data processing resource to perform rendering processing on the decoded multimedia data are performed. For example, referring to fig. 3, fig. 3 is a schematic diagram of a player according to an embodiment of the present application, where the player is obtained by integrating processing logic of a playing processing method, and the player is installed on a terminal device, and specifically includes:

a decoding layer 111, configured to receive multimedia data, decode the multimedia data by using a decoder to obtain decoded multimedia data, and store the decoded multimedia data in a buffer 112;

a screening layer 113, configured to read the decoded multimedia data processed by the decoding layer 111 from the cache 112, generate a resource acquisition request for an operating system of the terminal device according to the decoded multimedia data, determine a target system resource interface from a plurality of system resource interfaces of a system resource interface group configured by the screening layer 113 based on the resource acquisition request, and send interface information of the target system resource interface to a rendering layer 114;

Each system resource interface corresponds to an operating system;

the rendering layer 114 is configured to call a target system resource interface corresponding to the interface information according to the interface information sent by the filtering layer 113, call a multimedia data processing resource of the terminal device through the target system resource interface, perform rendering processing on the decoded multimedia data, and output multimedia content corresponding to the decoded multimedia data.

Correspondingly, in the embodiment of the present application, after receiving the play request, the player starts a play processing link, where the play processing link at least includes four nodes, namely, a decoding layer 111, a cache 112, a screening layer 113, and a rendering layer 114, so as to implement play processing on multimedia data. The playback processing link may be created in advance, for example, by configuring interface components for each node, and configuring a reference relationship between each interface component, so as to obtain the playback processing link. When the playing processing link is started, calling among the interface components and transferring the intermediate data are carried out according to the reference relation among the interface components, so that the processing of the multimedia data is realized.

The method comprises the steps of configuring a screening layer in a player, and through system resource interfaces configured in the screening layer and aiming at different operating systems, enabling the player to realize rendering processing of decoded multimedia data by calling a multimedia data processing resource of the terminal equipment through a target system resource interface matched with the operating system of the terminal equipment after the player is installed on the terminal equipment of the different operating systems, so that the player has cross-platform playing processing capability.

Wherein, by simplifying the player into a decoding layer, a screening layer and a rendering layer, the complexity of the player architecture is also reduced.

Optionally, in the embodiment of the present application, a system identifier for identifying an operating system may be configured in the resource acquisition request, the system identifier is obtained by analyzing the resource acquisition request, and a target system resource interface matched with an operating system corresponding to the system identifier is determined based on the system identifier, that is, optionally, in some embodiments of the present application, the step of "determining a target system resource interface supported by the operating system from a system resource interface group" includes:

analyzing the resource acquisition request to obtain a system identifier for identifying the operating system;

and setting the system resource interface matched with the system identifier in the system resource interface group as a target system resource interface.

It will be appreciated that the system identifier may be a text symbol, or a string, for example, with "Android" as the system identifier of the Android operating system and "IOS" as the system identifier of the apple operating system. I.e. each operating system corresponds to a different system identification, respectively.

Wherein the system identification is encoded into the resource acquisition request when the resource acquisition request is generated, wherein the system identification may be obtained by an acquisition request to an operating system of the terminal device, for example, a type acquisition request for the operating system of the terminal device is generated, and the type of operating system applied by the terminal device is acquired based on the type acquisition request.

In this embodiment of the present application, a mapping relationship between a system identifier and a system resource interface may be preconfigured, for example, a mapping relationship between an "Android" system identifier and an open graphics library (OpenGL) and a mapping relationship between a drawing application program (OpenGL) interface are established, and a mapping relationship between an "IOS" system identifier and an open graphics library (OpenGL) and a graphics rendering and hardware acceleration library (Metal) interface are established.

By establishing the mapping relation between the system identifier and the system resource interface, the operation system based on the current playing processing can be rapidly and accurately positioned based on the mapping relation, namely, the matched target system resource interface is determined.

In order to improve the richness of the play content and improve the play effect of the multimedia, the post-processing such as effect enhancement may be performed on the decoded multimedia data before the rendering processing of the decoded multimedia data, so as to improve the richness of the rendered multimedia content and improve the play effect, that is, optionally, in some embodiments of the present application, the step of "calling the multimedia data processing resource of the terminal device according to the target system resource interface, performing the rendering processing on the decoded multimedia data, and before outputting the multimedia content corresponding to the decoded multimedia data" further includes:

Calling multimedia data processing resources of the terminal equipment according to the target system resource interface, and performing signal processing on the decoded multimedia data to obtain target multimedia data;

the calling the multimedia data processing resource of the terminal equipment according to the target system resource interface, rendering the decoded multimedia data, and outputting the multimedia content corresponding to the decoded multimedia data, including:

and performing signal rendering processing on the target multimedia data through the multimedia data processing resource, and outputting multimedia content corresponding to the target multimedia data.

The signal processing process refers to a process of adjusting an audio signal or a video signal corresponding to the decoded multimedia data to achieve a specific effect, for example, the signal processing process may include a signal correction process and an effect enhancement process for the decoded multimedia data, the signal correction process includes at least one of a sound quality balancing process, an audio enhancement process, a background noise reduction process, a color correction process, a transparency enhancement process, or a reverberation process for the decoded multimedia data, and the effect enhancement process includes at least one of a special effect addition process, a filter process, a bullet screen addition process, or a color blindness mode addition process for the decoded multimedia data. In this embodiment of the present application, the signal processing process of the decoded multimedia data is not limited to the above-mentioned signal correction process and effect enhancement process, and specific processing types of the signal correction process and effect enhancement process are not limited to the above-mentioned several types, and functional processing may be added according to actual playing requirements, such as a custom new signal processing operation.

The quality of the played multimedia content is improved through signal correction processing of the decoded multimedia data, for example, after the signal correction processing, the audio has the characteristics of balanced tone quality, stereoscopic impression, more reality and the like. Through the effect enhancement processing of the decoded multimedia data, the richness of the played multimedia content is improved, for example, special effects and barrages are added in videos, and a user can switch a viewing mode (such as a color blindness mode).

The method is characterized in that the decoded multimedia data is subjected to signal processing before rendering, so that the richness of the multimedia content is improved, the played multimedia content can meet the requirements of users, and the user experience is improved.

For example, referring to fig. 4, fig. 4 is another architecture diagram of a player provided in an embodiment of the present application, where the player is integrated by processing logic of a playing processing method, and the player is installed on a terminal device, and specifically includes:

the decoding layer 121 is configured to receive multimedia data, decode the multimedia data through the decoding module to obtain decoded multimedia data, and store the decoded multimedia data in the buffer 122;

A screening layer 123, configured to read the decoded multimedia data processed by the decoding layer 121 from the buffer 122, generate a resource acquisition request for an operating system of the terminal device according to the decoded multimedia data, determine a target system resource interface from a plurality of system resource interfaces of a system resource interface group configured by the screening layer 123 based on the resource acquisition request, and send interface information of the target system resource interface to a processing layer 124;

each system resource interface corresponds to an operating system;

the processing layer 124 is configured to call a target system resource interface corresponding to the interface information according to the interface information sent by the filtering layer 123, call a multimedia data processing resource of the terminal device through the target system resource interface, perform signal processing on the decoded multimedia data, obtain target multimedia data, and send the target multimedia data to the rendering layer 126;

the target multimedia data processed by the processing layer 124 is typically video frame data or audio frame data, or video frame data and audio frame data. The multimedia data processed by the process layer 124 may be stored through the storage queue (Texture Buffer Quere) 125.

The rendering layer 126 is configured to perform rendering processing on the target multimedia data in the storage queue 125 through the multimedia data processing resource, and output multimedia content corresponding to the target multimedia data.

Correspondingly, in the embodiment of the present application, after receiving the play request, the player starts a play processing link, where the play processing link includes at least six nodes, namely, a decoding layer 121, a buffer 122, a screening layer 123, a processing layer 124, a storage queue 125, and a rendering layer 126, so as to implement play processing on the multimedia data. The playback processing link may be created in advance, for example, by configuring interface components for each node, and configuring a reference relationship between each interface component, so as to obtain the playback processing link. When the playing processing link is started, calling among the interface components and transferring the intermediate data are carried out according to the reference relation among the interface components, so that the processing of the multimedia data is realized.

Each node may be configured as a sub-link of a play processing link, for example, for a node corresponding to the processing layer 124, may be configured as a post-processing sub-link in the play processing link, where the post-processing sub-link is a sub-link in the play processing link, and in the post-processing sub-link, a play control interface (corresponding to a play control component) for each post-processing operation may be configured, for example, as shown in fig. 5, fig. 5 is a schematic diagram of creating the play processing link provided in the embodiment of the present application, where the post-processing sub-link a is created based on the screening layer 123, and the post-processing sub-link a includes play control interfaces, for example, a play control interface a, a play control interface b, and a play control interface c, where each play control interface and a corresponding play control component are independently developed in a modularized manner, and by creating a reference to each play control interface.

Accordingly, the rendering layer 114 may be configured as a rendering sub-link, where the rendering sub-link is a sub-link of the playback processing link, and is obtained by creating an interface component corresponding to the rendering layer 114. For example, referring to fig. 5, a rendering sub-link B is created based on the filtering layer 123, where the rendering sub-link B is connected after the filtering sub-link corresponding to the filtering layer 123, and the rendering sub-link B at least includes a rendering interface d for rendering multimedia data.

In summary, the creation of the playback processing link is achieved by configuring each interface component of the node, and establishing a reference relationship between each interface component.

Accordingly, in the related art, since the playing logic of the multimedia player is complex, the support for all the playing characteristics of the multimedia player can be coupled in each process within the overall framework of the multimedia player, and as the multimedia player supports more playing characteristics of the multimedia player, the overall playing logic of the multimedia player becomes more and more complex, and the later maintenance becomes more and more difficult. Secondly, if logic modification occurs in a multimedia playing characteristic, all processes supporting the logic need to be correspondingly modified, and the workload is large. By respectively configuring modularized and independent play control interfaces and play control components for each post-processing operation, the embodiment of the application ensures that each post-processing can be added into the processing of multimedia data through the calling of the corresponding interfaces, and the modification of each post-processing capacity or processing logic only needs to adjust the play control component corresponding to the post-processing, so that the other play control components are not influenced, the execution of each play control component is not influenced by the other play control components, and the addition and management of the post-processing capacity are facilitated.

The processing of the decoded multimedia data before rendering is helpful to make the played multimedia content meet the requirements of users.

In this embodiment of the present application, for each processing type, a play control component may be configured separately, and each play control component is developed in a modularized and independent manner, so that the association between play control components of each processing type is reduced, so as to modify the play control component corresponding to each processing type. That is, optionally, in some embodiments of the present application, the step of "calling, according to the target system resource interface, a multimedia data processing resource of the terminal device, performing signal processing on the decoded multimedia data to obtain target multimedia data" includes:

acquiring a play control request for the multimedia data, wherein the play control request comprises play control information for indicating play characteristics of the multimedia data;

determining a target play control interface matched with the play control information from at least one play control interface of a play control interface group in response to the play control request, wherein each play control interface corresponds to a modularized play control assembly;

Calling the target play control interface, and calling the multimedia data processing resource of the terminal equipment by utilizing the target system resource interface;

and performing signal processing on the decoded multimedia data according to the play control component corresponding to the target play control interface through the multimedia data processing resource to obtain target multimedia data.

The play control component is a programming code developed according to the processing logic, and the signal processing of the decoded multimedia data is realized through the execution of the code.

The play control information includes a play characteristic, that is, indicates a play requirement to be satisfied, and the play characteristic refers to a play type, that is, a processing type of decoded multimedia data, that is, play in a manner of opening a bullet screen or play in a manner of displaying a special effect.

The play control interface corresponds to a processing type, that is, each processing type corresponds to one play control interface, after the play control component corresponding to the play control interface executes the processing of the signal processing of the decoded multimedia data by using processing logic corresponding to the processing type, for example, if the play control information is to display a barrage for playing, the play control interface opened by the barrage is called, and the processing of the signal processing of the decoded multimedia data is performed by the play control component corresponding to the play control interface.

In this embodiment of the present application, the play control request may be generated based on an input of an end user, for example, the end user requests to display a barrage or close the barrage by clicking a control, and correspondingly generates a play control request for displaying the barrage or a play control request for closing the barrage.

Accordingly, the play control request may also be generated based on a default configuration of the play process, for example, if the enhanced definition is used as the default configuration of the play process, after the decoded multimedia data is decoded, the play control request for enhancing the definition is automatically generated, so that the play control interface for enhancing the definition is invoked to perform the definition enhancing process on the decoded multimedia data.

It can be understood that the play control interface group is configured with play control interfaces for a plurality of processing types, that is, play control components for each play control interface are configured in advance, when signal processing is required to be performed on decoded multimedia data, a corresponding play control request can be generated, a corresponding target play control interface is called based on the play control request, and signal processing is performed on the decoded multimedia data through the play control component corresponding to the target play control interface. The control of the signal processing of the decoded multimedia data is realized by calling the playing control interface, so that the signal processing of the decoded multimedia data is correspondingly and differently processed based on different playing requirements.

Because the play control components corresponding to the play control interfaces are modularly and independently developed, the situation of cross influence among the processing logics of each processing type does not exist, and therefore, when certain processing logic needs to be adjusted, the play control components corresponding to the processing logics can be adjusted and optimized, the influence of the play control components of other processing logics on the modification of the processing logic to be optimized is reduced, the influence of the modification of the processing logic to be optimized on the other processing logics is reduced, and the maintainability of the processing logic is improved. Modular, independent development is understood to mean that each play control component corresponds to a respective method structure, such as a method function. There is no reference or call relationship between the various method constructs.

In this embodiment of the present application, each play control component may perform editing adjustment based on a component editing request to optimize processing logic of each signal processing process, that is, processing logic of each processing type, that is, optionally, in some embodiments of the present application, step "signal processing is performed on the decoded multimedia data by the multimedia data processing resource according to the play control component corresponding to the target play control interface, and before obtaining the target multimedia data", the method further includes:

Responding to a component editing request aiming at the target playing control interface, editing a playing control component corresponding to the playing control interface to obtain an updated playing control component;

the processing the decoded multimedia data by the multimedia data processing resource according to the play control component corresponding to the target play control interface to obtain target multimedia data, including:

The component editing request indicates that editing of the playing control component of the target playing control interface is needed, and content of the playing control component after updating is needed, such as new codes, is carried. The component edit request is generated by entering a new code in the play control component. Correspondingly, after compiling, the updated play control component executes new processing operations according to the new processing logic.

The real-time modification of the relevant parameters of the signal processing can be realized by responding to the component editing request, and the effect of the multimedia content can be dynamically changed according to the requirement of a user.

Optionally, in this embodiment of the present application, after the playing processing of the decoded multimedia data is finished, corresponding multimedia data processing resources may be released, so that other applications or threads may be used, to implement effective management of resources, that is, optionally, in some embodiments of the present application, the step of "calling, according to the target system resource interface, the multimedia data processing resources of the terminal device, performing rendering processing on the decoded multimedia data, and outputting multimedia content corresponding to the decoded multimedia data" includes:

calling multimedia data processing resources of the terminal equipment according to the target system resource interface, reading the decoded multimedia data from a cache, rendering the decoded multimedia data, and outputting multimedia content corresponding to the decoded multimedia data;

and if the cache does not contain the decoded multimedia data, releasing the multimedia data processing resources.

The decoded multimedia data obtained by decoding is stored in the buffer memory, so that when the decoded multimedia data does not exist in the buffer memory, the current multimedia playing processing is considered to be finished, and therefore, the terminal equipment resources can be released.

Optionally, in this embodiment of the present application, whether the decoded multimedia data may be directly rendered without signal processing, may be determined by a content identification result of the decoded multimedia data, for example, for some decoded multimedia data of a content body that is of a non-interactive type with respect to some media content or lacks post-processing, the decoded multimedia data may be directly rendered without signal processing operation, so in this embodiment of the present application, when the rendering process is performed, it may also be implemented by a decision mechanism to make a decision on whether the decoded multimedia data needs signal processing operation, that is, optionally, in some embodiments of the present application, the step of "invoking a multimedia data processing resource of the terminal device according to the target system resource interface, rendering the decoded multimedia data, and outputting a multimedia content corresponding to the decoded multimedia data" includes:

performing content identification on the decoded multimedia data to obtain media content information contained in the decoded multimedia data;

if the media content information meets the preset condition, performing signal processing on the decoded multimedia data to obtain target multimedia data, performing rendering processing on the target multimedia data according to the multimedia data processing resource, and outputting multimedia content corresponding to the target multimedia data;

And if the media content information does not meet the preset condition, rendering the decoded multimedia data according to the multimedia data processing resource, and outputting the multimedia content corresponding to the decoded multimedia data.

It will be appreciated that the decoded multimedia data may be content identified by audio identification, image identification, or neural network models (e.g., content identification models) in machine learning to obtain media content information contained in the decoded multimedia data.

Accordingly, the preset condition is a condition that needs to perform signal processing operation, and when the condition is met, it indicates that the decoded multimedia data needs to be subjected to signal processing operation before being subjected to rendering processing, otherwise, the preset condition is not met, and the rendering processing can be directly performed without performing signal processing operation.

It may be appreciated that, since the signal processing includes processing a target object in the multimedia content, for example, adding a special effect to the target object, and replacing an avatar style or a face style of the target object, in this embodiment of the present application, whether the target object is included in the media content information may be used as a criterion for determining whether the media content information satisfies a preset condition, that is, optionally, in some embodiments of the present application, after the step of "performing content recognition on the decoded multimedia data to obtain the media content information included in the decoded multimedia data", the method further includes:

If the media content information contains a target object or the content style of the media content information is an interaction type, the media content information meets the preset condition;

if the media content information does not contain the target object or the content style type of the media content information is a non-interactive type, the media content information does not meet the preset condition.

It is to be understood that the target object includes, but is not limited to, a person, an animal, a building, etc., and may be predefined based on the play requirement.

It will be appreciated that the interactive class, also referred to as interactive class, generally refers to a form of combining video content with user interaction, such video providing a choice at a particular point in time, and the viewer may click on different options based on his own interests or decisions, thereby affecting the development or content of the video that follows. This form of video is often used in the field of educational, entertainment, or virtual experience. In interactive video, the audience can participate in the interactive video, and the interactivity of the viewing experience is enhanced. For example, a user can interact with a broadcasting host, and accordingly, more video content and communication modes are added to multimedia data through signal processing, so that user experience can be improved, for example, a barrage, special effects and the like are provided.

Therefore, the embodiment of the application can realize the decision on the processing flow of the decoded multimedia data according to whether the media content information meets the preset condition or not through the identification of the media content information, and select whether to execute the signal processing operation or directly execute the rendering operation or not.

Since the decoded multimedia data generally includes video frame data or audio frame data, decision conditions can be set based on the user-defined requirements, and the subsequent processing flow of the data can be controlled according to the recognition result by recognizing the video frame data and the audio frame data. Accordingly, the custom requirements may also include whether the video frame data or the audio frame data is a key frame, is identical to an adjacent video frame, and the like.

Accordingly, in the embodiment of the present application, since control of signal processing of decoded multimedia data is achieved by calling a play control interface, updating of a play processing link may be achieved by changing a play control interface called by a play processing through a play control request.

For the convenience of understanding the embodiments of the present application, the following will describe the playing processing method as a whole, for example, refer to fig. 6, and fig. 6 is another schematic flow chart of the playing processing method provided in the embodiments of the present application, where the playing processing method specifically includes:

201. Receiving multimedia data to be processed;

202. decoding the multimedia data to obtain decoded multimedia data;

203. generating a resource acquisition request for an operating system of the terminal equipment according to the decoded multimedia data;

204. determining a target system resource interface supported by an operating system from a system resource interface group in response to the resource acquisition request, wherein the system resource interface group comprises at least two system resource interfaces supported by different operating systems;

205. acquiring a play control request for the multimedia data, wherein the play control request comprises play control information for indicating play characteristics of the multimedia data;

206. determining a target play control interface matched with the play control information from at least one play control interface of the play control interface group in response to the play control request;

wherein, each play control interface corresponds a modular play control assembly respectively.

207. Calling a target play control interface, and calling multimedia data processing resources of the terminal equipment by using a target system resource interface;

208. performing signal processing on the decoded multimedia data according to a play control component corresponding to the target play control interface by utilizing the multimedia data processing resource to obtain target multimedia data;

209. And performing signal rendering processing on the target multimedia data through the multimedia data processing resource, and outputting multimedia content corresponding to the target multimedia data.

The method comprises the steps of selecting a target system resource interface from a plurality of system resource interfaces based on an operating system of terminal equipment according to which multimedia data playing processing is performed, and utilizing the selected target system resource interface to perform the playing processing of the multimedia data, so that the multimedia data can be played based on platforms of different operating systems, multimedia data processing resources of corresponding platforms are fully utilized, cross-platform multimedia playing processing is realized, and user experience is improved.

The control of the data post-processing is realized by configuring the play control interface and controlling the target play control interface to be called through the play control request, so that the played multimedia content can meet the expectations of users.

The playing control components corresponding to the playing control interfaces are modularized and independently developed, so that the cross influence among the playing control components is reduced, modification and editing of the playing control components are facilitated, and the flexibility and convenience of signal processing and processing configuration are improved.

In order to facilitate understanding of the playing processing method of the present application, hereinafter, taking playing of live audio and video through a terminal device as an example, an application of the playing processing method of the present application in a live scene is described, specifically, referring to fig. 7, fig. 7 is a live audio and video playing flowchart based on the playing processing method provided in an embodiment of the present application, including:

211. transmitting a live broadcast watching request to a live broadcast server;

212. receiving live broadcast data returned by a live broadcast server in response to a live broadcast watching request;

the live broadcast data are data which are obtained by a live broadcast terminal user through shooting and then transmitted to a live broadcast platform.

213. Decoding the live broadcast data to obtain decoded live broadcast data;

214. generating a resource acquisition request aiming at a terminal equipment operating system according to the decoded live broadcast data;

215. determining a target system resource interface matched with an operating system of the terminal equipment from a plurality of system resource interfaces in a system resource interface group in response to the resource acquisition request;

216. and calling multimedia data processing resources of the terminal equipment according to the target system resource interface, rendering the decoded live broadcast data, and outputting live broadcast content corresponding to the decoded live broadcast data.

The target system resource interface matched with the current terminal equipment operating system is screened, so that the full utilization of the multimedia data processing resource of the terminal equipment by using the target system resource interface is realized, and the rendering effect of live broadcast data is improved.

The playing processing method can be applied to terminal equipment of different operating systems by configuring system resource interfaces aiming at different operating systems, and can realize playing processing of live audio and video data.

Accordingly, in the embodiment of the present application, in the live broadcast watching process, the user may also configure a live broadcast audio/video data playing mode, for example, a live broadcast playing mode, a live broadcast watching mode, and the like, in which a bullet screen is opened, and a special effect is displayed, based on his own watching requirement. That is, before rendering the decoded live broadcast data, the decoded live broadcast data is post-processed, referring to fig. 6, the live broadcast audio/video playing process further includes:

217. responding to the triggering operation of a play control for a live interface of the terminal equipment, and generating a play control request;

218. acquiring the play control request, wherein the play control request comprises play control information for indicating the play characteristics of the decoded live broadcast data;

219. Determining a target play control interface matched with the play control information from a plurality of play control interfaces of the play control interface group according to the play control request;

220. calling the target play control interface, calling a multimedia data processing resource of the terminal equipment by utilizing a target system resource interface, and processing signals of decoded live broadcast data according to the multimedia data processing resource and a play control component corresponding to the target play control interface to obtain target live broadcast data;

221. and rendering the target live broadcast data by utilizing a multimedia data processing resource, and outputting live broadcast contents corresponding to the target live broadcast data on the terminal equipment.

The processing treatment of the live broadcast data before rendering is adopted to realize the post-processing operation of the live broadcast data so as to meet different experiences of watching the host broadcast by users. The watching users can realize post-processing control of the live broadcast data through the operation of different controls in the live broadcast interface, and each user can adjust the playing mode of the live broadcast video data according to the own requirement, namely, the watching mode of the live broadcast picture is switched. For example, the control of opening or closing the barrage is realized by clicking the barrage control, the control of opening or closing the special effect is realized by clicking the special effect control, and the user experience is improved.

In order to facilitate better implementation of the playing processing method, the application also provides a playing processing system based on the playing processing method. The meaning of the nouns is the same as that in the playing processing method, and specific implementation details can be referred to the description in the method embodiment.

Referring to fig. 8, fig. 8 is a schematic diagram of a playback processing system according to an embodiment of the present application, where the playback processing system may specifically be as follows:

a player 231, configured to decode multimedia data to obtain decoded multimedia data, generate a resource acquisition request for an operating system of a terminal device 232 according to the decoded multimedia data, and determine a target system resource interface supported by the operating system from a system resource interface group in response to the resource acquisition request, where the system resource interface group includes at least two system resource interfaces supported by different operating systems;

and the terminal equipment 232 is used for rendering the decoded multimedia data according to the multimedia data processing resources determined by the target system resource interface from the terminal equipment 232 and outputting multimedia content corresponding to the decoded multimedia data on the terminal equipment 232.

The player is installed on the terminal equipment, a play processing system corresponding to a play processing method is formed based on the player and the terminal equipment, and the play processing of the multimedia data is realized through the processing of the player and the terminal equipment on the multimedia data.

In order to facilitate better implementation of the playing processing method, the application also provides a playing processing device based on the playing processing method. The meaning of the nouns is the same as that in the playing processing method, and specific implementation details can be referred to the description in the method embodiment.

Referring to fig. 9, fig. 9 is a schematic structural diagram of a playback processing apparatus according to an embodiment of the present application, where the playback processing apparatus is applied to a terminal device, and the playback processing apparatus may specifically be as follows:

a decoding module 301, configured to decode the multimedia data to obtain decoded multimedia data;

a generating module 302, configured to generate a resource acquisition request for an operating system of the terminal device according to the decoded multimedia data;

a determining module 303, configured to determine, in response to the resource acquisition request, a target system resource interface supported by the operating system from a system resource interface group, where the system resource interface group includes at least two system resource interfaces supported by different operating systems;

And the output module 304 is configured to invoke a multimedia data processing resource of the terminal device according to the target system resource interface, perform rendering processing on the decoded multimedia data, and output multimedia content corresponding to the decoded multimedia data.

Optionally, in some embodiments of the present application, the determining module 303 includes:

the output module 304 includes:

The processing subunit is specifically configured to:

Optionally, in some embodiments of the present application, the output module 304 includes:

In this embodiment, the decoding module 301 decodes the multimedia data to obtain decoded multimedia data, then, the generating module 302 generates a resource acquisition request for an operating system of the terminal device according to the decoded multimedia data, then, the determining module 303 determines a target system resource interface supported by the operating system from a system resource interface group in response to the resource acquisition request, where the system resource interface group includes at least two system resource interfaces supported by different operating systems, and then, the output module 304 invokes a multimedia data processing resource of the terminal device according to the target system resource interface, performs rendering processing on the decoded multimedia data, and outputs a multimedia content corresponding to the decoded multimedia data.

In addition, the present application further provides an electronic device, as shown in fig. 10, which shows a schematic structural diagram of the electronic device according to the present application, specifically:

The electronic device may include one or more processing cores 'processors 401, one or more computer-readable storage media's memory 402, power supply 403, and input unit 404, among other components. It will be appreciated by those skilled in the art that the electronic device structure shown in fig. 10 is not limiting of the electronic device and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components. Wherein:

the processor 401 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 402, and calling data stored in the memory 402, thereby performing overall monitoring of the electronic device. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application program, etc., and the modem processor mainly processes wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 401.

The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by executing the software programs and modules stored in the memory 402. The memory 402 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the electronic device, etc. In addition, memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.

The electronic device further comprises a power supply 403 for supplying power to the various components, preferably the power supply 403 may be logically connected to the processor 401 by a power management system, so that functions of managing charging, discharging, and power consumption are performed by the power management system. The power supply 403 may also include one or more of any of a direct current or alternating current power supply, a recharging system, a power device commissioning circuit, a power converter or inverter, a power status indicator, etc.

The electronic device may further comprise an input unit 404, which input unit 404 may be used for receiving input digital or character information and generating keyboard, mouse, joystick, optical or trackball signal inputs in connection with user settings and function control.

Although not shown, the electronic device may further include a display unit or the like, which is not described herein. In this embodiment, the processor 401 in the electronic device loads executable files corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 401 executes the application programs stored in the memory 402, so as to implement the steps in any of the playing processing methods provided in the embodiments of the present application.

According to the method, the device and the system, multimedia data are decoded to obtain decoded multimedia data, a resource acquisition request aiming at an operating system of the terminal device is generated according to the decoded multimedia data, a target system resource interface supported by the operating system is determined from a system resource interface group in response to the resource acquisition request, the system resource interface group comprises at least two system resource interfaces supported by different operating systems, multimedia data processing resources of the terminal device are called according to the target system resource interface, rendering processing is conducted on the decoded multimedia data, and multimedia content corresponding to the decoded multimedia data is output.

In order to enable multimedia playing to adapt to platforms corresponding to different operating systems, system resource interfaces for the different operating system platforms are pre-established, wherein each system resource interface can call multimedia data processing resources of terminal equipment of the corresponding operating system platform. The method comprises the steps of determining a target system resource interface supported by a current terminal equipment operating system, enabling a multimedia data processing resource of the terminal equipment to be called by the target system resource interface to play the multimedia data, and realizing playing of the multimedia data. Correspondingly, based on the operating system of the terminal equipment according to which the multimedia data playing processing is performed, selecting a target system resource interface from the plurality of system resource interfaces, and performing the playing processing of the multimedia data by utilizing the selected target system resource interface, so that the multimedia data can be played based on platforms of different operating systems, the multimedia data processing resources of the corresponding platforms are fully utilized, the cross-platform multimedia playing processing is realized, and the user experience is improved.

The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.

Those of ordinary skill in the art will appreciate that all or a portion of the steps of the various methods of the above embodiments may be performed by instructions or by controlling associated hardware, which may be stored in a storage medium and loaded and executed by a processor.

To this end, the present application provides a storage medium comprising a computer readable storage medium having stored thereon a computer program that is loadable by a processor to perform the steps of any of the playback processing methods provided herein.

Wherein the computer-readable storage medium may comprise: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.

Because the instructions stored in the computer readable storage medium can execute the steps in any of the playing processing methods provided in the present application, the beneficial effects that can be achieved by any of the playing processing methods provided in the present application can be achieved, and detailed descriptions of the foregoing embodiments are omitted herein.

The foregoing has described in detail a method, a system, an apparatus, an electronic device and a storage medium for processing play, where specific examples are applied to illustrate the principles and embodiments of the present invention, and the description of the foregoing examples is only for helping to understand the method and core idea of the present invention; meanwhile, as those skilled in the art will vary in the specific embodiments and application scope according to the ideas of the present invention, the present description should not be construed as limiting the present invention in summary.

It should be noted that, in the specific embodiments of the present application, related data such as multimedia data, resource acquisition requests, play control requests, component editing requests, etc. are related, when the embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and collection, use and processing of related data need to comply with related laws and regulations and standards of related countries and regions.

Claims

1. A play processing method, which is applied to a terminal device, the method comprising:

decoding the multimedia data to obtain decoded multimedia data;

2. The playback processing method as claimed in claim 1, wherein the determining the target system resource interface supported by the operating system from the system resource interface group includes:

3. The playback processing method of claim 1, wherein the calling the multimedia data processing resource of the terminal device according to the target system resource interface renders the decoded multimedia data, and before outputting the multimedia content corresponding to the decoded multimedia data, the method further comprises:

4. The play processing method according to claim 3, wherein the calling the multimedia data processing resource of the terminal device according to the target system resource interface performs signal processing on the decoded multimedia data to obtain target multimedia data, and the method comprises:

5. The playback processing method of claim 4, wherein the processing the decoded multimedia data by the multimedia data processing resource according to the playback control component corresponding to the target playback control interface, before obtaining the target multimedia data, further comprises:

6. The play processing method according to claim 1, wherein the calling the multimedia data processing resource of the terminal device according to the target system resource interface, performing rendering processing on the decoded multimedia data, and outputting multimedia content corresponding to the decoded multimedia data, includes:

7. The playback processing method of claim 6, wherein after performing content recognition on the decoded multimedia data to obtain media content information contained in the decoded multimedia data, the method further comprises:

8. A playback processing system, the system comprising:

9. A play processing device, characterized in that it is applied to a terminal device, the device comprising:

10. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps in the playback processing method of any one of claims 1-7 when the computer program is executed by the processor.

11. A computer-readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements the steps of the playback processing method as claimed in any one of claims 1 to 7.