WO2023077866A1

WO2023077866A1 - Multimedia data processing method and apparatus, electronic device, and storage medium

Info

Publication number: WO2023077866A1
Application number: PCT/CN2022/106373
Authority: WO
Inventors: 尚强
Original assignee: 北京字节跳动网络技术有限公司
Priority date: 2021-11-02
Filing date: 2022-07-19
Publication date: 2023-05-11
Also published as: CN114095781A

Abstract

The present disclosure provides a multimedia data processing method and apparatus, an electronic device, and a storage medium. The multimedia data processing method comprises: receiving a multimedia playback request sent by a first system, the multimedia playback request carrying a playback plug-in identifier; in response to the multimedia playback request, generating a plug-in management unit in a second system; generating a target plug-in on the plug-in management unit according to the playback plug-in identifier; processing the multimedia data by means of the target plug-in to obtain target multimedia data; and transmitting the target multimedia data to the first system, so that the first system plays back the target multimedia data in a visual form.

Description

Multimedia data processing method, device, electronic device and storage medium

This application claims priority to a Chinese patent application with application number 202111290534.9 filed with the China Patent Office on November 2, 2021, the entire contents of which are incorporated herein by reference.

technical field

The present disclosure relates to the field of embedded technology, for example, to a multimedia data processing method, device, electronic equipment and storage medium.

Background technique

With the development of embedded technology, the application of embedded technology can be found in almost every field, such as smart home, industrial control enterprises, and consumer electronics. Embedded system is application-centric, based on modern computer technology, and can flexibly tailor software and hardware modules according to user needs, such as function, reliability, cost, volume, power consumption or environment. The resource allocation, task scheduling or coordination of the above-mentioned software and hardware are inseparable from the operating system. Generally, the operating system used on the terminal includes the Android (Android) operating system, which can provide upper-layer applications with certain functions. Data processing to realize the playback of multimedia data.

The multimedia data method in the related art has the problem of poor processing effect.

Contents of the invention

The present disclosure provides a multimedia data processing method, device, electronic equipment and storage medium, which are used to avoid the poor multimedia data processing effect in the related art and improve the multimedia data processing effect.

The present disclosure provides a multimedia data processing method, including: receiving a multimedia play request sent by the first system, the multimedia play request carrying a player plug-in identifier; in response to the multimedia play request, generating a plug-in management in the second system unit; generate a target plug-in on the plug-in management unit according to the playback plug-in identifier; use the target plug-in to process the multimedia data to obtain target multimedia data; transmit the target multimedia data to the first system, so that the first system plays the target multimedia data in a visualized form.

The present disclosure also provides a multimedia data processing device, including: a multimedia play request receiving module configured to receive a multimedia play request sent by the first system, the multimedia play request carrying a playback plug-in identifier; a plug-in management unit generation module configured to In response to the multimedia playback request, a plug-in management unit is generated in the second system; a target plug-in generating module is configured to generate a target plug-in on the plug-in management unit according to the playback plug-in identification; a target multimedia data obtaining module, It is configured to use the target plug-in to process the multimedia data to obtain target multimedia data; the target multimedia data transmission module is configured to transmit the target multimedia data to the first system, so that the first system uses The target multimedia data is played in a visualized form.

The present disclosure also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the program, it realizes the multimedia data processing described in any of the above method steps.

The present disclosure also provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of any one of the multimedia data processing methods described above are implemented.

Description of drawings

FIG. 1 is one of the application scenario schematic diagrams of the multimedia data processing method provided by the present disclosure;

Fig. 2 is one of the schematic flow charts of the multimedia data processing method provided by the present disclosure;

FIG. 3 is the second schematic flow diagram of the multimedia data processing method provided by the present disclosure;

Fig. 4 is the third schematic flow diagram of the multimedia data processing method provided by the present disclosure;

FIG. 5 is the fourth schematic flow diagram of the multimedia data processing method provided by the present disclosure;

FIG. 6 is the fifth schematic flow diagram of the multimedia data processing method provided by the present disclosure;

FIG. 7 is one of the structural schematic diagrams of the multimedia data processing method provided by the present disclosure;

FIG. 8 is the second structural schematic diagram of the multimedia data processing method provided by the present disclosure;

FIG. 9 is a schematic structural diagram of a multimedia data processing device provided by the present disclosure;

Fig. 10 is a schematic structural diagram of an electronic device provided by the present disclosure.

Detailed ways

The multimedia data processing method provided in this application can be applied to the application environment shown in FIG. 1 , and specifically applied to a multimedia data processing system. The multimedia data processing system includes a terminal 102 and a terminal 104, wherein the terminal 102 communicates with the terminal 104 through a network. For example, the terminal 102 receives a multimedia play request sent by the first system, and the multimedia play request carries a play plug-in identifier; in response to the multimedia play request, a plug-in management unit is generated in the second system in the terminal 104; according to the play Plug-in identification, generating a target plug-in on the plug-in management unit; utilizing the target plug-in to process the multimedia data to obtain the target multimedia data; transmitting the target multimedia data to the first system in the terminal 102, so that the first system plays in a visualized form Target multimedia data. Wherein, the terminal 102 or the terminal 104 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers and portable wearable devices. It can be understood that the foregoing terminal 102 and terminal 104 may be combined into a form of a terminal having both the first system and the second system.

The multimedia data processing method of the present disclosure will be described below with reference to FIGS. 2-6 .

In one embodiment, as shown in FIG. 2, a multimedia data processing method is provided, and the method is applied to a terminal as an example for illustration, including the following steps:

Step 202, receiving a multimedia play request sent by the first system, the multimedia play request carrying a playback plug-in identifier.

Wherein, the multimedia play request refers to a request for playing multimedia data. The playback plug-in identifier refers to a mark that can uniquely identify the playback plug-in.

For example, the terminal receives a multimedia play request sent by the first system by receiving a trigger operation on a multimedia application, and the multimedia play request carries a play plug-in identifier.

Step 204: Generate a plug-in management unit in the second system in response to the multimedia playback request.

Wherein, the plug-in management unit refers to a unit capable of unified management of plug-ins, and the unit may include plug-ins in multiple multimedia data processing stages or different types of plug-ins. For example, the plug-in management unit includes a stream fetching plug-in, a decoding plug-in, or an algorithm plug-in for multimedia video streams.

For example, after receiving the multimedia play request sent by the first system, the terminal generates a plug-in management unit in the second system, which is a parallel system compatible with the first system, in response to the multimedia play request.

Step 206, generate a target plug-in on the plug-in management unit according to the playback plug-in identifier.

For example, after the terminal generates the plug-in management unit in the second system, the target plug-in can be generated on the plug-in management unit through the playback plug-in identifier. For example, a picture in MP4 (Moving Picture Experts Group4) format needs to be played on the terminal, and the playback format corresponding to the picture is mpeg2 format, which can be used as a playback plug-in identification, and the target plug-in generated on the plug-in management unit is a plug-in of mpeg2enc type.

Step 208, use the target plug-in to process the multimedia data to obtain the target multimedia data.

Wherein, the multimedia data refers to data capable of supporting multimedia playing or data including multimedia playing content.

For example, after the terminal generates the target plug-in in the second system, it uses the target plug-in to process the multimedia data, and the processing includes acquiring, encoding, transmitting, and decoding the multimedia data.

Step 210, transmit the target multimedia data to the first system, so that the first system plays the target multimedia data in a visualized form.

For example, after the terminal obtains the target multimedia data, it transmits the target multimedia data to the first system that is compatible with the second system and runs in parallel, so that the first system can play the target multimedia data in a visualized form, and the terminal has completed the multimedia data The entire process from sending a request to playing.

In the above-mentioned multimedia data processing method, by receiving the multimedia playback request sent by the first system, the multimedia playback request carries a playback plug-in identification; in response to the multimedia playback request, a plug-in management unit is generated in the second system; according to the above-mentioned playback plug-in Identifying, generating the target plug-in on the plug-in management unit; using the target plug-in to process the multimedia data to obtain the target multimedia data; transmitting the target multimedia data to the first system, so that the first system can play the target multimedia data in a visual form. Through the combination of the first system and the second system, through the related processing of the plug-in corresponding to the multimedia playback request by the second system, the multimedia data can be played in a visualized form on the first system, and the multimedia data processing effect is improved.

In one embodiment, as shown in Figure 3, transmitting the target multimedia data to the first system includes:

Step 302, acquiring the target multimedia data type.

Wherein, the type of multimedia data refers to a type when playing multimedia data, and the type includes pictures, videos, or audios.

For example, the terminal judges the acquired target multimedia data through the multimedia data type judging plug-in, and acquires the target multimedia data type.

Step 304: Obtain the target transmission channel corresponding to the target multimedia data type according to the corresponding relationship between the target multimedia data type and the transmission channel.

Wherein, the transmission channel refers to a communication channel capable of transmitting multimedia data.

For example, after the terminal acquires the target multimedia data type, each target multimedia data type is provided with a corresponding transmission channel, and the target transmission channel corresponding to the target multimedia data type is obtained.

Step 306, transmit the target multimedia data to the first system through the target transmission channel.

For example, after obtaining the target transmission channel, the terminal may transmit the corresponding target multimedia data to the first system through the target transmission channel. It can be understood that the multimedia data is processed in the second system of the terminal, and the target multimedia data obtained after processing is transmitted to the first system through a corresponding transmission channel. For example, the audio is returned through the ARC (Audio return channel) channel.

In this embodiment, by obtaining the target multimedia data type, according to the corresponding relationship between the target multimedia data type and the transmission channel, the target transmission channel corresponding to the target multimedia data type is obtained, and the target multimedia data is transmitted to the first system through the target transmission channel, It can be realized that different types of multimedia data are transmitted through different transmission channels, thereby improving the efficiency of multimedia data processing.

In one embodiment, as shown in FIG. 4, in response to a multimedia playback request, generating a plug-in management unit in the second system includes:

Step 402, acquire the playing parameters in the multimedia playing request.

Wherein, the playing parameter refers to a parameter enabling the multimedia data to realize its playing function. For example, the playback parameter is a parameter for the eyebrow option in the video.

For example, the terminal can acquire the playing parameters in the multimedia playing request through the parameter identification of the playing parameters themselves. The parameter identifier can be a text description, or a unique label, etc. For example, through the text description of the parameter "heavy makeup/female/eyebrow", the playback parameter obtained in the multimedia playback request is a playback parameter for processing eyebrows.

Step 404, according to the corresponding relationship between the playback parameters and the unit generation tool, determine the unit generation tool corresponding to the plug-in management unit as the target unit generation tool.

For example, after acquiring the playback parameters, the terminal determines to generate a corresponding target unit generation tool according to the correspondence between the playback parameters and the unit generation tools. For example, if the acquired playback parameters are playback parameters for processing eyebrows, the related function or script tool for generating the plug-in management unit is called as the target unit generation tool.

Step 406, using the target unit generation tool to generate a plug-in management unit in the second system.

For example, after determining the target unit generation tool, the terminal uses the target unit generation tool to generate the plug-in management unit in the second system. For example, the target unit generation tool is a creation function for rendering eyebrows, and the plug-in management unit is generated in the second system by using the creation function. For example, the creation function is used to generate a pipeline with eyebrow rendering function in the second system. The pipeline refers to a plug-in management unit that can gather multiple plug-ins and use the above-mentioned multiple plug-ins to complete a certain function in a pipelined form.

In this embodiment, by obtaining the playback parameters in the multimedia playback request, according to the correspondence between the playback parameters and the unit generation tool, determine the unit generation tool corresponding to the plug-in management unit, as the target unit generation tool, using the target unit generation tool, By generating the plug-in management unit in the second system, the plug-in management unit can be accurately determined.

In one embodiment, as shown in Figure 5, the multimedia data processing method also includes:

Step 502, acquire the first description language of the playback parameter; the first description language is the description language of the playback parameter in the first system.

Wherein, the description language refers to describing the playback parameters as a language that can be recognized by the terminal and has certain grammatical rules.

For example, after acquiring the playing parameters, the terminal determines the description language of the playing parameters according to the grammatical structure of the playing parameters, so as to obtain the first description language of the playing parameters. For example, if the language used to describe the playback parameters is the grammatical structure of the JAVA language (computer programming language), then the acquired first description language is the JAVA language. The language is the language in the first system of the terminal.

Step 504, converting the first description language into an intermediate description language.

For example, after acquiring the first description language, the terminal converts it into a common description language, and the common description language can be used as a tool for language conversion between the first system and the second system of the terminal.

Step 506: Convert the intermediate description language into the second description language according to the correspondence between the intermediate description language and the second description language; the second description language is the description language of the playing parameters in the second system.

For example, after obtaining the intermediate description language, the terminal converts the intermediate description language into the second description language according to the correspondence between the intermediate description language and the second description language. For example, the first description language in the first system of the terminal is JAVA language, the second description language in the second system is C++ (computer description language), and the intermediate description language can be different from the first description language and the second description language. , first transform the first description language into an intermediate description language, and then convert the intermediate description language into a second description language.

In this embodiment, by obtaining the first description language of the playback parameters; the first description language is the description language of the playback parameters in the first system, the first description language is converted into an intermediate description language, and according to the intermediate description language and the second The corresponding relationship of the description language converts the intermediate description language into the second description language, so as to realize the compatibility between the first system and the second system in the terminal.

In one embodiment, as shown in FIG. 6, according to the playback plug-in identifier, generating the target plug-in on the plug-in management unit includes:

Step 602: Obtain one or more intermediate playback plug-ins corresponding to the playback plug-in identifiers from the set of candidate playback plug-ins.

For example, multiple types of playback plug-ins are stored in the second system of the terminal, and corresponding plug-ins can be obtained from the playback plug-in identifier according to the playback plug-in identifier in the multimedia playback request. It can be understood that each multimedia playback request includes one or more playback plug-in IDs, and correspondingly, one or more intermediate playback plug-ins corresponding to the playback plug-in IDs are obtained.

Step 604, sort the acquired intermediate playback plug-ins according to the priority of the playback plug-ins, to obtain a sequence of intermediate playback plug-ins.

Wherein, the priority refers to the level of priority processing, and the priority can be determined according to the priority identification on the multimedia player plug-in, and can also be determined according to the order of the plug-ins on the plug-in management unit, and the priority can determine that the plug-in is on the plug-in management unit The order of execution, the higher the priority, the earlier the execution time; the lower the priority, the later the execution time.

For example, after obtaining one or more intermediate playback plug-ins corresponding to the playback plug-in identifier, the terminal sorts the obtained intermediate playback plug-ins according to the priorities of the playback plug-ins to obtain a sequence of intermediate playback plug-ins. For example, the priority of the playback plug-in is represented by a number, the larger the number, the higher the priority; the priority of the middle playback plug-in 1 is 50, and the priority of the middle playback plug-in 2 is 20, so the middle playback plug-in 1 is sorted after the middle playback plug-in Before 2, when the plug-in is executed, the intermediate playback plug-in 1 is executed first, and then the intermediate playback plug-in 2 is executed.

Step 606, package the intermediate playback plug-ins in the intermediate playback plug-in sequence into an overall plug-in.

For example, after obtaining the sequence of intermediate playback plug-ins, the terminal may package the intermediate playback plug-ins in the sequence into an overall plug-in, so that after receiving the same multimedia playback request, the overall plug-in can be invoked as a whole to improve the efficiency of plug-in invocation.

Step 608, determine the overall plug-in as the target plug-in generated on the plug-in management unit.

For example, after obtaining the overall plug-in, the terminal determines the overall plug-in as the target plug-in, so as to directly invoke the target plug-in when establishing a corresponding plug-in management unit, thereby improving the processing efficiency of multimedia data. For example, to beautify a portrait in a video, you need an encoding plug-in, a decoding plug-in, a rendering plug-in, a blurring algorithm plug-in, and a filter plug-in. When there is a play flag for portrait beautification processing in the playback request, just call the plug-in management unit of the portrait beautification plug-in directly.

In this embodiment, by obtaining one or more intermediate playback plug-ins corresponding to the playback plug-in identifiers from the set of candidate playback plug-ins, sorting the intermediate playback plug-ins according to the priority of the playback plug-ins, obtaining the sequence of intermediate playback plug-ins, and In the playback plug-in sequence, the intermediate playback plug-in is packaged into an overall plug-in, and the overall plug-in is determined to be the target plug-in generated on the plug-in management unit, which can improve the efficiency of multimedia data processing.

In one embodiment, the multimedia data processing method further includes: canceling the generation result between the current plug-in and the target plug-in, and switching the status of the multimedia playback request to the event status before the initial request is not responded.

For example, when the terminal receives a multimedia playback request, it searches for the corresponding plug-in in the second system according to the playback plug-in identifier in the request, and when an abnormality occurs when searching for a certain plug-in, cancels the operation of the previously found plug-in and the found plug-in , retraversing the plug-ins in the plug-in collection in the form of an initial multimedia playback request, and regenerating the target plug-in.

In this embodiment, by canceling the generated result between the current plug-in and the target plug-in, and switching the state of the multimedia playback request to the event state before the initial request is not responded, the exception handling capability in the process of multimedia data processing can be improved .

In one embodiment, the first system of the terminal is an Android (Android) operating system, and the second system is a Linux operating system as an example, wherein the Linux operating system is another operating system different from the Android operating system. Among them, the Android operating system can provide a video playback framework through which the upper-layer application of video playback is provided. Android encoding and decoding in related technologies mainly rely on Medialayer and Mediaodec classes, and the functional processing of images and videos is not very rich. , the multimedia framework of the pipeline (pipeline) in the Gstreamer class in the Linux operating system can perform more abundant processing on the video in the form of a plug-in. For example, functions such as acquisition, encoding, decoding, rendering, and filters are implemented in the form of plug-ins. Finally, multiple modules are connected in series to achieve the desired effect. For example, a specified effect can be inserted into a video. For example, the processing of beautifying portraits in videos can be realized by inserting them into the pipeline in the form of plug-ins, and the processing of image blurring can also be achieved by adding corresponding blurring algorithms in the pipeline, and the video can be hot-swapped. to process. As shown in Figure 7, the pipeline can combine the supported pipelines, which can be easily cut in the form of switches. At the bottom is a collection of all plug-ins in the framework, including the built-in plug-ins and custom plug-ins in the Gstreamer framework. For example, the filescr plug-in for reading files or the gst-droid plug-in for transferring video data to the Android operating system, etc. The Android operating system can communicate with the Linux operating system through a compatible interface. Thereby reducing the cumbersome development procedures and difficult maintenance problems caused by the development of the Android operating system, and at the same time strengthening the compatibility of the multimedia part of the dual system.

In one embodiment, as shown in Figure 8, when starting to play video in above-mentioned Android operating system, through system compatible interface, call relevant control interface or interface control function, set up a pipeline in Linux operating system, in this pipeline Insert the functional plug-in required for video playback to process the video, return the video data and audio data to the Android operating system through different transmission channels, and visualize the video on the application interface supported by the Android operating system. Play the processed video and audio on the system application in the form of .

The multimedia data processing device provided by the present disclosure is described below, and the multimedia data processing device described below and the multimedia data processing method described above can be referred to in correspondence.

In one embodiment, as shown in FIG. 9 , a multimedia data processing device 900 is provided, including: a multimedia play request receiving module 902, a plug-in management unit generating module 904, a target plug-in generating module 906, and a target multimedia data obtaining module 908 And the target multimedia data transmission module 910, wherein: the multimedia play request receiving module 902 is set to receive the multimedia play request sent by the first system, and the multimedia play request carries the play plug-in identification; the plug-in management unit generation module 904 is set to respond to The multimedia playback request generates a plug-in management unit in the second system; the target plug-in generation module 906 is configured to generate a target plug-in on the plug-in management unit according to the playback plug-in identification; the target multimedia data obtains a module 908, which is configured to use the target plug-in to generate a target plug-in for the multimedia The data is processed to obtain target multimedia data; the target multimedia data transmission module 910 is configured to transmit the target multimedia data to the first system, so that the first system plays the target multimedia data in a visualized form.

In one embodiment, the target multimedia data transmission module 910 includes: a target multimedia data type acquisition unit, a target transmission channel acquisition unit and a target multimedia data transmission unit, wherein: the target multimedia data type acquisition unit is configured to acquire the target multimedia data type; The target transmission channel obtaining unit is set to obtain the target transmission channel corresponding to the target multimedia data type according to the corresponding relationship between the target multimedia data type and the transmission channel; the target multimedia data transmission unit is set to transmit the target multimedia data to the target multimedia data through the target transmission channel first system.

In one embodiment, the plug-in management unit generation module 904 is configured to obtain the playback parameters in the multimedia playback request; according to the correspondence between the playback parameters and the unit generation tool, determine the unit generation tool corresponding to the plug-in management unit as the target unit A generating tool; using the target unit generating tool to generate a plug-in snap-in in the second system.

In one embodiment, the multimedia data processing device is configured to obtain the first description language of the playback parameters; the first description language is the description language of the playback parameters in the first system; the first description language is converted into an intermediate description language; according to The corresponding relationship between the intermediate description language and the second description language is to convert the intermediate description language into the second description language; the second description language is the description language of the playing parameters in the second system.

In one embodiment, the target plug-in generation module 906 is configured to obtain one or more intermediate playback plug-ins corresponding to the playback plug-in identifier from the set of candidate playback plug-ins; sort the intermediate playback plug-ins according to the priority of the playback plug-ins, Obtaining the intermediate playback plug-in sequence; packaging the intermediate playback plug-in in the intermediate playback plug-in sequence into an overall plug-in; determining the overall plug-in as the target plug-in generated on the plug-in management unit.

In one embodiment, the multimedia data processing device is configured to cancel the generation result between the current plug-in and the target plug-in, and switch the status of the multimedia playback request to the event status before the initial request is not responded.

Figure 10 illustrates a schematic diagram of the physical structure of an electronic device, as shown in Figure 10, the electronic device may include: a processor (processor) 1010, a communication interface (Communications Interface) 1020, a memory (memory) 1030 and a communication bus 1040, Wherein, the processor 1010 , the communication interface 1020 , and the memory 1030 communicate with each other through the communication bus 1040 . The processor 1010 can call the logic instructions in the memory 1030 to execute the multimedia data processing method, the method includes: receiving a multimedia play request sent by the first system, the multimedia play request carrying a player plug-in identifier; responding to the multimedia play request, in Generate a plug-in management unit in the second system; generate a target plug-in on the plug-in management unit according to the playback plug-in identification; use the target plug-in to process the multimedia data to obtain the target multimedia data; transmit the target multimedia data to the first system, so that the second system A system plays target multimedia data in a visualized form.

In addition, the above logic instructions in the memory 1030 may be implemented in the form of software functional units and when sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present disclosure or the part that contributes to the related technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several The instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in multiple embodiments of the present disclosure. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disc, etc., which can store program codes. .

On the other hand, the present disclosure also provides a computer program product, the computer program product includes a computer program stored on a non-transitory computer-readable storage medium, the computer program includes program instructions, and when the program instructions are executed by a computer When executing, the computer can execute the multimedia data processing method provided by the above-mentioned multiple methods, the method includes: receiving the multimedia play request sent by the first system, the multimedia play request carries the player plug-in identification; in response to the multimedia play request, at the Generate a plug-in management unit in the second system; generate a target plug-in on the plug-in management unit according to the playback plug-in identification; use the target plug-in to process the multimedia data to obtain the target multimedia data; transmit the target multimedia data to the first system, so that the first The system plays the target multimedia data in a visualized form.

In yet another aspect, the present disclosure also provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the multimedia data processing method provided by the above-mentioned multiple embodiments is implemented. The method includes: receiving a multimedia playback request sent by the first system, the multimedia playback request carrying a playback plug-in identifier; in response to the multimedia playback request, generating a plug-in management unit in the second system; generating a plug-in management unit on the plug-in management unit according to the playback plug-in identifier The target plug-in; using the target plug-in to process the multimedia data to obtain the target multimedia data; transmitting the target multimedia data to the first system, so that the first system plays the target multimedia data in a visualized form.

The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. It can be understood and implemented by those skilled in the art without any creative effort.

Through the above description of the implementations, those skilled in the art can clearly understand that multiple implementations can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware. Based on this understanding, the essence of the above technical solutions or the part that contributes to related technologies can be embodied in the form of software products, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, disk , CD, etc., including several instructions to make a computer device (which may be a personal computer, server, or network device, etc.) execute the methods described in multiple embodiments or some parts of the embodiments.

Claims

A multimedia data processing method, comprising:

receiving a multimedia play request sent by the first system, where the multimedia play request carries a player plug-in identifier;

In response to the multimedia playback request, generate a plug-in management unit in the second system;

Generate a target plug-in on the plug-in management unit according to the playback plug-in identifier;

Using the target plug-in to process the multimedia data to obtain target multimedia data;

and transmitting the target multimedia data to the first system, so that the first system plays the target multimedia data in a visualized form.
The method according to claim 1, wherein said transmitting said target multimedia data to said first system comprises:

Obtain the target multimedia data type;

Obtain a target transmission channel corresponding to the target multimedia data type according to the correspondence between the target multimedia data type and the transmission channel;

The target multimedia data is transmitted to the first system through the target transmission channel.
The method according to claim 1, wherein said generating a plug-in management unit in the second system in response to the multimedia playback request comprises:

Obtain the playback parameters in the multimedia playback request;

According to the corresponding relationship between the playback parameters and the unit generation tool, determine the unit generation tool corresponding to the plug-in management unit as the target unit generation tool;

A plug-in management unit is generated in the second system using the target unit generation tool.
The method according to claim 3, further comprising:

Acquiring a first description language of the playback parameter; the first description language is the description language of the playback parameter in the first system;

converting the first description language to an intermediate description language;

According to the corresponding relationship between the intermediate description language and the second description language, the intermediate description language is converted into the second description language; the second description language is the description language of the playback parameter in the second system.
The method according to claim 1, wherein said generating a target plug-in on said plug-in management unit according to said playing plug-in identifier comprises:

Obtain at least one intermediate playback plug-in corresponding to the playback plug-in identifier from the set of candidate playback plug-ins;

According to the priority of the playing plug-ins, the acquired intermediate playing plug-ins are sorted to obtain a sequence of intermediate playing plug-ins;

packaging the intermediate playback plug-ins in the sequence of intermediate playback plug-ins into an overall plug-in;

The overall plug-in is determined to be the target plug-in generated on the plug-in management unit.
The method according to any one of claims 1-5, further comprising:

Perform cancellation processing on the generation result between the current plug-in and the target plug-in, and switch the state of the multimedia playback request to the event state before the initial request is not responded.
A multimedia data processing device, comprising:

The multimedia playback request receiving module is configured to receive the multimedia playback request sent by the first system, and the multimedia playback request carries a playback plug-in identification;

A plug-in management unit generation module, configured to generate a plug-in management unit in the second system in response to the multimedia playback request;

A target plug-in generating module configured to generate a target plug-in on the plug-in management unit according to the playback plug-in identifier;

The target multimedia data obtaining module is configured to use the target plug-in to process the multimedia data to obtain the target multimedia data;

The target multimedia data transmission module is configured to transmit the target multimedia data to the first system, so that the first system plays the target multimedia data in a visualized form.
The device according to claim 7, wherein the target multimedia data transmission module comprises:

a target multimedia data type acquisition unit, configured to acquire the target multimedia data type;

The target transmission channel obtaining unit is configured to obtain the target transmission channel corresponding to the target multimedia data type according to the corresponding relationship between the target multimedia data type and the transmission channel;

The target multimedia data transmission unit is configured to transmit the target multimedia data to the first system through the target transmission channel.
An electronic device, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, when the processor executes the program, the computer program described in any one of claims 1 to 6 is implemented. The multimedia data processing method is described.
A non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the multimedia data processing method according to any one of claims 1 to 6 is realized.