CN111562945B - Multimedia processing method, device, equipment and storage medium - Google Patents
Multimedia processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN111562945B CN111562945B CN202010252389.4A CN202010252389A CN111562945B CN 111562945 B CN111562945 B CN 111562945B CN 202010252389 A CN202010252389 A CN 202010252389A CN 111562945 B CN111562945 B CN 111562945B
- Authority
- CN
- China
- Prior art keywords
- plug
- functional
- multimedia
- processing
- functional plug
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
- G06F8/76—Adapting program code to run in a different environment; Porting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
- G06F9/44526—Plug-ins; Add-ons
Abstract
The application provides a multimedia processing method, a device, equipment and a storage medium, wherein the method comprises the following steps: acquiring at least one function plug-in selected by a user and a data flow direction pointer corresponding to each function plug-in; acquiring multimedia data to be processed; and processing the multimedia data through each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in. The method and the device have the advantages that various processing operations of the multimedia data are plugged, a uniform interface is provided for each functional plug-in, the functional plug-ins are unified and standardized, the functional plug-ins can be plugged and used at any time, and the functional plug-ins which are not needed any more can be conveniently unloaded. In the process of processing the multimedia data, a plurality of required functional plugins are sequenced, after the multimedia data is input into the functional plugins arranged at the head, a series of processing operations on the multimedia data are automatically completed through the sequenced functional plugins, a user does not need to copy data or perform other manual interventions, the operation is simple, and the efficiency of processing the multimedia data is very high.
Description
Technical Field
The present application belongs to the technical field of multimedia processing, and in particular, relates to a multimedia processing method, apparatus, device, and storage medium.
Background
Currently, there are many applications on the market for processing multimedia, originating from different providers and focusing on different multimedia processing operations, such as applications for compressing multimedia and applications for decoding multimedia.
When a user needs to perform various processing operations on multimedia, multiple applications originating from different providers may be required. Since there is a high possibility of incompatibility among the multiple applications, after a user uses one application to process multimedia, the user often needs to copy the multimedia processing data and input the copied processing data into the next application for processing.
Disclosure of Invention
The application provides a multimedia processing method, a multimedia processing device, multimedia processing equipment and a multimedia processing storage medium, various processing operations of multimedia data are plugged, functional plug-ins can be plugged at any time, and functional plug-ins which are not needed any more can be conveniently unloaded. In the process of processing the multimedia data, a plurality of functional plugins automatically complete a series of processing operations on the multimedia data according to the data flow direction pointer corresponding to each functional plugin, a user does not need to copy data or perform other manual intervention, the operation is simple, and the efficiency of processing the multimedia data is very high.
An embodiment of a first aspect of the present application provides a multimedia processing method, where the method includes:
acquiring at least one function plug-in selected by a user and a data flow direction pointer corresponding to each function plug-in;
acquiring multimedia data to be processed;
and processing the multimedia data through each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in.
In some embodiments of the present application, the processing, by the each functional plug-in, the multimedia data according to the data flow direction pointer corresponding to the each functional plug-in includes:
determining the running sequence of each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in;
and sequentially operating each functional plug-in to process the multimedia data according to the data flow direction pointer corresponding to each functional plug-in and the operation sequence of each functional plug-in.
In some embodiments of the present application, the sequentially running each functional plug-in according to the running sequence of each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in to process the multimedia data includes:
processing the multimedia data by operating the functional plug-ins arranged at the head in sequence to obtain a first intermediate processing result;
transmitting the first intermediate processing result to a next-stage functional plug-in unit indicated by a data flow direction pointer of the first-order functional plug-in unit for processing to obtain a second intermediate processing result;
and transmitting the second intermediate processing result to the functional plug-in indicated by the data flow pointer of the next-stage functional plug-in for processing until the functional plug-in with the last operation sequence finishes the processing operation, and obtaining a final processing result corresponding to the multimedia data.
In some embodiments of the present application, the method further comprises:
receiving a plug-in deletion request submitted by the user, wherein the plug-in deletion request comprises a plug-in identifier;
and uninstalling the functional plug-in corresponding to the plug-in identification from each functional plug-in.
In some embodiments of the present application, the method further comprises:
receiving a plug-in adding request submitted by the user, wherein the plug-in adding request comprises plug-in installation data and a data flow direction pointer;
installing a new functional plug-in according to the plug-in installation data;
and determining the operation sequence of the new functional plug-in according to the data flow direction pointer corresponding to each functional plug-in and the data flow direction pointer corresponding to the new functional plug-in.
In some embodiments of the present application, the method further comprises:
receiving a plug-in adjustment request submitted by the user, wherein the plug-in adjustment request comprises a plug-in identifier and a new data flow direction pointer;
updating the data flow direction pointer of the functional plug-in corresponding to the plug-in identification to be the new data flow direction pointer;
and re-determining the running sequence of each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in after the updating operation.
An embodiment of a second aspect of the present application provides a multimedia processing apparatus, the apparatus comprising:
the plug-in acquisition module is used for acquiring at least one functional plug-in selected by a user and a data flow direction pointer corresponding to each functional plug-in;
the multimedia acquisition module is used for acquiring multimedia data;
and the multimedia processing module is used for processing the multimedia data through each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in.
In some embodiments of the present application, the multimedia processing module is configured to determine an operating sequence of each functional plugin according to a data flow direction pointer corresponding to each functional plugin; and sequentially operating each functional plug-in to process the multimedia data according to the data flow direction pointer corresponding to each functional plug-in and the operation sequence of each functional plug-in.
An embodiment of the third aspect of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method of the first aspect.
An embodiment of a fourth aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, the program being executable by a processor to implement the method of the first aspect.
The technical scheme provided in the embodiment of the application at least has the following technical effects or advantages:
in the embodiment of the application, various processing operations of multimedia data are subjected to plug-in through the multimedia framework, a uniform interface is provided for each functional plug-in, the functional plug-ins are unified and standardized, the functional plug-ins can be plugged at any time, and the functional plug-ins which are not needed any more can be conveniently unloaded. The method includes the steps that various functional plug-ins for processing multimedia data are brought into a scalable, tailorable, extensible, flexible and unified multimedia processing framework, a unified SDK (Software Development Kit) is formed for a user to develop, the interface affinity for the user is high, the operation is convenient, the maintenance is easy, and the platform portability is high.
In the process of processing multimedia data by using the multimedia framework, the functional plugins are sequenced according to the sequence of various processing operations to be performed on the multimedia data, and after the multimedia data is input into the functional plugins arranged at the head, a series of processing operations on the multimedia data can be automatically completed by the sequenced functional plugins.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to refer to like parts throughout the drawings.
In the drawings:
fig. 1 is a flow chart illustrating a multimedia processing method according to an embodiment of the present application;
FIG. 2 is a schematic diagram illustrating a multimedia processing apparatus according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 4 is a schematic diagram of a storage medium provided in an embodiment of the present application.
Detailed Description
Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
It is to be noted that, unless otherwise specified, technical or scientific terms used herein shall have the ordinary meaning as understood by those skilled in the art to which this application belongs.
A multimedia processing method, an apparatus, a device and a storage medium according to embodiments of the present application are described below with reference to the accompanying drawings.
The embodiment of the application provides a multimedia processing method, which is implemented based on a brand-new multimedia processing framework, wherein the multimedia processing framework comprises a plurality of functional plugins, the functions of the functional plugins are different, and the functions of the functional plugins can be collecting multimedia data, decoding the multimedia data, compressing the multimedia data or playing the multimedia data and the like. In the process of processing multimedia data by using the multimedia framework, a user can select a plurality of required functional plugins, the functional plugins are sequenced according to the sequence of various processing operations required to be performed on the multimedia data, after the multimedia data is input into the functional plugins arranged at the head, the multimedia framework can automatically complete a series of processing operations on the multimedia data through the sequenced functional plugins, and in the process, the user does not need to perform data copying or other manual intervention, the operation is simple, and the efficiency of processing the multimedia data is high.
Referring to fig. 1, the method specifically includes the following steps:
step 101: and acquiring at least one function plug-in selected by a user and a data flow direction pointer corresponding to each function plug-in.
In the embodiment of the application, the multimedia framework provides a plurality of functional plug-ins for users, such as a collection plug-in for collecting multimedia data, a compression plug-in for compressing multimedia data, a playing plug-in for playing multimedia data, and the like.
When a user needs to process multimedia data by using the multimedia framework, one or more function plug-ins needed by the user can be selected from a plurality of function plug-ins provided by the multimedia framework, and a data flow pointer is set for each selected function plug-in. The data flow direction pointer is used for indicating a next-stage functional plug-in to which a processing result of the functional plug-in needs to flow, that is, the output of the functional plug-in is used as the input of the next-stage functional plug-in, the data flow direction pointer is used for indicating the next-stage functional plug-in, and the data flow direction pointer may be a plug-in identifier, a plug-in name, an interface number of a data interface of the next-stage functional plug-in, and the like corresponding to the next-stage functional plug-in.
When a user clicks one or more functional plugins in the multimedia framework and sets a data flow direction pointer for each clicked functional plugin, the terminal obtains at least one functional plugin selected by the user and the data flow direction pointer corresponding to each functional plugin.
Step 102: multimedia data is acquired.
When the user needs to process the multimedia data by using the selected functional plug-in, the user submits the multimedia data of the user to the multimedia framework, and the multimedia data can be audio data or video data and the like. The terminal acquires multimedia data submitted by a user.
Step 103: and processing the multimedia data through each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in.
After receiving multimedia data submitted by a user, firstly, determining the operation sequence of each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in selected by the user. And sequentially operating each functional plug-in to process the multimedia data according to the data flow direction pointer corresponding to each functional plug-in and the operation sequence of each functional plug-in.
Specifically, the multimedia data is processed by operating the functional plug-ins arranged at the head in sequence to obtain a first intermediate processing result; transmitting the first intermediate processing result to the next-stage functional plug-in indicated by the data flow direction pointer of the first-order functional plug-in for processing to obtain a second intermediate processing result; and transmitting the second intermediate processing result to the functional plug-in indicated by the data flow pointer of the next-stage functional plug-in for processing, and sequentially processing the functional plug-ins according to the running sequence of each functional plug-in until the functional plug-in with the running sequence arranged at the last position finishes the processing operation to obtain a final processing result corresponding to the multimedia data.
In the embodiment of the application, the processing is sequentially carried out according to the running sequence of each functional plug-in, the processing of the multimedia data is streamlined, the multimedia processing framework provides a uniform interface for each functional plug-in, the processing result after the last functional plug-in is processed is automatically transmitted to the next functional plug-in for processing, data copying is not needed in the processing process, and the processing efficiency of the multimedia data is greatly improved.
In the embodiment of the present application, in order to further improve multimedia processing efficiency, a multi-channel processing mechanism may be further provided, that is, a plurality of channels are provided inside each functional plug-in, and are used for parallel processing of different multimedia data through multiple threads. Each channel in the functional plug-in corresponds to a specific channel identifier, and the channel identifier is used for uniquely identifying which channel in which functional plug-in the channel is. Based on the multi-channel processing mechanism, a plurality of multimedia processing pipelines can be simultaneously set, each pipeline comprises one or more serialized function plug-ins, the function plug-ins in each pipeline can have shared function plug-ins, and for the plurality of pipelines sharing the function plug-ins, each pipeline respectively uses different channels in the shared function plug-ins. Through the multiple assembly lines, parallel processing of multiple multimedia data can be achieved, and the processing efficiency of the multimedia data is greatly improved.
Because various operations for processing the multimedia data are plugged in the multimedia processing framework, users can plug in and use the multimedia data for various processing functions, so that the flexibility of the multimedia data processing is very high. When the user no longer needs to process a certain function on the multimedia data, the user can submit a plug-in deletion request to the multimedia processing framework, wherein the plug-in deletion request comprises a plug-in identification corresponding to the functional plug-in needing to be deleted. And the terminal receives a plug-in deletion request submitted by the user, and unloads the functional plug-in corresponding to the plug-in identification from each functional plug-in selected by the user in the step 101.
When a user needs to perform a new function operation process on multimedia data, the user can submit a plug-in adding request to the multimedia processing framework, wherein the plug-in adding request comprises plug-in installation data and a data flow direction pointer corresponding to a function plug-in needing to be added. And the terminal receives a plug-in adding request submitted by a user, and installs the new functional plug-in according to the plug-in installation data included in the plug-in adding request. And determining the running sequence of the new functional plug-in according to the data flow direction pointer corresponding to each functional plug-in selected by the user in the step 101 and the data flow direction pointer corresponding to the new functional plug-in, so as to process the multimedia data by using the plurality of functional plug-ins selected by the user and the newly added functional plug-ins in the following step 103.
When the user needs to adjust the running sequence of the functional plug-in selected in step 101, the user may submit a plug-in adjustment request to the multimedia processing framework, where the plug-in adjustment request includes a plug-in identifier corresponding to the functional plug-in whose running sequence needs to be adjusted and a new data flow direction pointer. And the terminal receives a plug-in adjustment request submitted by a user, and updates the data flow direction pointer of the functional plug-in corresponding to the plug-in identification included in the plug-in adjustment request into a new data flow direction pointer. And then, according to the data flow direction pointer corresponding to each functional plug-in after the updating operation, re-determining the running sequence of each functional plug-in.
In the embodiment of the application, because each processing function plug-in the multimedia framework is realized and a uniform interface is provided for each function plug-in, the function plug-ins are unified and standardized, the function plug-ins can be plugged at any time, and the function plug-ins which are not needed any more can be conveniently unloaded. A plurality of functional plug-ins for processing multimedia data are incorporated into a scalable, tailorable, extensible, flexible and unified multimedia processing framework, and a unified SDK (Software Development Kit) is formed for users to develop. The multimedia processing framework has affinity to a user interface, is convenient to operate, is easy to maintain and has strong platform portability.
The embodiment of the application provides a multimedia processing device, and the device is used for executing the multimedia processing method in the embodiment. Referring to fig. 2, the apparatus includes:
the plug-in obtaining module 10 is configured to obtain at least one function plug-in selected by a user and a data flow direction pointer corresponding to each function plug-in;
a multimedia acquiring module 11, configured to acquire multimedia data;
and the multimedia processing module 12 is configured to process the multimedia data through each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in.
The multimedia processing module 12 includes:
the running sequence determining unit is used for determining the running sequence of each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in;
and the multimedia processing unit is used for sequentially operating each functional plug-in to process the multimedia data according to the data flow direction pointer corresponding to each functional plug-in and the operation sequence of each functional plug-in.
The multimedia processing unit is used for processing the multimedia data by operating the functional plug-ins arranged at the head in sequence to obtain a first intermediate processing result; transmitting the first intermediate processing result to the next-stage functional plug-in indicated by the data flow direction pointer of the first-order functional plug-in for processing to obtain a second intermediate processing result; and transmitting the second intermediate processing result to the functional plug-in indicated by the pointer of the data flow of the next-stage functional plug-in for processing until the functional plug-in with the operation sequence arranged at the last position completes the processing operation, and obtaining the final processing result corresponding to the multimedia data.
The device also includes:
the plug-in unloading module is used for receiving a plug-in deleting request submitted by a user, wherein the plug-in deleting request comprises a plug-in identifier; and unloading the plug-in from each functional plug-in to identify the corresponding functional plug-in.
The new plug-in module is used for receiving a plug-in adding request submitted by a user, wherein the plug-in adding request comprises plug-in installation data and a data flow direction pointer; installing a new functional plug-in according to the plug-in installation data; and determining the operation sequence of the new functional plug-ins according to the data flow direction pointer corresponding to each functional plug-in and the data flow direction pointer corresponding to the new functional plug-ins.
The sequence adjusting module is used for receiving a plug-in adjusting request submitted by a user, wherein the plug-in adjusting request comprises a plug-in identifier and a new data flow direction pointer; updating the data flow direction pointer of the functional plug-in corresponding to the plug-in identification into a new data flow direction pointer; and re-determining the running sequence of each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in after the updating operation.
The multimedia processing device provided by the embodiment of the application and the multimedia processing method provided by the embodiment of the application have the same beneficial effects as those of the device, the device and the method which are adopted, operated or realized by the same inventive concept.
The embodiment of the present application further provides an electronic device corresponding to the multimedia processing method provided in the foregoing embodiment, so as to execute the foregoing method.
Referring to fig. 3, the electronic device 2 includes: the system comprises a processor 200, a memory 201, a bus 202 and a communication interface 203, wherein the processor 200, the communication interface 203 and the memory 201 are connected through the bus 202; the memory 201 stores a computer program that can be executed on the processor 200, and the processor 200 executes the multimedia processing method provided by any one of the foregoing embodiments when executing the computer program.
The Memory 201 may include a high-speed Random Access Memory (RAM) and may further include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The communication connection between the network element of the system and at least one other network element is realized through at least one communication interface 203 (which may be wired or wireless), and the internet, a wide area network, a local network, a metropolitan area network, and the like can be used.
The processor 200 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 200. The Processor 200 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 201, and the processor 200 reads the information in the memory 201 and completes the steps of the method in combination with the hardware thereof.
The electronic device provided by the embodiment of the application and the multimedia processing method provided by the embodiment of the application have the same inventive concept and have the same beneficial effects as the method adopted, operated or realized by the electronic device.
Referring to fig. 4, the computer-readable storage medium is an optical disc 30, and a computer program (i.e., a program product) is stored thereon, and when being executed by a processor, the computer program executes the multimedia processing method provided by any of the foregoing embodiments.
It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory, or other optical and magnetic storage media, which are not described in detail herein.
The computer-readable storage medium provided by the above-mentioned embodiment of the present application and the multimedia processing method provided by the embodiment of the present application have the same beneficial effects as the method adopted, executed or implemented by the application program stored in the computer-readable storage medium.
It should be noted that:
the algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose devices may be used with the teachings herein. The required structure for constructing such a device will be apparent from the description above. In addition, this application is not directed to any particular programming language. It will be appreciated that a variety of programming languages may be used to implement the teachings of the present application as described herein, and any descriptions of specific languages are provided above to disclose the best modes of the present application.
In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the application may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the application, various features of the application are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the application and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: this application is intended to cover such departures from the present disclosure as come within known or customary practice in the art to which this invention pertains. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this application.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the application and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
The various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in the creation apparatus of a virtual machine according to embodiments of the present application. The present application may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present application may be stored on a computer readable medium or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
The above description is only for the preferred embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (7)
1. A multimedia processing method is characterized in that each processing function plug-in a multimedia framework is converted into a unified interface, the unified interface is provided for each function plug-in, the function plug-ins are unified and standardized, the function plug-ins can be plugged and used at any time, and the function plug-ins which are not needed can be conveniently unloaded; incorporating a plurality of functional plug-ins for processing multimedia data into a multimedia processing frame capable of stretching, cutting and expanding, and forming a uniform Software Development Kit (SDK) for a user to develop; when a user needs to process multimedia data by using the multimedia framework, selecting one or more required functional plugins from a plurality of functional plugins provided by the multimedia framework, and setting a data flow direction pointer for each selected functional plugin; the method comprises the following steps:
acquiring at least one function plug-in selected by a user and a data flow direction pointer corresponding to each function plug-in;
acquiring multimedia data to be processed;
processing the multimedia data through each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in; the multimedia processing framework provides a uniform interface for each functional plug-in, and a processing result after the last functional plug-in is processed is automatically transmitted to the next functional plug-in for processing;
wherein, the processing the multimedia data by each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in comprises:
determining the running sequence of each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in;
sequentially operating each functional plug-in to process the multimedia data according to the data flow direction pointer corresponding to each functional plug-in and the operation sequence of each functional plug-in;
wherein, the sequentially operating each functional plug-in to process the multimedia data according to the data flow direction pointer corresponding to each functional plug-in and the operation sequence of each functional plug-in comprises:
processing the multimedia data by operating the functional plug-ins arranged at the head in sequence to obtain a first intermediate processing result;
transmitting the first intermediate processing result to a next-stage functional plug-in unit indicated by a data flow direction pointer of the first-order functional plug-in unit for processing to obtain a second intermediate processing result;
and transmitting the second intermediate processing result to the functional plug-in indicated by the data flow pointer of the next-stage functional plug-in for processing until the functional plug-in with the last operation sequence finishes the processing operation, and obtaining a final processing result corresponding to the multimedia data.
2. The method of claim 1, further comprising:
receiving a plug-in deletion request submitted by the user, wherein the plug-in deletion request comprises a plug-in identifier;
and uninstalling the functional plug-in corresponding to the plug-in identification from each functional plug-in.
3. The method of claim 1, further comprising:
receiving a plug-in adding request submitted by the user, wherein the plug-in adding request comprises plug-in installation data and a data flow direction pointer;
installing a new functional plug-in according to the plug-in installation data;
and determining the operation sequence of the new functional plug-in according to the data flow direction pointer corresponding to each functional plug-in and the data flow direction pointer corresponding to the new functional plug-in.
4. The method of claim 1, further comprising:
receiving a plug-in adjustment request submitted by the user, wherein the plug-in adjustment request comprises a plug-in identifier and a new data flow direction pointer;
updating the data flow direction pointer of the functional plug-in corresponding to the plug-in identification to be the new data flow direction pointer;
and re-determining the running sequence of each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in after the updating operation.
5. A multimedia processing device is characterized in that each processing function plug-in a multimedia framework is converted into a unified interface, the unified interface is provided for each function plug-in, the function plug-ins are unified and standardized, the function plug-ins can be plugged and used at any time, and the function plug-ins which are not needed can be conveniently unloaded; incorporating a plurality of functional plug-ins for processing multimedia data into a multimedia processing frame capable of stretching, cutting and expanding, and forming a uniform Software Development Kit (SDK) for a user to develop; when a user needs to process multimedia data by using the multimedia framework, selecting one or more required functional plugins from a plurality of functional plugins provided by the multimedia framework, and setting a data flow direction pointer for each selected functional plugin; the device comprises:
the plug-in acquisition module is used for acquiring at least one functional plug-in selected by a user and a data flow direction pointer corresponding to each functional plug-in;
the multimedia acquisition module is used for acquiring multimedia data;
the multimedia processing module is used for processing the multimedia data through each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in; the multimedia processing framework provides a uniform interface for each functional plug-in, and a processing result after the last functional plug-in is processed is automatically transmitted to the next functional plug-in for processing;
the multimedia processing module is used for determining the operation sequence of each functional plug-in according to the data flow direction pointer corresponding to each functional plug-in; sequentially operating each functional plug-in to process the multimedia data according to the data flow direction pointer corresponding to each functional plug-in and the operation sequence of each functional plug-in;
the multimedia processing module is used for processing the multimedia data through the functional plug-ins arranged at the head in the running sequence to obtain a first intermediate processing result; transmitting the first intermediate processing result to a next-stage functional plug-in unit indicated by a data flow direction pointer of the first-order functional plug-in unit for processing to obtain a second intermediate processing result; and transmitting the second intermediate processing result to the functional plug-in indicated by the data flow pointer of the next-stage functional plug-in for processing until the functional plug-in with the last operation sequence finishes the processing operation, and obtaining a final processing result corresponding to the multimedia data.
6. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor executes the computer program to implement the method of any one of claims 1-4.
7. A computer-readable storage medium, on which a computer program is stored, characterized in that the program is executed by a processor to implement the method according to any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010252389.4A CN111562945B (en) | 2020-04-01 | 2020-04-01 | Multimedia processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010252389.4A CN111562945B (en) | 2020-04-01 | 2020-04-01 | Multimedia processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111562945A CN111562945A (en) | 2020-08-21 |
| CN111562945B true CN111562945B (en) | 2021-12-21 |
Family
ID=72071400
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010252389.4A Active CN111562945B (en) | 2020-04-01 | 2020-04-01 | Multimedia processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111562945B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112866814A (en) * | 2020-12-30 | 2021-05-28 | 广州虎牙科技有限公司 | Audio and video processing method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102055683A (en) * | 2009-10-30 | 2011-05-11 | 腾讯科技（深圳）有限公司 | Method, device and system for sharing music data |
| CN102279711A (en) * | 2011-08-09 | 2011-12-14 | 青岛海信网络科技股份有限公司 | Plug-in-based real-time data storage method and device |
| CN103414959A (en) * | 2013-07-15 | 2013-11-27 | 北京奇虎科技有限公司 | Method and device for accelerating online video playing |
| CN110489593A (en) * | 2019-08-20 | 2019-11-22 | 腾讯科技（深圳）有限公司 | Topic processing method, device, electronic equipment and the storage medium of video |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080134012A1 (en) * | 2006-11-30 | 2008-06-05 | Sony Ericsson Mobile Communications Ab | Bundling of multimedia content and decoding means |
| CN102006311A (en) * | 2010-12-28 | 2011-04-06 | 青岛海信网络科技股份有限公司 | Streaming media multifunctional distributing system and method |
| US8706473B2 (en) * | 2011-09-13 | 2014-04-22 | Cisco Technology, Inc. | System and method for insertion and removal of video objects |
| CN102789719A (en) * | 2012-07-09 | 2012-11-21 | 柳州桂通科技有限公司 | Diver sight line recognition instrument in road driving skill test process and realizing method thereof |
| US9793658B2 (en) * | 2014-06-01 | 2017-10-17 | Apple Inc. | Reuse of plug detection contacts to reduce crosstalk |
| CN105072507B (en) * | 2015-07-24 | 2019-01-25 | 南京信通科技有限责任公司 | A kind of transmission method and system of multi-medium data |
| CN109697072A (en) * | 2018-11-09 | 2019-04-30 | 长沙市到家悠享家政服务有限公司 | Information processing method, device and equipment |
| CN110515673B (en) * | 2019-07-24 | 2022-10-11 | 百度在线网络技术（北京）有限公司 | Plug-in system and method thereof |
-
2020
- 2020-04-01 CN CN202010252389.4A patent/CN111562945B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102055683A (en) * | 2009-10-30 | 2011-05-11 | 腾讯科技（深圳）有限公司 | Method, device and system for sharing music data |
| CN102279711A (en) * | 2011-08-09 | 2011-12-14 | 青岛海信网络科技股份有限公司 | Plug-in-based real-time data storage method and device |
| CN103414959A (en) * | 2013-07-15 | 2013-11-27 | 北京奇虎科技有限公司 | Method and device for accelerating online video playing |
| CN110489593A (en) * | 2019-08-20 | 2019-11-22 | 腾讯科技（深圳）有限公司 | Topic processing method, device, electronic equipment and the storage medium of video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111562945A (en) | 2020-08-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112667426B (en) | Log analysis method and device | |
| CN111935622B (en) | Debugging method, device, equipment and storage medium for electronic equipment with digital power amplifier | |
| CN111562945B (en) | Multimedia processing method, device, equipment and storage medium | |
| CN112181522A (en) | Data processing method and device and electronic equipment | |
| CN111124480B (en) | Method and device for generating application program package, electronic equipment and storage medium | |
| CN108536489B (en) | Method, apparatus, and computer-readable storage medium for matching resource environments | |
| CN110717050B (en) | Knowledge graph database access method and device | |
| CN111208933A (en) | Data access method, device, equipment and storage medium | |
| CN111858359B (en) | Method and device for acquiring engineering code position of executable file | |
| CN111246214B (en) | Video decoding method and device | |
| CN113760242A (en) | Data processing method, device, server and medium | |
| CN109558403B (en) | Data aggregation method and device, computer device and computer readable storage medium | |
| US10659321B2 (en) | Electronic apparatus for recording debugging information and control method thereof | |
| US7952499B1 (en) | Random access in run-length encoded structures | |
| CN111443920B (en) | Frame migration method and device | |
| US9436587B2 (en) | Test context generation | |
| CN107704340B (en) | PE mirror image file generation method and device and electronic equipment | |
| CN112818007B (en) | Data processing method and device and readable storage medium | |
| CN112181538B (en) | Diagnostic flow execution method, device, equipment and storage medium | |
| CN109783133B (en) | Code packaging method and device, computer equipment and storage medium | |
| CN113535338A (en) | Interaction method, system, storage medium and electronic device for data access | |
| CN113741878A (en) | GraphQL-based interface construction method and system, electronic equipment and storage medium | |
| CN114253828A (en) | Method and device for determining test template, computing equipment and storage medium | |
| CN114443375A (en) | Test method and device, electronic device and computer readable storage medium | |
| CN108255534B (en) | PC (personal computer) end application processing method, processing device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |