CN115757838A - Multimedia data processing method, system, device and nonvolatile storage medium - Google Patents
Multimedia data processing method, system, device and nonvolatile storage medium Download PDFInfo
- Publication number
- CN115757838A CN115757838A CN202211521146.1A CN202211521146A CN115757838A CN 115757838 A CN115757838 A CN 115757838A CN 202211521146 A CN202211521146 A CN 202211521146A CN 115757838 A CN115757838 A CN 115757838A
- Authority
- CN
- China
- Prior art keywords
- sub
- parameter information
- unit
- determining
- function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The application discloses a multimedia data processing method, a system, a device and a nonvolatile storage medium. Wherein, the method comprises the following steps: receiving multimedia source data and determining a plurality of project files corresponding to the multimedia source data; determining a plurality of sub-function units corresponding to each of a plurality of function units corresponding to a plurality of project files, and determining input parameter information, output parameter information and sub-function unit characteristic information of the sub-function units; determining the incidence relation among the sub-function units according to the input parameter information, the output parameter information and the feature information of the sub-function units; and combining the sub-functional units according to the association relation to generate a combined result. The method and the device solve the technical problem that the flexibility of processing the multimedia data is low due to the fact that the multimedia data are processed based on the fixed template in the prior art.
Description
Technical Field
The present application relates to the field of audio/video communication technologies, and in particular, to a multimedia data processing method, system, device, and non-volatile storage medium.
Background
Audio and video systems, namely, voice systems and video systems. On the basis of voice, the method can be divided into one-to-one voice, multicast talkback, voice conference and the like. The video is divided into one-to-one video call, video conference, video broadcast, video live broadcast and the like. These audio-video services are subdivided into different functional units. For example, for video monitoring, there are functional points of video recording and video viewing. For voice calls, there are functional points for call setup and hold-up. Some audio and video systems also require information interaction and other functions. The information technologies provide high-quality experience for the majority of users and improve the communication capacity of the users. For the audio and video service, a user can trigger different functions at different time points, but no entity stores the audio and video data making process in the process.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the application provides a multimedia data processing method, a system, a device and a nonvolatile storage medium, which at least solve the technical problem of low flexibility in processing multimedia data caused by processing the multimedia data based on a fixed template in the prior art.
According to an aspect of an embodiment of the present application, there is provided a multimedia data processing method, including: receiving multimedia source data and determining a plurality of project files corresponding to the multimedia source data, wherein each project file at least corresponds to one functional unit which is used for carrying out different processing modes on the multimedia source data; determining a plurality of sub-function units corresponding to each of a plurality of function units corresponding to a plurality of project files, and determining input parameter information, output parameter information and feature information of the sub-function units; determining the incidence relation among the sub-function units according to the input parameter information, the output parameter information and the feature information of the sub-function units; and combining the sub-functional units according to the association relation to generate a combined result.
Optionally, determining an association relationship between the sub-function units according to the input parameter information, the output parameter information, and the feature information of the sub-function units, includes: determining output parameter information of the first sub-function unit according to the input parameter information and the sub-function unit characteristic information of the first sub-function unit; and determining the output parameter information of the first sub-function unit as the input parameter information of the second sub-function unit, and determining the output parameter information of the second sub-function unit according to the input parameter information of the second sub-function unit and the feature information of the sub-function unit.
Optionally, the number of the input parameter information and the output parameter information is one or more.
Optionally, after generating the combined result, the method further includes: and storing the combined result as a file in a target format.
Optionally, combining the sub-functional units according to the association relationship to generate a combined result, including: receiving a target instruction for dragging the sub-functional unit; and responding to the target instruction, combining the sub-functional units according to the incidence relation to generate a combined result, and displaying the combined result in the engineering drawing board.
Optionally, the functional unit comprises at least one of: the system comprises a voice function unit, an intercom function unit and a video function unit; in case the functional unit is a speech functional unit, the sub-functional unit comprises at least one of: the system comprises a voice login unit, a voice dialing unit, a voice answering processing unit, a voice conversation filtering unit, a voice communication unit and a voice hanging-up unit.
According to another aspect of the embodiments of the present application, there is also provided a multimedia data processing system, including: server and client, wherein, the server includes: the system comprises a signaling server, a media server and a state server, wherein the signaling server is connected with the media server, the state server and a client and is used for sending multimedia source data to the client and sending historical operation information to the state server; the media server is connected with the signaling server, the state server and the client and is used for recording and storing multimedia source data; the state server is connected with the signaling server, the media server and the client and used for processing the historical operation information sent by the state server and storing the processed historical operation information; and the client is used for executing the multimedia data processing method.
According to still another aspect of the embodiments of the present application, there is also provided a non-volatile storage medium, where the storage medium includes a stored program, and the program is configured to control a device in which the storage medium is located to execute the above multimedia data processing method when running.
According to still another aspect of the embodiments of the present application, there is also provided an electronic device, including: a memory and a processor for running a program stored in the memory, wherein the program when running performs the above multimedia data processing method.
In the embodiment of the application, multimedia source data is received, and a plurality of project files corresponding to the multimedia source data are determined, wherein each project file at least corresponds to one functional unit, and the functional units are used for performing different processing modes on the multimedia source data; determining a plurality of sub-function units corresponding to each of a plurality of function units corresponding to a plurality of project files, and determining input parameter information, output parameter information and sub-function unit characteristic information of the sub-function units; determining the incidence relation among the sub-function units according to the input parameter information, the output parameter information and the feature information of the sub-function units; the functional units are combined by determining the association relationship among the functional units according to the input parameter information, the output parameter information and the functional unit information of the functional units in a manner of combining the sub-functional units according to the association relationship to generate a combined result, so that the purpose of freely combining the functional units is achieved, the technical effect of flexibly processing multimedia data is realized, and the technical problem of low flexibility in processing the multimedia data caused by processing the multimedia data based on a fixed template in the prior art is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 is a flow chart of a method of multimedia data processing according to an embodiment of the present application;
FIG. 2 is a block diagram of a multimedia data processing system according to an embodiment of the present application;
FIG. 3 is a block diagram of a multimedia data processing apparatus according to an embodiment of the present application;
fig. 4 is a block diagram of a hardware structure of a computer terminal (or an electronic device) according to a multimedia data processing method provided in an embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In accordance with an embodiment of the present application, there is provided a method embodiment of a method for multimedia data processing, it being noted that the steps illustrated in the flowchart of the drawings may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than that presented herein.
Fig. 1 is a flowchart of a multimedia data processing method according to an embodiment of the present application, as shown in fig. 1, the method including the steps of:
step S102, receiving multimedia source data, and determining a plurality of project files corresponding to the multimedia source data, wherein each project file corresponds to at least one functional unit, and the functional units are used for processing the multimedia source data in different modes.
The multimedia source data comprises text, graphics, images, sound and the like, the multimedia source data corresponds to a plurality of project files, the project files are carriers for saving multimedia source data flow projects, the project files relate to saving and loading, each project file at least corresponds to one functional unit, and the functional units comprise at least one of the following components: the device comprises a voice function unit, an intercom function unit and a video function unit.
Step S104, determining a plurality of sub-function units corresponding to each of a plurality of function units corresponding to a plurality of project files, and determining input parameter information, output parameter information and sub-function unit characteristic information of the sub-function units.
According to another alternative embodiment of the present application, the input parameter information comprises an input source for specifying an input data attribute structure of the functional unit and an input message for making a corresponding action with respect to a certain asynchronous message. The output parameter information comprises an output source and output information, wherein the output source is a structure for generating data after executing the functional units, and the output information is asynchronous information produced after executing different functional units. The sub-functional unit feature information is data information required for executing functions for different functional units.
And step S106, determining the incidence relation among the sub-function units according to the input parameter information, the output parameter information and the feature information of the sub-function units.
In some alternative embodiments of the present application, the functional unit is divided into two parts, one part is input and one part is output, some functional units are complex and may involve multiple input parts, and the output part of the previous functional unit may be used as the input part of the next functional unit.
And S108, combining the sub-functional units according to the association relation to generate a combined result.
The input and output parts of each functional unit can be connected by wires to form a serial structure, and connected by points to form a fixed multimedia data flow process engineering.
In an optional embodiment, the voice function unit includes a voice login unit, a voice dialing unit, a voice answering processing unit, a voice session filtering unit, a voice call unit, and a voice hang-up unit, and the following is an explanation of the voice function unit:
1. voice login unit
Inputting a source- > account object (including information such as an account, a password, a server address and the like);
output source- > voice account object (including account, password, voice service connection status);
output message (incoming call) > receives the event called by other users and carries the conversation object;
outgoing messages (session setup) > carry session objects.
2. Voice dialing unit
Inputting message- > voice login success message;
input source- > voice account object (including account, password, voice service connection status);
unit information- > call number;
outputting information such as source- > session id, opposite terminal number and the like;
output message (listen) - > session establishment, carrying session object information;
output message (reject) - > call number reject event.
3. Voice receiving processing unit
Input message- > incoming call message, carrying session id, session information
Unit information- > whether to answer
4. Voice conversation filtering unit
4.1 session id filter;
input message- > session establishment message;
input source- > session id;
output message- > session setup message (filtered according to session id).
4.2 Filter for number of opposite terminal
Inputting message- > conversation establishing message;
unit information- > opposite terminal number;
output message- > session setup message (filtered according to the peer number).
5. Voice communication unit
Inputting message- > conversation establishing message;
unit information- > speech device information setting:
5.1 media file location;
5.2 voice collection device (microphone information);
setting listening and speaking information:
5.3 saving as a voice file;
5.4 voice playing device (speaker information);
outputting source- > voice session object (session id, session state, opposite terminal number, home terminal number);
and outputting a message (call completion) > hanging up the voice of the opposite end, and finishing the call.
6. Voice hanging-up unit
Input source- > voice session object (session state);
outputting a message (call end) > call end, and receiving a hang-up request by an opposite terminal;
output message (hang up failure) > the opposite end did not receive the hang up request.
According to the steps, the incidence relation among the functional units is determined according to the input parameter information, the output parameter information and the functional unit information of the functional units, and the functional units are combined according to the incidence relation, so that the purpose of freely combining the functional units is achieved, and the technical effect of flexibly processing multimedia data is achieved.
According to an alternative embodiment of the present application, determining the association relationship between the sub-function units according to the input parameter information, the output parameter information and the feature information of the sub-function units comprises the following steps: determining output parameter information of the first sub-function unit according to the input parameter information of the first sub-function unit and the feature information of the sub-function unit; and determining the output parameter information of the first sub-function unit as the input parameter information of the second sub-function unit, and determining the output parameter information of the second sub-function unit according to the input parameter information of the second sub-function unit and the feature information of the sub-function unit.
In some alternative embodiments of the present application, the number of the input parameter information and the output parameter information is one or more.
The functional unit is divided into two parts, one part is input and the other part is output, some functional units are complex and may involve a plurality of input parts, the output part of the previous functional unit can be used as the input part of the next functional unit, the input part and the output part of each functional unit can be connected by a wire to form a serial structure, and a fixed audio-video flow engineering is formed by point connection.
In some optional embodiments of the present application, after generating the combined result, it is further required to: and storing the combined result as a file in a target format.
In the embodiment, an Extensible Markup Language (XML) is used to store the project file, where XML is an Extensible Markup Language, and is capable of effectively describing the definition of each functional unit in the project and describing the connection lines of each functional unit. Extensible markup language is a subset of standard generalized markup language, can be used to tag data, define data types, and is a source language that allows users to define their own markup language. XML is a standard general markup language with good expandability, content and form separation, following strict grammar requirements, good value-keeping and other advantages. In computers, a label means a symbol of information that can be understood by computers, and by this label, various information such as texts can be handled between computers. It can be used to mark data, define data types, and is a source language that allows a user to define his or her own markup language.
In an optional embodiment, the sub-functional units are combined according to the association relationship to generate a combined result, which may be implemented by the following method: receiving a target instruction for dragging the sub-functional unit; and responding to the target instruction, combining the sub-functional units according to the incidence relation to generate a combined result, and displaying the combined result in the engineering drawing board.
According to another alternative embodiment of the application, the functional unit comprises at least one of: the system comprises a voice function unit, an intercom function unit and a video function unit; in case the functional unit is a speech functional unit, the sub-functional unit comprises at least one of: the system comprises a voice login unit, a voice dialing unit, a voice answering processing unit, a voice conversation filtering unit, a voice communication unit and a voice hanging-up unit.
The audio and video flow of the existing audio and video system is initiated by manual operation of a user. The method and the device realize abstraction of the process flow, and can make the functional process flow in the audio and video system into the engineering file. Therefore, instantiation storage of the audio and video flow is realized. The method can realize quick triggering of the process aiming at the stored engineering files, and is applied to emergency plans and audio and video systems.
Fig. 2 is a block diagram of a multimedia data processing system according to an embodiment of the present application, as shown in fig. 2, the system including: a server 202 and a client 204, wherein,
the server 202 includes: a signaling server 2021, a media server 2022, and a state server 2023, wherein,
a signaling server 2021 connected to the media server 2022, the state server 2023 and the client 204, and configured to send multimedia source data to the client 204 and send historical operation information to the state server 2023;
the media server 2022 is connected with the signaling server 2021, the state server 2023 and the client 204 and is used for recording and storing multimedia source data;
the state server 2023 is connected with the signaling server 2021, the media server 2022 and the client 204, and is configured to process the historical operation information sent by the state server 2023 and store the processed historical operation information;
and the client 204 is used for executing the multimedia data processing method.
According to an optional embodiment of the present application, the client includes a mobile terminal client, a computer engineering editor and a computer console, wherein the mobile terminal client interacts with the signaling server, the media server and the status server to generate multimedia source data; the computer engineering editor is interacted with the signaling server, the media server and the state server and is used for processing a plurality of functional units corresponding to the multimedia source data and generating and displaying a processing result; and the computer console is interacted with the signaling server, the media server and the state server and is used for loading and displaying the processing result.
The computer console is a client of the PC end, can load the project files made by the project editor, can interact with the server, and can display the functions of voice, video, information, work order, talkback, position information check and the like.
The engineering editor is connected with a software development kit, wherein the software development kit encapsulates the implementation of basic functions, supports voice, intercom, video, information and other functions. The packaged basic function module can be loaded and used by clients such as an engineering editor, a computer console and the like. The project editor encapsulates the UI of the function unit, abstracts input parameter information, output parameter information, sub-function unit characteristic information and the like, and displays the functions realized by the function unit in a tool box in a visual UI unit mode. The engineering editor receives a target instruction for dragging the sub-functional units, responds to the target instruction, combines the sub-functional units according to the incidence relation, generates a combination result, and displays the combination result in the engineering drawing board.
Fig. 3 is a block diagram of a multimedia data processing apparatus according to an embodiment of the present application, as shown in fig. 3, the apparatus including:
a first determining module 30, configured to receive multimedia source data and determine a plurality of project files corresponding to the multimedia source data, where each project file corresponds to at least one functional unit, and the functional units are configured to perform different processing manners on the multimedia source data;
a second determining module 32, configured to determine a plurality of sub-function units corresponding to each of a plurality of function units corresponding to a plurality of project files, and determine input parameter information, output parameter information, and feature information of the sub-function units;
a third determining module 34, configured to determine an association relationship between the sub-function units according to the input parameter information, the output parameter information, and the feature information of the sub-function units;
and the combination module 36 is used for combining the sub-functional units according to the association relationship to generate a combination result.
It should be noted that each module in fig. 3 may be a program module (for example, a program instruction set for implementing a specific function), or may be a hardware module, and for the latter, it may be represented in the following form, but is not limited to this form: the expression of each of the above modules is a processor, or the function of each of the above modules is implemented by a processor.
Fig. 4 shows a hardware configuration block diagram of a computer terminal (or mobile device) for implementing the multimedia data processing method. As shown in fig. 4, the computer terminal 40 (or mobile device 40) may include one or more (shown as 402a, 402b, \8230;, 402 n) processors 402 (processor 402 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), memory 404 for storing data, and a transmission module 406 for communication functions. In addition, the method can also comprise the following steps: a display, an input/output interface (I/O interface), a Universal Serial BUS (USB) port (which may be included as one of the ports of the BUS), a network interface, a power source, and/or a camera. It will be understood by those skilled in the art that the structure shown in fig. 4 is only an illustration and is not intended to limit the structure of the electronic device. For example, the computer terminal 40 may also include more or fewer components than shown in FIG. 4, or have a different configuration than shown in FIG. 4.
It should be noted that the one or more processors 402 and/or other data processing circuitry described above may be referred to generally herein as "data processing circuitry". The data processing circuitry may be embodied in whole or in part in software, hardware, firmware, or any combination thereof. Further, the data processing circuit may be a single stand-alone processing module, or incorporated in whole or in part into any of the other elements in the computer terminal 40 (or mobile device). As referred to in the embodiments of the application, the data processing circuit acts as a processor control (e.g. selection of variable resistance termination paths connected to the interface).
The memory 404 may be used to store software programs and modules of application software, such as program instructions/data storage devices corresponding to the multimedia data processing method in the embodiment of the present application, and the processor 402 executes the software programs and modules stored in the memory 404 to execute various functional applications and data processing, that is, to implement the multimedia data processing method described above. The memory 404 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 404 may further include memory located remotely from the processor 402, which may be connected to the computer terminal 40 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission module 406 is used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal 40. In one example, the transmission module 406 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission module 406 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
The display may be, for example, a touch screen type Liquid Crystal Display (LCD) that may enable a user to interact with a user interface of the computer terminal 40 (or mobile device).
It should be noted that, in some alternative embodiments, the computer device (or electronic device) shown in fig. 4 may include hardware elements (including circuitry), software elements (including computer code stored on a computer-readable medium), or a combination of both hardware and software elements. It should be noted that fig. 4 is only one example of a particular specific example and is intended to illustrate the types of components that may be present in the computer device (or electronic device) described above.
It should be noted that the electronic device shown in fig. 4 is used for executing the multimedia data processing method shown in fig. 1, and therefore the explanation of the command execution method is also applicable to the electronic device, and is not repeated here.
The embodiment of the application also provides a nonvolatile storage medium, which comprises a stored program, wherein when the program runs, the device where the storage medium is located is controlled to execute the multimedia data processing method.
The nonvolatile storage medium executes a program for: receiving multimedia source data and determining a plurality of project files corresponding to the multimedia source data, wherein each project file at least corresponds to one functional unit which is used for carrying out different processing modes on the multimedia source data; determining a plurality of sub-function units corresponding to each of a plurality of function units corresponding to a plurality of project files, and determining input parameter information, output parameter information and feature information of the sub-function units; determining the incidence relation among the sub-function units according to the input parameter information, the output parameter information and the feature information of the sub-function units; and combining the sub-functional units according to the association relation to generate a combined result.
An embodiment of the present application further provides an electronic device, including: a memory and a processor for running a program stored in the memory, wherein the program when running performs the above multimedia data processing method.
The processor is used for running a program for executing the following functions: receiving multimedia source data and determining a plurality of project files corresponding to the multimedia source data, wherein each project file at least corresponds to one functional unit which is used for carrying out different processing modes on the multimedia source data; determining a plurality of sub-function units corresponding to each of a plurality of function units corresponding to a plurality of project files, and determining input parameter information, output parameter information and sub-function unit characteristic information of the sub-function units; determining the incidence relation among the sub-function units according to the input parameter information, the output parameter information and the feature information of the sub-function units; and combining the sub-functional units according to the association relation to generate a combined result.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present application, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technical content can be implemented in other manners. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed coupling or direct coupling or communication connection between each other may be an indirect coupling or communication connection through some interfaces, units or modules, and may be electrical or in other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, in essence or part of the technical solutions contributing to the related art, or all or part of the technical solutions, may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.
Claims (10)
1. A method for processing multimedia data, comprising:
receiving multimedia source data and determining a plurality of project files corresponding to the multimedia source data, wherein each project file at least corresponds to one functional unit which is used for carrying out different processing modes on the multimedia source data;
determining a plurality of sub-function units corresponding to each of a plurality of function units corresponding to the plurality of project files, and determining input parameter information, output parameter information and sub-function unit characteristic information of the sub-function units;
determining the incidence relation among the sub-function units according to the input parameter information, the output parameter information and the feature information of the sub-function units;
and combining the sub-functional units according to the incidence relation to generate a combined result.
2. The method of claim 1, wherein determining the association between the sub-functional units according to the input parameter information, the output parameter information, and the sub-functional unit feature information of the sub-functional units comprises:
determining output parameter information of a first sub-function unit according to input parameter information and sub-function unit characteristic information of the first sub-function unit;
and determining the output parameter information of the first sub-function unit as the input parameter information of a second sub-function unit, and determining the output parameter information of the second sub-function unit according to the input parameter information of the second sub-function unit and the feature information of the sub-function unit.
3. The method according to claim 1 or 2, characterized in that the number of the input parameter information and the output parameter information is one or more.
4. The method of claim 1, wherein after generating the combined result, the method further comprises: and storing the combined result as a file in a target format.
5. The method of claim 1, wherein combining the sub-functional units according to the association to generate a combined result comprises:
receiving a target instruction for dragging the sub-functional unit;
and responding to the target instruction, combining the sub-functional units according to the incidence relation to generate a combined result, and displaying the combined result in an engineering drawing board.
6. The method of claim 1,
the functional unit includes at least one of: the system comprises a voice function unit, an intercom function unit and a video function unit;
in the case that the functional unit is the voice functional unit, the sub-functional unit includes at least one of: the system comprises a voice login unit, a voice dialing unit, a voice answering processing unit, a voice conversation filtering unit, a voice communication unit and a voice hanging-up unit.
7. A multimedia data processing system, comprising: a server and a client, wherein,
the server includes: a signaling server, a media server, and a state server, wherein,
the signaling server is connected with the media server, the state server and the client, and is used for sending multimedia source data to the client and sending historical operation information to the state server;
the media server is connected with the signaling server, the state server and the client and is used for recording and storing the multimedia source data;
the state server is connected with the signaling server, the media server and the client, and is used for processing the historical operation information sent by the state server and storing the processed historical operation information;
the client, configured to execute the multimedia data processing method according to any one of claims 1 to 6.
8. A multimedia data processing apparatus, comprising:
a first determining module, configured to receive multimedia source data and determine multiple project files corresponding to the multimedia source data, where each project file corresponds to at least one functional unit, and the functional units are configured to perform different processing manners on the multimedia source data;
the second determining module is used for determining a plurality of sub-function units corresponding to each of a plurality of function units corresponding to the plurality of project files, and determining input parameter information, output parameter information and feature information of the sub-function units;
the third determining module is used for determining the incidence relation among the sub-function units according to the input parameter information, the output parameter information and the feature information of the sub-function units;
and the combination module is used for combining the sub-functional units according to the incidence relation to generate a combination result.
9. A non-volatile storage medium, comprising a stored program, wherein when the program is executed, a device in which the non-volatile storage medium is located is controlled to execute the multimedia data processing method according to any one of claims 1 to 6.
10. An electronic device, comprising: a memory and a processor for executing a program stored in the memory, wherein the program when executed performs the multimedia data processing method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211521146.1A CN115757838A (en) | 2022-11-30 | 2022-11-30 | Multimedia data processing method, system, device and nonvolatile storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211521146.1A CN115757838A (en) | 2022-11-30 | 2022-11-30 | Multimedia data processing method, system, device and nonvolatile storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115757838A true CN115757838A (en) | 2023-03-07 |
Family
ID=85341269
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211521146.1A Pending CN115757838A (en) | 2022-11-30 | 2022-11-30 | Multimedia data processing method, system, device and nonvolatile storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115757838A (en) |
-
2022
- 2022-11-30 CN CN202211521146.1A patent/CN115757838A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109347934B (en) | Message pushing method and system, server, storage medium and electronic device | |
| CN110602681B (en) | Information processing method and electronic device | |
| CN107342083B (en) | Method and apparatus for providing voice service | |
| CN108965109B (en) | Instant messaging control method, device and storage medium | |
| US20190068734A1 (en) | Notification api for external identification | |
| CN105430317B (en) | A kind of video background setting method and terminal device | |
| US10848928B2 (en) | Method for dynamic filtering of a group communication | |
| CN111510564A (en) | Data processing method, device and medium based on interactive voice response system | |
| CN110602683B (en) | Bluetooth control method, device, mobile terminal and storage medium | |
| KR100718011B1 (en) | System and Method for Providing Supplement Information classified by Broadcasting Program | |
| US7701930B2 (en) | Technique for providing virtual N-way video conferencing to IP videophones | |
| CN105120524A (en) | Method for establishing communication connection and electronic device | |
| CN109151607B (en) | Live broadcast channel multi-public-screen information display method, public-screen server and client | |
| CN105491223B (en) | Information processing method, related equipment and system | |
| CN115757838A (en) | Multimedia data processing method, system, device and nonvolatile storage medium | |
| CN113452948B (en) | Conference terminal control method, device, equipment and storage medium | |
| CN109947528A (en) | Information processing method and device | |
| US20190068771A1 (en) | External device for communicating with conferencing client using notification api | |
| CN202334590U (en) | Application server of multiparty multi-media communication system | |
| CN111556271B (en) | Video call method, video call device and electronic equipment | |
| CN114500129A (en) | Information processing method and electronic equipment | |
| EP2287725A2 (en) | Video window with integrated content | |
| CN208094697U (en) | Video conferencing system | |
| CN111132017B (en) | Communication method of communication terminal, electronic equipment and storage medium | |
| KR20090108251A (en) | Method and system for providing message service, method and mobile communication terminal for receiving message in mobile communication system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |