CN118075243A

CN118075243A - Media task stream processing method, device, equipment and storage medium

Info

Publication number: CN118075243A
Application number: CN202410151608.8A
Authority: CN
Inventors: 张超; 陈靖
Original assignee: Shuhang Technology Beijing Co ltd
Current assignee: Shuhang Technology Beijing Co ltd
Priority date: 2024-02-02
Filing date: 2024-02-02
Publication date: 2024-05-24

Abstract

The embodiment of the application discloses a processing method, a device, equipment and a storage medium of a media task stream, wherein the processing method of the media task stream comprises the following steps: receiving a task stream request sent by a client, wherein the request comprises a trigger source identifier and media data, acquiring a target trigger source corresponding to the trigger source identifier, the target trigger source comprises a plurality of trigger configuration information, each trigger configuration information comprises task parameters, different trigger configuration information corresponds to different media task streams, each media task stream comprises a plurality of media tasks, a plurality of trigger configuration information meeting preset trigger conditions is determined from the plurality of trigger configuration information, and for each trigger configuration information meeting the preset trigger conditions, a plurality of media tasks in the media task stream corresponding to each trigger configuration information are called to perform corresponding processing on the media data based on the task parameters, so that an execution result is obtained. The method realizes the simultaneous triggering of a plurality of media task flows and fully improves the data processing efficiency.

Description

Media task stream processing method, device, equipment and storage medium

Technical Field

The present invention relates to the field of the internet, and in particular, to a method, an apparatus, a device, and a storage medium for processing a media task stream.

Background

A complete business data processing flow is usually composed of a large number of task units, time-sequence and front-back dependency relations exist among the task units, a media task stream can define task units to be executed and relations among the task units so that media data can be processed according to the definition of the media task stream, in order to adapt to various business scenes, the media task stream needs to be continuously improved and optimized, namely, the relations of the task units and the called task units in the media task stream need to be adjusted, each time the adjustment can form a media task stream version, at present, generally after corresponding requests are received, each task unit and related needed parameters are manually set by a user to form a media task stream, then corresponding data processing is executed according to the media task stream, and the data processing efficiency is low because each time the user needs to manually set and only one media task stream can be triggered at one time.

Disclosure of Invention

The technical problem to be solved by the embodiment of the invention is to provide a processing method, a device, equipment and a storage medium for media task streams, which realize the simultaneous triggering of a plurality of media task streams and fully improve the data processing efficiency.

In a first aspect, an embodiment of the present invention provides a method for processing a media task stream, including:

Receiving a task flow request sent by a client, wherein the task flow request comprises a trigger source identifier and media data, the task flow request is generated by the client in response to a preset media operation, and the preset media operation corresponds to the trigger source identifier;

Acquiring a target trigger source corresponding to the trigger source identifier, wherein the target trigger source comprises a plurality of trigger configuration information, each trigger configuration information comprises a task parameter, the task parameters in different trigger configuration information are different, different trigger configuration information corresponds to different media task flows, and each media task flow comprises a plurality of media tasks;

determining a plurality of trigger configuration information meeting a preset trigger condition from the plurality of trigger configuration information;

and calling a plurality of media tasks in the media task stream corresponding to each trigger configuration information according to each trigger configuration information in the plurality of trigger configuration information meeting the preset trigger conditions, and correspondingly processing the media data based on the task parameters to obtain an execution result of the media data.

It can be seen that in the embodiment of the present application, a task flow request sent by a client is received, where the task flow request includes a trigger source identifier and service data, a target trigger source corresponding to the trigger source identifier is obtained, the target trigger source includes multiple trigger configuration information, each trigger configuration information includes a task parameter, task parameters in different trigger configuration information are different, different trigger configuration information corresponds to different media task flows, and each media task flow includes multiple media tasks, so that multiple trigger configuration information meeting a preset trigger condition can be determined from the multiple trigger configuration information, and for each trigger configuration information meeting the preset trigger condition, multiple media tasks in the media task flow corresponding to each trigger configuration information are invoked to perform corresponding processing on the media data based on the task parameters, so as to implement triggering multiple media task flows simultaneously for one task flow request, thereby fully improving data processing efficiency.

In an optional implementation manner, each task parameter includes an output address of a media task stream corresponding to trigger configuration information to which each task parameter belongs;

the step of calling the plurality of media tasks in the media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters, and after obtaining the execution result of the media data, further comprises the steps of:

acquiring an output address contained in the task parameter in each trigger configuration information;

And sending the execution result of the media data to the execution result pointed by the acquired output address to flow into the access node.

In an alternative embodiment, each trigger configuration information includes configuration version information;

The step of calling a plurality of media tasks in the media task stream corresponding to each trigger configuration information according to each trigger configuration information in the plurality of trigger configuration information meeting the preset trigger conditions to perform corresponding processing on the media data based on the task parameters to obtain an execution result of the media data, and determining a plurality of trigger configuration information meeting the preset trigger conditions from the plurality of trigger configuration information, wherein the step of determining the trigger configuration information meeting the preset trigger conditions comprises the following steps:

determining that first trigger configuration information exists in the plurality of trigger configuration information meeting preset trigger conditions, wherein the configuration version information included in the first trigger configuration information is test version information;

Determining target version information of a first media task stream corresponding to the first trigger configuration information according to the test version information in the first trigger configuration information; the target version information is used for indicating the media tasks called by the first media task stream in the process of processing the media data and the execution sequence of each called media task;

and calling the first media task stream to process the media data based on the task parameters in the first trigger configuration information and the media tasks indicated by the target version information of the first media task stream, so as to obtain an execution result of the media data.

In an optional implementation manner, determining, according to the test version information in the first trigger configuration information, target version information of the first media task stream corresponding to the first trigger configuration information includes:

generating a first random number according to a preset test hit rate through a first random number generator;

If the first random number is located in a first preset interval, determining the test version information as the target version information;

And if the first random number is located in a second preset interval, acquiring the last released version information corresponding to the test version information, and determining the last released version information as the target version information.

In an alternative embodiment, the method further comprises:

and determining that second trigger configuration information exists in the plurality of trigger configuration information meeting the preset trigger conditions, wherein the configuration version information included in the second trigger configuration information is released version information, and determining the released version information as target version information of a second media task stream corresponding to the second trigger configuration information.

In an alternative embodiment, the target trigger source includes at least one trigger group, each trigger group including at least one trigger configuration information;

After the target trigger source corresponding to the trigger source identifier is obtained, the method further comprises:

Traversing at least one trigger configuration information in any trigger group aiming at any trigger group, and ending the traversal of any trigger group if the currently traversed trigger configuration information meets the preset trigger condition;

and determining the trigger configuration information of the current traversal as one trigger configuration information in the at least one trigger configuration information.

In an alternative embodiment, each trigger group includes at least one trigger group, each trigger group includes at least one trigger configuration information, the priorities of the trigger configuration information included in the same trigger group are the same, and the priorities of the trigger configuration information included in different trigger groups are different;

traversing at least one trigger configuration information in any trigger group, and if the currently traversed trigger configuration information meets the preset trigger condition, ending the traversing of any trigger group, wherein the method comprises the following steps:

Traversing at least one trigger subgroup according to the priority order of trigger configuration information contained in the at least one trigger subgroup included in any trigger subgroup;

if the trigger configuration information meeting the preset trigger conditions exists in the currently traversed trigger subgroup, and each trigger configuration information meeting the preset trigger conditions in the currently traversed trigger subgroup is determined, the traversal of any trigger subgroup is finished.

In an alternative embodiment, the task flow request further includes a client identification of the client;

Invoking a plurality of media tasks in the media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters to obtain an execution result of the media data, wherein the method comprises the following steps:

acquiring an identification library corresponding to each preset configuration strategy in at least one preset configuration strategy;

Aiming at any preset configuration strategy, if the client identifier exists in an identifier library corresponding to the any preset configuration strategy, acquiring configuration parameters of the any preset configuration strategy;

and calling a plurality of media tasks in the media task stream corresponding to each piece of trigger configuration information to process the media data based on the task parameters and the configuration parameters, and obtaining an execution result of the media data.

In an alternative embodiment, after receiving the task flow request sent by the client, the method further includes:

generating a hash value of the task flow request;

comparing the hash value of each historical task flow request in the buffer area with the generated hash value, and deleting the task flow request if the generated hash value exists in the buffer area.

In an alternative embodiment, the method further comprises:

And if the generated hash value exists in the cache region and the task flow request comprises service execution indication information, triggering and executing the step of acquiring the target trigger source corresponding to the trigger source identifier.

In an alternative embodiment, each trigger configuration information further includes a node hit rate;

for each trigger configuration information in the plurality of trigger configuration information meeting the preset trigger conditions, invoking a plurality of media tasks in a media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters, so as to obtain an execution result of the media data, wherein the method comprises the following steps:

Generating a second random number corresponding to each piece of trigger configuration information according to the node hit rate in each piece of trigger configuration information through a second random number generator aiming at each piece of trigger configuration information in the plurality of pieces of trigger configuration information meeting preset trigger conditions;

determining a media processing node corresponding to a preset interval to which the second random number belongs; the media processing node is provided with a plurality of media tasks in the media task stream corresponding to each piece of trigger configuration information;

And sending the task parameters in each piece of trigger configuration information to the media processing node so that the media processing node can correspondingly process the media data based on the task parameters in each piece of trigger configuration information through a plurality of media tasks in the media task stream corresponding to each piece of trigger configuration information to obtain an execution result of the service data.

Determining a theme corresponding to the trigger source identifier in the task flow request according to the corresponding relation between the trigger source identifier and the theme;

Searching a storage interval corresponding to the determined theme from a plurality of storage intervals contained in the message queue; different storage intervals correspond to different topics;

storing the task flow request to the searched storage interval;

And when the condition of reading the task flow request is met, acquiring the task flow request from the storage interval, and triggering and executing the step of acquiring a target trigger source corresponding to the trigger source identifier.

In a second aspect, an embodiment of the present invention provides a device for processing a media task stream, where the device includes:

The receiving unit is used for receiving a task flow request sent by a client, wherein the task flow request comprises a trigger source identifier and media data, the task flow request is generated by the client in response to a preset media operation, and the preset media operation corresponds to the trigger source identifier;

The acquisition unit is used for acquiring a target trigger source corresponding to the trigger source identifier, the target trigger source comprises a plurality of trigger configuration information, each trigger configuration information comprises task parameters, the task parameters in different trigger configuration information are different, the different trigger configuration information corresponds to different media task flows, and each media task flow comprises a plurality of media tasks;

A determining unit, configured to determine, from the plurality of trigger configuration information, a plurality of trigger configuration information that satisfies a preset trigger condition; and the processing unit is used for calling a plurality of media tasks in the media task stream corresponding to each trigger configuration information according to each trigger configuration information in the plurality of trigger configuration information meeting the preset trigger conditions, and correspondingly processing the media data based on the task parameters to obtain an execution result of the media data.

In a third aspect, an embodiment of the present invention provides a server, where the server includes a memory, a communication interface, and a processor, where the memory, the communication interface, and the processor are connected to each other; the memory stores a computer program and the processor invokes the computer program stored in the memory for implementing the method according to the first aspect.

In a fourth aspect, embodiments of the present invention provide a computer readable storage medium storing a computer program which, when executed by a processor, implements the method of the first aspect.

In a fifth aspect, embodiments of the present invention provide a computer program product comprising computer program code which, when run on a computer, causes the computer to perform the method of the first aspect described above.

In a sixth aspect, an embodiment of the present invention provides a computer program comprising computer program code which, when run on a computer, causes the computer to perform the method of the first aspect described above.

Drawings

In order to more clearly describe the embodiments of the present invention or the technical solutions in the background art, the following description will describe the drawings that are required to be used in the embodiments of the present invention or the background art.

Fig. 1 is a schematic diagram of a system architecture of a method for processing a media task stream according to an embodiment of the present application;

FIG. 2 is a flow chart of a method for processing a media task stream according to the present application;

FIG. 3 is a flowchart of determining trigger configuration information according to an embodiment of the present application;

FIG. 4 is a schematic illustration of a trigger provided by an embodiment of the present application;

FIG. 5 is a centralized platform interface diagram of a method for processing a media task stream according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a system architecture according to an embodiment of the present application;

FIG. 7 is a flowchart illustrating the operation of a media task flow scheduling gateway system according to an embodiment of the present application;

FIG. 8 is a schematic diagram of a processing device for media task flows according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed Description

Embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention.

When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the application. Rather, they are merely examples of apparatus and methods consistent with aspects of the application as detailed in the accompanying claims.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the element defined by the phrase "comprising one … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element, and furthermore, elements having the same name in different embodiments of the application may have the same meaning or may have different meanings, the particular meaning of which is to be determined by its interpretation in this particular embodiment or by further combining the context of this particular embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope herein. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "in response to a determination" depending on the context. Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes," and/or "including" specify the presence of stated features, steps, operations, elements, components, items, categories, and/or groups, but do not preclude the presence, presence or addition of one or more other features, steps, operations, elements, components, items, categories, and/or groups. The terms "or", "and/or", "including at least one of", and the like, as used herein, may be construed as inclusive, or mean any one or any combination. For example, "including at least one of: A. b, C "means" any one of the following: a, A is as follows; b, a step of preparing a composite material; c, performing operation; a and B; a and C; b and C; a and B and C ", again as examples," A, B or C "or" A, B and/or C "means" any of the following: a, A is as follows; b, a step of preparing a composite material; c, performing operation; a and B; a and C; b and C; a and B and C). An exception to this definition will occur only when a combination of elements, functions, steps or operations are in some way inherently mutually exclusive.

It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily occurring in sequence, but may be performed alternately or alternately with other steps or at least a portion of the other steps or stages.

The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrase "if determined" or "if detected (stated condition or event)" may be interpreted as "when determined" or "in response to determination" or "when detected (stated condition or event)" or "in response to detection (stated condition or event), depending on the context.

In the present application, step numbers such as S201 and S202 are adopted, and the purpose of the present application is to more clearly and briefly describe the corresponding content, and not to constitute a substantial limitation on the sequence, and those skilled in the art may execute S202 first and then S201 when implementing the present application, which are all within the scope of the present application.

Before further describing embodiments of the present application, the terms involved in the embodiments of the present application are described as follows.

Task flows, which are an ordered series of tasks, activities, or steps, define, organize, and execute processes according to specific rules and conditions. It describes the sequence of activities, dependencies, data flows, and personnel or system roles involved in a work or business process. Task flows can be used in a variety of fields and industries, including project management, business process management, software development, data processing, manufacturing, and the like. The method can help to automate complex business processes and improve the working efficiency, accuracy and traceability.

The version of the task flow refers to the concept of identifying and managing changes to the task flow definition and logic. When the task flow is modified or adjusted, new functions may be introduced, the task order may be changed, the condition determination may be modified, etc. Each such change can be seen as a new version for recording and managing the evolution history of the task flow. Each version represents a modification or update of the task flow and may include adding, deleting or modifying task nodes, adjusting logic or parameters of the task flow, and the like. A task flow typically includes all task nodes and execution sequences between task nodes. Different task flow versions may identify specific ones of the tasks to be performed and their order of execution.

The version of the task flow can have the released state, the test state or the rollback state, when the version of the task flow is in the released state, the version of the task flow is the released version, the released version is the version of the task flow which is considered to be stable and reliable after full test and verification, and the version ensures normal functions, good performance and suitability for use in a production environment after comprehensive test, quality assurance and verification processes; when the version of the task flow is in a test state, the version of the task flow is a test version, and the test version refers to the version of the task flow which is in the process of testing performance and has normal functions and good performance which are not ensured before release; when the version of the task stream is in the rollback state, the version of the task stream is the rollback version, and the rollback version refers to that the task stream is restored to the previous version, namely the definition and logic of the task stream identified by the rollback version are not used any more.

Trigger sources, which refer to events or conditions that trigger execution of a task flow. The trigger source may be varied depending on the particular application scenario and requirements.

Trigger configuration for defining and configuring rules and conditions for triggering execution of the data processing task flow. By triggering the configuration, it is possible to specify when to launch the task flow, how to trigger the task flow, and the tasks that need to be executed after triggering.

The processing method of the media task stream provided by the embodiment of the application can be applied to Internet products including social platforms, online video platforms and the like. Taking an online video platform as an example, after a client uploads a video, the client can acquire a trigger source identifier corresponding to a preset media operation of uploading the video, then automatically sends a task stream request carrying the video data and the trigger source identifier to a server, after the server receives the task stream request, the server can acquire a target trigger source corresponding to the trigger source identifier, and determines a plurality of trigger configuration information meeting a preset trigger condition from a plurality of trigger configuration information included in the target trigger source, wherein media workflows corresponding to the plurality of trigger configuration information meeting the preset trigger condition can be a video uploading workflow, a video transcoding workflow, a video retrieval and indexing workflow and a video auditing workflow respectively.

Wherein the plurality of media tasks in the video upload workflow may include verifying a video format, storing a video file, and recording metadata;

The plurality of media tasks in the video transcoding workflow may include video decoding, analyzing encoding parameters, transcoding operations;

the plurality of media tasks in the video retrieval and indexing workflow may include extracting video key frames, performing video content analysis, extracting metadata information, and generating a video index;

The plurality of media tasks in the video auditing workflow may include video content identification, assigning videos to human auditors for auditing;

Further, a plurality of media tasks in the video uploading workflow can be called to carry out corresponding processing on video data carried by the task flow request based on task parameters in trigger configuration information corresponding to the video uploading workflow, so that the video data are stored in a designated position in a file form, metadata information related to the video data is recorded, and then a video file obtained by the video uploading workflow can be sent to a video transcoding workflow; invoking a plurality of media tasks in a video transcoding workflow to perform corresponding processing on video data in a video file obtained by the video uploading workflow based on task parameters in trigger configuration information corresponding to the video transcoding workflow, thereby obtaining a transcoded video file, and sending the transcoded video file to a video auditing workflow and a video retrieval and indexing workflow; invoking a plurality of media tasks in a video auditing workflow to perform corresponding processing on video data in the transcoded video file based on task parameters in trigger configuration information corresponding to the video auditing workflow, so as to obtain an auditing result of the transcoded video file; and calling a plurality of media tasks in the video retrieval and index workflow to perform corresponding processing on the video data in the transcoded video file based on the task parameters in the trigger configuration information corresponding to the video retrieval and index workflow, so as to obtain video indexes, key frames, metadata information and the like of the video data in the transcoded video file. It can be understood that if the audit result of the transcoded video file indicates that the audit result passes, the video index, the key frame, the metadata information and the like obtained by the video retrieval and indexing workflow can be sent to other systems, so that the client can obtain the video index through corresponding retrieval operation, and obtain the transcoded video file corresponding to the video index by responding to clicking operation for the video index.

The trigger configuration information indicates related configuration data information of rules and conditions for triggering the execution of the media task stream, the trigger configuration information includes task parameters, the task parameters in the trigger configuration information may include parameters and settings related to the execution of the media task stream, such as execution environment parameters, input and output parameter format settings, output addresses, and the like of each task in the media task stream corresponding to the trigger configuration information, and the task parameters in different trigger configuration information are different.

In order to better understand the processing method of the media task stream provided by the embodiment of the application, a system architecture applicable to the embodiment of the application is described below.

Referring to fig. 1, fig. 1 is a schematic diagram of a system architecture of a method for processing a media task stream according to an embodiment of the present application, where, as shown in fig. 1, the system architecture includes at least one client (e.g., a client 1 or a client 2), at least one data processing platform, and at least one media processing node (e.g., a media processing node 1, a media processing node 2, or a media processing node 3). The client 1 may send a task flow request 1 to a data processing platform, where the task flow request 1 includes an trigger source identifier 1 and media data 1, the data processing platform may send the media data 1 to a media processing node 1 by using a processing method of a media task flow provided by an embodiment of the present application, so that the media processing node processes the media data 1 by using the media task flow 1 determined by using the processing method of the media task flow, and similarly, may send the media data 1 to a media processing node 2, so that the media processing node 2 processes the media data 1 by using the media task flow 2 determined by using the processing method of the media task flow, and similarly, may send the media data 1 to a media processing node 3, so that the media processing node 3 processes the media data 1 by using the media task flow 3 determined by using the processing method of the media task flow.

Wherein, the client may be any of the following: a terminal, a stand-alone application, an application programming interface (Application Programming Interface, API), or a software development kit (Software Development Kit, SDK). Wherein, the terminal may include, but is not limited to: the data processing platform can execute the processing method of the media task stream provided by the embodiment of the application, and the corresponding processing equipment of the data processing platform can be a server, a client or any terminal equipment, etc., wherein the server can be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, and can also be a cloud server for providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content distribution networks (Content Delivery Network, CDNs), big data and artificial intelligent platforms. The media processing node may be a server, a computer cluster, a cloud computing platform, or an edge device, such as an internet of things device, a sensor, an edge server, or the like. The embodiment of the application is not limited.

Referring to fig. 2, fig. 2 is a flow chart of a processing method of a media task stream according to the present application, as shown in fig. 2, the processing method of the media task stream may include steps S201 to S204, where:

S201, receiving a task flow request sent by a client, wherein the task flow request comprises a trigger source identifier and media data.

In one implementation, the task flow request is generated by the client in response to a preset media operation, where the preset media operation corresponds to a trigger source identifier, and the trigger source identifier corresponding to the preset media operation may be set in advance.

Specifically, the client responds to a preset media operation, can acquire a trigger source identifier corresponding to the preset media operation, generates a task stream request, sends the task stream request to the server, determines a theme corresponding to the trigger source identifier in the task stream request according to a corresponding relation between the trigger source identifier and the theme included in the task stream request, searches a storage interval corresponding to the determined theme from a plurality of storage intervals included in a message queue, wherein different storage intervals correspond to different themes, stores the task stream request to the searched storage interval, acquires the task stream request from the storage interval when a condition of reading the task stream request is met, and triggers and executes the step of acquiring a target trigger source corresponding to the trigger source identifier. The condition for reading the task flow request is that the time for storing the task flow request in the storage interval is earlier than any other task flow request in the storage interval.

The server may include a message queue, where the message queue includes a plurality of topics, each topic corresponds to a trigger source identifier, and the client uploads a video as a preset media operation, and when the preset media operation occurs, the client may acquire the trigger source identifier corresponding to the preset media operation, determine a target topic corresponding to the trigger source identifier, and automatically store media data including the preset media operation, that is, video data of the uploaded video and a task flow request of the trigger source identifier, to a storage interval corresponding to the target topic in the message queue.

It is understood that message queues are an asynchronous communication mechanism for transferring messages between different systems or components. It provides a decoupled, asynchronous and reliable way of communication. Common message queue systems include APACHE KAFKA, rabbitMQ and Amazon Simple Queue Service (SQS), and the like. The subject is a logical class or identifier in the message queue that is used to group related messages. Each topic has a unique name that can be created and configured as desired.

Optionally, the task flow request may be actively initiated by an object corresponding to the client, where a trigger source identifier included in the task flow request may be input by the object corresponding to the client.

The object corresponding to the client is actively initiated, which may include RPC trigger or HTTP trigger, wherein RPC (Remote Procedure Call) is a communication protocol and programming model for implementing remote invocation between different computers or processes. It allows programs to communicate and interact between different nodes on the network in a manner similar to local function calls. The RPC triggers the transmission of the task flow request via the RPC. HTTP triggering is a common way to trigger a task flow or remote service through the HTTP (Hypertext Transfer Protocol) protocol. It allows specified data and parameters to be sent via HTTP requests, triggering the execution of backend services. Illustratively, the client may be a software development kit (Software Development Kit, SDK), and the object corresponding to the client may use the SDK to invoke RPC or HTTP input to trigger the source identifier to initiate the task flow request.

In an alternative embodiment, after receiving a task flow request sent by a client, a hash value of the task flow request may be generated, a hash value of each historical task flow request in a buffer area is compared with the generated hash value, and if the generated hash value exists in the buffer area, the task flow request is deleted. The hash value is fixed-length data obtained by calculating input data according to a hash algorithm, and the historical task flow requests refer to all task flow requests received before the system time of the task flow requests sent by the client is received. The hash algorithm may include MD5(Message Digest Algorithm 5)、SHA-1(Secure Hash Algorithm 1)、SHA-256(Secure Hash Algorithm 256-bit)、SHA-3(Secure Hash Algorithm 3)、CRC32(Cyclic Redundancy Check), etc.

Specifically, if a hash value is generated based on MD5, identifying data such as service data included in the task flow request or header information of the task flow request may be extracted from the task flow request sent by the received client, MD5 hash calculation is performed on the identifying data to generate a corresponding hash value, the hash value of each historical task flow request in the buffer is compared with the generated hash value, and if the generated hash value exists in the buffer, the task flow request is deleted.

It can be understood that the buffer zone may perform a deletion operation on the hash value of each historical task flow request buffered in the buffer zone according to a certain preset time, or perform a deletion operation on the hash value of each historical task flow request buffered in the buffer zone when the data volume buffered in the buffer zone reaches a certain preset data volume threshold, so that the hash value generated by the task flow request sent by the received client is compared with the hash value of each historical task flow request in the buffer zone, if the generated hash value exists in the buffer zone, the task flow request is deleted, and the task flow request repeatedly received in a period of time can be deleted, so that the task flow request is only executed once in the period of time, thereby saving a large amount of resources.

Further, if the generated hash value exists in the buffer area and the task flow request includes service execution indication information, the step of acquiring a target trigger source corresponding to the trigger source identifier is triggered to be executed. Optionally, if the task flow request includes the service execution indication information, the step of acquiring the target trigger source corresponding to the trigger source identifier may also be directly triggered and executed, the hash value of the task flow request is not generated, and the hash value of each historical task flow request in the buffer area is compared with the generated hash value.

The service execution indication information is set by an object corresponding to the client, and is used for omitting the step of deleting the repeated received task flow request and forcedly executing the task flow request comprising the service execution indication information.

S202, acquiring a target trigger source corresponding to the trigger source, wherein the target trigger source comprises a plurality of trigger configuration information, each trigger configuration information comprises a task parameter, the task parameters in different trigger configuration information are different, different trigger configuration information corresponds to different media task flows, and each media task flow comprises a plurality of media tasks.

Different trigger configuration information may correspond to different media task flows, task parameters in different trigger configuration information may be different, and the task parameters may include configuration parameters, external data source parameters, and the like, where the configuration parameters include: configuration options and parameters of the media task stream. These parameters may be settings for the media task stream, environment variables, resource limitations, permissions, etc. For example, relevant parameters such as execution timeout time, concurrency, retry strategy, etc. of the task flow may be specified. External data source parameters: if the media task stream requires interaction with an external data source, relevant parameters such as database connection information, API keys, authentication credentials, etc. may be specified. These parameters may be used to access and manipulate external data sources during execution of the media task stream, and embodiments of the application are not limited.

In one embodiment, each trigger configuration information includes configuration version information, where the configuration version information is related parameter information for defining a precedence relationship between a specific task to be executed and each task in a process of calling a media task stream corresponding to the trigger configuration information to process the media data, for example, the media task stream corresponding to the trigger configuration information may be a video processing and transcoding workflow, and a plurality of media tasks in the video processing and transcoding workflow include format conversion, coding parameter setting, resolution adjustment and rate control, and the configuration version information in the trigger configuration information may define that three tasks including format conversion, coding parameter setting and rate control in the video processing and transcoding task stream are sequentially executed on the video data. The configuration version information included in each trigger configuration information is one version information with the setting time closest to the current system time in the trigger configuration information, and the one version information can be test version information or released version information, wherein the test version information indicates that the media workflow version indicated by the version information is in a test state, and the released version information indicates that the media workflow version indicated by the version information is in a released state.

Since each time the media task stream corresponding to the trigger configuration information is modified or adjusted, new functions may be introduced, the task sequence may be changed, the condition for modification may be judged, and each time such modification is completed, the modification may be regarded as a new version, and each version represents a modification or update of the media task stream, so the trigger configuration information may further include historical version information, where the historical version information may include version information corresponding to at least one version of the media task stream corresponding to the trigger configuration information, except for the configuration version information, where the state of the at least one version may be a released state or a rollback state, and the version information corresponding to the at least one version is related parameter information of the at least one version.

It can be understood that, only the version of the media task stream indicated by the version information with the setting time closest to the current system time in the trigger configuration information may be in a test state, if the test version is tested, it is ensured that the function is normal, the performance is good and the media task stream is suitable for use in a production environment, the version state may be changed to be released, if the test version is tested, it is found that the version has abnormal conditions such as a functional defect and a performance problem, and the version state may be changed to be rolled back, that is, the test version information is changed to be rolled back, and the configuration version information of the trigger configuration information is changed to be the released version information with the setting time closest to the rolled back version information.

S203, determining a plurality of trigger configuration information meeting a preset trigger condition from the plurality of trigger configuration information.

The manner of determining the plurality of trigger configuration information satisfying the preset trigger condition from the plurality of trigger configuration information may be described in detail below with reference to fig. 3.

S204, for each trigger configuration information in the plurality of trigger configuration information meeting the preset trigger conditions, calling a plurality of media tasks in the media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters, and obtaining an execution result of the media data.

In one embodiment, each task parameter includes an output address of a media task flow corresponding to trigger configuration information to which each task parameter belongs, so after an execution result of media data is obtained, the output address included in the task parameter in each trigger configuration information may be obtained, and the execution result of the media data may be sent to an execution result pointed by the obtained output address and flows into the access node. The execution result inflow access node may include an electronic device, a data storage address, a database address, a media task stream, or the like corresponding to any client. If the streaming access node is one media task stream, the execution result of the media data can be used as the input of the one media task stream, so that a plurality of media tasks in the one media task stream can correspondingly process the execution result of the media data based on task parameters to obtain another execution result.

In one implementation manner, it is determined that first trigger configuration information exists in a plurality of trigger configuration information meeting a preset trigger condition, the configuration version information included in the first trigger configuration information is test version information, target version information of a first media task stream corresponding to the first trigger configuration information is determined according to the test version information in the first trigger configuration information, the target version information is used for indicating media tasks called by the first media task stream in a processing process of the media data, and execution sequences of each called media task, the first media task stream is called to process the media data based on task parameters in the first trigger configuration information and the media tasks indicated by the target version information of the first media task stream, and execution results of the media data are obtained.

The method for determining the target version information of the first media task stream corresponding to the first trigger configuration information according to the test version information in the first trigger configuration information may be that a first random number is generated by a first random number generator according to a preset test hit rate, if the first random number is located in a first preset interval, the test version information is determined to be the target version information, and if the first random number is located in a second preset interval, the last released version information corresponding to the test version information is obtained, and the last released version information is determined to be the target version information.

If the current configuration version information in one piece of trigger configuration information is test version information, that is, the version of the media task stream corresponding to the trigger configuration information indicated by the test version information is in a test state, the last released version information corresponding to the test version information in the historical version information of the trigger configuration information can be searched, the last released version information is the version information in the last released state, the setting time of which is closest to the setting time of the test version information, in the historical version information, if the preset test hit rate is 10%, the target version information of the media task stream corresponding to the trigger configuration information can be represented as the current configuration information, that is, the test version information, the target version information of the media task stream corresponding to the trigger configuration information is represented as the last released version information corresponding to the test version information with the probability of 90%, a specific determining mode can use a random number generator, for example, a random number between 0 and 100 can be generated, and if the generated random number is less than or equal to 10 (that is, the probability of 10%), the target version information corresponding to the trigger configuration information is the current configuration information, that is the target version information of the media task stream is the test version information; if the generated random number is greater than 10, the target version information of the media task stream corresponding to the trigger configuration information is the last released version information corresponding to the test version information.

Further, determining that second trigger configuration information exists in the plurality of trigger configuration information meeting the preset trigger conditions, wherein the configuration version information included in the second trigger configuration information is released version information, and determining the released version information as target version information of a second media task stream corresponding to the second trigger configuration information. That is, if the configuration version information in the second trigger configuration information is released version information, that is, one version information in the trigger configuration information, the time of which is set to be closest to the current system time, is in a released state, the released version information is determined to be the target version information of the second task flow corresponding to the second trigger configuration information.

It can be understood that by implementing the embodiment, for any media task stream, the any media task stream can trigger different versions according to a preset proportion, so that the version test of any media task stream can be realized, the test version of the media task stream is triggered according to a preset test hit rate, and the stability and adaptability of the system are ensured while the test and evaluation performance of the test version are performed.

In one embodiment, the task flow request further includes a client identifier of the client, an identifier library corresponding to each preset configuration policy in at least one preset configuration policy may be obtained, for any preset configuration policy, if the client identifier exists in the identifier library corresponding to any preset configuration policy, a configuration parameter of the any preset configuration policy is obtained, and a plurality of media tasks in a media task flow corresponding to each trigger configuration information are invoked to process media data based on the task parameter and the configuration parameter, so as to obtain an execution result of the media data. The identifier library corresponding to each preset configuration policy may be used to store a list or a database of client identifiers that execute the preset configuration policy, and each preset configuration policy may include a loudness equalization policy, a forbidden policy of a code stream, and so on.

For example, if a preset configuration policy is a loudness balancing policy, the loudness balancing policy may correspond to a white list and a black list, media task flows triggered by task flow requests sent by clients identified by client identifiers in the white list execute the loudness balancing process, media task flows triggered by task flow requests sent by clients identified by client identifiers in the black list do not execute the loudness balancing process, where the client identifiers in the black list may be set in advance, for example, in a media processing platform, because in some media videos uploaded by objects corresponding to the clients, volumes of different video segments may have a larger difference, so volumes of respective video segments may be balanced through the loudness balancing process, and client identifiers of the clients may be added into the white list; the objects corresponding to part of the clients belong to professionals, the audio requirements for video are higher, for example, professional musicians and the like have strict control over the audio quality, and the loudness balance can destroy the special tone quality and volume requirements of the professional musicians and the like, so that the client identifiers of the objects can be added into a blacklist after the objects are fed back, namely, the loudness balance control is not carried out on the media task stream triggered by the task stream request sent by the client identified by the client identifiers.

Specifically, a blacklist and a whitelist corresponding to the loudness equalization policy may be obtained, if the client identifier exists in the whitelist corresponding to the loudness equalization policy, a configuration parameter of the loudness equalization policy is obtained, a media task stream is called to be based on a task parameter in trigger configuration information corresponding to the media task stream, and the configuration parameter processes the service data to obtain an execution result of the service data. For example, if the media task stream is an audio conversion and post-processing task stream, the audio conversion and post-processing task stream may include the following tasks: the configuration parameters of the loudness equalization can be used in a volume adjustment task to enable the business data to be subjected to loudness equalization processing through a loudness equalization processing module in the volume adjustment task when the business data are processed in the task. And if the client identifier exists in the blacklist corresponding to the loudness balancing strategy, calling the media task stream to process the service data based on the task parameter in the first trigger configuration information and the target version information of the first task stream, and obtaining an execution result of the service data.

If the preset configuration policy is a prohibition policy of the code stream, the prohibition policy of the code stream may correspond to a white list and a black list, and the media task stream triggered by the task stream request sent by the client identified by the client identification in the white list performs prohibition processing of the code stream, and the media task stream triggered by the task stream request sent by the client identified by the client identification in the black list does not perform prohibition processing of the code stream, where the client identification in the black list may be set in advance, for example, in a media processing platform, because some media videos may have a complex picture, when performing transcoding processing on the video, the transcoding effect according to the set transcoding parameters may be poor, so that the high-bitrate or high-resolution complex video, for example, the outdoor video uploaded by an outdoor blogger or the like, is mostly such a complex video, and therefore the client identification of the object may be added into the white list, that is, the task stream corresponding to the task stream request sent by the client identified by the client identification of the class of the task stream is prohibited.

Specifically, a blacklist and a whitelist corresponding to a forbidden policy of the code stream may be obtained, if the client identifier exists in the whitelist corresponding to the forbidden policy of the code stream, a configuration parameter of the forbidden policy of the code stream is obtained, a media task stream is invoked based on a task parameter in corresponding trigger configuration information, and the configuration parameter processes the media data to obtain an execution result of the media data. For example, if any of the media task flows is a real-time streaming media processing task flow, the real-time streaming media processing task flow may include the following tasks: the configuration parameters of the forbidden strategies of the code stream can be used in a real-time transcoding task, so that when media data are processed in the task, the configuration parameters can forbid higher quantization parameters aiming at a quantization module in the real-time transcoding task, so as to ensure the transcoding quality. And if the client identifier exists in the blacklist corresponding to the forbidden policy of the code stream, calling a media task stream to process the media data based on the task parameter in the corresponding trigger configuration information, and obtaining an execution result of the service data.

By executing the embodiment, the media task flows triggered by different task flow requests can be dynamically controlled, instead of being fixed by each trigger configuration information, so that the processing method of the media task flows provided by the embodiment of the application can be suitable for various scenes, and flexibility and usability are improved.

In an embodiment, each trigger configuration information further includes a node hit rate, for each trigger configuration information in the plurality of trigger configuration information that satisfies the preset trigger condition, a second random number corresponding to each trigger configuration information may be generated by a second random number generator according to the node hit rate in each trigger configuration information, a media processing node corresponding to a preset interval to which the second random number belongs is determined, and a task parameter in each trigger configuration information is sent to the media processing node, so that the media processing node performs corresponding processing on the media data based on the task parameter in each trigger configuration information through a plurality of media tasks in a media task stream corresponding to each trigger configuration information, and an execution result of the media data is obtained. Wherein, the media processing node is deployed with a plurality of media tasks in the media task stream corresponding to each trigger configuration information.

Optionally, the trigger configuration information may include at least one media processing node corresponding to the media task flow corresponding to the trigger configuration information, where each media processing node in the at least one media processing node may belong to different cloud vendors, each trigger configuration information includes a node hit rate, each media processing node may correspond to a different node hit rate, and then a second random number may be generated by a second random number generator according to the node hit rate, and a media processing node corresponding to a preset interval to which the second random number belongs is determined. For example, if the certain trigger configuration information includes the media processing node 1, the media processing node 2 and the media processing node 3 corresponding to the media task flow corresponding to the certain trigger configuration information, the node hit rate corresponding to the media processing node 1 may be 30%, the node hit rate corresponding to the media processing node 2 may be 40%, the node hit rate corresponding to the media processing node 3 may be 30%, a second random number generator may be used, for example, a random number between 0 and 100 may be generated, the generated random number may be less than or equal to 30 (i.e., a probability of 30%) may correspond to the media processing node 1, the generated random number may be greater than or equal to 70 (i.e., a probability of 40%) may correspond to the media processing node 2, and if the generated random number is less than or equal to 30, the task parameter in the certain trigger configuration information is sent to the media processing node 1, so that the media processing node 1 performs the result on the task data based on the corresponding to the task data in the certain trigger configuration information in the media task flow corresponding to the certain trigger configuration information; if the generated random number is greater than 30 and less than or equal to 70, sending the task parameters in the certain trigger configuration information to the media processing node 2, so that the media processing node 2 carries out corresponding processing on the media data based on the task parameters in the certain trigger configuration information through a plurality of media tasks in the media task stream corresponding to the certain trigger configuration information, and an execution result of the media data is obtained; if the generated random number is greater than 70, the task parameter in the certain trigger configuration information is sent to the media processing node 3, so that the media processing node 3 performs corresponding processing on the media data based on the task parameter in the certain trigger configuration information through a plurality of media tasks in the media task stream corresponding to the certain trigger configuration information, and an execution result of the media data is obtained.

By executing the embodiment, the same media task stream can be proportionally sent to media processing nodes of different cloud manufacturers for processing, so that the reliability and stability of the data processing service are improved, and the risk resistance is greatly improved.

In an alternative embodiment, the target trigger source includes at least one trigger group, each trigger group includes at least one trigger configuration information, each trigger configuration information includes a preset trigger condition of the trigger configuration information, the preset trigger conditions of different trigger configuration information may be the same, and the manner of determining at least one trigger configuration information meeting the preset trigger condition from the plurality of trigger configuration information is shown in fig. 3, and fig. 3 is a flowchart for determining trigger configuration information according to an embodiment of the present application, as shown in fig. 3.

S301, traversing at least one trigger configuration information in any trigger group aiming at the trigger group, and ending the traversal of any trigger group if the currently traversed trigger configuration information meets the preset trigger condition.

The parameters used for judging whether the trigger configuration information meets the preset trigger condition of the trigger configuration information may include parameters in the task flow request, a return result of an external interface or service, context information, and the like. The parameters in the task flow request can include a time stamp, an event type, a trigger source identifier and the like, different trigger conditions can be set according to specific business logic for different parameters, for example, the time indicated by the time stamp can be set as the trigger condition for the time stamp in the task flow request, and the trigger condition can be set as the trigger condition for the event type in the task flow request when the event type is 'uploading video'; the returned result of the external interface or service refers to whether the returned result of the external interface or service used by the electronic device executing the processing method of the media task stream provided by the embodiment of the application is used as a parameter of whether the trigger configuration information meets the preset trigger condition of the trigger configuration information, for example, a status code returned by a certain external service, a value of a specific field, etc., and the external interface or service may be a video multi-method evaluation (Video Multimethod Assessment Fusion, VMAF), a method for simulating subjective perception of video quality by human eyes, and quantifying video quality, the method may return a VMAF value, and the trigger condition may be set for the VMAF value to trigger when the VMAF value is greater than a certain threshold or is in a certain preset range; the context information refers to information such as edit records or settings of certain parameters in the process of executing a processing method of a media task stream provided by the embodiment of the present application, and a trigger condition is set for the context information, for example, when a value of a certain parameter matches a specific value.

S302, determining the trigger configuration information of the current traversal as one trigger configuration information in the at least one trigger configuration information.

In an alternative embodiment, each trigger group may include at least one trigger group, each trigger group includes at least one trigger configuration information, priorities of trigger configuration information included in the same trigger group are the same, priorities of trigger configuration information included in different trigger groups are different, the at least one trigger group may be traversed according to an order of priorities of trigger configuration information included in at least one trigger group included in any trigger group, if trigger configuration information meeting the preset trigger condition exists in the currently traversed trigger group, and it is determined that each trigger configuration information meeting the preset trigger condition in the currently traversed trigger group is met, traversing of any trigger group is ended.

Referring to fig. 4, fig. 4 is a schematic trigger diagram provided by the embodiment of the present application, where as shown in fig. 4, the target trigger source may include two trigger groups, namely, trigger group a and trigger group B, where trigger group a may include three trigger groups, the first trigger group may include trigger configuration information 1, trigger configuration information 2, and trigger configuration information 3 with priorities of-2, the second trigger group may include trigger configuration information 4 and trigger configuration information 5 with priorities of 0, the third trigger group may include trigger configuration information 6 and trigger configuration information 7 with priorities of 5, trigger group B may include three trigger groups, the first trigger group may include trigger configuration information 8, trigger configuration information 9, and trigger configuration information 10 with priorities of-3, the second trigger group may include trigger configuration information 11 and trigger configuration information 12 with priorities of-1, and the third trigger group may include trigger configuration information 13 and trigger configuration information 14 with priorities of 3.

For any trigger group (such as trigger group a or trigger group B) in the target trigger source, the any trigger group can be traversed according to the order of the priority of the trigger configuration information contained in at least one trigger group included in the any trigger group from small to large, if the trigger configuration information meeting the preset trigger condition exists in the currently traversed trigger group, and it is determined that each trigger configuration information meeting the preset trigger condition in the currently traversed trigger group, the traversing of the any trigger group is finished.

Specifically, for the trigger group a, the three trigger groups may be traversed according to the order of the priorities of the trigger configuration information included in the three trigger groups included in the trigger group a from small to large, and the trigger configuration information 2 in each trigger configuration information with the priority of-2 included in the first trigger group meets the trigger condition, so that only the media task stream corresponding to the trigger configuration information 2 is initiated, and meanwhile, the subsequent priority is not processed any more, and the traversal of the trigger group a is ended.

Similarly, for the trigger group B, the three trigger groups may be traversed according to the order of the priorities of the trigger configuration information included in the three trigger groups included in the trigger group B from small to large, where all the trigger configuration information with the priority of-3 included in the first trigger group is not triggered. And continuing to process a second trigger group, wherein trigger configuration information 11 and trigger configuration information 12 exist in each trigger configuration information with priority 1 contained in the second trigger group to trigger successfully, so that only media task flows corresponding to the trigger configuration information 11 and the trigger configuration information 12 are initiated, and meanwhile, the subsequent priority is not processed any more, and the traversal of the trigger group B is finished.

The parallel processing is carried out among different trigger groups, so that the trigger efficiency can be improved, the serial waiting time can be reduced, the trigger configuration information with high priority can be ensured to be processed quickly by sequentially traversing each trigger group according to the priority order, and the next trigger group is not traversed when at least one trigger configuration information exists in one trigger group is triggered, so that the resource consumption and the processing time can be reduced.

Taking a media task flow scheduling gateway system as an example, the media task flow scheduling gateway system can manage and schedule the media task flow through the processing method of the media task flow provided by the embodiment of the application, wherein the gateway refers to a key component in the system, and the component can realize the functions of managing and coordinating task scheduling, resource allocation, data flow control and the like in the processing process of the media task flow.

The media task flow scheduling gateway system can provide a centralized platform for managing functions of media task flow definition, task scheduling, resource allocation, monitoring and the like, please refer to fig. 5, fig. 5 is a centralized platform interface diagram of a media task flow processing method provided by the embodiment of the application, as shown in fig. 5, operations of trigger configuration information editing, authority management, history record management and the like can be performed in a visual interface provided by the platform, wherein the authority management can be that different authorities are set for account numbers logging in the centralized platform, for example, account numbers with high authority can edit the trigger configuration information, and account numbers with low authority only provide viewing functions. The history management may be management of history version information of each trigger configuration information.

Specifically, referring to fig. 6, fig. 6 is a schematic diagram of a system architecture of the media task flow scheduling gateway system, and as shown in fig. 6, the system architecture of the media task flow scheduling gateway system may include a console, a data layer, and an execution layer. The console may provide editing and viewing capabilities of trigger configuration information based on a visual interface, such as a centralized platform depicted in fig. 5, and may include modules such as media task stream publishing, trigger parameter configuration, trigger condition configuration, rights point management, business party management, and policy and list management.

Wherein, the media task stream publishing module: for publishing developed media task flows to a production environment for use. It involves deploying definitions and configuration files of media task flows into a media task flow management system or platform so that other users or systems can use and trigger the media task flow.

Triggering parameter configuration module: for defining and configuring parameters required when triggering a media task stream. These parameters may include input data, media task stream environment configuration, operational options, and the like. By configuring the triggering parameters, the user can provide corresponding values when triggering the media task stream so as to meet specific service requirements.

The trigger condition configuration module: the trigger condition configuration module is used for defining the condition for triggering the media task stream. These conditions may be based on time rules, data states, event triggers, etc. By configuring the trigger condition, execution of the media task stream may be automatically triggered when a particular condition is met, without requiring manual triggering.

Rights point management module: for managing rights and access control in a media task stream system. It includes definition, allocation and management of users, roles and rights. By rights point management, it can be ensured that only authorized users or roles can perform or access specific media task flows, configurations and functions.

And the business side management module is used for: for managing different business parties or departments using the media task stream system. It includes registration, configuration, rights control and management of the business party. Through business party management, different business parties can be isolated and managed to meet respective requirements and business processes.

Policy and list management module: policies and lists for defining and managing media task flow execution. This includes execution policies (e.g., parallel, serial, conditional execution, etc.), task scheduling policies, exception handling policies, etc. List management involves defining a white list, a black list, or an access control list for controlling objects or conditions that allow or prohibit execution of a media task stream.

Further, the data layer may store configuration data for each functional module of the console, providing runtime reading. MySql (My Structured Query Language), REDIS CACHE (Remote Dictionary SERVER CACHE), local Cache (Local Cache) may be included.

Among them, mySql is an open-source relational database management system (RDBMS, relational Database MANAGEMENT SYSTEM), which is one of the most popular and widely used databases. MySql supports multiple users, multiple threads, and multiple storage engines, providing stable, reliable, high performance data storage and processing capabilities. May be used to store primary configuration data for the media task flow dispatch gateway system, such as configuration data for various modules in the console. REDIS CACHE is an open source memory data storage system, which can be used to store various data generated in the operation of the media task stream scheduling gateway system. The local cache can be used for caching configuration data and the like with high reading frequency and low requirement on update instantaneity.

The execution layer is an implementation module of the core function of the media task flow scheduling gateway system and provides relevant capabilities such as media task flow triggering scheduling and the like. The method can comprise the steps of triggering types, triggering parameters, gray control, requesting duplication elimination, dynamic parameters and the like. The trigger type module divides the received media task stream request into two types, namely active trigger and passive trigger, wherein the active trigger can comprise RPC trigger and HTTP trigger, namely, the object corresponding to the client sends the task stream request through RPC or the object corresponding to the client sends the media task stream request through HTTP protocol. The passive trigger may include a message queue trigger, that is, the client may automatically send a message to the message queue of the media task flow scheduling gateway system after the occurrence of the preset event, which may be specifically described in the above step S201, and will not be described herein.

The trigger parameter module is a configuration parameter for controlling the running of the media task stream, and can comprise a trigger source, a trigger group, a trigger sequence, a trigger condition and the like.

The gray control module enables the media task stream to be determined as a test version or a released version at a preset test hit rate, and enables the media task stream to be sent to different media processing nodes for processing and the like according to the preset node hit rate.

The request deduplication module is configured to generate hash values after receiving the media task stream requests, compare the hash values with hash values of each historical media task stream request in the buffer, delete the task stream request if the hash values are repeated, and force the task stream request to be executed if the task stream request includes service execution indication information, which can be seen from the detailed description in the step S201 and will not be repeated here.

The dynamic parameter module is configured to match different preset configuration policies for different media task flow requests, and specific details of the step S204 may be referred to, which is not described herein.

The operation flow of the media task flow scheduling gateway system may refer to fig. 7, and fig. 7 is the operation flow of the media task flow scheduling gateway system provided by the embodiment of the present application, as shown in fig. 7.

S701, receiving a task flow request sent by a client, wherein the task flow request comprises a trigger source identifier and media data.

The task flow request sent by the client can be actively initiated by the object corresponding to the client, or can be automatically initiated by the client according to the occurrence of the preset media operation of the client.

S702, the execution layer reads the trigger condition in the trigger configuration information included in the trigger source identified by the trigger source identifier, and judges whether the trigger is triggered.

The execution layer may sequentially read the trigger conditions in the trigger configuration information according to the flow described in fig. 3, and determine whether to trigger.

S703, the process is ended without triggering.

S704, determining target version information of the media task stream corresponding to each piece of trigger configuration information to be triggered.

If the configuration version information in the trigger configuration information to be triggered is test version information, acquiring the last released version information corresponding to the test version information, and determining the target version information of the task flow corresponding to the trigger configuration information to be triggered according to a preset test hit rate; if the configuration version information in the trigger configuration information to be triggered is released version information, determining the target version information of the task flow corresponding to the trigger configuration information to be triggered as the released version information.

S705, based on the task flow request, acquiring a preset configuration strategy corresponding to the task flow request and configuration parameters of the corresponding preset configuration strategy.

See for details the description in step S204.

S706, calling the media task flow corresponding to each piece of trigger configuration information to be triggered to process the service data based on the task parameters in each piece of trigger configuration information to be triggered, the version information of the media task flow corresponding to each piece of trigger configuration information to be triggered and the configuration parameters of the corresponding preset configuration strategy to obtain the execution result of the media data.

Further, the output address of the media task stream included in the task parameter of each trigger configuration information may be obtained, and the execution result of the media data may be sent to the execution result inflow access node pointed by the corresponding output address.

Based on the description of the related embodiments, the embodiments of the present application further provide a processing device for a media task stream, where the processing device for a media task stream may perform the operations shown in fig. 1 to fig. 7. Referring to fig. 8, fig. 8 is a schematic diagram of a processing device for media task flows according to an embodiment of the present application. As shown in fig. 8, the processing device of the media task stream may include, but is not limited to, a receiving unit 801, an acquiring unit 802, a determining unit 803, and a processing unit 804.

A receiving unit 801, configured to receive a task flow request sent by a client, where the task flow request includes a trigger source identifier and media data, where the task flow request is generated by the client in response to a preset media operation, and the preset media operation corresponds to the trigger source identifier;

An obtaining unit 802, configured to obtain a target trigger source corresponding to the trigger source identifier, where the target trigger source includes a plurality of trigger configuration information, each trigger configuration information includes a task parameter, task parameters in different trigger configuration information are different, different trigger configuration information corresponds to different media task flows, and each media task flow includes a plurality of media tasks;

a determining unit 803 configured to determine, from the plurality of trigger configuration information, a plurality of trigger configuration information that satisfies a preset trigger condition;

The processing unit 804 is configured to call, for each trigger configuration information of the plurality of trigger configuration information that satisfies the preset trigger condition, a plurality of media tasks in the media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters, so as to obtain an execution result of the media data.

In an optional implementation manner, each task parameter includes an output address of a media task stream corresponding to trigger configuration information to which each task parameter belongs; the processing unit 804 invokes a plurality of media tasks in the media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters, and after obtaining an execution result of the media data, further includes:

In an alternative embodiment, each trigger configuration information includes configuration version information; the processing unit 804 invokes, for each trigger configuration information in the plurality of trigger configuration information satisfying the preset trigger condition, a plurality of media tasks in a media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameter, to obtain an execution result of the media data, and determines, from the plurality of trigger configuration information, a plurality of trigger configuration information satisfying the preset trigger condition, including:

In an alternative embodiment, the determining unit 803 determines, according to the test version information in the first trigger configuration information, target version information of the first media task stream corresponding to the first trigger configuration information, including:

In an optional implementation manner, the determining unit 803 is further configured to determine that second trigger configuration information exists in the plurality of trigger configuration information that meets the preset trigger condition, where the second trigger configuration information includes configuration version information that is published version information, and determine the published version information as target version information of a second media task stream corresponding to the second trigger configuration information.

After the obtaining unit 802 obtains the target trigger source corresponding to the trigger source identifier, the method further includes:

The processing device of the media task stream further includes a traversing unit 805;

the traversing unit 805 traverses at least one trigger configuration information in the any trigger group, and if the currently traversed trigger configuration information meets the preset trigger condition, the traversing of the any trigger group is finished, including:

The processing unit 804 invokes a plurality of media tasks in the media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters, so as to obtain an execution result of the media data, including:

the acquiring unit 802 acquires an identifier library corresponding to each preset configuration policy in at least one preset configuration policy;

The obtaining unit 802 is further configured to obtain, for any preset configuration policy, a configuration parameter of the any preset configuration policy if the client identifier exists in an identifier library corresponding to the any preset configuration policy;

The processing unit 804 invokes a plurality of media tasks in the media task stream corresponding to each trigger configuration information to process the media data based on the task parameters and the configuration parameters, so as to obtain an execution result of the media data.

In an alternative embodiment, after the receiving unit 801 receives the task flow request sent by the client, the method further includes:

generating a hash value of the task flow request;

In an alternative embodiment, the processing device of the media task stream further comprises a triggering unit 806;

and a triggering unit 806, configured to trigger the step of acquiring the target trigger source corresponding to the trigger source identifier if the generated hash value exists in the buffer, and the task flow request includes service execution indication information.

the processing unit 804 invokes, for each trigger configuration information in the plurality of trigger configuration information satisfying the preset trigger condition, a plurality of media tasks in a media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters, to obtain an execution result of the media data, where the processing unit includes:

And sending the task parameters in each piece of trigger configuration information to the media processing node so that the media processing node can correspondingly process the media data based on the task parameters in each piece of trigger configuration information through a plurality of media tasks in the media task stream corresponding to each piece of trigger configuration information to obtain an execution result of the media data.

storing the task flow request to the searched storage interval;

The embodiment of the application also provides a server, please refer to fig. 9, fig. 9 is a schematic structural diagram of the server provided by the embodiment of the application. As shown in fig. 9, the server includes at least a processor 901, a memory 902 and a communication interface 903, which may be connected via a bus 904 or otherwise, as exemplified by the present embodiment. The processor 901 of the embodiment of the present application may execute the operation of the server in the foregoing processing method of the media task stream by executing the computer program stored in the memory 902, for example:

The processor 901 invokes a plurality of media tasks in the media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters, and after obtaining an execution result of the media data, the following operations are further performed:

The processor 901 invokes, for each trigger configuration information in the plurality of trigger configuration information meeting the preset trigger conditions, a plurality of media tasks in a media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters, so as to obtain an execution result of the media data, determine, from the plurality of trigger configuration information, a plurality of trigger configuration information meeting the preset trigger conditions, and perform the following operations:

In an alternative embodiment, the processor 901 determines, according to the test version information in the first trigger configuration information, the target version information of the first media task stream corresponding to the first trigger configuration information, and performs the following operations:

In an alternative embodiment, processor 901 further performs the following:

after the processor 901 obtains the target trigger source corresponding to the trigger source identifier, the following operations are further executed:

The processor 901 traverses at least one trigger configuration information in any trigger group, if the currently traversed trigger configuration information meets the preset trigger condition, the traversing of any trigger group is finished, and the following operations are executed:

the processor 901 invokes a plurality of media tasks in the media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters, so as to obtain an execution result of the media data, and execute the following operations:

In an alternative embodiment, after receiving the task flow request sent by the client, the processor 901 is further configured to perform the following operations:

generating a hash value of the task flow request;

In an alternative embodiment, processor 901 further performs the following:

the processor 901 invokes, for each trigger configuration information of the plurality of trigger configuration information satisfying the preset trigger condition, a plurality of media tasks in a media task stream corresponding to each trigger configuration information to perform corresponding processing on the media data based on the task parameters, to obtain an execution result of the media data, and performs the following operations:

In an alternative embodiment, after the processor 901 receives the task stream request sent by the client, the following operations are further performed:

storing the task flow request to the searched storage interval;

The application also provides a computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of any of the method embodiments described above.

Embodiments of the present application also provide a computer program product comprising computer program code to, when run on a computer, cause the computer to perform the steps of any of the method embodiments described above.

The embodiment of the application also provides a chip, which comprises a memory and a processor, wherein the memory is used for storing a computer program, and the processor is used for calling and running the computer program from the memory, so that the device provided with the chip executes the steps in any method embodiment.

The steps in the method of the embodiment of the application can be sequentially adjusted, combined and deleted according to actual needs.

The units in the device of the embodiment of the application can be combined, divided and deleted according to actual needs.

Claims

1. A method for processing a media task stream, comprising:

2. The method of claim 1, wherein each task parameter includes an output address of a media task stream corresponding to trigger configuration information to which each task parameter belongs;

The step of calling the plurality of media tasks in the media task stream corresponding to each trigger configuration information to correspondingly process the media data based on the task parameters, and after obtaining the execution result of the media data, the method further comprises the steps of:

3. The method of claim 1, wherein each trigger configuration information comprises configuration version information;

4. The method of claim 3, wherein determining the target version information of the first media task stream corresponding to the first trigger configuration information according to the test version information in the first trigger configuration information comprises:

5. A method as claimed in claim 3, wherein the method further comprises:

6. The method of claim 1, wherein the target trigger source comprises at least one trigger group, each trigger group comprising at least one trigger configuration information;

7. The method of claim 6, wherein each trigger group comprises at least one trigger group, each trigger group comprises at least one trigger configuration information, the priorities of the trigger configuration information contained in the same trigger group are the same, and the priorities of the trigger configuration information contained in different trigger groups are different;

8. The method of claim 1, wherein the task flow request further comprises a client identification of the client;

The calling the plurality of media tasks in the media task stream corresponding to each trigger configuration information to correspondingly process the media data based on the task parameters to obtain an execution result of the media data comprises the following steps:

9. The method of claim 1, wherein after receiving the task flow request sent by the client, further comprising:

generating a hash value of the task flow request;

10. The method of claim 9, wherein the method further comprises:

11. The method of claim 1, wherein each trigger configuration information further comprises a node hit rate;

The step of calling a plurality of media tasks in the media task stream corresponding to each trigger configuration information according to each trigger configuration information in the plurality of trigger configuration information meeting the preset trigger conditions to correspondingly process the media data based on the task parameters to obtain an execution result of the media data, comprises the following steps:

12. The method of claim 1, wherein after receiving the task flow request sent by the client, further comprising:

storing the task flow request to the searched storage interval;

13. A device for processing a media task stream, the device comprising:

A determining unit, configured to determine, from the plurality of trigger configuration information, a plurality of trigger configuration information that satisfies a preset trigger condition;

and the processing unit is used for calling a plurality of media tasks in the media task stream corresponding to each trigger configuration information according to each trigger configuration information in the plurality of trigger configuration information meeting the preset trigger conditions, and correspondingly processing the media data based on the task parameters to obtain an execution result of the media data.

14. A server comprising a memory, a communication interface, and a processor, wherein the memory, the communication interface, and the processor are interconnected; the memory stores a computer program, and the processor invokes the computer program stored in the memory for implementing the method of any one of claims 1 to 12.

15. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 12.