CN107463391B

CN107463391B - Task processing method, device and equipment

Info

Publication number: CN107463391B
Application number: CN201610391199.4A
Authority: CN
Inventors: 管铮
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2016-06-03
Filing date: 2016-06-03
Publication date: 2020-11-10
Anticipated expiration: 2036-06-03
Also published as: CN107463391A

Abstract

The application provides a task processing method, a task processing device and a task processing device, wherein the method comprises the following steps: receiving a task processing request message, wherein the task processing request message comprises an identifier of a task to be processed; determining a target processing chain corresponding to the identifier of the task to be processed according to the task request message; initializing the target processing chain according to a target processing template corresponding to the target processing chain; and processing the task to be processed through the initialized target processing chain. To improve the efficiency of maintenance of the processing chain.

Description

Task processing method, device and equipment

Technical Field

The present application relates to the field of internet technologies, and in particular, to a method, an apparatus, and a device for task processing.

Background

With the development of internet technology and the continuous improvement of enterprise informatization construction, most enterprises adopt task processing devices to process tasks needing to be processed.

In the actual application process, a processing chain can be added or deleted in the task processing device according to actual needs, when a processing chain is added in the task processing device, firstly, a software code corresponding to the processing chain is written according to a function to be realized by the processing chain, and the software code is added to the task processing device, so that in the process of running the processing chain, the function corresponding to the processing chain is realized by calling the software code corresponding to the processing chain. However, when the function of the processing chain in the task processing device needs to be modified, the software code corresponding to the processing chain needs to be modified, and the task processing device is restarted, and in the process of restarting the task processing device, all the processing chains in the task processing device need to be suspended for use, so that the process of maintaining the processing chain in the task processing device in the prior art is complex, and the maintenance efficiency of the processing chain is low.

Disclosure of Invention

The application provides a task processing method, a task processing device and task processing equipment, which are used for improving the maintenance efficiency of a processing chain.

On one hand, the method includes that an execution main body of the method is a task processing device, after the task processing device receives a task processing request message including an identifier of a task to be processed, the task processing device determines a target processing chain corresponding to the identifier of the task to be processed according to the task processing request message, initializes the target processing chain according to a target processing template corresponding to the target processing chain, and processes the task to be processed according to the initialized target processing chain.

In the process, before the task to be processed is processed according to the target processing chain, the target processing chain needs to be initialized first, so that the target processing chain has the processing function of the target processing template, and therefore after the target processing template is maintained, the task processing device does not need to be restarted, the maintenance of the target processing chain can be completed, the maintenance process of the processing chain of the task processing device is simplified, and the maintenance efficiency of the processing chain is improved.

In a possible implementation manner, initializing a target processing chain according to a target processing template corresponding to the target processing chain includes:

acquiring configuration information corresponding to a target processing chain;

determining a plurality of target processing modules corresponding to the target processing chain and target processing templates corresponding to the target processing modules according to the configuration information;

and initializing each target processing module according to the target processing template corresponding to each target processing module.

In another possible implementation manner, determining, according to the configuration information, an object processing template corresponding to the object processing module includes:

judging whether a target processing template corresponding to the target processing module is a user-defined processing template or not according to the configuration information;

if so, acquiring a plug-in corresponding to the target processing module according to the configuration information, acquiring a custom processing module corresponding to the target processing module from the plug-in, and determining the custom processing module as a target processing template;

if not, acquiring a common processing template corresponding to the target processing module in the common processing template library according to the configuration information, and determining the common processing template as the target processing template.

In another possible implementation manner, initializing the target processing module according to the target processing template corresponding to the target processing module, where the target processing template is a custom processing template, includes:

acquiring a class loader corresponding to the plug-in;

acquiring class information in a target processing template through a class loader;

and initializing the target processing module according to the class information.

In another possible implementation, the initializing the target processing module according to the target processing template corresponding to the target processing module, where the target processing template is a common processing template, includes:

acquiring class information in a target processing template;

In another possible implementation, the class information includes an implementation class and a configuration class, and the initializing the target processing module according to the class information includes:

reflecting a constructor in the implementation class and performing JSON deserialization on the configuration class to realize the initialization of the target processing module;

the class information comprises an implementation class, and the target processing module is initialized according to the class information, and the method comprises the following steps:

and reflecting the constructor in the implementation class to realize the initialization of the target processing module.

In another possible implementation, processing the to-be-processed task according to the initialized target processing chain includes:

acquiring the execution sequence of each target processing module according to the configuration information;

and processing the tasks to be processed according to the target processing modules in sequence according to the execution sequence.

In another possible implementation, before receiving the task processing request message, the method further includes:

receiving a processing chain establishing request input by a user, wherein the processing chain establishing request comprises an identification of a target processing chain;

receiving configuration information corresponding to a target processing chain input by a user, wherein the configuration information comprises identifiers of a plurality of target processing modules corresponding to the target processing chain, an execution sequence of each target processing module and an identifier of a processing template corresponding to each processing module;

and creating a target processing chain according to the processing chain creation request and the configuration information.

In another aspect, the present application provides a task processing apparatus including:

the first receiving module is used for receiving a task processing request message, and the task processing request message comprises an identifier of a task to be processed;

the determining module is used for determining a target processing chain corresponding to the identifier of the task to be processed according to the task request message;

the initialization module is used for initializing the target processing chain according to the target processing template corresponding to the target processing chain;

and the processing module is used for processing the task to be processed according to the initialized target processing chain.

In a possible embodiment, the initialization module comprises an acquisition unit, a determination unit, and an initialization unit, wherein,

the acquisition unit is used for acquiring configuration information corresponding to the target processing chain;

the determining unit is used for determining a plurality of target processing modules corresponding to the target processing chain and target processing templates corresponding to the target processing modules according to the configuration information;

the initialization unit is used for initializing each target processing module according to the target processing template corresponding to each target processing module.

In another possible implementation, the determining unit is specifically configured to:

In another possible implementation manner, the target processing template is a custom processing template, and the initialization unit is specifically configured to:

acquiring a class loader corresponding to the plug-in;

In another possible implementation manner, the target processing template is a common processing template, and the initialization unit is specifically configured to:

acquiring class information in a target processing template;

In another possible implementation, the class information includes an implementation class and a configuration class, and the initialization unit is specifically configured to reflect a constructor in the implementation class and perform JSON deserialization on the configuration class to initialize the target processing module;

the class information includes an implementation class, and the initialization unit is specifically configured to reflect a constructor in the implementation class to initialize the target processing module.

In another possible implementation, the processing module is specifically configured to:

In another possible embodiment, the apparatus further comprises a second receiving module and a creating module, wherein,

the second receiving module is used for receiving a processing chain establishment request input by a user before the first receiving module receives the task processing request message, wherein the processing chain establishment request comprises an identifier of a target processing chain;

the second receiving module is further configured to receive configuration information corresponding to the target processing chain, where the configuration information includes identifiers of multiple target processing modules corresponding to the target processing chain, an execution sequence of each target processing module, and an identifier of a processing template corresponding to each processing module;

the creation module is used for creating a target processing chain according to the processing chain creation request and the configuration information.

In another aspect, the present application provides a task processing device, including a processor, a memory, and a communication port, where the memory is used to store a program, and the processor is used to read the program in the memory, and perform the following operations:

receiving a task processing request message through a communication port, wherein the task processing request message comprises an identifier of a task to be processed;

determining a target processing chain corresponding to the identifier of the task to be processed according to the task request message;

initializing the target processing chain according to the configuration information of the target processing chain and a target processing template corresponding to the target processing chain;

and processing the task to be processed according to the initialized target processing chain.

In one possible implementation, the processor is specifically configured to:

acquiring configuration information corresponding to the target processing chain;

determining a plurality of target processing modules corresponding to the target processing chain and a target processing template corresponding to each target processing module according to the configuration information;

In another possible implementation, the processor is specifically configured to:

judging whether the target processing template corresponding to the target processing module is a user-defined processing template or not according to the configuration information;

if yes, obtaining a plug-in corresponding to the target processing module according to the configuration information, obtaining a user-defined processing module corresponding to the target processing module from the plug-in, and determining the user-defined processing module as the target processing template;

if not, acquiring a common processing template corresponding to the target processing module in a common processing template library according to the configuration information, and determining the common processing template as the target processing template.

In another possible implementation manner, when the target processing template is the custom processing template, the processor is specifically configured to:

acquiring a class loader corresponding to the plug-in;

acquiring class information in the target processing template through the class loader;

In another possible implementation manner, when the target processing template is the common processing template, the processor is specifically configured to:

acquiring class information in the target processing template;

In another possible implementation manner, when the class information includes an implementation class and a configuration class, the processor is specifically configured to: reflecting a constructor in the implementation class and performing JSON deserialization on the configuration class to realize initialization of the target processing module;

when the class information includes an implementation class, the processor is specifically configured to: and reflecting the constructor in the implementation class to realize the initialization of the target processing module.

In another possible embodiment, the device further comprises an input device, wherein,

the processor is further configured to receive, through the input device, a processing chain creation request input by a user before receiving a task processing request message through the communication port, where the processing chain creation request includes an identifier of the target processing chain;

the processor is further configured to receive, through the input device, the configuration information corresponding to the target processing chain input by a user, where the configuration information includes an identifier of the plurality of target processing modules corresponding to the target processing chain, an execution order of each of the target processing modules, and an identifier of a processing template corresponding to each of the processing modules;

the processor is further configured to create the target processing chain according to the processing chain creation request and the configuration information.

In the method, after a task processing device receives a task processing request message comprising an identifier of a task to be processed, the task processing device determines a target processing chain corresponding to the identifier of the task to be processed according to the task processing request message, initializes the target processing chain according to a target processing template corresponding to the target processing chain, and processes the task to be processed according to the initialized target processing chain; in the practical application process, when the target processing chain needs to be maintained, only the target processing template corresponding to the target processing chain needs to be maintained, and since the target processing chain needs to be initialized before the task to be processed is processed according to the target processing chain, the target processing chain has the processing function of the target processing template, after the target processing template is maintained, the task processing device does not need to be restarted, the processing chain in the task processing device does not need to be suspended, the maintenance of the target processing chain can be completed, and the maintenance efficiency of the processing chain is further improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

FIG. 1 is a schematic diagram of an application scenario of a task processing method provided by the present invention;

FIG. 2 is a schematic flow chart of a task processing method provided by the present invention;

FIG. 3 is a flowchart illustrating a method for initializing a target processing chain according to the present invention;

FIG. 4 is a schematic diagram of a processing chain according to the present invention;

FIG. 5 is a diagram illustrating a reference relationship of a class loader provided by the present invention;

FIG. 6 is a flowchart illustrating a method for creating a target processing chain according to the present invention;

FIG. 7 is a first schematic view of an interactive interface provided by the present invention;

FIG. 8 is a second schematic view of an interactive interface provided by the present invention;

FIG. 9 is a first schematic structural diagram of a task processing device according to the present invention;

FIG. 10 is a second schematic structural diagram of a task processing device according to the present invention;

FIG. 11 is a first schematic structural diagram of a task processing device according to the present invention;

fig. 12 is a schematic structural diagram of a task processing device according to a second embodiment of the present invention.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.

Fig. 1 is a schematic view of an application scenario of a task processing method provided by the present invention, referring to fig. 1, a task processing device includes a client 101 and a task processing device 102, and the client 101 can request the task processing device 102 to process a task to be processed; the task processing device 102 includes a processing template library 1021 and a plurality of processing chains (1022-1 to 1022-N), where the processing template library 1021 includes a plurality of processing templates, each processing chain can process a task, and before the processing chain processes the task, the processing chain is initialized according to the processing template corresponding to the processing chain in the template library 1021, so that the processing chain has the function of the corresponding processing template. The technical means shown in the present application will be described in detail below with reference to specific examples.

It should be noted that the following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

Fig. 2 is a schematic flowchart of a task processing method provided by the present invention, an execution subject of the method is a task processing device, please refer to fig. 2, and the method may include:

s201, receiving a task processing request message, wherein the task processing request message comprises an identifier of a task to be processed;

s202, determining a target processing chain corresponding to the identification of the task to be processed according to the task request message;

s203, initializing the target processing chain according to the target processing template corresponding to the target processing chain;

and S204, processing the task to be processed according to the initialized target processing chain.

In the embodiment of the present invention, a plurality of processing chains are arranged in a task processing device, where different processing chains are used to process different tasks, and after the task processing device receives a task processing request, the task processing request is used to instruct a task to be processed, and in order to facilitate determination of a target processing chain for processing the task to be processed, a corresponding relationship between an identifier of the task and an identifier of the processing chain may be arranged in the task processing device, so that the task processing device may determine the target processing chain corresponding to the identifier of the task to be processed according to the identifier of the task to be processed and the corresponding relationship; optionally, the corresponding relationship may be as shown in table 1:

TABLE 1

Identification of tasks	Identification of processing chains
		Task 1	Processing chain 1
Task 2	Processing chain 2
		Task 3	Processing chain 3
……	……

Since the processing procedures of all tasks by the task processing device are similar, the method shown in the embodiment of fig. 2 will be described in detail below by taking the process of processing the task to be processed by the task processing device as an example.

In an actual application process, after the task processing device receives the task processing request message including the identifier of the to-be-processed task, the task processing device obtains the target processing chain corresponding to the identifier of the to-be-processed task, and optionally, the task processing device may determine the target processing chain corresponding to the identifier of the to-be-processed task according to the identifier of the to-be-processed task and the corresponding relationship.

After the task processing device determines to obtain the target processing chain, the task processing device obtains a target processing template corresponding to the target processing chain, and performs initialization processing on the target processing chain according to the target processing template, wherein the number of the target processing templates corresponding to the target processing chain may be multiple, and each processing template has a function, and initializes the target processing chain according to the target processing template, so that the target processing chain can have the processing function of the target processing template, and when there are multiple target processing templates corresponding to the target processing chain, initializes the target processing chain according to the multiple target processing templates, so that the target processing chain can have the processing functions of the multiple target processing templates.

After the task processing device initializes the target processing chain, the target processing chain has the processing function of the target processing template, and the task processing device processes the task to be processed according to the initialized target processing chain.

The method shown in the embodiment of fig. 2 is described in detail below by way of specific examples.

For example, it is assumed that the task processing device includes a plurality of processing chains for processing microblog data.

After a user logs in a microblog through a client, and after the user clicks a "popular topic ranking list" label, the client sends a task processing request message 1 to a task processing device, wherein the task processing request message 1 comprises an identifier of a task to be processed (the popular topic ranking list).

After the task processing device receives the task processing request 1, the task processing device may determine a target processing chain corresponding to the "popular topic ranking list" (the identifier of the task to be processed) according to the "popular topic ranking list" (the identifier of the task to be processed) and a preset corresponding relationship, and assume that the target processing chain determined by the task processing device is the processing chain 1.

After the task processing device determines that the obtained target processing chain is the processing chain 1, the task processing device obtains a target processing template corresponding to the processing chain 1, assuming that the processing chain 1 corresponds to 3 target processing templates, and the identifiers of the 3 target processing templates and the processing functions of each target processing template are shown in table 2:

TABLE 2

Identification of process templates	Handling functions of templates
		Treatment template 1	Data extraction
Treatment template 2	Data desensitization
		Treatment template 3	Data ordering

After the task processing device obtains the 3 processing templates shown in table 2, the task processing device initializes the processing chain 1 according to the processing templates 1-3, so that the processing chain 1 has processing functions of "data extraction", "data desensitization", and "data sorting", then, the task processing device processes a task to be processed (hit topic ranking list) according to the initialized processing chain 1, specifically, data corresponding to a hit topic is extracted through the processing chain 1, and the extracted data is desensitized, and then the data after data desensitization is sorted, optionally, after the task processing device completes task processing, the sorted hit topic can be sent to the client.

In the task processing method provided by the embodiment of the invention, after the task processing device receives the task processing request message including the identifier of the task to be processed, the task processing device determines the target processing chain corresponding to the identifier of the task to be processed according to the task processing request message, initializes the target processing chain according to the target processing template corresponding to the target processing chain, and processes the task to be processed according to the initialized target processing chain; in the practical application process, when the target processing chain needs to be maintained, only the target processing template corresponding to the target processing chain needs to be maintained, and since the target processing chain needs to be initialized before the task to be processed is processed according to the target processing chain, the target processing chain has the processing function of the target processing template, after the target processing template is maintained, the task processing device does not need to be restarted, the processing chain in the task processing device does not need to be suspended, the maintenance of the target processing chain can be completed, and the maintenance efficiency of the processing chain is further improved.

On the basis of the embodiment shown in fig. 2, optionally, the target processing chain may be initialized according to the target processing template corresponding to the target processing chain in the following feasible implementation manner (S203 in the embodiment shown in fig. 2), specifically, please refer to the embodiment shown in fig. 3.

Fig. 3 is a schematic flowchart of a method for initializing a target processing chain according to the present invention, please refer to fig. 3, where the method may include:

s301, acquiring configuration information corresponding to a target processing chain;

s302, determining a plurality of target processing modules corresponding to the target processing chain and target processing templates corresponding to the target processing modules according to the configuration information;

and S303, initializing each target processing module according to the target processing template corresponding to each target processing module.

To facilitate understanding of the embodiment shown in fig. 3, the structure of the processing chain will be described in detail first with reference to fig. 4.

Fig. 4 is a schematic structural diagram of a processing chain provided by the present invention, please refer to fig. 4, which includes a processing template library 401 and a processing chain 402, wherein,

the processing template library 401 comprises a common processing template library and a plurality of plugins, the common processing template library and each plugin comprise at least one processing template, and the plugins are uploaded by a user according to actual needs; each processing template has a processing function, and the processing module can be initialized through the processing templates in the processing template library, so that the processing module has the processing function of the processing template, and different processing modules can be initialized through the same processing module.

The processing chain 402 includes a plurality of processing modules, and when a task needs to be processed through the processing chain, the plurality of processing modules perform processing on the task according to a preset sequence, each processing module corresponds to a processing template, and before the processing module runs, the processing module needs to be initialized through the processing template corresponding to the processing module, so that the processing module has a corresponding processing function.

In an actual application process, a part of the processing templates may include configuration items, and when different processing modules are initialized through the same processing template, the configuration items of the processing templates may be configured differently, so that different processing modules initialized through the same processing template have functional differences.

For example, assume that the processing template 1 has the following functions: the method comprises the steps that preset function operation is carried out on input N parameters to obtain a reference value, decimal places reserved by the reference value are configurable, when a processing module 1 is initialized through a processing template 1, the decimal places can be set to be 3 places, so that the processing module 1 has the function of the processing template 1, and the decimal places of the reference value obtained through operation of the processing module 1 are 3 places; when the processing module 2 is initialized by the processing template 1, the decimal place can be set to 2 bits so that the processing module 2 has the function of the processing template 1, and the decimal place of the reference value calculated by the processing module 2 is 2 bits.

The method shown in the example of fig. 3 will be described in detail below.

In the actual application process, in the process of creating the processing chain by the user, the user sets corresponding configuration information for the created processing chain, where the configuration information includes identifiers of a plurality of processing modules corresponding to the processing chain, an execution sequence of each processing module, and an identifier of a processing template corresponding to each processing module, so that, when the task processing device needs to initialize the target processing chain, the task processing device obtains the configuration information corresponding to the target processing chain, and determines a plurality of target processing modules corresponding to the target processing chain according to the configuration information, and then determines a target processing template corresponding to each target processing module according to the configuration information, because the target processing template may be located in the common processing template library or may be located in the plug-in, optionally, for any one target processing module of the plurality of target processing modules, the task processing device may obtain the target processing template corresponding to the target processing module in the following feasible implementation manner, specifically, the method comprises the following steps:

the task processing device judges whether a target processing template corresponding to the target processing module is a user-defined processing template or not according to the configuration information; if so, acquiring a plug-in corresponding to the target processing module according to the configuration information, acquiring a custom processing module corresponding to the target processing module from the plug-in, and determining the custom processing module as a target processing template; if not, acquiring a common processing template corresponding to the target processing module in the common processing template library according to the configuration information, and determining the common processing template as the target processing template.

After the task configuration device determines to obtain the target processing templates corresponding to the target processing modules, the task processing device initializes the target processing modules according to the target processing templates corresponding to the target processing modules, so that each target processing module has the processing function of the corresponding target processing template, and in a specific implementation process, according to different types (custom processing templates or common processing templates) of the target processing templates, the process of initializing the target processing modules according to the target processing templates is different, optionally, the following two feasible implementation manners may be included:

one possible implementation is: the target processing template is a self-defined processing template;

the task processing device firstly acquires a class loader corresponding to the plug-in, the class loader acquires class information in the target processing template, and the target processing module is initialized according to the class information.

In this possible implementation, a detailed description is first given with reference to the reference relationship diagram of the class loader shown in fig. 5.

Fig. 5 is a schematic diagram of a reference relationship of a class loader provided by the present invention, please refer to fig. 5, which includes a class loader manager 501 and a

class loader

502 and 507, wherein,

after a user uploads a plug-in to a processing template library, the class loader manager associates a custom class loader 502 with the uploaded plug-in, the parent class of the custom class loader 502 sequentially comprises a module class loader 504, an application class loader 505, an extension class loader 506, and a guide class loader 507, the custom class loader 502 inherits a URL class loader 503, the URL class loader 503 can load classes and resources from a search path pointing to a JAR file and a URL of a target, and since the plug-in is usually a JAR file, the custom type loader 502 can acquire the plug-in through the URL class loader 503.

In the process of initializing the target processing module, the task processing device first acquires a custom class loader associated with the plug-in, so that the custom class loader acquires class information in the target processing template in the plug-in through the URL class loader, and newly initializes the target processing module according to the acquired type, where the class information may include an implementation class, or the class information may include an implementation class and a configuration class, specifically:

when the class information comprises an implementation class and a configuration class, according to the class information, the task processing device reflects a constructor in the implementation class and performs JSON deserialization on the configuration class to realize the initialization of the target processing module;

when the class information comprises the implementation class, the task processing device reflects a constructor in the implementation class according to the class information so as to initialize the target processing module.

Another possible implementation: the target processing template is a public processing template;

in this possible implementation manner, the task processing device obtains class information from the target processing template, and initializes the target processing module according to the class information.

It should be noted that, in this feasible implementation manner, the process of initializing the target processing module according to the class information is the same as the process of initializing the target processing module according to the class information in the previous feasible implementation manner, and details are not repeated here.

The method shown in the embodiment of fig. 3 is described in detail below by way of specific examples.

For example, when the target processing chain needs to be initialized, configuration information corresponding to the target processing chain is first obtained, and 3 target processing modules corresponding to the target processing chain can be determined according to the configuration information corresponding to the target processing chain and are respectively marked as processing modules 1 to 3, where processing templates corresponding to the 3 processing modules and types of the processing modules are respectively shown in table 3:

TABLE 3

Identification of processing modules	Identification of process templates	Type of processing module
			Processing module 1	Treatment template 1	Common processing template
Processing module 2	Treatment template 2	Common processing template
			Processing module 3	Treatment template 3	Custom processing template (plug-in 1)

After the task processing device determines that the correspondence relationship shown in table 3 is obtained, the task processing device determines that the processing template 1 and the processing template 1 are a common processing module, and then the task processing device directly obtains the processing template 1 and the processing template 2 from the common processing module library, initializes the processing module 1 through the processing template 1 so that the processing module 1 has the processing function of the processing template 1, and initializes the processing module 2 through the processing template 2 so that the processing module 2 has the processing function of the processing template 2.

The task processing device judges that the processing template 3 is a self-defined processing template, the task processing device firstly determines that the processing template 3 is positioned in the plug-in 1, acquires the processing template 3 from the plug-in 1, and initializes the processing module 3 through the processing template 3 so that the processing module 3 has the processing function of the processing template 3; after the task processing device completes initialization of the processing modules 1 to 3, initialization of the target processing chain is completed.

On the basis of any one of the above embodiments, in the process of running the processing chain, in order to obtain the running status of the processing chain in real time, the running status of the processing chain may be monitored in real time, specifically: the method can acquire the running information of each processing module in a processing chain in real time, such as the execution time, the execution context and the like of each processing module, detect whether each processing module runs normally according to the acquired running information, and generate diagnosis information, so that a user can conveniently check the running condition of each processing module, the running condition of each processing module can be identified by fonts with different colors, for example, when the processing module runs normally, the generated diagnosis information can be represented by green, when the processing module runs abnormally, the generated diagnosis information can be represented by red, and when the processing module runs abnormally, the user can analyze the running condition of the processing module according to the acquired running information so as to position the fault of the processing module; the mode is simple and visual, a user can easily know the operation condition of the processing module, and when the processing module operates abnormally, the user can conveniently position the fault of the processing module according to the operation information, so that the maintenance efficiency of the user on the processing module is improved.

On the basis of any of the above embodiments, before the task processing device processes the task to be processed according to the target processing chain, the task processing device needs to create the target processing chain first, and a method for creating the target processing chain is described below with reference to the embodiment shown in fig. 6, specifically, please refer to the embodiment shown in fig. 6.

Fig. 6 is a flowchart illustrating a method for creating a target processing chain according to the present invention, please refer to fig. 6, where the method may include:

s601, receiving a processing chain establishing request input by a user, wherein the processing chain establishing request comprises an identifier of a target processing chain;

s602, receiving configuration information corresponding to a target processing chain input by a user, wherein the configuration information comprises identifiers of a plurality of target processing modules corresponding to the target processing chain, an execution sequence of each target processing module and an identifier of a processing template corresponding to each processing module;

and S603, creating a target processing chain according to the processing chain creation request and the configuration information.

It should be noted that, in an actual application process, after a target processing chain is created, a plurality of task processes may be performed according to the target processing chain, and therefore, before the embodiments shown in fig. 1 to 5, the embodiment shown in fig. 6 only needs to be executed once, and the embodiment shown in fig. 6 does not need to be executed before the embodiments shown in fig. 1 to 5 are executed each time.

In an actual application process, when a user needs to create a new processing chain, the user may input a processing chain creation request in the task processing device, and optionally, the user may input a preset operation (for example, clicking a processing chain creation button) in the task processing device.

After the user inputs the processing chain creation request, the user may further input configuration information corresponding to the target processing chain in the task processing device, where the configuration information includes identifiers of a plurality of target processing modules corresponding to the target processing chain, an execution sequence of each target processing module, and an identifier of a processing template corresponding to each processing module, specifically, the task processing device includes a processing module library including a plurality of processing modules, the user may select a target processing module corresponding to the target processing chain in the processing module library, and during an actual application process, a relationship between a processing module in the processing module library and a processing template is usually configured, so that the user determines the target processing module and also determines the target processing template corresponding to the target processing module, and after the user selects and completes the target processing module, the user needs to input an association relationship between the target processing modules, to determine the execution order among the various target processing modules.

After the user inputs the configuration information to complete the target processing chain, the task processing device creates the target processing chain according to the processing chain creation request and the configuration information.

In the embodiment shown in fig. 6, when a user needs to create a new processing chain in the task processing device, the user only needs to input configuration information corresponding to the processing chain in the task processing device, and does not need to write software codes for each processing module in the processing chain, thereby improving the efficiency of creating the processing chain.

On the basis of the embodiment shown in fig. 6, the task processing device may receive configuration information input by a user through a plurality of possible implementation manners, and since the configuration information includes identifiers of a plurality of target processing modules corresponding to the target processing chain, identifiers of processing templates corresponding to the processing modules, and an execution order of the target processing modules, a process of receiving the identifiers of the plurality of target processing modules corresponding to the target processing chain and the execution order of the target processing modules, which are input by the user, will be described in detail below with reference to the terminal interface diagrams shown in fig. 7 to 8, specifically, please refer to the embodiment shown in fig. 7 to 8.

Fig. 7 is a schematic diagram of an interactive interface provided in the present invention, please refer to fig. 7, which includes an interface 701-an interface 703, specifically:

after the task processing device receives a processing chain creation request input by a user, the task processing device displays an interface 701 in the interactive interface.

In the interface 701, a selection area M and a configuration area N are included, the selection area M includes identifiers of all processing modules in a module library, the identifiers of all processing modules are arranged in a list form, the identifier of each processing module corresponds to a selected box, and each selected box is in an unselected state initially; the configuration area N is used for displaying the identification of the target processing module selected by the user, and initially, the configuration area N does not include any identification of the target processing module. When the user needs to select the target processing module in the selection area M, the user may perform a selection operation on a selection box in the selection area M, specifically, please refer to the interface 702.

In the interface 702, the user may perform a selection operation on a corresponding selection box in the selection area M according to a processing module required by the newly created processing chain, and after the user selects and completes a processing module in the processing module list, the user may click the "ok" button to determine the identifier of the processing module selected by the user as the identifier of the target processing module. For example, assuming that the processing chain to be created needs the processing module 2, the processing module 4, and the processing module 5, the user performs a selection operation on the selection boxes corresponding to the processing module 2, the processing module 4, and the processing module 5, and performs a click operation on the "ok" button, so that the identifier of the target processing module is displayed in the configuration area, specifically, please refer to the interface 703.

In the interface 703, after the task processing device receives the user's selection operation of the checkboxes of the processing module 2, the processing module 4, and the processing module 5 and the click operation of the "ok" button, the identifiers of the processing module 2, the processing module 4, and the processing module 5 are determined as the identifier of the target processing module, and the identifiers of the processing module 2, the processing module 4, and the processing module 5 are displayed in the area N.

While the user determines the target processing module corresponding to the target processing chain through the embodiment shown in fig. 7, the user also determines the target processing template corresponding to each target processing module, and the execution sequence of receiving the user input is described in detail through the embodiment shown in fig. 8.

Fig. 8 is a schematic diagram of an interactive interface provided by the present invention, please refer to fig. 8, which includes an interface 801 and an interface 802, specifically:

in the interface 801, a selection area M and a configuration area N are included, where the selection area M is used to display the identifiers of all the processing modules in the module library, the configuration area N is used to display the identifier of a target processing module selected by a user, the configuration area N further includes a tool list, the tool list includes a plurality of association tools, the target processing module in the configuration area N can be associated by the plurality of association tools, and optionally, the association tools may include a connection tool (an arrow in the tool list), and an attribute node tool (a "start" node and an "end" node in the tool list); when a user needs to perform a correlation operation on a target processing module in the configuration area N, the user may select a correlation tool from the correlation tool list to perform a correlation operation on each target processing module, specifically, please refer to the interface 802.

In the interface 802, it is assumed that the processing order among the processing module 2, the processing module 4, and the processing module 5 in the newly created processing chain is: since the processing module 2 is the first processing module and the processing module 5 is the last processing module of the processing chain, the user can use the "start" node before the processing module 2 and the "end" node after the processing module 5, and sequentially use the connection tool among the "start" node, the processing module 2, the processing module 4, the processing module 5 and the "end" node to show the processing sequence of each processing module in the processing chain, and after the user completes the association operation on each target processing module, the user can click the "complete" button in the configuration area N, so that the task processing device can generate the execution sequence among the processing module 2, the processing module 4 and the processing module 5 according to the association operation input by the user.

In the embodiments shown in fig. 7 to 8, a user may determine, through a visual operation interface, a plurality of processing modules corresponding to a processing chain and an execution sequence among the plurality of processing modules, so that the task processing device quickly creates the processing chain according to configuration information input by the user.

Fig. 9 is a schematic structural diagram of a task processing device according to a first embodiment of the present invention, referring to fig. 9, the device may include:

a first receiving module 11, configured to receive a task processing request message, where the task processing request message includes an identifier of a task to be processed;

the determining module 12 is configured to determine, according to the task request message, a target processing chain corresponding to the identifier of the task to be processed;

the initialization module 13 is configured to initialize the target processing chain according to the target processing template corresponding to the target processing chain;

and the processing module 14 is configured to process the to-be-processed task according to the initialized target processing chain.

The task processing device shown in the embodiment of the present invention may execute the technical solutions shown in the above method embodiments, and the implementation principles and beneficial effects thereof are similar, and are not described herein again.

Fig. 10 is a schematic structural diagram of a second task processing device according to the second embodiment of the present invention, and referring to fig. 10, the initialization module 13 includes an obtaining unit 131, a determining unit 132, and an initialization unit 133, wherein,

the obtaining unit 131 is configured to obtain configuration information corresponding to a target processing chain;

the determining unit 132 is configured to determine, according to the configuration information, a plurality of target processing modules corresponding to the target processing chain and a target processing template corresponding to each target processing module;

the initialization unit 133 is configured to initialize each target processing module according to the target processing template corresponding to each target processing module.

In a possible implementation, the determining unit 132 is specifically configured to:

In another possible implementation manner, when the target processing template is a custom processing template, the initialization unit 133 is specifically configured to:

acquiring a class loader corresponding to the plug-in;

In another possible implementation manner, when the target processing template is a common processing template, the initialization unit 133 is specifically configured to:

acquiring class information in a target processing template;

In another possible implementation manner, when the class information includes an implementation class and a configuration class, the initialization unit 133 is specifically configured to reflect a constructor in the implementation class and perform JSON deserialization on the configuration class to initialize the target processing module;

when the class information includes the implementation class, the initialization unit 133 is specifically configured to reflect a constructor in the implementation class to initialize the target processing module.

In another possible implementation, the processing module 14 is specifically configured to:

In another possible implementation, the apparatus further comprises a second receiving module 15 and a creating module 16, wherein,

the second receiving module 15 is configured to receive a processing chain creation request input by a user before the first receiving module receives the task processing request message, where the processing chain creation request includes an identifier of a target processing chain;

the second receiving module 15 is further configured to receive configuration information corresponding to a target processing chain input by a user, where the configuration information includes identifiers of a plurality of target processing modules corresponding to the target processing chain, an execution sequence of each target processing module, and an identifier of a processing template corresponding to each processing module;

the creation module 16 is configured to create a target processing chain according to the processing chain creation request and the configuration information.

Fig. 11 is a first structural diagram of a task processing device provided by the present invention, please refer to fig. 11, which includes a processor 21, a memory 22, a communication port 23, and a communication bus 24, where the communication bus 24 is used to implement communication connection between elements, the memory 22 is used to store a program, and the processor 21 is used to read the program in the memory 22 and execute the following operations:

receiving a task processing request message through the communication port 23, wherein the task processing request message includes an identifier of a task to be processed;

In a possible implementation, the processor 21 is specifically configured to:

In another possible implementation, the processor 21 is specifically configured to:

In another possible implementation manner, when the target processing template is the custom processing template, the processor 21 is specifically configured to:

acquiring a class loader corresponding to the plug-in;

In another possible implementation manner, when the target processing template is the common processing template, the processor 21 is specifically configured to:

acquiring class information in the target processing template;

In another possible implementation manner, when the class information includes an implementation class and a configuration class, the processor 21 is specifically configured to: reflecting a constructor in the implementation class and performing JSON deserialization on the configuration class to realize initialization of the target processing module;

when the class information includes an implementation class, the processor 21 is specifically configured to: and reflecting the constructor in the implementation class to realize the initialization of the target processing module.

Fig. 12 is a schematic structural diagram of a second task processing device according to the present invention, and referring to fig. 12, on the basis of the embodiment shown in fig. 11, the device further includes an input device 25, wherein,

the processor 21 is further configured to receive, through the input device 25, a processing chain creation request input by a user before receiving the task processing request message through the communication port 23, where the processing chain creation request includes an identifier of the target processing chain;

the processor 21 is further configured to receive, through the input device 25, the configuration information corresponding to the target processing chain, where the configuration information includes an identifier of the target processing modules corresponding to the target processing chain, an execution order of each target processing module, and an identifier of a processing template corresponding to each processing module;

the processor 21 is further configured to create the target processing chain according to the processing chain creation request and the configuration information.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A task processing method, comprising:

receiving a task processing request message, wherein the task processing request message comprises an identifier of a task to be processed;

determining a target processing chain corresponding to the identifier of the task to be processed according to the task processing request message;

initializing the target processing chain according to a target processing template corresponding to the target processing chain;

processing the task to be processed according to the initialized target processing chain;

initializing the target processing chain according to a target processing template corresponding to the target processing chain, including:

2. The method of claim 1, wherein determining the target processing template corresponding to the target processing module according to the configuration information comprises:

3. The method of claim 2, wherein the target processing template is the customized processing template, and initializing the target processing module according to the target processing template corresponding to the target processing module comprises:

acquiring a class loader corresponding to the plug-in;

4. The method according to claim 2, wherein the target processing template is the common processing template, and initializing the target processing module according to the target processing template corresponding to the target processing module comprises:

acquiring class information in the target processing template;

5. The method according to claim 3 or 4,

the class information includes an implementation class and a configuration class, and the initializing the target processing module according to the class information includes:

reflecting the constructor in the implementation class and performing JSON deserialization on the configuration class to realize initialization of the target processing module.

6. The method according to claim 3 or 4,

the class information includes an implementation class, and the initializing the target processing module according to the class information includes:

7. The method according to any one of claims 1 to 4, wherein processing the task to be processed according to the initialized target processing chain comprises:

8. The method according to any one of claims 1-4, further comprising, prior to receiving the task processing request message:

receiving a processing chain creation request input by a user, wherein the processing chain creation request comprises an identifier of the target processing chain;

receiving the configuration information corresponding to the target processing chain input by a user, wherein the configuration information comprises the identification of the plurality of target processing modules corresponding to the target processing chain, the execution sequence of each target processing module and the identification of the processing template corresponding to each processing module;

and creating the target processing chain according to the processing chain creation request and the configuration information.

9. A task processing apparatus, comprising:

the first receiving module is used for receiving a task processing request message, wherein the task processing request message comprises an identifier of a task to be processed;

a determining module, configured to determine, according to the task processing request message, a target processing chain corresponding to the identifier of the to-be-processed task;

the initialization module is used for initializing the target processing chain according to a target processing template corresponding to the target processing chain;

the processing module is used for processing the task to be processed according to the initialized target processing chain;

the initialization module includes an acquisition unit, a determination unit, and an initialization unit, wherein,

the acquisition unit is used for acquiring the configuration information corresponding to the target processing chain;

the determining unit is configured to determine, according to the configuration information, a plurality of target processing modules corresponding to the target processing chain and a target processing template corresponding to each of the target processing modules;

10. The apparatus according to claim 9, wherein the determining unit is specifically configured to:

11. The apparatus according to claim 10, wherein the target processing template is the custom processing template, and the initialization unit is specifically configured to:

acquiring a class loader corresponding to the plug-in;

12. The apparatus according to claim 10, wherein the target processing template is the common processing template, and the initialization unit is specifically configured to:

acquiring class information in the target processing template;

13. The apparatus of claim 11 or 12,

the class information includes an implementation class and a configuration class, and the initialization unit is specifically configured to reflect a constructor in the implementation class and perform JSON deserialization on the configuration class to initialize the target processing module.

14. The apparatus of claim 11 or 12,

15. The apparatus according to any one of claims 9 to 12, wherein the processing module is specifically configured to:

16. The apparatus according to any of claims 9-12, further comprising a second receiving module and a creating module, wherein,

the second receiving module is configured to receive a processing chain creation request input by a user before the first receiving module receives the task processing request message, where the processing chain creation request includes an identifier of the target processing chain;

the second receiving module is further configured to receive the configuration information corresponding to the target processing chain, where the configuration information includes an identifier of the plurality of target processing modules corresponding to the target processing chain, an execution order of each of the target processing modules, and an identifier of a processing template corresponding to each of the processing modules;

the creating module is configured to create the target processing chain according to the processing chain creation request and the configuration information.

17. A task processing device, comprising a processor, a memory, and a communication port, wherein the memory is used for storing programs, and the processor is used for reading the programs in the memory and executing the following operations:

receiving a task processing request message through the communication port, wherein the task processing request message comprises an identifier of a task to be processed;

wherein the processor is specifically configured to: