CN113918330A - Method and device for quickly handling batch isomorphic tasks - Google Patents
Method and device for quickly handling batch isomorphic tasks Download PDFInfo
- Publication number
- CN113918330A CN113918330A CN202111181760.3A CN202111181760A CN113918330A CN 113918330 A CN113918330 A CN 113918330A CN 202111181760 A CN202111181760 A CN 202111181760A CN 113918330 A CN113918330 A CN 113918330A
- Authority
- CN
- China
- Prior art keywords
- isomorphic
- task
- tasks
- batch
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/508—Monitor
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Medical Informatics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a method and a device for quickly handling isomorphic tasks in batches, wherein the method comprises the following steps: establishing a typical isomorphic service model, and combining batch tasks into a disposal task; the system service defines time sensitivity and is applied to an isomorphic service model; constructing an isomorphic process, and setting concurrent counting control for the isomorphic process; after the task is initiated, judging whether to trigger an isomorphic process according to the defined time sensitivity, calling a corresponding isomorphic service model to perform task isomorphism, and processing and issuing the isomorphic task; and processing isomorphic batch tasks according to the handling type of the isomorphic service model. According to the method and the device, by constructing a typical isomorphic service model, the system automatically identifies isomorphic tasks, and performs scheduling treatment after task merging, so that system-level data interaction concurrency is reduced, system-level performance consumption of batch tasks is reduced, and task execution efficiency and system performance are improved.
Description
Technical Field
The invention relates to the field of batch task processing, in particular to a method and a device for quickly processing batch isomorphic tasks.
Background
The prior art scheme mainly comprises the following steps for batch task disposal schemes: 1. queue handling; 2. cache disposal; 3. thread pool concurrent handling, distributed handling, and the like. These handling schemes basically require separate processing for each task, which improves the execution efficiency by means of concurrent hardware performance, cache mechanism and software, and the consumption of resources is not reduced. For the invocation of part of the underlying devices with performance bottlenecks, under the influence of protocols and the devices, a large number of high-concurrency tasks may cause task handling exception, and tasks which are handled more slowly, such as query verification, may become high-concurrency blocking bottlenecks.
For example, the management of the network device has a session limitation, the time consumption for configuring query, submitting and storing operations is long, and new instructions in the operations cannot be processed. If there are high concurrent tasks, the whole task processing period will be longer, and if the issuing frequency is too high, a large number of failed tasks will occur, and the network device itself will be adversely affected.
Such as provisioning of services to users in a multi-level service system. The service demands submitted by users are scattered and irregular, and service peaks easily appear. In such a scenario, the consumption of time-insensitive handling of highly concurrent tasks on system time performance will affect the time-sensitive traffic and the user experience.
Disclosure of Invention
In order to solve the problems existing in the prior art, the invention provides a method and a device for rapidly processing isomorphic tasks in batches, which are used for merging isomorphic batch tasks, so that corresponding non-time-sensitive tasks can be processed in an idle period, the influence of high-concurrency batch tasks on system performance is reduced, and the task processing efficiency is improved.
In order to achieve the purpose, the invention adopts the following technical scheme:
in an embodiment of the present invention, a method for quickly handling a batch of isomorphic tasks is provided, where the method includes:
establishing a typical isomorphic service model, and combining batch tasks into a disposal task;
the system service defines time sensitivity and is applied to an isomorphic service model;
constructing an isomorphic process, and setting concurrent counting control for the isomorphic process;
after the task is initiated, judging whether to trigger an isomorphic process according to the defined time sensitivity, calling a corresponding isomorphic service model to perform task isomorphism, and processing and issuing the isomorphic task;
and processing isomorphic batch tasks according to the handling type of the isomorphic service model.
Further, the definition of time sensitivity includes:
the time sensitivity I represents the time zero tolerance and is directly executed without isomorphism;
the time sensitivity II represents time sensitivity, tolerates a certain time delay t, and isomorphically processes tasks within the time t;
the time sensitivity III represents a non-time-sensitive task, an off-line processing service and a task in the isomorphic processing T time.
Further, the isomorphic process sets concurrent count control, including:
and calculating the concurrency number limit with the highest execution efficiency of each service through statistical analysis, and executing isomorphic handling or establishing an isomorphic process when the isomorphic task number in the isomorphic process exceeds the concurrency number limit.
Further, after the task is initiated, according to the defined time sensitivity, judging whether to trigger an isomorphic process, calling a corresponding isomorphic service model, performing task isomorphism, and processing and issuing isomorphic tasks, including:
initiating a task with time sensitivity I, executing immediately, and not triggering an isomorphic process;
initiating a task with the time sensitivity II, checking an isomorphic process, starting the isomorphic process if the isomorphic process does not exist, calling a corresponding isomorphic service model, isomorphizing the task, and timing until t; when the timing of the isomorphic process is finished, treating and issuing the isomorphic task; each isomorphic service model corresponds to an isomorphic process;
initiating a task with the time sensitivity III, checking an isomorphic process, starting the isomorphic process if the isomorphic process does not exist, calling a corresponding isomorphic service model, isomorphizing the task, and timing until T; when the isomorphic process timing is finished, judging whether the resources are idle; and if the task is idle, treating the isomorphic task and issuing the isomorphic task, otherwise, timing T again.
Further, processing isomorphic batch tasks according to the handling type of the isomorphic business model, including:
if the terminals of the isomorphic service model support batch disposal, the isomorphic batch tasks are directly executed once;
and if the terminals of the isomorphic service model do not support batch processing, disassembling the isomorphic batch tasks, and assembling and returning the subtask execution results after processing.
In an embodiment of the present invention, a device for quickly handling a batch of isomorphic tasks is further provided, where the device includes:
the isomorphic business model building module is used for extracting business characteristics, building isomorphic business models and providing a capacity base for other modules;
the task isomorphism module is used for isomorphism of task contents according to the isomorphism service model after the task is initiated, and constructing an isomorphism task;
the isomorphic processing module is used for monitoring the execution states of the isomorphic tasks and the subtasks, controlling the concurrency and time of the isomorphic tasks and issuing the isomorphic tasks to the execution module;
and the execution module is used for processing the isomorphic batch tasks according to the handling type of the isomorphic service model.
Further, system services define time sensitivity and are applied to homogeneous service models.
Further, the definition of time sensitivity includes:
the time sensitivity I represents the time zero tolerance and is directly executed without isomorphism;
the time sensitivity II represents time sensitivity, tolerates a certain time delay t, and isomorphically processes tasks within the time t;
the time sensitivity III represents a non-time-sensitive task, an off-line processing service and a task in the isomorphic processing T time.
Further, controlling the concurrency of isomorphic tasks, comprising:
and calculating the concurrency number limit with the highest execution efficiency of each service through statistical analysis, and executing isomorphic handling or establishing an isomorphic process when the isomorphic task number in the isomorphic process exceeds the concurrency number limit.
Further, after the task is initiated, isomorphism of task content is performed according to the isomorphism service model, and an isomorphism task is constructed, wherein the isomorphism task comprises the following steps:
initiating a task with time sensitivity I and immediately executing the task;
initiating a task with time sensitivity II, calling a corresponding isomorphic service model, isomorphizing the task, and timing until t;
and initiating a task with the time sensitivity III, calling a corresponding isomorphic service model, isomorphizing the task, and timing until T.
Further, monitoring the execution states of the isomorphic tasks and the subtasks, and issuing the isomorphic tasks to the execution module comprises:
when the task isomorphism timing of the time sensitivity II is finished, treating the isomorphism task and issuing the isomorphism task to an execution module;
and when the task isomorphism timing of the time sensitivity III is finished, judging whether the resources are idle, if so, handling the isomorphism task and issuing the isomorphism task to an execution module, otherwise, timing again.
Further, processing isomorphic batch tasks according to the handling type of the isomorphic business model, including:
if the terminals of the isomorphic service model support batch disposal, the isomorphic batch tasks are directly executed once;
and if the terminals of the isomorphic service model do not support batch processing, disassembling the isomorphic batch tasks, and assembling and returning the subtask execution results to the isomorphic disposal module after the processing.
In an embodiment of the present invention, a computer device is further provided, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the method for quickly handling the batch isomorphic tasks is implemented.
In an embodiment of the present invention, a computer-readable storage medium is further provided, where a computer program for executing the method for fast handling of a batch isomorphic task is stored in the computer-readable storage medium.
Has the advantages that:
1. the invention can obviously solve the task execution efficiency and success rate of certain scenes by combining and processing isomorphic batch tasks.
2. The invention controls the quantity of concurrent tasks among the systems and improves the efficiency of the system for coordinating and processing the tasks.
Drawings
FIG. 1 is a flowchart illustrating a method for fast handling of isomorphic tasks in a batch according to an embodiment of the present invention;
FIG. 2 is an exemplary diagram of the isomorphism and handling of one embodiment of the present invention;
FIG. 3 is a schematic diagram of task isomorphism and handling flow according to an embodiment of the present invention;
fig. 4 is an exemplary diagram of isomorphism and disposition issued in batches by a network device according to an embodiment of the present invention;
FIG. 5 is an isomorphic and disposition diagram of a multi-level system batch task according to an embodiment of the invention;
FIG. 6 is a block diagram of a fast batch isomorphic task handler according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a computer device according to an embodiment of the present invention.
Detailed Description
The principles and spirit of the present invention will be described below with reference to several exemplary embodiments, which should be understood to be presented only to enable those skilled in the art to better understand and implement the present invention, and not to limit the scope of the present invention in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
As will be appreciated by one skilled in the art, embodiments of the present invention may be embodied as a system, apparatus, device, method, or computer program product. Accordingly, the present disclosure may be embodied in the form of: entirely hardware, entirely software (including firmware, resident software, micro-code, etc.), or a combination of hardware and software.
According to the embodiment of the invention, a method and a device for rapidly processing the isomorphic tasks in batches are provided, by constructing a typical isomorphic service model, the isomorphic tasks are automatically identified by a system, and scheduling processing is carried out after the tasks are combined, so that the concurrence of data interaction of the system level is reduced, the performance consumption of the tasks in batches on the system level is reduced, and the task execution efficiency and the system performance are improved.
The principles and spirit of the present invention are explained in detail below with reference to several representative embodiments of the invention.
Fig. 1 is a flowchart illustrating a batch isomorphic task fast handling method according to an embodiment of the present invention. As shown in fig. 1, the method includes:
and S1, establishing a typical isomorphic business model, and combining the batch tasks into a disposal task. Two ways are as follows: (1) establishing an isomorphic service model by using expert experience; (2) and establishing an isomorphic business model by utilizing machine learning modeling and expert confirmation modes based on a large amount of task processing data.
S2, the system service defines the time sensitivity and applies to the isomorphic service model. The time sensitivity I represents the time zero tolerance and is directly executed without isomorphism; the time sensitivity II indicates time sensitivity, but the batch tasks can cause the overall efficiency of the tasks to be reduced, a certain time delay t is tolerated, the tasks within the time t are isomorphically processed, and the t can be manually set and can also be dynamically adjusted within a certain time interval according to the task execution efficiency through a program; the time sensitivity III represents a non-time-sensitive task, can handle business off line, can isomorphically process the task in T time, and can also be set in a manual or program dynamic adjustment mode.
And S3, constructing an isomorphic process, and setting concurrent counting control by the isomorphic process. And calculating the concurrency number limit with the highest execution efficiency of each service through statistical analysis, namely defining an acceptable threshold of service processing delay, calculating the delay corresponding to different concurrency numbers, if a plurality of samples calculate the average value of the concurrency numbers reaching the delay threshold, taking the average value as the concurrency number limit, and executing isomorphic disposal or newly building an isomorphic process when the number of isomorphic tasks in the isomorphic process exceeds the concurrency number limit.
S4, after the task is initiated, according to the defined time sensitivity, determining whether to trigger an isomorphic process, invoking a corresponding isomorphic service model, performing task isomorphism, and handling and issuing isomorphic tasks, as shown in fig. 2 and fig. 3.
Initiating a task with time sensitivity I, executing immediately, and not triggering an isomorphic process;
initiating a task with the time sensitivity II, checking an isomorphic process, starting the isomorphic process if the isomorphic process does not exist, calling a corresponding isomorphic service model, isomorphizing the task, and timing until t; when the timing of the isomorphic process is finished, treating and issuing the isomorphic task;
if tasks of different isomorphic service models occur simultaneously, different isomorphic processes are started, and each isomorphic service model corresponds to one isomorphic process;
initiating a task with the time sensitivity III, checking an isomorphic process, starting the isomorphic process if the isomorphic process does not exist, calling a corresponding isomorphic service model, isomorphizing the task, and timing until T; when the isomorphic process timing is finished, calling a system monitoring module to judge whether the resources are idle; and if the task is idle, treating the isomorphic task and issuing the isomorphic task, otherwise, timing T again.
And S5, processing the isomorphic batch tasks according to the handling type of the isomorphic business model. If the terminals of the isomorphic service model support batch disposal, the isomorphic batch tasks are directly executed once; and if the terminals of the isomorphic service model do not support batch processing, disassembling the isomorphic batch tasks, and assembling and returning the subtask execution results after processing.
It should be noted that although the operations of the method of the present invention have been described in the above embodiments and the accompanying drawings in a particular order, this does not require or imply that these operations must be performed in this particular order, or that all of the operations shown must be performed, to achieve the desired results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
For a clearer explanation of the above method for rapidly generating a functional configuration based on a new metro network topology, a specific embodiment is described below, however, it should be noted that this embodiment is only for better explaining the present invention, and should not be construed as an undue limitation to the present invention.
The implementation scenario one is as follows: network equipment batch delivery
The strategy issue of the network equipment relates to the prior inspection, the in-process issue and the after-verification. Each task comprises at least three operations for each device, and each operation is unequal. And the network equipment strategy has high formatting and belongs to a typical isomorphic task. According to the disposal method provided by the invention, the isomorphic task can be checked in advance, issued in the process of affairs and verified after affairs, and then the instructions are merged and issued once. The program sorts the information returned by the network devices, and the interaction efficiency between the network devices which easily cause performance problems is remarkably improved, as shown in fig. 4.
And a second implementation scenario: multi-level system batch task handling
The multi-level system coordinates a service handling scenario, generally, a bottom-layer device performs capability encapsulation, and the multi-level system has a uniform data interface format and is also a typical isomorphic model, and for each interface, an isomorphic service model can be constructed. A capability interface between systems is required to support batch task delivery.
The uppermost system is directly oriented to users, tasks are scattered and not determined concurrently, the bottom system is responsible for handling service capacity and handling massive same service capacity repeatedly, interfaces interacted between systems can be subjected to isomorphic processing, loss of service performance between systems is reduced, a large number of high concurrences are handled inside the systems, and efficiency and system performance of cooperative handling of the whole system can be improved, as shown in fig. 5.
Based on the same inventive concept, the invention also provides a device for quickly handling the batch isomorphic tasks. The implementation of the device can be referred to the implementation of the method, and repeated details are not repeated. The term "module," as used below, may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
FIG. 6 is a block diagram of a fast handling apparatus for isomorphic task in batch according to an embodiment of the present invention. As shown in fig. 6, the apparatus includes:
and the isomorphic business model building module 101 is positioned on the business organization system side and used for extracting business features, building isomorphic business models and providing a capacity base for other modules.
The task isomorphism module 102 is positioned at the business organization system side and used for isomorphism of task contents according to the isomorphism business model after the task is initiated to construct an isomorphism task;
the isomorphic processing module 103 is positioned at the business organization system side and used for monitoring the execution state of isomorphic tasks and subtasks, controlling the concurrency and time of isomorphic tasks and issuing the isomorphic tasks to the execution module; the basic information required to be maintained includes: isomorphic task number, service model number, isomorphic task execution time, isomorphic task state, isomorphic subtask number, subtask state, subtask processing time and the like;
the system service defines time sensitivity and is applied to an isomorphic service model; the time sensitivity I represents the time zero tolerance and is directly executed without isomorphism; the time sensitivity II represents time sensitivity, tolerates a certain time delay t, and isomorphically processes tasks within the time t; the time sensitivity III represents a non-time-sensitive task, off-line processing service and isomorphically processing the task in T time;
initiating a task with time sensitivity I and immediately executing the task;
initiating a task with time sensitivity II, calling a corresponding isomorphic service model, isomorphizing the task, and timing until t; when the timing is finished, the isomorphic task is processed and issued to the execution module;
initiating a task with time sensitivity III, calling a corresponding isomorphic service model, isomorphizing the task, and timing until T; when the timing is finished, judging whether the resources are idle, if so, processing the isomorphic task and issuing the isomorphic task to an execution module, otherwise, timing again;
and calculating the concurrency number limit with the highest execution efficiency of each service through statistical analysis, and executing isomorphic handling or establishing an isomorphic process when the isomorphic task number in the isomorphic process exceeds the concurrency number limit.
And the execution module 104 is located on the side of the capability output system and is used for processing the isomorphic batch tasks according to the handling type of the isomorphic business model. If the terminals of the isomorphic service model support batch disposal, the isomorphic batch tasks are directly executed once; if the terminals of the isomorphic service model do not support batch processing, the isomorphic batch tasks are disassembled, and the subtask execution results are assembled and returned to the isomorphic processing module 103 after processing.
It should be noted that although several modules of the batch isomorphic task fast handler are mentioned in the above detailed description, such partitioning is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the modules described above may be embodied in one module according to embodiments of the invention. Conversely, the features and functions of one module described above may be further divided into embodiments by a plurality of modules.
Based on the aforementioned inventive concept, as shown in fig. 7, the present invention further provides a computer apparatus 200, which includes a memory 210, a processor 220, and a computer program 230 stored on the memory 210 and executable on the processor 220, wherein the processor 220 implements the aforementioned batch isomorphic task fast handling method when executing the computer program 230.
Based on the foregoing inventive concept, the present invention further provides a computer-readable storage medium storing a computer program for executing the foregoing batch isomorphic task fast processing method.
According to the method and the device for rapidly processing the isomorphic batch tasks, disclosed by the invention, the task execution efficiency and the success rate of certain scenes can be obviously solved by combining and processing the isomorphic batch tasks; the invention controls the quantity of concurrent tasks among the systems and improves the efficiency of the system for coordinating and processing the tasks.
While the spirit and principles of the invention have been described with reference to several particular embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, nor is the division of aspects, which is for convenience only as the features in such aspects may not be combined to benefit. The invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.
The limitation of the protection scope of the present invention is understood by those skilled in the art, and various modifications or changes which can be made by those skilled in the art without inventive efforts based on the technical solution of the present invention are still within the protection scope of the present invention.
Claims (14)
1. A method for quickly handling a batch isomorphic task is characterized by comprising the following steps:
establishing a typical isomorphic service model, and combining batch tasks into a disposal task;
the system service defines time sensitivity and is applied to an isomorphic service model;
constructing an isomorphic process, and setting concurrent counting control for the isomorphic process;
after the task is initiated, judging whether to trigger an isomorphic process according to the defined time sensitivity, calling a corresponding isomorphic service model to perform task isomorphism, and processing and issuing the isomorphic task;
and processing isomorphic batch tasks according to the handling type of the isomorphic service model.
2. The batch isomorphic task fast processing method according to claim 1, wherein the definition of time sensitivity comprises:
the time sensitivity I represents the time zero tolerance and is directly executed without isomorphism;
the time sensitivity II represents time sensitivity, tolerates a certain time delay t, and isomorphically processes tasks within the time t;
the time sensitivity III represents a non-time-sensitive task, an off-line processing service and a task in the isomorphic processing T time.
3. The method for rapidly handling the isomorphic task batch according to claim 1, wherein the isomorphic process sets a concurrent number counting control, comprising:
and calculating the concurrency number limit with the highest execution efficiency of each service through statistical analysis, and executing isomorphic handling or establishing an isomorphic process when the isomorphic task number in the isomorphic process exceeds the concurrency number limit.
4. The method for rapidly processing the isomorphic tasks in batches according to claim 1, wherein after the tasks are initiated, whether isomorphic processes are triggered or not is judged according to defined time sensitivity, corresponding isomorphic service models are called to perform task isomorphism, and the isomorphic tasks are processed and issued, and the method comprises the following steps:
initiating a task with time sensitivity I, executing immediately, and not triggering an isomorphic process;
initiating a task with the time sensitivity II, checking an isomorphic process, starting the isomorphic process if the isomorphic process does not exist, calling a corresponding isomorphic service model, isomorphizing the task, and timing until t; when the timing of the isomorphic process is finished, treating and issuing the isomorphic task; each isomorphic service model corresponds to an isomorphic process;
initiating a task with the time sensitivity III, checking an isomorphic process, starting the isomorphic process if the isomorphic process does not exist, calling a corresponding isomorphic service model, isomorphizing the task, and timing until T; when the isomorphic process timing is finished, judging whether the resources are idle; and if the task is idle, treating the isomorphic task and issuing the isomorphic task, otherwise, timing T again.
5. The method for rapidly disposing the isomorphic batch tasks according to claim 1, wherein the processing the isomorphic batch tasks according to the disposition type of the isomorphic business model comprises:
if the terminals of the isomorphic service model support batch disposal, the isomorphic batch tasks are directly executed once;
and if the terminals of the isomorphic service model do not support batch processing, disassembling the isomorphic batch tasks, and assembling and returning the subtask execution results after processing.
6. A device for rapidly handling homogeneous tasks in batches, the device comprising:
the isomorphic business model building module is used for extracting business characteristics, building isomorphic business models and providing a capacity base for other modules;
the task isomorphism module is used for isomorphism of task contents according to the isomorphism service model after the task is initiated, and constructing an isomorphism task;
the isomorphic processing module is used for monitoring the execution states of the isomorphic tasks and the subtasks, controlling the concurrency and time of the isomorphic tasks and issuing the isomorphic tasks to the execution module;
and the execution module is used for processing the isomorphic batch tasks according to the handling type of the isomorphic service model.
7. The batch isomorphic task fast handler of claim 6 wherein system services define time sensitivity and are applied to isomorphic service models.
8. The batch isomorphic task fast handler device of claim 7, wherein the definition of time sensitivity comprises:
the time sensitivity I represents the time zero tolerance and is directly executed without isomorphism;
the time sensitivity II represents time sensitivity, tolerates a certain time delay t, and isomorphically processes tasks within the time t;
the time sensitivity III represents a non-time-sensitive task, an off-line processing service and a task in the isomorphic processing T time.
9. The apparatus for rapidly processing the isomorphic task batch as recited in claim 6, wherein the controlling the concurrency of isomorphic tasks comprises:
and calculating the concurrency number limit with the highest execution efficiency of each service through statistical analysis, and executing isomorphic handling or establishing an isomorphic process when the isomorphic task number in the isomorphic process exceeds the concurrency number limit.
10. The apparatus for rapidly processing the isomorphic task in batch according to claim 6, wherein after the task is initiated, isomorphism of task content is performed according to the isomorphism service model, and the isomorphism task is constructed, including:
initiating a task with time sensitivity I and immediately executing the task;
initiating a task with time sensitivity II, calling a corresponding isomorphic service model, isomorphizing the task, and timing until t;
and initiating a task with the time sensitivity III, calling a corresponding isomorphic service model, isomorphizing the task, and timing until T.
11. The apparatus for rapidly processing the isomorphic tasks in batch according to claim 6, wherein the monitoring the execution status of the isomorphic tasks and the subtasks, and the issuing of the isomorphic tasks to the execution module, comprises:
when the task isomorphism timing of the time sensitivity II is finished, treating the isomorphism task and issuing the isomorphism task to an execution module;
and when the task isomorphism timing of the time sensitivity III is finished, judging whether the resources are idle, if so, handling the isomorphism task and issuing the isomorphism task to an execution module, otherwise, timing again.
12. The apparatus for fast processing of isomorphic batch tasks according to claim 6, wherein the processing of isomorphic batch tasks according to the processing type of isomorphic business model comprises:
if the terminals of the isomorphic service model support batch disposal, the isomorphic batch tasks are directly executed once;
and if the terminals of the isomorphic service model do not support batch processing, disassembling the isomorphic batch tasks, and assembling and returning the subtask execution results to the isomorphic disposal module after the processing.
13. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of any of claims 1-5 when executing the computer program.
14. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for executing the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111181760.3A CN113918330A (en) | 2021-10-11 | 2021-10-11 | Method and device for quickly handling batch isomorphic tasks |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111181760.3A CN113918330A (en) | 2021-10-11 | 2021-10-11 | Method and device for quickly handling batch isomorphic tasks |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113918330A true CN113918330A (en) | 2022-01-11 |
Family
ID=79239002
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111181760.3A Pending CN113918330A (en) | 2021-10-11 | 2021-10-11 | Method and device for quickly handling batch isomorphic tasks |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113918330A (en) |
-
2021
- 2021-10-11 CN CN202111181760.3A patent/CN113918330A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108762931A (en) | Method for scheduling task, server based on distributed scheduling system and storage medium | |
| CN104298550B (en) | A kind of dynamic dispatching method towards Hadoop | |
| CN110308980A (en) | Batch processing method, device, equipment and the storage medium of data | |
| CN111338791A (en) | Method, device and equipment for scheduling cluster queue resources and storage medium | |
| CN102081554A (en) | Cloud computing operating system as well as kernel control system and method thereof | |
| CN111158888A (en) | Multi-task scheduling method and device | |
| US8312466B2 (en) | Restricting resources consumed by ghost agents | |
| CN113157411A (en) | Reliable configurable task system and device based on Celery | |
| CN111160873A (en) | Batch processing device and method based on distributed architecture | |
| CN111209077A (en) | Deep learning framework design method | |
| CN1055557C (en) | Method of controlling message overload of unit program in multi processor controlling system | |
| CN104298565B (en) | A kind of method and device of initiating port | |
| CN112231073A (en) | Distributed task scheduling method and device | |
| CN109739634A (en) | A kind of atomic task execution method and device | |
| CN113485812B (en) | Partition parallel processing method and system based on large-data-volume task | |
| CN110417678A (en) | A kind of method and device of application programming interfaces current limliting | |
| CN114463131A (en) | Transaction processing method and device, storage medium and electronic equipment | |
| EP3667495A1 (en) | Task scheduling method, apparatus and device, and storage medium | |
| CN113687926A (en) | Control method, device and equipment for server asset scanning | |
| US11429435B1 (en) | Distributed execution budget management system | |
| CN113918330A (en) | Method and device for quickly handling batch isomorphic tasks | |
| CN117149382A (en) | Virtual machine scheduling method, device, computer equipment and storage medium | |
| CN114385227A (en) | Service processing method, device, equipment and storage medium | |
| US20230393782A1 (en) | Io request pipeline processing device, method and system, and storage medium | |
| CN115268909A (en) | Method, system and terminal for establishing and running construction task at web front end |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |