CN111078510B - Task processing progress recording method and device - Google Patents
Task processing progress recording method and device Download PDFInfo
- Publication number
- CN111078510B CN111078510B CN201811212841.3A CN201811212841A CN111078510B CN 111078510 B CN111078510 B CN 111078510B CN 201811212841 A CN201811212841 A CN 201811212841A CN 111078510 B CN111078510 B CN 111078510B
- Authority
- CN
- China
- Prior art keywords
- task
- processing
- subtask
- processing module
- task processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/324—Display of status information
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/17—Function evaluation by approximation methods, e.g. inter- or extrapolation, smoothing, least mean square method
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Data Mining & Analysis (AREA)
- Computational Mathematics (AREA)
- Pure & Applied Mathematics (AREA)
- Mathematical Optimization (AREA)
- Quality & Reliability (AREA)
- Mathematical Analysis (AREA)
- Entrepreneurship & Innovation (AREA)
- Mathematical Physics (AREA)
- Economics (AREA)
- General Engineering & Computer Science (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Operations Research (AREA)
- Marketing (AREA)
- Algebra (AREA)
- Game Theory and Decision Science (AREA)
- Educational Administration (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Development Economics (AREA)
- Debugging And Monitoring (AREA)
- Retry When Errors Occur (AREA)
Abstract
The invention discloses a method and a device for recording task processing progress, relates to the technical field of data processing, and aims to solve the problem that the performance of task processing progress recording is poor because transaction rollback processing is required to be carried out when a program crashes in order to accurately record task processing amount. The method of the invention comprises the following steps: acquiring subtask processing logs corresponding to all subtasks in the task respectively; respectively calculating the first task number and the second task number corresponding to each task processing module according to the subtask processing logs; and determining and recording the processing progress of the task in each task processing module according to the first task number and the second task number. The method and the device are suitable for being applied to recording the task processing progress.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a method and an apparatus for recording task processing progress.
Background
With the rapid development of big data technology, the application of big data is also becoming wider and wider. In the big data task processing process, the task processing progress needs to be monitored. However, a task typically includes a large amount of data, which is equivalent to a large number of subtasks, and each piece of data is processed in a plurality of steps. Therefore, in order to save the total number of tasks and the number of processed tasks in each processing step when recording the task processing progress, it is necessary to update the saved number every time one or a batch of tasks are processed.
Currently, when recording the task processing progress in each step, distributed transactions are mainly used to record task volume numbers. However, when the big data task processing program crashes, for the subtasks currently being processed in each task processing module, the distributed transaction cannot accurately record whether the subtasks are completed, in order to ensure the accuracy of the task processing progress record, for example, the number of processed tasks of the distributed transaction record is 135 when the program crashes, when the program is restarted, whether the recorded number is correct needs to be judged through the transaction rollback process, and when the recorded number is wrong, the number is corrected, so that the performance of the task processing progress record is poor by the existing mode of recording the task processing progress by using the distributed transaction.
Disclosure of Invention
In view of the above problems, the present invention provides a method and an apparatus for recording task processing progress, which are mainly aimed at recording task processing progress according to task processing logs created by each task processing module when task processing is completed.
In order to solve the above technical problems, in a first aspect, the present invention provides a method for recording task processing progress, where the method includes:
Acquiring subtask processing logs corresponding to the subtasks in the task respectively, wherein the subtask processing logs are respectively created when each corresponding subtask processing module completes processing of each subtask;
respectively calculating a first task number and a second task number corresponding to each task processing module according to the subtask processing logs, wherein the first task number is the number of all subtasks injected into the task processing modules, and the second task number is the number of the subtasks processed and completed by the task processing modules;
and determining and recording the processing progress of the task in each task processing module according to the first task number and the second task number.
Optionally, before obtaining the processing log of the task, the method further includes:
and configuring the task processing module so that the task processing module creates the subtask processing log when the processing of each subtask is completed.
Optionally, the subtask processing log includes first identification information and second identification information, the first identification information is used for identifying a current task processing module that executes the subtask processing and creates the subtask processing log, the second identification information is used for identifying a next task processing module that executes the subtask processing, the subtask processing log further includes quantity information, the quantity information is used for identifying a quantity of subtasks that the current task processing module transmits to the next task processing module, and the calculating, according to the subtask processing log, the first task quantity corresponding to each of the task processing modules includes:
Extracting the subtask processing logs corresponding to each task processing module according to the second identification information to obtain a first log set corresponding to each task processing module;
sequentially extracting the quantity information in each subtask processing log in the first log set;
and superposing the extracted quantity information to obtain a first task quantity corresponding to each task processing module.
Optionally, the calculating, according to the subtask processing log, the second task number corresponding to each task processing module includes:
extracting the subtask processing logs corresponding to each task processing module according to the first identification information to obtain a second log set corresponding to each task processing module;
and counting the number of the subtask processing logs in the second log set to obtain the second task number corresponding to each task processing module.
Optionally, each subtask processing log further includes identification information of the subtasks, and before the first task number and the second task number corresponding to each task processing module are calculated according to the subtask processing log, the method further includes:
And performing de-duplication processing on the subtask processing logs corresponding to each task processing module according to the identification information of the subtasks.
Optionally, the method further comprises:
according to the first task quantity and the second task quantity which are respectively corresponding to the task processing modules, calculating a first total task quantity and a second total task quantity of the tasks, wherein the first total task quantity is the quantity of all the subtasks contained in the tasks, and the second total task quantity is the quantity of the subtask processing completed by all the task processing modules;
and when the first total task quantity and the second total task quantity are equal, determining that the processing of the task is completed.
Optionally, the subtask processing log further includes time information, and the method further includes:
sequencing the subtask processing logs according to time information;
and calculating task processing time corresponding to each task processing module according to the time information.
In a second aspect, the present invention also provides a recording device for task processing progress, where the device includes:
the task processing system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring subtask processing logs respectively corresponding to all subtasks in a task, and the subtask processing logs are respectively created when each corresponding subtask processing module finishes processing of each subtask;
The computing unit is used for respectively computing a first task number and a second task number corresponding to each task processing module according to the subtask processing logs, wherein the first task number is the number of all subtasks injected into the task processing modules, and the second task number is the number of the subtasks processed and completed by the task processing modules;
and the determining unit is used for determining and recording the processing progress of the tasks in each task processing module according to the first task number and the second task number.
Optionally, the apparatus further includes:
and the configuration unit is used for configuring the task processing module so that the task processing module creates the subtask processing log when the processing of each subtask is completed.
Optionally, the subtask processing log includes first identification information and second identification information, the first identification information is used for identifying a current task processing module that executes the subtask processing, the second identification information is used for identifying a next task processing module that executes the subtask processing and creates the subtask processing log, the subtask processing log further includes quantity information, the quantity information is used for identifying a quantity of subtasks that the current task processing module transmits to the next task processing module, and the calculating unit includes:
The first extraction module is used for extracting the subtask processing logs corresponding to each task processing module according to the second identification information to obtain a first log set corresponding to each task processing module;
the first extraction module is further configured to sequentially extract the number information in each subtask processing log in the first log set;
and the superposition module is used for superposing the extracted plurality of quantity information to obtain a first task quantity corresponding to each task processing module.
Optionally, the computing unit further includes: the second extraction module and the statistics module.
The second extraction module is used for extracting the subtask processing logs corresponding to each task processing module according to the first identification information to obtain a second log set corresponding to each task processing module;
the statistics module is configured to count the number of subtask processing logs in the second log set, so as to obtain a second task number corresponding to each task processing module.
Optionally, each subtask processing log further includes identification information of the subtasks, and the apparatus further includes:
And the de-duplication unit is used for performing de-duplication treatment on the subtask processing logs corresponding to each task processing module according to the identification information of the subtasks.
Alternatively to this, the method may comprise,
the computing unit is further configured to compute a first total task amount and a second total task amount of the tasks according to a first task amount and a second task amount corresponding to each task processing module, where the first total task amount is the number of all subtasks included in the tasks, and the second total task amount is the number of subtask processes completed by all task processing modules.
The determining unit is configured to determine that processing of the task is completed when the first total task amount and the second total task amount are equal.
Optionally, the subtask processing log further includes time information, and the apparatus further includes: a sorting unit for sorting the articles in a row,
the sequencing unit is used for sequencing the subtask processing logs according to the time information;
and the calculating unit is also used for calculating the task processing time corresponding to each task processing module according to the time information.
In order to achieve the above object, according to a third aspect of the present invention, there is provided a storage medium including a stored program, wherein the recording method of the task processing progress described above is controlled to be performed by a device in which the storage medium is located when the program is run.
In order to achieve the above object, according to a fourth aspect of the present invention, there is provided a processor for running a program, wherein the program runs while executing the recording method of task processing progress described above.
By means of the technical scheme, when the task processing progress is recorded by using the distributed transaction, the transaction rollback processing is needed to be carried out when a program crashes, so that the task processing progress is poorer in performance, and when each task processing module completes each subtask processing, a corresponding subtask processing log is created, so that the task processing progress can be determined by acquiring the subtask processing logs respectively corresponding to each subtask, calculating the total subtask quantity injected into each task processing module and the subtask quantity processed by each task processing module according to the subtask processing logs, and further, the task processing progress of each task processing module is determined; in addition, the time information is configured in the subtask processing logs so as to calculate the task processing time of each task processing module or the processing time of each task according to the time in each subtask processing log, thereby more comprehensively recording the task processing and improving the comprehensiveness of the task processing progress record.
The foregoing description is only an overview of the present invention, and is intended to be implemented in accordance with the teachings of the present invention in order that the same may be more clearly understood and to make the same and other objects, features and advantages of the present invention more readily apparent.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:
FIG. 1 shows a flowchart of a recording method of task processing progress provided by an embodiment of the present invention;
FIG. 2 is a flowchart of another method for recording task processing progress according to an embodiment of the present invention;
FIG. 3 is a block diagram showing the constitution of a recording device for task processing progress provided by an embodiment of the present invention;
fig. 4 is a block diagram showing another recording apparatus for task processing progress according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
In order to improve accuracy of task processing progress recording, an embodiment of the present invention provides a method for recording task processing progress, as shown in fig. 1, where the method includes:
101. and acquiring subtask processing logs corresponding to all the subtasks in the task respectively.
The subtask processing logs are respectively created for each task processing module when the processing of each corresponding subtask is completed. The task processing module is a functional module for executing task processing, such as a data acquisition module for executing data acquisition tasks, a storage module for executing data storage tasks, and the like.
It should be noted that, in the task processing process, any task includes a plurality of subtasks, each subtask may be sequentially transferred and processed in each task processing module, and in the transfer process, the subtasks may fail to be processed, or more subtasks may be generated. And each task processing module can be configured in advance for the embodiment of the invention, so that the task processing module can create a corresponding subtask processing log when each subtask processing is completed, and send and store the created subtask processing log in a database, thereby directly extracting the task processing log corresponding to the task from the database when a user needs to acquire the task processing progress.
Furthermore, for the embodiment of the invention, a plurality of subtask processing logs corresponding to a plurality of tasks respectively can be stored in the database, and when the subtask processing log is created, the task processing module is configured to add identification information corresponding to the tasks in the log, so that the task processing log can be distinguished by utilizing the task identification.
102. And respectively calculating the first task number and the second task number corresponding to each task processing module according to the subtask processing logs.
The first task number is the number of all the subtasks injected into the task processing module, and the second task number is the number of the subtasks which the task processing module has processed and completed.
When the task processing progress to be recorded in the task processing process is that a plurality of subtasks are transferred in the task processing modules, the number of subtasks to be processed and the number of subtasks which have been processed by each task processing module are required to be processed. For the embodiment of the invention, when the subtask processing logs are created, each task processing module can be configured with the identification information of the current task processing module and the identification information of the next task processing module in the logs, so that the number of subtasks to be processed and the number of subtasks which are processed and are respectively corresponding to each task processing module can be respectively calculated according to the two identification information in the step, and further the record of the task processing progress of each task processing module is realized.
For example, for task A, there are 10 subtasks, subtask a 1 、a 2 ……a 10 The ten subtasks need to be processed by the task processing module 1, the task processing module 2 and the task processing module 3 in sequence, and when each subtask processing is completed, each task processing module creates a subtask processing log and stores the subtask processing log in a database. When a user needs to acquire the processing progress of the task A in the three task processing modules, 6 subtask processing logs are extracted from the database according to the identification information of the task A, and the processing logs are { log 1: a current task processing module 1 and a next task processing module 2; log 2: a current task processing module 1 and a next task processing module 2; log 3: a current task processing module 1 and a next task processing module 2; log 4: a current task processing module 2,A next task processing module 3; log 5: a current task processing module 2 and a next task processing module 3; log 6: the current task processing module 3}, at this time, all the subtasks required to be completed by the task processing module 1 can be obtained as 10 subtasks, and the number of the subtasks which are completed to be processed is 3; the task processing module 2 has 3 tasks to be completed, and the number of subtasks which are completed to be processed is 2; the task processing module 3 needs 2 tasks to be completed, and the number of subtasks that have completed processing is 1.
103. And determining and recording the processing progress of the task in each task processing module according to the first task number and the second task number.
The task processing progress may be a percentage of completing subtask processing by each task processing module, or may be the number of incomplete subtasks, which is not specifically limited in the embodiment of the present invention. For example, when the task processing progress is a percentage of the completion of the subtask processing by each task processing module, the task processing progress may be determined and recorded according to the quotient between the first task number and the second task number calculated in the above steps.
According to the task processing progress recording method, when the distributed transaction is utilized to record the task processing progress in the prior art, the transaction rollback processing is needed to accurately record the task processing amount when a program crashes, so that the task processing progress recording performance is poor.
Further, as a refinement and extension to the embodiment shown in fig. 1, the embodiment of the present invention further provides another recording method of task processing progress, as shown in fig. 2.
201. And acquiring subtask processing logs corresponding to all the subtasks in the task respectively.
The subtask processing logs are respectively created for each task processing module when the processing of each corresponding subtask is completed. The specific embodiment of this step may refer to the corresponding description in step 101, which is not repeated here.
For the embodiment of the present invention, before this step, it may further include: and configuring the task processing module so that the task processing module creates the subtask processing log when the processing of each subtask is completed. Specifically, in this step, a program package is obtained by packaging the configuration code in advance, so that each task processing module is configured by using the program package, and thus, when the subtask processing is completed, each task processing module creates a corresponding subtask processing log.
In addition, for the embodiment of the present invention, the subtask processing log includes first identification information and second identification information, where the first identification information is used to identify a current task processing module that executes the subtask processing and creates the subtask processing log, and the second identification information is used to identify a next task processing module that executes the subtask processing. The subtask processing log also comprises quantity information, and the quantity information is used for identifying the quantity of the subtasks transmitted to the next task processing module by the current task processing module. It should be noted that, when the task processing module processes any one subtask, one or more subtasks may be generated, so when completing processing of one subtask, the number of subtasks and the number of subtasks generated can be accurately recorded by adding the number of subtasks generated by the current subtask in the subtask processing log and configuring the subtask identification information corresponding to each subtask, thereby ensuring the accuracy of the task processing progress record.
For example, when the task processing module a completes processing the subtask with the subtask identifier M, the identification information carried in the created subtask processing log is: { task ID: task M; module: moduleA; next module: next module b; jobID: m is M 1 、M 2 、M 3 The method comprises the steps of carrying out a first treatment on the surface of the count:3}, wherein the task ID is a task identifier of the executed process, the module is a current task processing module identifier, the next module is a next task processing module identifier, the jobID is a subtask identifier generated in the current task processing module, the count is the number information of the generated subtasks, which indicates that the subtask M is executed at the moment to be processed as a task processing module A, the next task processing module is a task processing module B, and when the task processing module A completes the subtask M, three subtasks are generated as subtasks M respectively 1 Subtask M 2 And subtask M 3 At this time, the number of subtasks injected into the next task processing module B by the task processing module a is 3 identified by count. After each task processing module finishes subtask processing, a task processing log which at least comprises the current task processing module identification, the next task processing module identification, the newly generated subtask identification and the task quantity information sent to the next task processing module by the current task processing module is created, so that the processing progress of each task processing module can be rapidly and accurately calculated according to each subtask processing log, and the accuracy and the efficiency of the task processing progress record are improved.
For the embodiment of the present invention, in order to avoid the problem of task processing progress record error caused by repeated recording of the same subtask, the embodiment of the present invention may further include: and performing de-duplication processing on the log processed by the subtasks according to the identification information of the subtasks. It should be noted that, for a certain subtask, the subtask may be repeatedly processed by a task processing module, and when the subtask generates a plurality of subtasks in the task processing module, the subtask identification information generated by the subtask is the same as the jobId during each repeated processing, so that when the subtask processing is completed, the subtask identification jobId can be de-duplicated according to the newly generated subtask identification jobId, so as to ensure that the number of each subtask is unique, and further improve the accuracy of the task processing progress record. For example, when a subtask of the task X is processed by the task processing module a, 3 subtasks are generated and each subtask identifier is o, p, q, respectively, a corresponding subtask processing log is created when the task processing module completes the subtask processing, and the subtask processing log is subjected to deduplication processing according to a field taskId #module #jobid, that is, x#a#o, x#a#p, x#a#q.
202. And extracting the subtask processing log corresponding to each task processing module according to the second identification information.
Further, a first log set corresponding to each task processing module is obtained. The task processing module may be any task processing module that performs processing the task, and all subtasks to be injected into the task processing module are stored in the obtained first log set. It should be noted that, each subtask processing log includes second identification information, where the second identification information may identify a next task processing module that executes subtask processing, so that all subtasks to be injected into a certain task processing module can be obtained by extracting the subtask processing log according to the second identification information, and therefore, when the first log set of a certain task processing module needs to be extracted, the query condition is determined as "second identification information=identification information of the task processing module to be queried". For example, when it is required to obtain the task processing progress of the task processing module X on the task1, a query condition "next module=modulex and taskid=task1" is input into the database storing the task processing logs, and then a first log set corresponding to the task processing module X is created according to the sub-task processing log extracted at this time.
203. And sequentially extracting the quantity information in each subtask processing log in the first log set.
For example, according to the query condition input in the step 202, five subtask processing logs are extracted, and the count number information carried in each subtask processing log is respectively 2, 5, 4 and 3, that is, the last task processing module of the task processing module X, when the five subtask processing is completed to the task processing module X, the number of subtasks generated by each subtask is respectively 2, 5, 4 and 3.
204. And superposing the extracted plurality of quantity information.
Further, a first task number corresponding to each task processing module is obtained. When a previous task processing module completes processing a certain subtask to generate one or more subtasks, all the subtasks generated at this time need to be injected into a next task processing module, so that the number of all the subtasks injected into each task processing module can be obtained by superposing the number of subtasks newly generated by the previous task processing module. As described in step 203, when the last task processing module processes five subtasks, a corresponding number of subtasks are generated respectively, and at this time, the total number of subtasks that the last task processing module injects into the task processing module X can be calculated as follows: 2+2+5+4+3=16.
For the embodiment of the invention, the number of the new subtasks is obtained by extracting all the subtasks to be injected into the task processing module to be queried according to the next task processing module identification contained in the subtask processing log, further according to the number identification in the subtask processing log, and the number of the subtasks to be injected into the task processing module to be queried is obtained by superposition according to the number information, so that the number of the subtasks to be injected into the task processing module can be recorded rapidly and accurately, and the accuracy and the efficiency of task processing progress recording are improved.
205. And extracting the subtask processing log corresponding to each task processing module according to the first identification information.
Further, a second log set corresponding to each task processing module is obtained. It should be noted that, only when a task processing module completes a certain subtask process, a corresponding subtask processing log can be created, and the log is configured with the identification information of the current task processing module. Therefore, through the first identification information for identifying the current task processing module, all subtasks which are processed by the task processing module to be queried can be extracted.
For the embodiment of the invention, each subtask processing log also contains a task processing state identifier, namely whether the task processing module processes successfully when executing the subtask processing, and in this step, only the subtask processing log with the task processing state being processed successfully can be extracted. In addition, the number of subtasks failed in task processing may be determined according to the task processing status identification information, and when the number of subtasks failed in processing exceeds a certain threshold, alarm information may be output, so that the user may repair or suspend task processing.
206. And counting the number of the subtask processing logs in the second log set.
Further, a second task number corresponding to each task processing module is obtained. For example, when the number of subtasks processed by the task processing module X is queried, the first identification information is input into the database as the query condition of the task processing module X, so as to obtain 8 subtask processing logs, and then the number of subtasks processed by the task processing module X can be determined to be 8. In addition, in the embodiment of the invention, when the task processing progress of a plurality of task processing modules is required to be queried simultaneously, a plurality of query conditions can be input simultaneously to query simultaneously, so that the query efficiency of the task processing progress is further improved.
Further, in order to improve accuracy of task processing progress records, the embodiment of the invention may further include: according to the first task quantity and the second task quantity respectively corresponding to the task processing modules, calculating a first total task quantity and a second total task quantity of the tasks; and when the first total task quantity and the second total task quantity are equal, determining that the task processing is completed. The first total task amount is the number of all the subtasks contained in the task, and the second total task amount is the number of the subtask processes completed by all the task processing modules. It should be noted that, in the embodiment of the present invention, when one task processing module completes one subtask processing, N subtasks identified in the count number information are to be injected into the next subtask processing module, so that only when all the task processing modules complete all the subtask processing corresponding to one task, the task is identified as having completed processing. By accumulating the total number of subtasks required to be completed by all the task processing modules in the task processing system and the number of subtasks completed, determining that the task processing is completed when the two numbers are equal, and verifying whether the two total numbers are equal or not, the problem of misjudgment caused by judging that the task processing is completed when the task is not completed can be avoided, and therefore the accuracy of task processing progress record is improved.
In addition, when the task processing module creates the subtask processing log, time information can be configured, and in the embodiment of the invention, the method further comprises the following steps: sequencing the subtask processing logs according to time information; and calculating task processing time corresponding to each task processing module according to the time information, and calculating task processing time corresponding to each task processing module according to the time information. For example, the time required for a task processing module to process the task may be determined from the difference between the time information in the last created subtask processing log processed by the task processing module and the time information in the first subtask processing log. Of course, the processing time of the task can also be determined according to the difference between the time information in the last subtask processing log created by the last task processing module in the task processing system and the time information in the first subtask processing log created by the first task processing module.
For the embodiment of the invention, the task processing progress can be more comprehensively recorded by configuring the corresponding time information in the subtask processing log and calculating the processing time of each task processing module according to the time information, so that the comprehensiveness of the task processing progress record is improved.
Further, according to the methods described in steps 201 to 206, the embodiment of the present invention may further provide an implementation manner of recording the task processing progress in a specific application scenario, which is specifically described below:
the task S is sequentially processed in 6 task processing modules of the task processing system, and each task processing module creates a subtask processing log as shown in the following table 1 when processing one subtask in the processing process:
TABLE 1
The subtask process log created by the second task processing module upon completion of the subtask process may be as shown in table 2:
TABLE 2
| taskS |
| Module 2 |
| Module 3 |
| Job1、job2 |
| taskS#module2#job1、taskS#module2#job2 |
| 2 |
| Is that |
When the task processing progress of the task S needs to be queried, identification information carrying the task S and the identification information of the task processing modules can be input into a database, corresponding subtask processing logs are extracted, and then the number of subtasks which need to be processed by each task processing module, the number of subtasks which are processed by each task processing module and the like are calculated according to the subtask processing logs.
However, it should be noted that the specific implementation manner described in the foregoing application scenario is merely exemplary, and is not the only specific implementation manner of the embodiment of the present invention, but is only one of the optimized implementation manners consistent with the method described in the present invention.
Further, as an implementation of the method shown in fig. 1, the embodiment of the present invention further provides a recording device for task processing progress, which is configured to implement the method shown in fig. 1. The embodiment of the device corresponds to the embodiment of the method, and for convenience of reading, details of the embodiment of the method are not repeated one by one, but it should be clear that the device in the embodiment can correspondingly realize all the details of the embodiment of the method. As shown in fig. 3, the apparatus includes: an acquisition unit 31, a calculation unit 32, a determination unit 33, wherein
The obtaining unit 31 may be configured to obtain subtask processing logs corresponding to respective subtasks in a task, where the subtask processing logs are created for each task processing module when processing of each corresponding subtask is completed.
The calculating unit 32 may be configured to calculate, according to the subtask processing logs obtained by the obtaining unit 31, a first task number and a second task number corresponding to each of the task processing modules, where the first task number is a number of all subtasks injected into the task processing module, and the second task number is a number of subtasks that have been processed and completed by the task processing module.
The determining unit 33 may be configured to determine and record a processing progress of the task in each of the task processing modules according to the first task number and the second task number calculated by the calculating unit 32.
Further, as an implementation of the method shown in fig. 2, the embodiment of the present invention further provides another recording apparatus for task processing progress, which is configured to implement the method shown in fig. 2. The embodiment of the device corresponds to the embodiment of the method, and for convenience of reading, details of the embodiment of the method are not repeated one by one, but it should be clear that the device in the embodiment can correspondingly realize all the details of the embodiment of the method. As shown in fig. 4, the apparatus includes: an acquisition unit 41, a calculation unit 42, a determination unit 43, wherein
The obtaining unit 41 may be configured to obtain subtask processing logs corresponding to respective subtasks in the task, where the subtask processing logs are created for each task processing module respectively when processing of each corresponding subtask is completed.
The calculating unit 42 may be configured to calculate, according to the subtask processing logs obtained by the obtaining unit 41, a first task number and a second task number corresponding to each of the task processing modules, where the first task number is a number of all subtasks injected into the task processing module, and the second task number is a number of subtasks that have been processed and completed by the task processing module.
The determining unit 43 may be configured to determine and record a processing progress of the task in each of the task processing modules according to the first task number and the second task number calculated by the calculating unit 42.
Further, the device further comprises:
the configuration unit 44 may be configured to configure the task processing module so that the task processing module creates the subtask processing log when processing of each of the subtasks is completed.
The deduplication unit 45 may be configured to perform deduplication processing on the subtask processing log corresponding to each task processing module according to the identification information of the subtask. .
Further, the device further comprises: an extraction unit 46, and a superposition unit 47.
The extracting unit 46 may be configured to extract the subtask processing logs corresponding to each task processing module according to the second identification information, so as to obtain a first log set corresponding to each task processing module.
The extracting unit 46 may be further configured to sequentially extract the number information in each of the subtask processing logs in the first log set.
The superimposing unit 47 may be configured to superimpose the extracted plurality of quantity information to obtain a first task quantity corresponding to each task processing module.
Further, the device further comprises: a statistics unit 48.
The extracting unit 46 may be further configured to extract the subtask processing logs corresponding to each task processing module according to the first identification information, so as to obtain a second log set corresponding to each task processing module.
The statistics unit 48 may be further configured to count the number of subtask processing logs in the second log set, to obtain a second number of tasks corresponding to each task processing module.
Further, the method comprises the steps of,
the calculating unit 42 may be further configured to calculate a first total task amount and a second total task amount of the tasks according to a first task amount and a second task amount respectively corresponding to each task processing module.
The determining unit 43 may be further configured to determine that the task processing is completed when the first total task amount and the second total task amount are equal.
Further, the device further comprises: a sorting unit 49.
The sorting unit 49 may be configured to sort each of the subtask processing logs according to time information.
The calculating unit 42 may be further configured to calculate task processing times corresponding to the task processing modules according to the time information.
The embodiment of the invention provides another recording device for task processing progress. The device comprises: an acquisition unit, a calculation unit, and a determination unit. For the prior art, when a task processing progress is recorded by using distributed transactions, in order to accurately record the task processing amount, transaction rollback processing is needed to ensure that the task processing progress is poorer in performance when a program crashes, corresponding subtask processing logs are created when each subtask processing module completes processing of each subtask, so that the task processing progress is ensured and the performance of the task processing progress record is improved while the accuracy of the task processing progress record is ensured by acquiring the subtask processing logs corresponding to each subtask respectively and calculating the total subtask number injected into each task processing module and the subtask number of the processing completed by each task processing module according to the subtask processing logs, and further, the task processing progress of each task processing module is determined; in addition, the time information is configured in the subtask processing logs so as to calculate the task processing time of each task processing module or the processing time of each task according to the time in each subtask processing log, thereby more comprehensively recording the task processing and improving the comprehensiveness of the task processing progress record.
The text processing device includes a processor and a memory, the above-mentioned acquisition unit 31, calculation unit 32, determination unit 33, and the like are stored as program units in the memory, and the above-mentioned program units stored in the memory are executed by the processor to realize the corresponding functions.
The processor includes a kernel, and the kernel fetches the corresponding program unit from the memory. The kernel can be provided with one or more than one, and the performance of task processing progress records is improved by adjusting kernel parameters.
The memory may include volatile memory, random Access Memory (RAM), and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM), among other forms in computer readable media, the memory including at least one memory chip.
The embodiment of the invention provides a storage medium, on which a program is stored, which when executed by a processor, implements a recording method of the task processing progress.
The embodiment of the invention provides a processor which is used for running a program, wherein the recording method of the task processing progress is executed when the program runs.
The embodiment of the invention provides equipment, which comprises a processor, a memory and a program stored in the memory and capable of running on the processor, wherein the processor realizes the following steps when executing the program: acquiring subtask processing logs corresponding to the subtasks in the task respectively, wherein the subtask processing logs are respectively created when each corresponding subtask processing module completes processing of each subtask; respectively calculating a first task number and a second task number corresponding to each task processing module according to the subtask processing logs, wherein the first task number is the number of all subtasks injected into the task processing modules, and the second task number is the number of the subtasks processed and completed by the task processing modules; and determining and recording the processing progress of the task in each task processing module according to the first task number and the second task number.
Further, the method further comprises:
and configuring the task processing module so that the task processing module creates the subtask processing log when the processing of each subtask is completed.
Further, the subtask processing log includes first identification information and second identification information, the first identification information is used for identifying a current task processing module executing the subtask processing, the second identification information is used for identifying a next task processing module executing the subtask processing and creating the subtask processing log, the subtask processing log also includes quantity information, the quantity information is used for identifying the quantity of subtasks transferred to the next task processing module by the current task processing module, and the calculating the first task quantity corresponding to each task processing module according to the task processing log includes:
extracting the subtask processing logs corresponding to each task processing module according to the second identification information to obtain a first log set corresponding to each task processing module;
sequentially extracting the quantity information in each subtask processing log in the first log set;
And superposing the extracted quantity information to obtain a first task quantity corresponding to each task processing module.
Further, the calculating, according to the subtask processing log, the second task number corresponding to each task processing module includes:
extracting the subtask processing logs corresponding to each task processing module according to the first identification information to obtain a second log set corresponding to each task processing module;
and counting the number of the subtask processing logs in the second log set to obtain the second task number corresponding to each task processing module.
Further, before the calculating, according to the subtask processing log, the first task number and the second task number corresponding to each task processing module, the method further includes:
and performing de-duplication processing on the subtask processing logs corresponding to each task processing module according to the identification information of the subtasks.
Further, the method further comprises:
according to the first task quantity and the second task quantity which are respectively corresponding to the task processing modules, calculating a first total task quantity and a second total task quantity of the tasks, wherein the first total task quantity is the quantity of all the subtasks contained in the tasks, and the second total task quantity is the quantity of the subtask processing completed by all the task processing modules;
And when the first total task quantity and the second total task quantity are equal, determining that the processing of the task is completed.
Further, the subtask processing log further includes time information, and the method further includes:
sequencing the subtask processing logs according to time information;
and calculating task processing time corresponding to each task processing module according to the time information.
The embodiments of the present invention also provide a computer program product adapted to perform, when executed on a data processing apparatus, a program initialized with the method steps of: acquiring subtask processing logs corresponding to the subtasks in the task respectively, wherein the subtask processing logs are respectively created when each corresponding subtask processing module completes processing of each subtask; respectively calculating a first task number and a second task number corresponding to each task processing module according to the subtask processing logs, wherein the first task number is the number of all subtasks injected into the task processing modules, and the second task number is the number of the subtasks processed and completed by the task processing modules; and determining and recording the processing progress of the task in each task processing module according to the first task number and the second task number.
Further, the method further comprises:
and configuring the task processing module so that the task processing module creates the subtask processing log when the processing of each subtask is completed.
Further, the subtask processing log includes first identification information and second identification information, the first identification information is used for identifying a current task processing module executing the subtask processing, the second identification information is used for identifying a next task processing module executing the subtask processing and creating the subtask processing log, the subtask processing log also includes quantity information, the quantity information is used for identifying the quantity of subtasks transferred to the next task processing module by the current task processing module, and the calculating the first task quantity corresponding to each task processing module according to the task processing log includes:
extracting the subtask processing logs corresponding to each task processing module according to the second identification information to obtain a first log set corresponding to each task processing module;
sequentially extracting the quantity information in each subtask processing log in the first log set;
And superposing the extracted quantity information to obtain a first task quantity corresponding to each task processing module.
Further, the calculating, according to the subtask processing log, the second task number corresponding to each task processing module includes:
extracting the subtask processing logs corresponding to each task processing module according to the first identification information to obtain a second log set corresponding to each task processing module;
and counting the number of the subtask processing logs in the second log set to obtain the second task number corresponding to each task processing module.
Further, before the calculating, according to the subtask processing log, the first task number and the second task number corresponding to each task processing module, the method further includes:
and performing de-duplication processing on the subtask processing logs corresponding to each task processing module according to the identification information of the subtasks.
Further, the method further comprises:
according to the first task quantity and the second task quantity which are respectively corresponding to the task processing modules, calculating a first total task quantity and a second total task quantity of the tasks, wherein the first total task quantity is the quantity of all the subtasks contained in the tasks, and the second total task quantity is the quantity of the subtask processing completed by all the task processing modules;
And when the first total task quantity and the second total task quantity are equal, determining that the processing of the task is completed.
Further, the subtask processing log further includes time information, and the method further includes:
sequencing the subtask processing logs according to time information;
and calculating task processing time corresponding to each task processing module according to the time information.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.
Claims (8)
1. A method for recording progress of task processing, the method comprising:
acquiring subtask processing logs corresponding to the subtasks in the task respectively, wherein the subtask processing logs are respectively created when each corresponding subtask processing module completes processing of each subtask;
Calculating a first task number and a second task number corresponding to each task processing module according to the subtask processing log, wherein the first task number is the number of all the subtasks injected into the task processing module, the second task number is the number of the subtasks processed and completed by the task processing module, the subtask processing log comprises first identification information and second identification information, the first identification information is used for identifying a current task processing module executing the subtask processing and creating the subtask processing log, the second identification information is used for identifying a next task processing module executing the subtask processing, the subtask processing log also comprises quantity information, the quantity information is used for identifying the number of the subtasks transferred to the next task processing module by the current task processing module, and the calculating the first task number corresponding to each task processing module according to the subtask processing log comprises the following steps: extracting the subtask processing logs corresponding to each task processing module according to the second identification information to obtain a first log set corresponding to each task processing module; sequentially extracting the quantity information in each subtask processing log in the first log set; superposing the extracted quantity information to obtain a first task quantity corresponding to each task processing module; the calculating, according to the subtask processing logs, the second task numbers corresponding to the task processing modules respectively includes: extracting the subtask processing logs corresponding to each task processing module according to the first identification information to obtain a second log set corresponding to each task processing module; counting the number of subtask processing logs in the second log set to obtain a second task number corresponding to each task processing module;
And determining and recording the processing progress of the task in each task processing module according to the first task number and the second task number.
2. The method of claim 1, wherein prior to obtaining the processing log of the task, the method further comprises:
and configuring the task processing module so that the task processing module creates the subtask processing log when the processing of each subtask is completed.
3. The method of claim 1, wherein each of the subtask processing logs further includes identification information of the subtasks, and before calculating the first task number and the second task number corresponding to each of the task processing modules according to the subtask processing log, the method further includes:
and performing de-duplication processing on the subtask processing logs corresponding to each task processing module according to the identification information of the subtasks.
4. The method according to claim 1, wherein the method further comprises:
according to the first task quantity and the second task quantity which are respectively corresponding to the task processing modules, calculating a first total task quantity and a second total task quantity of the tasks, wherein the first total task quantity is the quantity of all the subtasks contained in the tasks, and the second total task quantity is the quantity of the subtask processing completed by all the task processing modules;
And when the first total task quantity and the second total task quantity are equal, determining that the processing of the task is completed.
5. The method according to any one of claims 1-4, wherein the subtask processing log further includes time information, the method further comprising:
sequencing the subtask processing logs according to time information;
and calculating task processing time corresponding to each task processing module according to the time information.
6. A recording apparatus for task processing progress, the apparatus comprising:
the task processing system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring subtask processing logs respectively corresponding to all subtasks in a task, and the subtask processing logs are respectively created when each corresponding subtask processing module finishes processing of each subtask;
the computing unit is configured to respectively compute, according to the subtask processing logs, a first task number and a second task number corresponding to each of the task processing modules, where the first task number is a number of all subtasks injected into the task processing module, and the second task number is a number of subtasks that have been processed and completed by the task processing module, where the subtask processing logs include first identification information and second identification information, the first identification information is used to identify a current task processing module that executes the subtask processing and creates the subtask processing log, the second identification information is used to identify a next task processing module that executes the subtask processing, and the subtask processing log further includes quantity information, where the quantity information is used to identify a number of the subtasks that the current task processing module has transferred to the next task processing module, and the apparatus further includes: the extraction unit can be used for extracting the subtask processing logs corresponding to each task processing module according to the second identification information to obtain a first log set corresponding to each task processing module; the extracting unit may be further configured to sequentially extract the number information in each of the subtask processing logs in the first log set; the superposition unit can be used for superposing the extracted plurality of quantity information to obtain a first task quantity corresponding to each task processing module; the apparatus further comprises: the statistic unit is further configured to extract the subtask processing logs corresponding to each task processing module according to the first identification information, so as to obtain a second log set corresponding to each task processing module; the statistics unit is further configured to count the number of subtask processing logs in the second log set, so as to obtain a second task number corresponding to each task processing module;
And the determining unit is used for determining and recording the processing progress of the tasks in each task processing module according to the first task number and the second task number.
7. A storage medium comprising a stored program, wherein the program, when run, controls a device in which the storage medium is located to perform the recording method of the task processing progress of any one of claims 1 to 5.
8. A processor for running a program, wherein the program runs to perform the recording method of task processing progress as claimed in any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811212841.3A CN111078510B (en) | 2018-10-18 | 2018-10-18 | Task processing progress recording method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811212841.3A CN111078510B (en) | 2018-10-18 | 2018-10-18 | Task processing progress recording method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111078510A CN111078510A (en) | 2020-04-28 |
| CN111078510B true CN111078510B (en) | 2023-05-16 |
Family
ID=70308307
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811212841.3A Active CN111078510B (en) | 2018-10-18 | 2018-10-18 | Task processing progress recording method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111078510B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112698843A (en) * | 2020-12-28 | 2021-04-23 | 浙江国利网安科技有限公司 | Industrial control software installation method and device, storage medium and industrial control equipment |
| CN112380024B (en) * | 2021-01-18 | 2021-05-25 | 天道金科股份有限公司 | Thread scheduling method based on distributed counting |
| CN113064869B (en) * | 2021-03-23 | 2023-06-13 | 网易（杭州）网络有限公司 | Log processing method, device, transmitting end, receiving end equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102110015A (en) * | 2009-12-29 | 2011-06-29 | 北大方正集团有限公司 | Method and device for determining task progress and task processing time |
| CN105260287A (en) * | 2015-09-16 | 2016-01-20 | 北京奇虎科技有限公司 | Method and device for updating parent task progress |
| WO2017101488A1 (en) * | 2015-12-18 | 2017-06-22 | 乐视控股（北京）有限公司 | Real-time transcoding monitoring method and real-time transcoding system |
| CN106980636A (en) * | 2016-07-22 | 2017-07-25 | 平安科技（深圳）有限公司 | Declaration form data processing method and device |
-
2018
- 2018-10-18 CN CN201811212841.3A patent/CN111078510B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102110015A (en) * | 2009-12-29 | 2011-06-29 | 北大方正集团有限公司 | Method and device for determining task progress and task processing time |
| CN105260287A (en) * | 2015-09-16 | 2016-01-20 | 北京奇虎科技有限公司 | Method and device for updating parent task progress |
| WO2017101488A1 (en) * | 2015-12-18 | 2017-06-22 | 乐视控股（北京）有限公司 | Real-time transcoding monitoring method and real-time transcoding system |
| CN106980636A (en) * | 2016-07-22 | 2017-07-25 | 平安科技（深圳）有限公司 | Declaration form data processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111078510A (en) | 2020-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111078510B (en) | Task processing progress recording method and device | |
| US10228936B2 (en) | Software delivery pipeline management | |
| CN107025224B (en) | Method and equipment for monitoring task operation | |
| CN106897342B (en) | Data verification method and equipment | |
| CN109934712B (en) | Account checking method and account checking device applied to distributed system and electronic equipment | |
| CN109471697A (en) | The method, apparatus and storage medium that system is called in a kind of monitoring virtual machine | |
| CN111767227A (en) | Recording playback test method and device | |
| CN105302717A (en) | Detection method and apparatus for big data platform | |
| CN106980571A (en) | The construction method and equipment of a kind of test use cases | |
| CN108121774B (en) | Data table backup method and terminal equipment | |
| CN106648839B (en) | Data processing method and device | |
| CN113918658A (en) | Method and device for recovering data | |
| CN107783879B (en) | Method and equipment for analyzing workflow execution path | |
| CN112579327A (en) | Fault detection method, device and equipment | |
| CN107644041A (en) | Declaration form settlement processing method and device | |
| CN110928941A (en) | Data fragment extraction method and device | |
| CN109558249B (en) | Control method and device for concurrent operation | |
| CN114070737B (en) | Method and device for checking configuration data of equipment, storage medium and electronic equipment | |
| WO2016140654A1 (en) | Performance testing using service call executors | |
| CN106569731B (en) | Limit storage method, device and equipment | |
| CN113900856A (en) | Data processing method and related equipment | |
| CN114691496A (en) | Unit testing method, unit testing device, computing equipment and medium | |
| CN114416442A (en) | Hardware change detection method and device, electronic equipment and readable storage medium | |
| CN109561126A (en) | A kind of method of data synchronization and device, storage medium, processor | |
| CN106980555A (en) | A kind of overtime thread processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |