CN116126646A - Method and device for determining execution progress of batch data - Google Patents
Method and device for determining execution progress of batch data Download PDFInfo
- Publication number
- CN116126646A CN116126646A CN202310388716.2A CN202310388716A CN116126646A CN 116126646 A CN116126646 A CN 116126646A CN 202310388716 A CN202310388716 A CN 202310388716A CN 116126646 A CN116126646 A CN 116126646A
- Authority
- CN
- China
- Prior art keywords
- task
- target task
- execution
- target
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 238000001514 detection method Methods 0.000 claims description 21
- 238000004590 computer program Methods 0.000 claims description 6
- 230000008901 benefit Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000010923 batch production Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Probability & Statistics with Applications (AREA)
- Fuzzy Systems (AREA)
- Software Systems (AREA)
- Debugging And Monitoring (AREA)
- General Factory Administration (AREA)
Abstract
The invention discloses a method and a device for determining execution progress of batch data, wherein the method is applied to a server; one embodiment comprises: firstly, receiving a query request aiming at the execution progress of a target task, wherein the query request at least comprises a task ID, and the query request is sent by a client; inquiring a target task execution table corresponding to the task ID from a database; secondly, detecting whether unexecuted data exists in a target task execution table; if yes, continuing to execute corresponding operation on the unexecuted data according to the target task; acquiring the current executed task quantity and the total task quantity in a target task execution table at preset time; and finally, the total task amount and the current executed task amount are sent to the client so that the client can determine the current execution progress of the target task based on the total task amount and the current executed task amount. Therefore, the current execution progress of the target task can be determined based on the client, so that the user can know the execution condition of the data in real time, and the experience of the user is improved.
Description
Technical Field
The invention belongs to the technical field of computers, and particularly relates to a method and a device for determining execution progress of batch data.
Background
In practical product applications, it has become very common to batch process data in files. When there is a lot of data to be processed, the data is generally transmitted to an excel file first, and then the data processing is performed on the lot of data in the excel file based on the target task. Thus, in order to be able to effectively monitor the data processing process, the user typically compares the progress of the data processing with respect to the batch data.
In the prior art, when a user performs network link, a link progress bar can be generally seen at the front end; although the link progress bar can reflect the network link condition to a certain extent, the link progress bar only reflects two situations in practice, one is no network link, and the other is successful network link; the link progress bar cannot reflect the link condition of the current network in real time. In addition, when a user transfers a batch of files from one space to another, the front end can also see the transmission progress bar of the files, however, the transmission progress bar is only used for monitoring the transmission progress of the batch of files, and cannot monitor the processing progress of the batch of data in the files.
Disclosure of Invention
Aiming at the problems in the prior art, the embodiment of the invention provides a method and a device for determining the execution progress of batch data, so that a user can know the execution condition of the data in real time, and the experience of the user is improved.
According to a first aspect of the embodiment of the invention, a method for determining execution progress of batch data is provided, which comprises a client and a server; the method is applied to the server side; the method comprises the following steps: receiving a query request aiming at the execution progress of a target task, which is sent by a client; the query request at least comprises a task ID corresponding to the target task; inquiring a target task execution table corresponding to the task ID from a database; detecting whether unexecuted data exists in the target task execution table; if the detection result represents that the unexecuted data exists in the target task execution table, continuing to execute corresponding operation on the unexecuted data according to the target task; acquiring the current executed task quantity and the total task quantity in the target task execution table at preset time; and sending the total task amount and the current executed task amount to a client so that the client can determine the current execution progress of the target task based on the total task amount and the current executed task amount.
Optionally, the method further comprises: if the detection result represents that the unexecuted data does not exist in the target task execution table; acquiring total task quantity and current executed task quantity from the target task execution table; and sending the total task amount and the current executed task amount to a client so that the client can determine the current execution progress of the target task based on the total task amount and the current executed task amount.
Optionally, the target task execution table is obtained by the following method: acquiring an execution request of a user for a target task; selecting original data corresponding to the target task from a database based on the execution request; creating a target task execution table corresponding to the original data; the target task execution table is used for representing data which is counted at the current moment and is based on the execution result of the target task on the original data.
Optionally, the creating a target task execution table corresponding to the original data includes: acquiring a task ID corresponding to the original data; counting the total task quantity corresponding to the original data; creating a corresponding target task execution table based on the task ID and the total task amount; the target task execution table at least comprises a task ID, a total task amount and an executed task amount; the performed task amount is used for indicating the completed amount for the original data counted at the current moment.
Optionally, the method further comprises: acquiring a data updating request of the target task execution table based on the completion trigger after each piece of original data is executed; based on the data updating request, counting the executed task quantity of the original data at the current moment; and updating the target task execution table based on the executed task quantity.
According to a second aspect of the embodiment of the invention, a method for determining execution progress of batch data is provided, which comprises a client and a server; the method is applied to the client; the method comprises the following steps: acquiring a query request aiming at the execution progress of a target task; sending the query request to a server; the query request at least comprises a task ID corresponding to the target task; receiving the total task quantity and the current executed task quantity which are sent by a server and correspond to the query request; and determining the current execution progress of the target task based on the total task quantity and the current executed task quantity, and displaying the current execution progress.
According to a third aspect of the embodiment of the present invention, there is also provided a method for determining execution progress of batch data, including a client and a server; the method comprises the steps that a client obtains a query request aiming at the execution progress of a target task and sends the query request to a server; the query request at least comprises a task ID corresponding to the target task; the server side inquires a target task execution table corresponding to the task ID from a database; the server detects whether non-executed data exists in the target task execution table; if the detection result represents that the unexecuted data exists in the target task execution table, the server continues to execute corresponding operation on the unexecuted data according to the target task; acquiring the current executed task quantity and the total task quantity in the target task execution table at preset time; the server side sends the total task amount and the currently executed task amount to the client side; and the client determines the current execution progress of the target task based on the total task amount and the current executed task amount, and displays the current execution progress.
According to a fourth aspect of the embodiment of the present invention, there is also provided an apparatus for determining execution progress of batch data, including a client and a server; the device is applied to the server; the device comprises: the first receiving module is used for receiving a query request which is sent by the client and aims at the execution progress of the target task; the query request at least comprises a task ID corresponding to the target task; the query module is used for querying a target task execution table corresponding to the task ID from a database; the detection module is used for detecting whether unexecuted data exists in the target task execution table; the first acquisition module is used for continuously executing corresponding operation on the unexecuted data according to the target task if the detection result represents that unexecuted data exists in the target task execution table; acquiring the current executed task quantity and the total task quantity in the target task execution table at preset time; and the first sending module is used for sending the total task quantity and the current executed task quantity to the client so that the client can determine the current execution progress of the target task based on the total task quantity and the current executed task quantity.
According to a fifth aspect of the embodiment of the present invention, there is also provided an apparatus for determining execution progress of batch data, including a client and a server; the device is applied to a client, and comprises: the second acquisition module is used for acquiring a query request aiming at the execution progress of the target task; the second sending module is used for sending the query request to a server; the query request at least comprises a task ID corresponding to the target task; the second receiving module is used for receiving the total task quantity and the current executed task quantity which are sent by the server and correspond to the query request; and the determining and displaying module is used for determining the current execution progress of the target task based on the total task quantity and the current executed task quantity and displaying the current execution progress.
According to a sixth aspect of embodiments of the present invention, there is also provided a computer readable medium having stored thereon a computer program which, when executed by a processor, implements the method according to the first or second aspect.
The embodiment of the invention provides a method for determining execution progress of batch data, which comprises a client and a server; the method is applied to the server side; the method comprises the following steps: firstly, receiving a query request aiming at the execution progress of a target task, which is sent by a client; the query request at least comprises a task ID corresponding to the target task; inquiring a target task execution table corresponding to the task ID from a database; secondly, detecting whether unexecuted data exists in the target task execution table; if the detection result represents that the unexecuted data exists in the target task execution table, continuing to execute corresponding operation on the unexecuted data according to the target task; acquiring the current executed task quantity and the total task quantity in the target task execution table at preset time; and finally, the total task amount and the current executed task amount are sent to a client so that the client can determine the current execution progress of the target task based on the total task amount and the current executed task amount. The server determines the total task amount of the target task and the current executed task amount based on the client query request, and feeds back the total task amount and the current executed task amount to the client. Therefore, the current execution progress of the target task can be determined based on the client, so that the user can know the execution condition of the data in real time, and the experience of the user is improved.
Drawings
Some specific embodiments of the invention will be described in detail hereinafter by way of example and not by way of limitation with reference to the accompanying drawings. The same reference numbers will be used throughout the drawings to refer to the same or like parts or portions. It will be appreciated by those skilled in the art that the drawings are not necessarily drawn to scale. In the accompanying drawings:
FIG. 1 is a flowchart illustrating a method for determining execution progress of batch data according to an embodiment of the present invention;
FIG. 2 is a flowchart of a method for obtaining a target task execution table according to an embodiment of the present invention;
FIG. 3 is a flowchart of updating a target task execution table according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating a method for determining execution progress of batch data according to another embodiment of the present invention;
FIG. 5 is a flowchart illustrating a method for determining execution progress of batch data according to still another embodiment of the present invention;
FIG. 6 is a flow chart of an apparatus for determining execution progress of batch data according to an embodiment of the invention;
FIG. 7 is a flow chart of an apparatus for determining execution progress of batch data according to another embodiment of the invention.
Detailed Description
In order to make the objects, features and advantages of the present invention more comprehensible, the technical solutions according to the embodiments of the present invention will be clearly described in the following with reference to the accompanying drawings, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Fig. 1 is a flowchart of a method for determining execution progress of batch data according to an embodiment of the invention. A method for determining execution progress of batch data comprises a client and a server; the method is applied to the server, and at least comprises the following steps:
s101, receiving a query request aiming at the execution progress of a target task, which is sent by a client; the query request at least comprises a task ID corresponding to the target task;
s102, inquiring a target task execution table corresponding to the task ID from a database;
s103, detecting whether unexecuted data exists in a target task execution table;
s104, if the detection result represents that the unexecuted data exists in the target task execution table, continuing to execute corresponding operation on the unexecuted data according to the target task; acquiring the current executed task quantity and the total task quantity in a target task execution table at preset time;
s105, the total task amount and the current executed task amount are sent to the client, so that the client can determine the current execution progress of the target task based on the total task amount and the current executed task amount.
Specifically, the target task execution table is used for representing the data which is counted at the current moment and is based on the execution result of the target task on the original data; that is, the target task execution table is actually monitoring the execution result of the original data. Each target task has a corresponding target task execution table, and each target task execution table has a corresponding task ID.
The server side inquires a target task execution table corresponding to the task ID from the database according to the task ID, and detects the target task execution table; if the detection result represents that the unexecuted data exists in the target task execution table, continuing to execute corresponding operation on the unexecuted data according to the target task; after the preset time is reached, acquiring the current executed task quantity and the total task quantity in the target task execution table; if the detection result represents that the unexecuted data does not exist in the target task execution table; the total task amount and the current task amount which are executed are obtained from the target task execution table. And then, the server side sends the total task amount and the current executed task amount to the client side, so that the client side displays the current execution progress after determining the current execution progress of the target task according to the total task amount and the current executed task amount.
The server determines the total task amount of the target task and the current executed task amount based on the client query request, and feeds back the total task amount and the current executed task amount to the client. Therefore, the current execution progress of the target task can be determined and displayed on the client, so that a user knows the execution condition of the data in real time, and the experience of the user is improved.
FIG. 2 is a flowchart of a method for obtaining a target task execution table according to an embodiment of the invention. The method for obtaining the target task execution table at least comprises the following steps:
s201, acquiring an execution request of a user for a target task;
s202, selecting original data corresponding to a target task from a database based on an execution request;
s203, creating a target task execution table corresponding to the original data; the target task execution table is used for representing data which is counted at the current moment and is based on the execution result of the target task on the original data.
Here, before a query is made with respect to the execution progress of the target task, it is necessary to create a target task execution table corresponding to the target task in the database based on the execution request of the target task. The target task is used for indicating data processing on the original data to achieve the specified task.
For example: the execution request of the target task is: and inquiring students with math score of more than 90 in the early and middle period of a certain area. The original data queried from the database are: mathematical achievements at the end of the early and middle phases of a certain area. The created target task execution table at least comprises: a tol field, a task ID field, and a completed field; the total number of students in a certain area is corresponding to the total number of students in a certain area, the target task ID is corresponding to the task ID field, and the completed field is corresponding to the number of executed target tasks.
The creation process of the target task execution table is not limited; in a preferred embodiment, the creating a target task execution table corresponding to the original data includes: acquiring a task ID corresponding to the original data; counting the total task quantity corresponding to the original data; creating a corresponding target task execution table based on the task ID and the total task amount; the target task execution table at least comprises a task ID, a total task amount and an executed task amount; the performed task amount is used for indicating the completed amount for the original data counted at the current moment. Thus, the present embodiment establishes a mapping relationship between the original data and the target task execution table based on the task ID.
It should be noted that, the target task execution table is used to monitor the execution process of the original data, and the amount of executed tasks in the target task execution table is updated as the original data is continuously executed.
The service end of the embodiment establishes an association relationship between original data and a target task execution table based on an execution request of a user for the target task; therefore, original data can be effectively monitored through the target task execution table, and the current execution progress of the target task can be determined, so that user experience is improved.
FIG. 3 is a flow chart illustrating the updating of the target task execution table according to an embodiment of the invention. Updating the target task execution table, at least comprising the following steps:
s301, acquiring a data update request of a target task execution table based on completion trigger after each piece of original data is executed;
s302, based on a data updating request, counting the executed task quantity of original data at the current moment;
s303, updating the target task execution table based on the executed task quantity.
Specifically, after the user uploads the executed file corresponding to the target task, the server side counts the total amount of original data in the executed file, and records the total amount into a total field in the target task execution table, and sets the completed field to 0, which represents that the target task needs to be executed total times, and the target task is actually executed for 0 times. And executing the target task based on triggering of the preset time, carrying out running batch service according to target task logic, and adding 1 to the completed field when one data run is completed so as to ensure that the database knows the number of the original data already run in real time.
For example: the execution request of the target task is: and inquiring students with math score of more than 90 in the early and middle period of a certain area. The original data queried from the database are: mathematical achievements at the end of the early and middle phases of a certain area. The triggering server side based on the preset time executes the target task; and in the process of inquiring the original data, 1 is added to the completed field in the target task execution table every time the original data is inquired. Therefore, the executed task amount in the target task table can be updated in real time based on the completion trigger after the original data is executed, so that the execution process of the original data is monitored in real time through the target task table, the executed task amount of the target task can be accurately obtained, and the accuracy of the execution progress of the target task is improved.
Fig. 4 is a flowchart of a method for determining execution progress of batch data according to another embodiment of the present invention. A method for determining execution progress of batch data comprises a client and a server; the method is applied to the client; the method at least comprises the following steps:
s401, acquiring a query request aiming at the execution progress of a target task;
s402, sending a query request to a server; the query request at least comprises a task ID corresponding to the target task;
s403, receiving the total task quantity and the current executed task quantity which are sent by the server and correspond to the query request;
s404, determining the current execution progress of the target task based on the total task amount and the current executed task amount, and displaying the current execution progress.
The client side of the embodiment firstly receives the total task quantity corresponding to the query request and the current executed task quantity from the server side based on the trigger of the query request; determining the current execution progress of the target task based on the total task quantity and the current executed task quantity; then, the current execution progress is displayed on the client; therefore, based on interaction between the client and the service, the client can calculate the execution progress of the target task at the current moment in real time, so that a user can know the execution condition of data in real time, and the experience of the user is improved.
The method described above for this embodiment will be described in detail with reference to specific applications.
Fig. 5 is a flowchart of a method for determining execution progress of batch data according to still another embodiment of the present invention. The method for determining the execution progress of the batch data comprises a client and a server; the method at least comprises the following steps:
s501, a client acquires a query request aiming at the execution progress of a target task and sends the query request to a server; the query request at least comprises a task ID corresponding to the target task;
s502, a server queries a target task execution table corresponding to a task ID from a database;
s503, the server detects whether non-executed data exists in the target task execution table;
s504, if the detection result represents that the unexecuted data exists in the target task execution table, the server continues to execute corresponding operation on the unexecuted data according to the target task; acquiring the current executed task quantity and the total task quantity in a target task execution table at preset time;
s505, the server side sends the total task amount and the currently executed task amount to the client side;
s506, the client determines the current execution progress of the target task based on the total task amount and the current executed task amount, and displays the current execution progress.
For example: s1, creating a target task execution table
Firstly, a server side obtains an execution request of a user for a target task; the execution request of the target task is: and inquiring students with math score of more than 90 in the early and middle period of a certain area. Then, the service end selects original data corresponding to the target task from a database based on a target execution request; the raw data are: mathematical achievements at the end of the early and middle phases of a certain area. Then, the server acquires a task ID corresponding to the original data; counting the total task quantity corresponding to the original data as n; finally, based on the task ID and the total task quantity n, a corresponding target task execution table is created; the target task execution table at least comprises: the total number of students n in a certain area, the task ID field corresponds to the target task ID, and the completed field corresponds to the number of executed target tasks 0.
S2, updating the target task execution table
Firstly, the server side executes a target task based on triggering of preset time; secondly, when executing the target task, the server side also acquires a data update request of the target task execution table based on completion trigger after each piece of original data is executed; based on the data updating request, counting the executed task quantity of the original data at the current moment; and finally, the server updates the target task execution table based on the executed task quantity. For example: and inquiring students with the mathematical score of more than 90 minutes in the original data according to the target task logic, and adding 1 to the completed field after each data inquiry is completed so as to update the target task execution table.
S3, determining the current execution progress of the target task
Based on the triggering of the user to the client, the client acquires a query request of the user for the execution progress of the target task; the query request includes at least: the task ID is then sent to the server by the client. The server side inquires a target task execution table corresponding to the task ID from a database; and detecting whether the unexecuted original data exists in the target task execution table. If the detection result represents that the unexecuted original data exists in the target task execution table, the server side continuously inquires students with the end mathematical score of more than 90 minutes from the original data; and after reaching a preset time, acquiring the current executed task quantity and the total task quantity in the target task execution table. If the detection result represents that the unexecuted data does not exist in the target task execution table; the server acquires the total task quantity n and the current executed task quantity m from the target task execution table; for example: the original data has only one piece of data, so the query operation is already executed immediately before detection, and no unexecuted data exists when the target task execution table is detected. Then, the server side sends the total task quantity n and the current executed task quantity m to the client side; the client compares the current executed task quantity m with the total task quantity n to obtain the current execution progress s of the target task, and the current execution progress s is presented on the client.
The client side is used for acquiring an execution request of a user for a target task, and creating a target task execution table through the server side after acquiring the execution request; the client side also obtains a query request of a user for the execution progress of the target task; after obtaining the query request, querying the current executed task quantity and the total task quantity in the target task execution table through the server; finally, the client displays the current execution progress on the client after calculating the current execution progress of the target task; therefore, the current execution progress of the target task can be determined based on the client, and the current execution progress is displayed, so that a user knows the execution condition of the data in real time, and the experience of the user is improved.
FIG. 6 is a flow chart of an apparatus for determining execution progress of batch data according to an embodiment of the invention.
The device for determining the execution progress of the batch data comprises a client and a server; the device is applied to the server; the apparatus 600 includes: a first receiving module 601, configured to receive a query request for a target task execution progress sent by a client; the query request at least comprises a task ID corresponding to the target task; a query module 602, configured to query a database for a target task execution table corresponding to the task ID; a detection module 603, configured to detect whether there is unexecuted data in the target task execution table; a first obtaining module 604, configured to, if the detection result indicates that there is unexecuted data in the target task execution table, continue to perform a corresponding operation on the unexecuted data according to the target task; acquiring the current executed task quantity and the total task quantity in the target task execution table at a first preset time; a first sending module 605 is configured to send the total task amount and the current executed task amount to a client, so that the client determines, based on the total task amount and the current executed task amount, a current execution progress of the target task.
In a preferred embodiment, the device further comprises: the second acquisition module is used for indicating that the unexecuted data does not exist in the target task execution table if the detection result indicates that unexecuted data does not exist in the target task execution table; acquiring total task quantity and current executed task quantity from the target task execution table; and the third sending module is used for sending the total task quantity and the current executed task quantity to the client so that the client can determine the current execution progress of the target task based on the total task quantity and the current executed task quantity.
In a preferred embodiment, the target task execution table is obtained by the following modules: the third acquisition module is used for acquiring an execution request of a user for a target task; the selecting module is used for selecting original data corresponding to the target task from a database based on the execution request; the creation module is used for creating a target task execution table corresponding to the original data; the target task execution table is used for representing data which is counted at the current moment and is based on the execution result of the target task on the original data.
In a preferred embodiment, the creation module comprises: the acquisition unit is used for acquiring a task ID corresponding to the original data; the statistics unit is used for counting the total task quantity corresponding to the original data; a creating unit, configured to create a corresponding target task execution table based on the task ID and the total task amount; the target task execution table at least comprises a task ID, a total task amount and an executed task amount; the performed task amount is used for indicating the completed amount for the original data counted at the current moment.
The device can execute the method for determining the execution progress of the batch data provided by the embodiment of the invention, and has the corresponding functional modules and beneficial effects of executing the method for determining the execution progress of the batch data. Technical details not described in detail in this embodiment may be referred to a method for determining execution progress of batch data according to an embodiment of the present invention.
FIG. 7 is a flow chart of an apparatus for determining execution progress of batch data according to an embodiment of the invention.
The device for determining the execution progress of the batch data comprises a client and a server; the apparatus 700 is applied to a client, comprising: a first obtaining module 701, configured to obtain a query request for a target task execution progress; a first sending module 702, configured to send the query request to a server; the query request at least comprises a task ID corresponding to the target task; a receiving module 703, configured to receive a total task amount and a currently executed task amount, which are sent by a server and correspond to the query request; and the determining and displaying module 704 is configured to determine a current execution progress of the target task based on the total task amount and the current executed task amount, and display the current execution progress.
The device can execute the method for determining the execution progress of the batch data provided by the embodiment of the invention, and has the corresponding functional modules and beneficial effects of executing the method for determining the execution progress of the batch data. Technical details not described in detail in this embodiment may be referred to a method for determining execution progress of batch data according to an embodiment of the present invention.
The present invention also provides an electronic device including: a processor; a memory for storing the processor-executable instructions; the processor is used for reading the executable instructions from the memory and executing the instructions to realize the method for determining the execution progress of the batch data.
In addition to the methods and apparatus described above, embodiments of the present application may also be a computer program product comprising computer program instructions which, when executed by a processor, cause the processor to perform steps in a method according to various embodiments of the present application described in the "exemplary methods" section of the present specification.
The computer program product may write program code for performing the operations of embodiments of the present application in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server.
Furthermore, embodiments of the present application may also be a computer-readable storage medium, having stored thereon computer program instructions, which when executed by a processor, cause the processor to perform steps in a method according to embodiments of the present application described in the above-mentioned "exemplary method" section of the present application.
The computer readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The basic principles of the present application have been described above in connection with specific embodiments, however, it should be noted that the advantages, benefits, effects, etc. mentioned in the present application are merely examples and not limiting, and these advantages, benefits, effects, etc. are not to be considered as necessarily possessed by the various embodiments of the present application. Furthermore, the specific details disclosed herein are for purposes of illustration and understanding only, and are not intended to be limiting, as the application is not intended to be limited to the details disclosed herein as such.
The block diagrams of the devices, apparatuses, devices, systems referred to in this application are only illustrative examples and are not intended to require or imply that the connections, arrangements, configurations must be made in the manner shown in the block diagrams. As will be appreciated by one of skill in the art, the devices, apparatuses, devices, systems may be connected, arranged, configured in any manner. Words such as "including," "comprising," "having," and the like are words of openness and mean "including but not limited to," and are used interchangeably therewith. The terms "or" and "as used herein refer to and are used interchangeably with the term" and/or "unless the context clearly indicates otherwise. The term "such as" as used herein refers to, and is used interchangeably with, the phrase "such as, but not limited to.
It is also noted that in the apparatus, devices and methods of the present application, the components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered as equivalent to the present application.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the application. Thus, the present application is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of the application to the form disclosed herein. Although a number of example aspects and embodiments have been discussed above, a person of ordinary skill in the art will recognize certain variations, modifications, alterations, additions, and subcombinations thereof.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present invention, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. The method for determining the execution progress of the batch data is characterized by comprising a client and a server; the method is applied to the server side; the method comprises the following steps:
receiving a query request aiming at the execution progress of a target task, which is sent by a client; the query request at least comprises a task ID corresponding to the target task;
inquiring a target task execution table corresponding to the task ID from a database;
detecting whether unexecuted data exists in the target task execution table;
if the detection result represents that the unexecuted data exists in the target task execution table, continuing to execute corresponding operation on the unexecuted data according to the target task; acquiring the current executed task quantity and the total task quantity in the target task execution table at preset time;
and sending the total task amount and the current executed task amount to a client so that the client can determine the current execution progress of the target task based on the total task amount and the current executed task amount.
2. The method as recited in claim 1, further comprising:
if the detection result represents that the unexecuted data does not exist in the target task execution table; acquiring total task quantity and current executed task quantity from the target task execution table;
and sending the total task amount and the current executed task amount to a client so that the client can determine the current execution progress of the target task based on the total task amount and the current executed task amount.
3. The method according to claim 1 or 2, wherein the target task execution table is obtained by:
acquiring an execution request of a user for a target task;
selecting original data corresponding to the target task from a database based on the execution request;
creating a target task execution table corresponding to the original data; the target task execution table is used for representing data which is counted at the current moment and is based on the execution result of the target task on the original data.
4. The method of claim 3, wherein creating a target task execution table corresponding to the raw data comprises:
acquiring a task ID corresponding to the original data;
counting the total task quantity corresponding to the original data;
creating a corresponding target task execution table based on the task ID and the total task amount; the target task execution table at least comprises a task ID, a total task amount and an executed task amount; the performed task amount is used for indicating the completed amount for the original data counted at the current moment.
5. A method according to claim 3, further comprising:
acquiring a data updating request of the target task execution table based on the completion trigger after each piece of original data is executed;
based on the data updating request, counting the executed task quantity of the original data at the current moment;
and updating the target task execution table based on the executed task quantity.
6. The method for determining the execution progress of the batch data is characterized by comprising a client and a server; the method is applied to the client; the method comprises the following steps:
acquiring a query request aiming at the execution progress of a target task;
sending the query request to a server; the query request at least comprises a task ID corresponding to the target task;
receiving the total task quantity and the current executed task quantity which are sent by a server and correspond to the query request;
and determining the current execution progress of the target task based on the total task quantity and the current executed task quantity, and displaying the current execution progress.
7. The method for determining the execution progress of the batch data is characterized by comprising a client and a server;
the method comprises the steps that a client obtains a query request aiming at the execution progress of a target task and sends the query request to a server; the query request at least comprises a task ID corresponding to the target task;
the server side inquires a target task execution table corresponding to the task ID from a database;
the server detects whether non-executed data exists in the target task execution table;
if the detection result represents that the unexecuted data exists in the target task execution table, the server continues to execute corresponding operation on the unexecuted data according to the target task; acquiring the current executed task quantity and the total task quantity in the target task execution table at preset time;
the server side sends the total task amount and the currently executed task amount to the client side;
and the client determines the current execution progress of the target task based on the total task amount and the current executed task amount, and displays the current execution progress.
8. The device for determining the execution progress of the batch data is characterized by comprising a client and a server; the device is applied to the server; comprising the following steps:
the first receiving module is used for receiving a query request which is sent by the client and aims at the execution progress of the target task; the query request at least comprises a task ID corresponding to the target task;
the query module is used for querying a target task execution table corresponding to the task ID from a database;
the detection module is used for detecting whether unexecuted data exists in the target task execution table;
the first acquisition module is used for continuously executing corresponding operation on the unexecuted data according to the target task if the detection result represents that unexecuted data exists in the target task execution table; acquiring the current executed task quantity and the total task quantity in the target task execution table at preset time;
and the first sending module is used for sending the total task quantity and the current executed task quantity to the client so that the client can determine the current execution progress of the target task based on the total task quantity and the current executed task quantity.
9. The device for determining the execution progress of the batch data is characterized by comprising a client and a server; the device is applied to a client, and comprises:
the second acquisition module is used for acquiring a query request aiming at the execution progress of the target task;
the second sending module is used for sending the query request to a server; the query request at least comprises a task ID corresponding to the target task;
the second receiving module is used for receiving the total task quantity and the current executed task quantity which are sent by the server and correspond to the query request;
and the determining and displaying module is used for determining the current execution progress of the target task based on the total task quantity and the current executed task quantity and displaying the current execution progress.
10. A computer readable medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method of any one of claims 1-5 or claim 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310388716.2A CN116126646A (en) | 2023-04-13 | 2023-04-13 | Method and device for determining execution progress of batch data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310388716.2A CN116126646A (en) | 2023-04-13 | 2023-04-13 | Method and device for determining execution progress of batch data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116126646A true CN116126646A (en) | 2023-05-16 |
Family
ID=86306593
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310388716.2A Pending CN116126646A (en) | 2023-04-13 | 2023-04-13 | Method and device for determining execution progress of batch data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116126646A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116431315A (en) * | 2023-06-07 | 2023-07-14 | 成都登临科技有限公司 | Batch processing task processing method and device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113868687A (en) * | 2021-10-18 | 2021-12-31 | 北京京东乾石科技有限公司 | Task processing progress management method and device |
| CN114924865A (en) * | 2022-06-30 | 2022-08-19 | 北京字跳网络技术有限公司 | Batch task processing method, device, equipment and storage medium |
| CN114996081A (en) * | 2022-04-29 | 2022-09-02 | 中银金融科技有限公司 | Batch job progress monitoring method and device, electronic equipment and storage medium |
| CN115203304A (en) * | 2022-07-14 | 2022-10-18 | 平安科技（深圳）有限公司 | Batch data importing method based on timed polling and related equipment |
| CN115374175A (en) * | 2021-05-18 | 2022-11-22 | 腾讯科技（深圳）有限公司 | Method and device for tracking task execution progress based on micro-service architecture |
| CN115525797A (en) * | 2022-09-29 | 2022-12-27 | 金篆信科有限责任公司 | Database data query method, device, equipment and storage medium |
-
2023
- 2023-04-13 CN CN202310388716.2A patent/CN116126646A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115374175A (en) * | 2021-05-18 | 2022-11-22 | 腾讯科技（深圳）有限公司 | Method and device for tracking task execution progress based on micro-service architecture |
| CN113868687A (en) * | 2021-10-18 | 2021-12-31 | 北京京东乾石科技有限公司 | Task processing progress management method and device |
| CN114996081A (en) * | 2022-04-29 | 2022-09-02 | 中银金融科技有限公司 | Batch job progress monitoring method and device, electronic equipment and storage medium |
| CN114924865A (en) * | 2022-06-30 | 2022-08-19 | 北京字跳网络技术有限公司 | Batch task processing method, device, equipment and storage medium |
| CN115203304A (en) * | 2022-07-14 | 2022-10-18 | 平安科技（深圳）有限公司 | Batch data importing method based on timed polling and related equipment |
| CN115525797A (en) * | 2022-09-29 | 2022-12-27 | 金篆信科有限责任公司 | Database data query method, device, equipment and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116431315A (en) * | 2023-06-07 | 2023-07-14 | 成都登临科技有限公司 | Batch processing task processing method and device, electronic equipment and storage medium |
| CN116431315B (en) * | 2023-06-07 | 2023-08-29 | 成都登临科技有限公司 | Batch processing task processing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101547721B1 (en) | System for assisting with execution of actions in response to detected events, method for assisting with execution of actions in response to detected events, assisting device, and computer program | |
| US9229871B2 (en) | Cache device, communication apparatus, and computer program product | |
| CN110162976B (en) | Risk assessment method and device and terminal | |
| US20140143625A1 (en) | Computer-readable recording medium, failure prediction device and applicability determination method | |
| CN116126646A (en) | Method and device for determining execution progress of batch data | |
| CN101252462B (en) | Alarming page furbishing method as well as server and client end | |
| CN111698335A (en) | Equipment state query method and device and server | |
| CN103312733A (en) | Method and device for information processing | |
| EP3779701B1 (en) | Data monitoring method, electronic device, and computer readable storage medium | |
| CN110795440A (en) | Method and device for updating index | |
| Iervolino | Generalized earthquake counting processes for sequence‐based hazard | |
| CN112799955B (en) | Method and device for detecting model change, storage medium and electronic equipment | |
| CN113377789A (en) | Processing method and device for database change data, computer equipment and medium | |
| CN116521694A (en) | Data maintenance method, intelligent terminal and storage medium | |
| US20130086021A1 (en) | Apparatus and method for controlling data access | |
| CN111324310A (en) | Data reading method and device and computer system | |
| US20210232686A1 (en) | Attack detection device, attack detection method, and attack detection program | |
| CN113094088A (en) | Database configuration information acquisition method and device, computer equipment and storage medium | |
| CN113792058A (en) | Index data processing method and device, electronic equipment and storage medium | |
| US20140136487A1 (en) | Content management targeted rollback | |
| CN106709353B (en) | Security detection method and device for search engine | |
| CN111158798A (en) | Service data processing method and device | |
| CN113849391B (en) | Program performance determining method and device, electronic equipment and storage medium | |
| CN111078718B (en) | Frequency control method, device, equipment and computer storage medium | |
| US20230359190A1 (en) | Process capability index warning system and warning method for the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20230516 |
|
| RJ01 | Rejection of invention patent application after publication |