CN111176762A - Batch processing program execution method and device, electronic equipment and storable medium - Google Patents
Batch processing program execution method and device, electronic equipment and storable medium Download PDFInfo
- Publication number
- CN111176762A CN111176762A CN201911404990.4A CN201911404990A CN111176762A CN 111176762 A CN111176762 A CN 111176762A CN 201911404990 A CN201911404990 A CN 201911404990A CN 111176762 A CN111176762 A CN 111176762A
- Authority
- CN
- China
- Prior art keywords
- service
- execution
- service instance
- task
- instance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/448—Execution paradigms, e.g. implementations of programming paradigms
- G06F9/4482—Procedural
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the invention provides a batch processing program execution method and device, electronic equipment and a storable medium, wherein the method comprises the following steps: acquiring at least one executable service instance; and respectively executing at least one service instance, and providing a function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance. The execution method and device of the batch processing program, the electronic device and the storage medium provided by the embodiment of the invention can reduce the workload of a developer for writing service codes and reduce the operation load of a system when the batch processing program is executed.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and an apparatus for executing a batch processing program, an electronic device, and a storage medium.
Background
With the continuous development of electronic information technology, information is circulated more and more frequently on the network, and an information processing method for big data is gradually formed, so the development trend and direction of data also continuously adapt to the requirement of big data, that is, the data is required to be managed in a full centralized way. Under the development trend of data full centralized management, the timeliness and reliability of data processing can be improved by processing data in batches.
In the related technology, a developer needs to compile service codes corresponding to required functions for each business instance according to actual requirements of different business data, so that the workload of the developer in writing batch processing programs is increased, and the running load of a system is increased.
Disclosure of Invention
The embodiment of the invention aims to provide a batch processing program execution method and device, an electronic device and a storage medium, so as to achieve the effects of reducing the workload of developers and lightening the running load of a system on the batch processing program. The specific technical scheme is as follows:
in a first aspect of the present invention, there is provided a method for executing a batch process, the method including:
acquiring at least one executable service instance;
and respectively executing at least one service instance, and providing a function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance.
In a second aspect of the present invention, there is also provided an apparatus for executing a batch processing program, including:
the acquisition module is used for acquiring at least one executable service instance;
and the execution module is used for executing at least one service instance respectively, and providing a function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance.
In another aspect of the present invention, there is also provided an electronic device, including a processor, a communication interface, a memory and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing the execution method of any one batch processing program when the program stored in the memory is executed.
In yet another aspect of the present invention, there is also provided a computer-readable storage medium having stored therein instructions, which when executed on a computer, cause the computer to execute the execution method of any one of the batch processing programs described above.
In yet another aspect of the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the method of executing a batch processing program as described in any one of the above.
According to the method for executing the batch processing program provided by the embodiment of the invention, developers only need to pre-write codes of services which may be needed by all subsequent batch processing programs and respectively encapsulate the codes into the service resource library, and when each service instance is subsequently and respectively executed, at least one service in the service resource library can be utilized to provide functions corresponding to the at least one service for each service instance. Therefore, the workload of a developer for writing the service codes is reduced, and the operation load of the system when the batch processing program is executed is reduced compared with the condition that different service sets are respectively configured for each service instance in the related art.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
FIG. 1 is a flowchart illustrating a method for executing a batch process according to an embodiment of the present invention;
FIG. 2 is a schematic diagram illustrating a service instance in a method for executing a batch processing program according to another embodiment of the present invention;
FIG. 3 is a flow chart illustrating the execution of a batch process according to another embodiment of the present invention;
FIG. 4 is a diagram illustrating a task restart service in a batch processing program according to another embodiment of the present invention;
FIG. 5 is a block diagram illustrating an apparatus for executing a batch process program according to an embodiment of the present invention;
FIG. 6 is a schematic diagram illustrating an apparatus for executing a batch processing program according to another embodiment of the present invention;
FIG. 7 is a block diagram illustrating an apparatus for executing a batch processing program according to another embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.
An embodiment of the present invention provides an execution method of a batch processing program, as shown in fig. 1, the method includes:
step 101: acquiring at least one executable service instance;
step 102: and respectively executing at least one service instance, and providing a function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance.
According to the method for executing the batch processing program provided by the embodiment of the invention, developers only need to pre-write codes of services which may be needed by all subsequent batch processing programs and respectively encapsulate the codes into the service resource library, and when each service instance is subsequently and respectively executed, at least one service in the service resource library can be utilized to provide functions corresponding to the at least one service for each service instance. Therefore, the workload of a developer for writing the service codes is reduced, and the operation load of the system when the batch processing program is executed is reduced compared with the condition that different service sets are respectively configured for each service instance in the related art.
As shown in fig. 2, the service instances are service instances of batch tasks in the thread pool, and include service logic and service data, where the service logic may adopt a mode of uploading a service logic code to a programming system by a third party, and the system executes the code in subsequent operation; or registering the external uniform application programming Interface (API for short) in the programming system, storing the service logic code in a third party, and remotely calling the service logic code by the system during subsequent operation; or a Software Development Kit (SDK) embedded in a third party defines service logic codes according to the SDK rule, and the third party registers in a programming system in subsequent operation to remotely call the service logic codes by the system.
The service data includes identification information of data to be processed, for example: if the data to be processed are commodities in the online shopping mall, the identification information of the data to be processed is the ID set of the commodities; and if the data to be processed is the videos of the video website, the identification information of the data to be processed is the ID set of the videos. The service data may support a variety of data formats, such as: JS Object Notation (JSON), XML, binary, and the like.
The service logic can be multiplexed, that is, the same service logic and different service data can obtain different service instances.
The execution of the service instance may be performed manually or automatically using a service (e.g., a time scheduling service) in a service repository.
The above-mentioned manner of acquiring at least one service instance may be to acquire a service instance code combining the service logic and the service data, or may be to acquire the service logic code and the service instance code respectively and then combine them by a batch processing program execution device.
The service resource library stores a plurality of services of the service instances which are assisted to the thread pool, each service is associated with a group of service codes in advance, and each group of service codes are packaged to wait for being called in the execution process of the service instances.
In the embodiment of the invention, the service resource library stores a plurality of services required by the batch processing program, and the services in the service resource library can be continuously increased in an updating mode. The developer can select the service required by the service instance in the service resource library aiming at each service instance, so that the service instance has corresponding functions in the execution process. Therefore, the workload of a developer for writing the service codes is reduced, and the user can see the service when selecting the service, so that the developer can be reminded to select the service which is actually needed but is omitted in advance, and the integrity of the function of the service instance is improved.
In the embodiment of the invention, all the service instances executed by the batch processing program execution device are provided with corresponding services by the service resource library, so that compared with the service set which configures corresponding functions for each service instance in the related art, the number of repeated services in the batch processing program execution device can be reduced, and the running load of the batch processing program execution device during execution is reduced.
Optionally, as shown in fig. 3, the service repository includes at least one of a pre-processing service, a post-processing service, a task restarting service, a repeated execution service, an exception skipping service, an exception retry service, a logging service, a result query service, and a task statistics service.
A preprocessing service, configured to perform preprocessing operations on business data before business logic is executed, for example: and filtering invalid data in the service data.
The post-processing service is used for processing data after the business logic is executed, for example: and checking and sequencing the execution result.
And the task restarting service is used for checking the running state of each record when the task is restarted after the task is abnormally ended (such as the server is down), and the task is not executed if the running state is executed. As shown in fig. 4, the task restart service checks each execution record, and if execution 1, execution 2, and execution 4 are all executed normally during the execution process, the task restart service is used to restart execution 3 after execution 3 is interrupted abnormally.
And the repeated execution service is used for taking the result of the previous execution as the initial value of the next execution and performing repeated execution for a plurality of times according to the designed repeated times when the business instance needs to be executed repeatedly for a plurality of times.
And the exception skipping service is used for skipping the exception record and executing the next record when the operation is abnormal. For example: the service instance is used for processing 1000 pieces of data in batches, when an error occurs from execution to 100, the abnormal log is recorded and skipped, and the subsequent tasks are executed; finally, the results of 999 successful items and 1 failed item are obtained.
The abnormal retry service, as shown in fig. 4, is configured to end the abnormal record and re-execute the abnormal record when an abnormal operation occurs (i.e. re-attempt to execute item 100 after item 100 is abnormal in the above example), and the number of retries may be determined by the number of retries input by the developer for the abnormal retry service, where the number of retries is parameter information input by the developer for the abnormal retry service.
The above abnormal operation may be a bad network status, an idempotent interface, etc., and is only an example here.
And the log recording service is used for recording the state of each task in the execution process of the logic instance.
A result query service for querying the execution of tasks using the logging service, for example: task execution start time/end time, task execution ID set, execution start/execution time per ID, execution result (success/failure), failure reason, and the like.
And the task statistical service is used for recording the execution success times, the execution failure times, the longest execution time, the shortest execution time, the most common abnormal problems and the like by utilizing the log recording service statistics.
In addition, as shown in fig. 3, the service resource pool may further include at least one of a time scheduling service and a partition scheduling service.
The time scheduling service is used for meeting the requirements of developers on execution time, such as: the operation and maintenance system executes the service instance regularly every day to send the operation and maintenance report mail, and executes the service instance regularly every day to update a plurality of videos. In this embodiment, the time scheduling supports a cron expression, and the implementation manner is many, such as quartz.
And the partition scheduling service is used for splitting the service instance code into a plurality of groups of subcodes and enabling each group of subcodes to be executed in parallel under the condition that the data volume of the service instance is overlarge and a single partition cannot meet the execution requirement. The partition scheduling service can be automatically performed by the system, or can be performed by a developer selecting and outputting parameter information setting, namely, self-defining.
In an alternative embodiment, the at least one service includes a logging service and a result query service;
the step of providing the function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance comprises the following steps:
recording the running state of each task of a first service instance in the execution process, and storing the running state in a log, wherein the first service instance is any one of the at least one executable service instance;
and if a query request aiming at the first service instance is received, feeding back record information corresponding to the first service instance in the log, wherein the record information comprises at least one item of task starting time, task ending time, a task-associated identification information set and a task execution result.
In this embodiment, the first service instance is a service instance configured by a developer with a log service and a result query service. During the execution process of the first service instance, the state of each task of the first service instance during the execution process is recorded in a log through a log service.
And subsequently, when the developer wants to obtain the execution result of the batch processing program, sending an inquiry request for the first service instance, and after receiving the inquiry request for the first service instance, the batch processing program execution device feeds back the record information which is recorded in the log and corresponds to the first service instance, wherein the record information comprises at least one of task starting time, task ending time, a task-associated identification information set and the execution result of the task.
In the embodiment, the developer only needs to select the log recording service and the result query service for the first service instance in the service resource library in advance before executing the service instance, and the developer does not need to write the service code, so that the execution result of the first service instance can be obtained based on the content recorded in the log.
In another optional embodiment, the at least one service includes a logging service and a task statistics service;
the step of providing the function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance comprises the following steps:
recording the running state of each task in the execution process of a second service instance, and storing the running state in a log, wherein the second service instance is any one of the at least one executable service instance;
after the second service instance is executed, if a counting request aiming at a target service instance is received, counting the record information corresponding to the second service instance in the log to obtain the counting information of the second service instance;
and feeding back statistical information of the second service instance, wherein the statistical information comprises at least one of task execution success number, task execution failure number, single task execution longest time, single task execution shortest time, total execution time and exception set.
In this embodiment, the second service instance is a service instance configured by a developer with a log service and a task statistics service. And in the execution process of the second service instance, recording the state of each task in the execution process of the second service instance in a log through the log service.
If a statistical request aiming at the second service instance is received, firstly screening out records related to the second service instance; and then carrying out data statistics on the records to obtain statistical information of the second service instance. The statistical information comprises at least one item of task execution success number, task execution failure number, single task execution longest time, single task execution shortest time, total execution time and abnormal set; and finally, feeding back the statistical information of the second service instance.
In the embodiment, the developer only needs to select the log recording service and the task statistical service for the second service instance in the service resource library in advance before executing the service instance, and the developer does not need to write the service code, so that the statistical information of the second service instance can be obtained based on the content recorded in the log after the execution of the second service instance is finished.
In another optional implementation, the step of separately executing the at least one service instance includes:
receiving a time scheduling instruction, wherein the time scheduling instruction comprises at least one execution time point corresponding to the at least one service instance one to one;
and executing the service instance corresponding to the target execution time point at a target execution time point, wherein the target execution time point is any execution time point in the at least one execution time point.
The developer can set the execution time point of the corresponding service instance for the time scheduling service by sending the time scheduling instruction, where the execution time point may be set for all the service instances in a one-to-one correspondence manner, or may be set for part of the service instances, and this is not limited here.
When an execution time point is reached, the time scheduling service initiates execution of the service instance corresponding to the execution time point, and the effect of executing the service instance at the execution time point is achieved.
In the embodiment, a developer only needs to select the time scheduling service for the service instance in advance in the service resource library before executing the service instance, and the developer does not need to write the service code, so that the service instance can be executed at a desired time point.
It should be noted that the above is only an example of individual cases, and it should be considered that at least one service in the service resource library may be combined with each other to provide corresponding functions for the service instance, and not only the above-mentioned cases are merely examples.
As shown in fig. 5, an embodiment of the present invention further provides an apparatus 500 for executing a batch processing program, including:
an obtaining module 510, configured to obtain at least one executable service instance;
the executing module 520 is configured to execute at least one service instance respectively, and provide a function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the executing process of each service instance.
Optionally, the at least one service includes a logging service and a result query service;
the execution module 520 is configured to record an operation state of each task in an execution process of a first service instance, and store the operation state in a log, where the first service instance is any service instance in the at least one executable service instance; and if a query request aiming at the first service instance is received, feeding back record information corresponding to the first service instance in the log, wherein the record information comprises at least one item of task starting time, task ending time, a task-associated identification information set and a task execution result.
Optionally, the at least one service includes a logging service and a task statistics service;
the execution module 520 is configured to record an operation state of each task in an execution process of a second service instance, and store the operation state in a log, where the second service instance is any service instance in the at least one executable service instance; after the second service instance is executed, if a counting request aiming at a target service instance is received, counting the record information corresponding to the second service instance in the log to obtain the counting information of the second service instance; and feeding back statistical information of the second service instance, wherein the statistical information comprises at least one of task execution success number, task execution failure number, single task execution longest time, single task execution shortest time, total execution time and exception set.
Optionally, as shown in fig. 6, the execution module 520 includes:
a receiving unit 521, configured to receive a time scheduling instruction, where the time scheduling instruction includes at least one execution time point corresponding to the at least one service instance one to one;
an executing unit 522, configured to execute, at a target execution time point, a service instance corresponding to the target execution time point, where the target execution time point is any execution time point of the at least one execution time point.
The batch processing program execution device 500 according to the embodiment of the present invention can implement each process implemented by the batch processing program execution method according to the method embodiments in fig. 1 to fig. 4, and is not described herein again to avoid repetition.
The batch processing program execution device 500 of the embodiment of the invention can reduce the working difficulty and workload of developers and improve the execution efficiency of the batch processing program.
An embodiment of the present invention further provides an electronic device, as shown in fig. 7, including a processor 701, a communication interface 702, a memory 703 and a communication bus 704, where the processor 701, the communication interface 702, and the memory 703 complete mutual communication through the communication bus 704,
a memory 703 for storing a computer program;
the processor 701 is configured to implement the following steps when executing the program stored in the memory 703:
acquiring at least one executable service instance;
and respectively executing the at least one service instance, and providing a function corresponding to the at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance.
Optionally, the service resource library includes at least one of a preprocessing service, a post-processing service, a task restarting service, a repeat execution service, an exception skipping service, an exception retry service, a logging service, a result query service, and a task statistics service.
Optionally, the at least one service includes a logging service and a result query service;
the step of providing the function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance comprises the following steps:
recording the running state of each task of a first service instance in the execution process, and storing the running state in a log, wherein the first service instance is any one of the at least one executable service instance;
and if a query request aiming at the first service instance is received, feeding back record information corresponding to the first service instance in the log, wherein the record information comprises at least one item of task starting time, task ending time, a task-associated identification information set and a task execution result.
Optionally, the at least one service includes a logging service and a task statistics service;
the step of providing the function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance comprises the following steps:
recording the running state of each task in the execution process of a second service instance, and storing the running state in a log, wherein the second service instance is any one of the at least one executable service instance;
after the second service instance is executed, if a counting request aiming at a target service instance is received, counting the record information corresponding to the second service instance in the log to obtain the counting information of the second service instance;
and feeding back statistical information of the second service instance, wherein the statistical information comprises at least one of task execution success number, task execution failure number, single task execution longest time, single task execution shortest time, total execution time and exception set.
Optionally, the step of executing the at least one service instance respectively includes:
receiving a time scheduling instruction, wherein the time scheduling instruction comprises at least one execution time point corresponding to the at least one service instance one to one;
and executing the service instance corresponding to the target execution time point at a target execution time point, wherein the target execution time point is any execution time point in the at least one execution time point.
The communication bus mentioned in the above terminal may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the terminal and other equipment.
The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
In still another embodiment of the present invention, a computer-readable storage medium is further provided, which stores instructions that, when executed on a computer, cause the computer to execute the execution method of the batch processing program described in any one of the above embodiments.
In yet another embodiment of the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the method for executing a batch processing program according to any one of the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (10)
1. A method of performing a batch process, the method comprising:
acquiring at least one executable service instance;
and respectively executing at least one service instance, and providing a function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance.
2. The method of claim 1, wherein the service repository comprises at least one of a pre-processing service, a post-processing service, a task restart service, a repeat execution service, an exception skip service, an exception retry service, a logging service, a result query service, and a task statistics service.
3. The method of claim 2, wherein the at least one service comprises a logging service and a result query service;
the step of providing the function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance comprises the following steps:
recording the running state of each task of a first service instance in the execution process, and storing the running state in a log, wherein the first service instance is any one of the at least one executable service instance;
and if a query request aiming at the first service instance is received, feeding back record information corresponding to the first service instance in the log, wherein the record information comprises at least one item of task starting time, task ending time, a task-associated identification information set and a task execution result.
4. The method of claim 2, wherein the at least one service comprises a logging service and a task statistics service;
the step of providing the function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance comprises the following steps:
recording the running state of each task in the execution process of a second service instance, and storing the running state in a log, wherein the second service instance is any one of the at least one executable service instance;
after the second service instance is executed, if a counting request aiming at a target service instance is received, counting the record information corresponding to the second service instance in the log to obtain the counting information of the second service instance;
and feeding back statistical information of the second service instance, wherein the statistical information comprises at least one of task execution success number, task execution failure number, single task execution longest time, single task execution shortest time, total execution time and exception set.
5. The method of claim 1, wherein the step of separately executing the at least one service instance comprises:
receiving a time scheduling instruction, wherein the time scheduling instruction comprises at least one execution time point corresponding to the at least one service instance one to one;
and executing the service instance corresponding to the target execution time point at a target execution time point, wherein the target execution time point is any execution time point in the at least one execution time point.
6. An apparatus for executing a batch process, comprising:
the acquisition module is used for acquiring at least one executable service instance;
and the execution module is used for executing at least one service instance respectively, and providing a function corresponding to at least one service for each service instance by using at least one service in the same service resource library in the execution process of each service instance.
7. The batch processing program execution apparatus of claim 6, wherein the at least one service includes a logging service and a result query service;
the execution module is used for recording the running state of each task in the execution process of a first service instance, and storing the running state in a log, wherein the first service instance is any one of the at least one executable service instance; and if a query request aiming at the first service instance is received, feeding back record information corresponding to the first service instance in the log, wherein the record information comprises at least one item of task starting time, task ending time, a task-associated identification information set and a task execution result.
8. The batch processing program execution device of claim 6, wherein the execution module comprises:
a receiving unit, configured to receive a time scheduling instruction, where the time scheduling instruction includes at least one execution time point corresponding to the at least one service instance one to one;
and the execution unit is used for executing the service instance corresponding to the target execution time point at a target execution time point, wherein the target execution time point is any execution time point in the at least one execution time point.
9. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the steps of the method for executing a batch program according to any one of claims 1 to 5 when executing the program stored in the memory.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of executing a batch processing program according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911404990.4A CN111176762A (en) | 2019-12-31 | 2019-12-31 | Batch processing program execution method and device, electronic equipment and storable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911404990.4A CN111176762A (en) | 2019-12-31 | 2019-12-31 | Batch processing program execution method and device, electronic equipment and storable medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111176762A true CN111176762A (en) | 2020-05-19 |
Family
ID=70649065
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911404990.4A Pending CN111176762A (en) | 2019-12-31 | 2019-12-31 | Batch processing program execution method and device, electronic equipment and storable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111176762A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114003279A (en) * | 2021-10-22 | 2022-02-01 | 深圳供电局有限公司 | Method and system for judging flow blockage based on data analysis |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120284316A1 (en) * | 2011-05-06 | 2012-11-08 | Sap Ag, A German Corporation | Systems and methods for business process logging |
| US20130145371A1 (en) * | 2011-12-01 | 2013-06-06 | Sap Ag | Batch processing of business objects |
| CN109710236A (en) * | 2018-12-30 | 2019-05-03 | 北京字节跳动网络技术有限公司 | Business development and implementation method, device, platform and medium based on shared service |
| CN109800223A (en) * | 2018-12-12 | 2019-05-24 | 平安科技（深圳）有限公司 | Log processing method, device, electronic equipment and storage medium |
| CN110308980A (en) * | 2019-06-27 | 2019-10-08 | 深圳前海微众银行股份有限公司 | Batch processing method, device, equipment and the storage medium of data |
| CN110457382A (en) * | 2019-08-12 | 2019-11-15 | 中国联合网络通信集团有限公司 | Method for processing business and equipment |
-
2019
- 2019-12-31 CN CN201911404990.4A patent/CN111176762A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120284316A1 (en) * | 2011-05-06 | 2012-11-08 | Sap Ag, A German Corporation | Systems and methods for business process logging |
| US20130145371A1 (en) * | 2011-12-01 | 2013-06-06 | Sap Ag | Batch processing of business objects |
| CN109800223A (en) * | 2018-12-12 | 2019-05-24 | 平安科技（深圳）有限公司 | Log processing method, device, electronic equipment and storage medium |
| CN109710236A (en) * | 2018-12-30 | 2019-05-03 | 北京字节跳动网络技术有限公司 | Business development and implementation method, device, platform and medium based on shared service |
| CN110308980A (en) * | 2019-06-27 | 2019-10-08 | 深圳前海微众银行股份有限公司 | Batch processing method, device, equipment and the storage medium of data |
| CN110457382A (en) * | 2019-08-12 | 2019-11-15 | 中国联合网络通信集团有限公司 | Method for processing business and equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114003279A (en) * | 2021-10-22 | 2022-02-01 | 深圳供电局有限公司 | Method and system for judging flow blockage based on data analysis |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104991821B (en) | method and device for processing monitoring tasks in batches | |
| CN111858727B (en) | Multi-data source data export system and method based on template configuration | |
| CN112667426A (en) | Log analysis method and device | |
| CN110457142B (en) | Service processing method, system, machine room, architecture and electronic equipment | |
| CN112581018A (en) | Process task management method, system, device and storage medium | |
| CN110275768A (en) | Data processing method, device and electronic equipment | |
| US20220019625A1 (en) | Systems and methods for improved transactional mainframes | |
| CN112486719A (en) | Method and equipment for RPC interface call failure processing | |
| CN111782440A (en) | Data processing method and device and electronic equipment | |
| CN111176762A (en) | Batch processing program execution method and device, electronic equipment and storable medium | |
| CN117785212A (en) | Import dependent package and third party library clipping optimization method, device, medium and equipment | |
| CN113379501A (en) | Message pushing method and device, electronic equipment and storage medium | |
| CN113297153A (en) | Data export method, device, equipment and storage medium | |
| CN114928603B (en) | Upgrading method and device of client software, electronic equipment and medium | |
| CN110334031B (en) | Memory allocation code detection method and device, computer equipment and storage medium | |
| CN111142925A (en) | Pipeline type data processing method, equipment and storage medium | |
| CN114879942B (en) | Distributed time wheel group registration verification method, device, medium and equipment | |
| CN114816583B (en) | Flink-based data automatic processing method and device and electronic equipment | |
| CN116521134A (en) | Method, device and medium for modifying parameters of CI pipeline in execution process | |
| CN113867778B (en) | Image file generation method and device, electronic equipment and storage medium | |
| CN112764774B (en) | Product information management method, management system, electronic equipment and storage medium | |
| CN114791884A (en) | Test environment construction method and device, storage medium and electronic equipment | |
| CN111652580B (en) | Method and device for processing data of nodes | |
| CN111190725B (en) | Task processing method, device, storage medium and server | |
| CN110750271B (en) | Service aggregation, method and device for executing aggregated service and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |