CN115794623A - Batch task processing method and device, electronic equipment and storage medium - Google Patents

Abstract

The application discloses a batch task processing method and device, electronic equipment and a storage medium, and relates to the technical field of automatic testing. Wherein, the method comprises the following steps: acquiring an environment configuration parameter of a target program and a deployment script of the target program, and deploying a test environment of the target program based on the environment configuration parameter and the deployment script; carrying out batch processing on the tasks to be handled through the target program to obtain batch processing results of the tasks to be handled; automatically testing the batch processing result through the target program under the test environment to obtain a test result of the batch processing result; and determining whether the tasks to be processed are successfully processed in batches based on the test result. The method and the device can replace manual work to automatically complete the tasks to be processed in batches and perform batch processing and batch testing, can ensure the accuracy of batch processing and batch testing, can realize the automation of batch testing to improve the testing efficiency, and can also improve the automation rate of the DevOps platform.

Description

Batch task processing method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of automated testing technologies, and in particular, to a batch task processing method and apparatus, an electronic device, and a storage medium.

Background

Online transactions have the characteristic of real-time and fast response to user requests, the requests are received and processed in real time, and the results are returned to the client immediately after processing is completed. The batch transaction is to process in sequence after receiving the request, and then output the processing result in a unified way after all the processing is finished, so the batch transaction has the characteristics of large processing data volume and longer execution time.

An integrated project management platform for developing operation and maintenance integration (DevOps for short) integrated project management, codes and knowledge bases follows the concept of Development-test-operation and maintenance integration. In the process of DevOps engineering construction, on-line transaction testing is automated, but batch transaction testing still needs off-line manual testing due to the problems of complex logic, large processing data volume, long execution time, high error possibility and the like. And the deployment, test and output of the batch test program are not integrated on the pipeline, and the test result is not integrated on the DevOps platform, so that the test result is not traceable. Therefore, how to improve the automation rate of the DevOps project management platform on batch transaction testing becomes a problem to be solved urgently.

Disclosure of Invention

The application provides a batch task processing method and device, electronic equipment and a storage medium, which can replace manual work to automatically complete batch processing and batch testing of tasks to be processed in batches, can ensure the accuracy of batch processing and batch testing, can realize the automation of batch testing to improve the testing efficiency, and can improve the automation rate of a DevOps platform.

In a first aspect, the present application provides a batch task processing method, including:

acquiring environment configuration parameters of a target program and a deployment script of the target program, and deploying a test environment of the target program based on the environment configuration parameters and the deployment script;

performing batch processing on the tasks to be handled through the target program to obtain a batch processing result of the tasks to be handled;

automatically testing the batch processing result through the target program under the test environment to obtain a test result of the batch processing result;

and determining whether the tasks to be handled are successfully processed in batches or not based on the test result.

The embodiment of the application provides a batch task processing method, which comprises the following steps: acquiring an environment configuration parameter of a target program and a deployment script of the target program, and deploying a test environment of the target program based on the environment configuration parameter and the deployment script; the tasks to be handled are processed in batches through the target program to obtain batch processing results of the tasks to be handled; automatically testing the batch processing result through the target program under the test environment to obtain a test result of the batch processing result; and determining whether the tasks to be handled are successfully processed in batches or not based on the test result. The method comprises the steps of processing tasks to be processed in batches through a target program, and then automatically testing batch processing results through the target program in a deployed testing environment so as to verify the batch processing results; according to the method and the system, a batch task testing assembly line is realized by establishing a batch task processing system, manual work can be replaced to automatically complete batch processing and batch testing of tasks to be handled to be processed in batches, the accuracy of batch processing and batch testing can be guaranteed, the automation of batch testing can be realized to improve the testing efficiency, and the automation rate of a DevOps platform can be improved.

Further, the performing an automated test on the batch processing result through the target program in the test environment to obtain a test result of the batch processing result includes: determining a test type corresponding to the task to be processed; generating an automatic test script corresponding to the test type; and carrying out automatic test on the batch processing result based on the automatic test script to obtain a test result of the batch processing result.

Further, the generating an automated test script corresponding to the test type includes: acquiring a corresponding test content standard from a preset test database based on the test type; determining corresponding contents to be tested in the batch processing result; comparing the contents to be tested based on the test content standard to obtain a comparison result; and programming the comparison result by adopting a preset structured query language to obtain an automatic test script.

Further, the performing batch processing on the tasks to be handled through the target program to obtain a batch processing result of the tasks to be handled includes: acquiring a configuration text of the target program; determining an execution node of the target program based on the configuration text; and when the execution nodes of the target program are met, performing batch processing on the tasks to be handled through the target program to obtain a batch processing result of the tasks to be handled.

Further, the determining whether the batch processing of the tasks to be handled is successful based on the test result includes: calculating the test passing rate of the batch processing result according to the test result; if the test passing rate reaches a passing rate standard, determining that the tasks to be processed are successfully processed in batches, wherein the passing rate standard is determined based on the test content standard; and if the test passing rate does not reach the passing rate standard, determining that the batch processing of the tasks to be processed fails.

Further, after it is determined that the batch processing of the tasks to be handled fails, the method further includes: generating a failure log for batch processing of the tasks to be processed; and displaying the failure log to guide a tester to investigate the failure reason of the batch processing of the tasks to be processed.

Further, the task to be handled includes at least one of: the system comprises a financial processing batch task, a statistical statement batch task, a state processing batch task, a data cleaning batch task and a historical data generation batch task.

In a second aspect, the present application provides a batch task processing apparatus, including:

the test environment deployment module is used for acquiring the environment configuration parameters of the target program and the deployment script of the target program, and deploying the test environment of the target program based on the environment configuration parameters and the deployment script;

the batch task processing module is used for carrying out batch processing on the tasks to be handled through the target program to obtain a batch processing result of the tasks to be handled;

the processing result testing module is used for automatically testing the batch processing results through the target program under the testing environment to obtain the testing results of the batch processing results;

and the processing result judging module is used for determining whether the tasks to be handled are successfully processed in batches based on the test result.

In a third aspect, the present application provides an electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the batch task processing method according to any embodiment of the present application.

In a fourth aspect, the present application provides a computer-readable storage medium storing computer instructions for causing a processor to implement a batch task processing method according to any embodiment of the present application when the computer instructions are executed.

It should be noted that all or part of the computer instructions may be stored on the computer readable storage medium. The computer-readable storage medium may be packaged with the processor of the batch task processing device, or may be packaged separately from the processor of the batch task processing device, which is not limited in this application.

For the descriptions of the second aspect, the third aspect and the fourth aspect in the present application, reference may be made to the detailed description of the first aspect; in addition, for the beneficial effects described in the second aspect, the third aspect and the fourth aspect, reference may be made to the beneficial effect analysis of the first aspect, and details are not repeated here.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present application, nor do they limit the scope of the present application. Other features of the present application will become apparent from the following description.

It can be understood that, before the technical solutions disclosed in the embodiments of the present application are used, the type, the use range, the use scenario, and the like of the personal information related to the present application should be informed to the user and authorized by the user in a proper manner according to the relevant laws and regulations.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a first flowchart of a batch task processing method according to an embodiment of the present disclosure;

fig. 2 is a second flowchart of a batch task processing method according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of a batch task processing device according to an embodiment of the present disclosure;

fig. 4 is a block diagram of an electronic device for implementing a batch task processing method according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, but not all the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that the terms "first," "second," "target," and "original" and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or otherwise described herein. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Before the embodiments of the present application are described, a batch task processing system is described. The batch task processing method is applied to a batch task processing system, and the batch task processing system is integrated on a DevOps platform. The method is characterized in that a complete life cycle of target program testing is deployed in a DevOps platform according to the target program, a complete closed assembly line of the target program testing is designed, and automation of batch testing is realized to improve testing efficiency. The batch task processing system comprises four modules according to time sequence, namely a test environment deployment module, a batch task processing module, a processing result testing module and a processing result judging module. The test environment deployment module is used for executing a preorder node, and the processing result test module is used for executing a subsequent node.

Fig. 1 is a first flowchart of a batch task processing method according to an embodiment of the present disclosure, which is applicable to a situation where a batch task is processed and an automatic test is performed on a batch processing result. The batch task processing method provided by this embodiment may be executed by the batch task processing apparatus provided by this embodiment, and the apparatus may be implemented by software and/or hardware and integrated in an electronic device executing this method.

Referring to fig. 1, the method of the present embodiment includes, but is not limited to, the following steps:

s110, obtaining the environment configuration parameters of the target program and the deployment script of the target program, and deploying the test environment of the target program based on the environment configuration parameters and the deployment script.

The target program in the application has two tasks, namely a batch processing task and a batch testing task, wherein the batch processing task is a batch processing task to be handled, and the batch testing task is an automatic test of a batch processing result of the batch processing task to be handled. The environment configuration parameters are environment parameters configured when the test environment is deployed for the target program, and may include environment information such as various thresholds, quality access control of program codes, quality access control of unit tests, and modes of automated tests of the DevOps platform when the test environment is deployed. A deployment script is a method flow when deploying a test environment for an object program.

Optionally, the task to be handled includes at least one of the following: the system comprises a financial processing batch task, a statistical statement batch task, a state processing batch task, a data cleaning batch task and a historical data generation batch task.

In the embodiment of the present application, the step is a test environment deployment module in the batch task processing system. A user (such as a tester) logs in a DevOps platform, enters a pre-configured batch task processing system, manually notes the environment configuration parameters of a target program in an interactive interface of the batch task processing system by the tester, clicks to create and issue a pipeline operation, and sends a test environment deployment instruction to a pipeline; and after receiving the test environment deployment instruction, the test environment deployment module triggers the pipeline to run and enters a test environment deployment stage. In the test environment deployment stage, the server automatically acquires the environment configuration parameters of the target program and the deployment script of the target program in the interactive interface, and automatically executes environment deployment based on the environment configuration parameters and the deployment script to realize the test environment for deploying the target program.

And S120, performing batch processing on the tasks to be handled through the target program to obtain a batch processing result of the tasks to be handled.

In the embodiment of the present application, the step is a batch task processing module in the batch task processing system. And after the test environment is successfully deployed, sending a deployment success signal to the target program starting platform. And after receiving the deployment success signal, the target program calling platform immediately executes the target program, so that the tasks to be processed in batch are processed to obtain a batch processing result.

Further, the batch processing result of the tasks to be handled is obtained by batch processing the tasks to be handled through the target program, and the batch processing result comprises the following steps: acquiring a configuration text of a pre-configured target program; determining an execution node of the target program based on the configuration text; and when the execution node of the target program is met, performing batch processing on the tasks to be handled through the target program to obtain a batch processing result of the tasks to be handled.

Optionally, the configuration text may further include attribute information of tasks to be handled to be processed in batches.

And S130, carrying out automatic test on the batch processing result through the target program under the test environment to obtain a test result of the batch processing result.

In the embodiment of the present application, the step is a processing result testing module in the batch task processing system. And after the tasks to be processed in batch are processed to obtain a batch processing result, the target program calling platform sends a test execution instruction to the target program automatic test execution stage. And the automatic test execution stage enters the test execution stage after receiving the test execution instruction so as to realize the automatic test of the batch processing result and obtain the test result of the batch processing result.

And S140, determining whether the tasks to be handled are successfully processed in batch based on the test result.

In the embodiment of the present application, the step is a processing result determination module in the batch task processing system. And the processing result judging module analyzes the test result according to the judging standard to determine whether the tasks to be processed in batches are successfully processed in batches.

Further, determining whether the tasks to be handled are successfully processed in batch based on the test result includes: calculating the test passing rate of the batch processing result according to the test result; if the test passing rate reaches the passing rate standard, determining that the tasks to be processed are successfully processed in batches, and sending a batch processing success signal to a test discharging stage; and if the test passing rate does not reach the passing rate standard, determining that the batch processing of the tasks to be processed fails and not allowing the test to be performed. Wherein the passing rate criteria is determined based on the test content criteria.

Further, after determining that the to-do task fails to be processed in batch, the method further includes: generating a failure log for batch processing of tasks to be processed; and displaying a failure log in the interactive interface, wherein the failure log can comprise failure reasons to guide a tester to investigate the failure reasons of the batch processing of the tasks to be handled, so that the auxiliary tester can be supported to investigate problems and then process the tasks to be handled in batch again. The failure log display method is not limited, and the failure log can be displayed in any preset display mode.

Optionally, the failure log may further include a standard for test execution verification, that is, a test content standard.

According to the technical scheme provided by the embodiment, the test environment of the target program is deployed on the basis of the environment configuration parameters and the deployment script by acquiring the environment configuration parameters of the target program and the deployment script of the target program; carrying out batch processing on the tasks to be handled through the target program to obtain batch processing results of the tasks to be handled; automatically testing the batch processing result through the target program under the test environment to obtain a test result of the batch processing result; and determining whether the tasks to be handled are successfully processed in batches or not based on the test result. The method comprises the steps of processing tasks to be processed in batches through a target program, and then automatically testing batch processing results through the target program in a deployed testing environment so as to verify the batch processing results; according to the method and the system, a batch task testing assembly line is realized by establishing a batch task processing system, manual work can be replaced to automatically complete batch processing and batch testing of tasks to be handled to be processed in batches, the accuracy of batch processing and batch testing can be guaranteed, the automation of batch testing can be realized to improve the testing efficiency, and the automation rate of a DevOps platform can be improved.

The batch task processing method provided by the embodiment of the present application is further described below, and fig. 2 is a second flow diagram of the batch task processing method provided by the embodiment of the present application. The embodiment of the application is optimized on the basis of the embodiment, and specifically optimized as follows: the present embodiment explains the process of performing the automated test on the batch processing result (i.e., step S130 in the embodiment corresponding to fig. 1) in detail.

Referring to fig. 2, the method of the present embodiment includes, but is not limited to, the following steps:

and S210, determining the test type corresponding to the task to be handled.

In the embodiment of the application, the processing result testing module can automatically identify the testing type of the task to be handled.

Optionally, the task to be handled includes at least one of the following: the system comprises a financial processing batch task, a statistical statement batch task, a state processing batch task, a data cleaning batch task and a historical data generation batch task. The specific types of tasks to be handled are different, and the test types are also different.

And S220, acquiring a corresponding test content standard from a preset test database based on the test type.

In the embodiment of the present application, the test database may be an inspection field that is set in advance in an excel form by a tester, and the test content standard is specific test content, such as a standard field, for performing an automated test on a batch processing result. And the processing result testing module acquires the corresponding testing content standard from the testing database based on the testing type.

And S230, determining corresponding contents to be tested in the batch processing result, and comparing the contents to be tested based on the test content standard to obtain a comparison result.

In the embodiment of the application, the corresponding content to be tested in the batch processing result is determined, the content to be tested can be a field to be checked, and the field to be checked is checked and compared based on the standard field to obtain a comparison result.

And S240, programming the comparison result by adopting a preset structured query language to obtain an automatic test script.

In the embodiment of the present application, the preset Structured Query Language may be a Structured Query Language (SQL Language), and may also be another Language. And programming the comparison result by adopting SQL language to generate an automatic test script corresponding to the test type.

And S250, carrying out automatic test on the batch processing result based on the automatic test script to obtain a test result of the batch processing result.

In the embodiment of the application, the automatic test script is executed to realize the automatic test of the batch processing result to obtain the test result of the batch processing result, and the test result can be stored in the specified path.

According to the technical scheme provided by the embodiment, the test type corresponding to the task to be handled is determined; acquiring a corresponding test content standard from a preset test database based on the test type; determining corresponding contents to be tested in the batch processing result, and comparing the contents to be tested based on the test content standard to obtain a comparison result; programming the comparison result by adopting a preset structured query language to obtain an automatic test script; and carrying out automatic test on the batch processing result based on the automatic test script to obtain a test result of the batch processing result. According to the method and the system, a batch task testing assembly line is realized by establishing a batch task processing system, manual work can be replaced to automatically complete batch processing and batch testing of tasks to be handled to be processed in batches, the accuracy of batch processing and batch testing can be guaranteed, the automation of batch testing can be realized to improve the testing efficiency, and the automation rate of a DevOps platform can be improved.

Fig. 3 is a schematic structural diagram of a batch task processing apparatus according to an embodiment of the present disclosure, and as shown in fig. 3, the apparatus 300 may include:

a test environment deployment module 310, configured to obtain an environment configuration parameter of a target program and a deployment script of the target program, and deploy a test environment of the target program based on the environment configuration parameter and the deployment script;

the batch task processing module 320 is configured to perform batch processing on the tasks to be handled through the target program to obtain a batch processing result of the tasks to be handled;

a processing result testing module 330, configured to perform an automated test on the batch processing result through the target program in the testing environment to obtain a testing result of the batch processing result;

and the processing result judging module 340 is configured to determine whether the to-do tasks are successfully processed in batches based on the test result.

Further, the processing result testing module 330 may be specifically configured to: determining a test type corresponding to the task to be processed; generating an automatic test script corresponding to the test type; and carrying out automatic test on the batch processing result based on the automatic test script to obtain a test result of the batch processing result.

Further, the processing result testing module 330 may be further specifically configured to: acquiring a corresponding test content standard from a preset test database based on the test type; determining corresponding contents to be tested in the batch processing result; comparing the contents to be tested based on the test content standard to obtain a comparison result; and programming the comparison result by adopting a preset structured query language to obtain an automatic test script.

Further, the batch task processing module 320 may be specifically configured to: acquiring a configuration text of the target program; determining an execution node of the target program based on the configuration text; and when the execution nodes of the target program are met, performing batch processing on the tasks to be handled through the target program to obtain a batch processing result of the tasks to be handled.

Further, the processing result determining module 340 may specifically be configured to: calculating the test passing rate of the batch processing result according to the test result; if the test passing rate reaches a passing rate standard, determining that the tasks to be processed are successfully processed in batches, wherein the passing rate standard is determined based on the test content standard; and if the test passing rate does not reach the passing rate standard, determining that the batch processing of the tasks to be handled fails.

Further, the batch task processing apparatus may further include: a log generation module;

the log generation module is used for generating a failure log of the batch processing of the tasks to be handled after the determination that the batch processing of the tasks to be handled fails; and displaying the failure log to guide a tester to investigate the failure reason of the batch processing of the tasks to be processed.

Optionally, the task to be handled includes at least one of the following items: the system comprises a financial processing batch task, a statistical statement batch task, a state processing batch task, a data cleaning batch task and a historical data generation batch task.

The batch task processing device provided by the embodiment can be applied to the batch task processing method provided by any embodiment, and has corresponding functions and beneficial effects.

Fig. 4 is a block diagram of an electronic device for implementing a batch task processing method according to an embodiment of the present application. The electronic device 10 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.

As shown in fig. 4, the electronic device 10 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, and the like, wherein the memory stores a computer program executable by the at least one processor, and the processor 11 can perform various suitable actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from a storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data necessary for the operation of the electronic apparatus 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.

A number of components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, or the like; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.

The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, or the like. The processor 11 performs the various methods and processes described above, such as a batch task processing method.

In some embodiments, the batch task processing method may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the batch task processing method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the batch task processing method by any other suitable means (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

A computer program for implementing the methods of the present application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be performed. A computer program can execute entirely on a machine, partly on a machine, as a stand-alone software package partly on a machine and partly on a remote machine or entirely on a remote machine or server.

In the context of this application, a computer readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.

The computing system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solution of the present application can be achieved, and the present invention is not limited thereto.

The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (10)

1. A method for batch task processing, the method comprising:

acquiring an environment configuration parameter of a target program and a deployment script of the target program, and deploying a test environment of the target program based on the environment configuration parameter and the deployment script;

carrying out batch processing on the tasks to be handled through the target program to obtain batch processing results of the tasks to be handled;

automatically testing the batch processing result through the target program under the test environment to obtain a test result of the batch processing result;

and determining whether the tasks to be handled are successfully processed in batches based on the test result.

2. The batch task processing method of claim 1, wherein the automatically testing the batch processing result by the target program under the test environment to obtain the test result of the batch processing result comprises:

determining a test type corresponding to the task to be processed;

generating an automatic test script corresponding to the test type;

and carrying out automatic test on the batch processing result based on the automatic test script to obtain a test result of the batch processing result.

3. The batch task processing method according to claim 2, wherein the generating of the automated test script corresponding to the test type includes:

acquiring a corresponding test content standard from a preset test database based on the test type;

determining corresponding contents to be tested in the batch processing result;

comparing the contents to be tested based on the test content standard to obtain a comparison result;

and programming the comparison result by adopting a preset structured query language to obtain an automatic test script.

4. The batch task processing method of claim 1, wherein the obtaining of the batch processing result of the tasks to be handled through the batch processing of the tasks to be handled by the target program comprises:

acquiring a configuration text of the target program;

determining an execution node of the target program based on the configuration text;

and when the execution nodes of the target program are met, performing batch processing on the tasks to be handled through the target program to obtain a batch processing result of the tasks to be handled.

5. The batch task processing method of claim 3, wherein the determining whether the to-do tasks are successfully batch processed based on the test result comprises:

calculating the test passing rate of the batch processing result according to the test result;

if the test passing rate reaches a passing rate standard, determining that the tasks to be processed are successfully processed in batches, wherein the passing rate standard is determined based on the test content standard;

and if the test passing rate does not reach the passing rate standard, determining that the batch processing of the tasks to be processed fails.

6. The batch task processing method according to claim 5, further comprising, after determining that the batch processing of the tasks to be handled fails:

generating a failure log for batch processing of the tasks to be processed;

and displaying the failure log to guide a tester to investigate the failure reason of the batch processing of the tasks to be processed.

7. The batch task processing method of claim 1, wherein the tasks to be handled include at least one of: the system comprises a financial processing batch task, a statistical statement batch task, a state processing batch task, a data cleaning batch task and a historical data generation batch task.

8. A batch task processing apparatus, characterized in that the apparatus comprises:

the test environment deployment module is used for acquiring the environment configuration parameters of the target program and the deployment script of the target program, and deploying the test environment of the target program based on the environment configuration parameters and the deployment script;

the batch task processing module is used for carrying out batch processing on the tasks to be handled through the target program to obtain a batch processing result of the tasks to be handled;

the processing result testing module is used for automatically testing the batch processing results through the target program under the testing environment to obtain the testing results of the batch processing results;

and the processing result judging module is used for determining whether the tasks to be handled are successfully processed in batches or not based on the test result.

9. An electronic device, characterized in that the electronic device comprises:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the batch task processing method of any one of claims 1 to 7.

10. A computer-readable storage medium storing computer instructions for causing a processor to perform the batch task processing method of any one of claims 1 to 7 when executed.

Images