CN116466927A

CN116466927A - Code generation method, system, electronic device and storage medium for batch processing task

Info

Publication number: CN116466927A
Application number: CN202310473479.XA
Authority: CN
Inventors: 刘沛然; 王丹; 黄子卿; 马博宇; 马路; 许鑫悦
Original assignee: Bank of China Ltd
Current assignee: Bank of China Ltd
Priority date: 2023-04-27
Filing date: 2023-04-27
Publication date: 2023-07-21

Abstract

The application provides a code generation method, a system, electronic equipment and a storage medium for batch processing tasks, which can be used in the field of big data. The method comprises the following steps: the editor responds to the low code generation requirement for the target batch task, and determines a target template from a template library according to the low code generation requirement; the editor generates an initial configuration file of a target batch task according to the target template, obtains the assignment of the variable, and updates the initial configuration file based on the assignment of the variable to obtain the target configuration file; the code generator generates a low code of the target batch task according to the target configuration file and the target template. Generating a corresponding target configuration file through a corresponding template of a batch processing task preset in the editor, and processing the target configuration file through a code generator to generate a corresponding low code. The development of low codes with complex logic can be realized, and the development efficiency of codes and the normalization of codes are effectively improved.

Description

Code generation method, system, electronic device and storage medium for batch processing task

Technical Field

The present disclosure relates to the field of big data, and in particular, to a method, a system, an electronic device, and a storage medium for generating a code for a batch processing task.

Background

The low code is a visual application development method, uses less code to deliver an application program at a faster speed, and automates the code which a programmer does not want to develop.

Some low-code auxiliary generation tools exist in the market at present, and source codes are automatically generated by using information configured by a graphical interface. However, the business logic of the low code generated by the existing auxiliary generation tool is relatively simple, and has very simple basic functions such as adding, deleting, checking and the like. Therefore, how to develop a low code with complex business logic is a problem that needs to be solved by those skilled in the art.

Disclosure of Invention

The application provides a code generation method, a system, electronic equipment and a storage medium for batch processing tasks, which are used for rapidly developing low codes with complex business logic.

In a first aspect, the present application provides a method for generating a code for a batch task, where the code generating system includes: the system comprises an editor and a code generator, wherein a template library is preset in the editor, and the template library comprises: a plurality of templates, each of said templates being for describing a low code infrastructure of a batch task; the method comprises the following steps:

The editor responds to the low code generation requirement of a target client for a target batch processing task, and determines a target template from the template library according to the low code generation requirement;

the editor generates an initial configuration file of the target batch task according to the target template, wherein the initial configuration file comprises: identification information of an initial configuration file, storage path information and variables to be assigned in a low-code basic framework of the target template;

the editor interactively acquires the assignment of the variable with the target client, updates the initial configuration file based on the assignment of the variable to obtain a target configuration file of the target batch processing task, and sends the target configuration file and the target template to the code generator;

and the code generator generates a low code of the target batch task according to the target configuration file and the target template.

Optionally, the editor generates an initial configuration file of the target batch task according to the target template, including:

the editor determines and generates an identification information field and a storage path information field of the initial configuration file according to the target template;

The editor sends an acquisition request to the target client to request to acquire the filling content of the identification information field and the storage path information field;

and when receiving the filling content of at least one field returned by the target client, the editor adds the filling content into the field corresponding to the initial configuration file, generates default filling content for the field which does not receive the filling content, and generates the initial configuration file.

Optionally, the target template is used for describing a low-code basic framework of a batch task for creating a data table, the variables include basic information of a low-code, basic information of a database processed by the batch task of the data table, and basic information of a data table which can be created in batch in the database;

the basic information of the low code comprises at least one of packet name information and storage path information of the low code;

the basic information of the database comprises at least one of identification information of the database, table name information of the database and Chinese name information;

the basic information of the data table which can be created in batch comprises at least one of field information, database field name information, chinese name information, length information, type information, default value information and primary key information of the data table.

Optionally, the target template is used for describing a low-code basic framework of a batch query statement for creating a database, the variable comprises basic information of the low code, and the basic information of the batch query statement of the database;

the basic information of the batch query statement of the database comprises at least one of identification information, chinese name information, data source information, query type information, database type information to be queried, query parameter information, query statement information and query result input type information of the batch query statement.

Optionally, the target template is used for describing a low-code basic framework for creating the data batch task, the variable comprises basic information of the low-code, and the basic information of the data batch task;

the basic information of the data batch processing task comprises at least one of data secondary splitting information, batch data item information, data grouping strategy information and batch data processor information; wherein the batch data item information is used to indicate a type of batch data.

Optionally, the target template is used for describing a low-code basic framework for creating a file batch task, the variable comprises basic information of the low code, and the basic information of the file batch task;

the basic information of the file batch processing task comprises at least one of file batch processing type information, job parameter information, file format information and file structure information;

the file batch type information comprises at least one of file batch writing, file batch reading and writing; the file structure information includes at least one of a file header, a file body, and a file trailer.

Optionally, the code generator generates a low code of the target batch task according to the target configuration file and the target template, including:

the code generator generates a code class of a low code of the target batch task according to the target configuration file and the target template;

and the code generator compiles the code class through a compiler to obtain the executable low code of the target equipment.

In a second aspect, the present application provides a code generation system for batch processing tasks, the code generation system comprising: the system comprises an editor and a code generator, wherein a template library is preset in the editor, and the template library comprises: a plurality of templates, each of said templates being for describing a low code infrastructure of a batch task;

the editor is used for responding to the low code generation requirement of the target client for the target batch processing task and determining a target template from the template library according to the low code generation requirement;

the editor is configured to generate an initial configuration file of the target batch task according to the target template, where the initial configuration file includes: the method comprises the steps of configuring identification information and storage path information of a file, and assigning variables in a low-code basic framework of a target template;

the editor is used for interactively acquiring the assignment of the variable with the target client, updating the initial configuration file based on the assignment of the variable to obtain a target configuration file of the target batch processing task, and sending the target configuration file and the target template to the code generator;

The code generator is used for generating the low code of the target batch task according to the target configuration file and the target template.

In a third aspect, the present application provides an electronic device, comprising: a memory and a processor;

the memory is used for storing computer instructions; the processor is configured to execute the computer instructions stored in the memory to implement the method of any one of the first aspects.

In a fourth aspect, the present application provides a computer readable storage medium having stored thereon a computer program for execution by a processor to implement the method of any one of the first aspects.

In a fifth aspect, the present application provides a computer program product comprising a computer program which, when executed by a processor, implements the method of any one of the first aspects.

According to the method, the system, the electronic equipment and the storage medium for generating the code of the batch processing task, the corresponding target configuration file is generated through the corresponding template of the batch processing task preset in the editor and the code generation requirement of the batch processing task of the user, and the target configuration file is processed through the code generator to generate the corresponding low code. The development of low codes with complex logic can be realized, and the development efficiency of codes and the normalization of codes are effectively improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.

Fig. 1 is a schematic view of a scenario provided in an embodiment of the present application;

FIG. 2 is a flowchart illustrating a method for generating code for a batch task according to an embodiment of the present application;

FIG. 3 is a second flow chart of a method for generating code for batch task according to the embodiment of the present application;

FIG. 4 is a schematic diagram of variables to be assigned provided in an embodiment of the present application;

FIG. 5 is a schematic diagram of a code generation system for batch processing tasks according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Specific embodiments thereof have been shown by way of example in the drawings and will herein be described in more detail. These drawings and the written description are not intended to limit the scope of the inventive concepts in any way, but to illustrate the concepts of the present application to those skilled in the art by reference to specific embodiments.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the accompanying claims.

In the embodiments of the present application, the words "first", "second", etc. are used to distinguish identical items or similar items having substantially the same function and action, and the order of them is not limited. It will be appreciated by those of skill in the art that the words "first," "second," and the like do not limit the amount and order of execution, and that the words "first," "second," and the like do not necessarily differ.

In the embodiments of the present application, words such as "exemplary" or "such as" are used to mean examples, illustrations, or descriptions. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

It should be noted that, the user information (including but not limited to user equipment information, user personal information, etc.) and the data (including but not limited to data for analysis, stored data, presented data, etc.) referred to in the present application are information and data authorized by the user or fully authorized by each party, and the collection, use and processing of the related data need to comply with the related laws and regulations and standards, and provide corresponding operation entries for the user to select authorization or rejection.

The method, system, electronic device and storage medium for generating the code of the batch task provided by the application can be used in the field of big data, and can also be used in any field except the field of big data.

With the rapid development of the software industry, the great demand of software development and the great increase of developers, how to rapidly develop codes with stable specifications becomes a difficult problem to be solved.

The low code is a visual application development method, fewer codes are used for delivering application programs at a high speed, the codes which a developer does not want to develop are automated, and the low code can help the developer to develop more standard and stable codes quickly.

Some low-code auxiliary generation tools exist in the market at present, and source codes are automatically generated by using information configured by a graphical interface. However, the business logic of the low code generated by the existing auxiliary generation tool is relatively simple, and has very simple basic functions such as adding, deleting, checking and the like. And batch processing task is a widely applied task processing method, which has complex business logic. At present, there is no low code generation tool for batch processing tasks, so how to develop a low code corresponding to a batch processing task with complex logic is a problem that needs to be solved by those skilled in the art.

In view of this, the embodiments of the present application provide a method, a system, an electronic device, and a storage medium for developing a code of a batch task, which generate a corresponding low code according to a low code basic frame of a preset batch task and a code generation requirement of a user batch task, so as to effectively improve the development efficiency of the code and ensure the normalization and correctness of the code.

The following describes the technical solutions of the present application and how the technical solutions of the present application solve the above technical problems in detail with specific embodiments. The following embodiments may be implemented independently or combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

Fig. 1 is a schematic view of an application scenario in an embodiment of the present application, as shown in fig. 1, including a code development system 101 and a client 102, where the code development system 101 and the client 102 may perform data interaction.

The code development system 101 includes an editor 1011 and a code generator 1012.

The code development system 101 receives the code generation demand of the batch job transmitted from the client 102, and generates a corresponding code by the editor 1011 and the code generator 1012.

Illustratively, the editor 1011 stores a plurality of basic templates corresponding to batch tasks, and the editor 1011 can determine a corresponding target template according to code generation requirements of the batch tasks sent by the client 102, and generate a configuration file corresponding to the batch tasks according to configuration information of the target template sent by the client 102.

The editor 1011 may send the configuration file to the code generator 1012 and when the code generator 1012 receives the configuration file, may generate a low code corresponding to the batch task from the configuration file. And returns the generated low code to the client 102.

Alternatively, the code development system 101 may run in a server or, alternatively, in a data processing platform. The code development system 101 may provide a code generation requirement input interface for batch processing tasks to a user through a client 102.

Optionally, in one possible implementation manner, the code development system 101 further includes a front-end page facing the user, where the user may input a code generation requirement of the batch task, and when the front-end interface of the code development system 101 receives the code generation requirement, the front-end interface sends the code generation requirement to the back-end handler editor 1011 and the code generator 1012 of the code development system 101, and when generating the corresponding code, the code generator 1012 may output the corresponding code, and display a prompt message through the front-end page to prompt the user.

The application scenario provided by the embodiment of the present application is described above, and the code generation method of the batch processing task provided by the embodiment of the present application is described below by taking the code generation system applied in fig. 1 as an example.

Fig. 2 is a flow chart of a method for generating codes of batch processing tasks according to an embodiment of the present application, as shown in fig. 2, including the following steps:

s201, the editor responds to the low code generation requirement of the target client for the target batch processing task, and a target template is determined from the template library according to the low code generation requirement.

In this embodiment of the present application, a template library is preset in the editor, where the template library includes: a plurality of templates, each of said templates being for describing a low code infrastructure of a batch task. Wherein a low code infrastructure may be used to indicate the execution logic and necessary configuration information to generate the low code.

The low code generation requirements of the target batch task may be requirements to generate low code to process the target batch task. The editor can acquire the low code generation requirement through interaction with the target client, and determine a target template from the template library according to the low code generation requirement.

In one possible implementation, the editor may be a visual editor that may display the input interface of the low code generation requirement in the target client. The editor may obtain the low code generation requirements entered by the user via the input interface. And analyzing the low code generation requirement and determining the template type corresponding to the low code generation requirement. And determining a corresponding target template in the template library according to the template type.

In another possible implementation, the editor may display a low code template selection interface in the target client. And when the client receives the low-code template selected by the user at the low-code template selection interface, determining a target template matched with the low-code template selected by the user from a template library.

S202, the editor generates an initial configuration file of the target batch task according to the target template, wherein the initial configuration file comprises: identification information of the initial configuration file, storage path information and variables to be assigned in a low-code basic framework of the target template.

In this embodiment, the initial configuration file of the target batch task may be a file for describing configuration parameters for generating the low code. The identification information of the initial configuration file may include an ID and a chinese name of the initial configuration file. The storage path information may include a folder name storing the initial profile and a storage path along which the folder is stored. The variables to be assigned in the low-code base frame of the target template can be some configuration information for generating the low code, for example, identification of the low code, operation objects of the low code, and the like, and the variables to be assigned can be acquired through the target template.

For example, after the editor determines the target template, an input interface of the identification information and the storage path information of the initial configuration file may be displayed on the target client, so that the user inputs the identification information and the storage path information in the input interface.

When the editor obtains the identification information and the storage path information, an initial configuration file named by the identification information can be generated under a path corresponding to the storage path information according to variables to be assigned in the target template.

Alternatively, the type of the initial configuration file may be an extensible markup language (Extensible Markup Language, XML) file.

S203, the editor interactively acquires the assignment of the variable with the target client, and updates the initial configuration file based on the assignment of the variable to obtain a target configuration file of the target batch task.

In this embodiment of the present application, when an editor generates an initial configuration file, a variable to be assigned in need may be determined according to the configuration file, and the variable to be assigned may be sent to a target client, so that the target client displays the variable to be assigned. When the assignment information of the variable to be assigned returned by the client is received, the assignment information can be written into the corresponding field and stored, and the target configuration file is obtained. And updating the initial configuration file through the received assignment information of the variable to be assigned to obtain the target configuration file.

When the initial configuration file is generated, the editor may open the initial configuration file, determine the variable to be assigned in the configuration file, and display the variable to be assigned in the target client, so that the user inputs the assignment information of the variable to be assigned through the target client.

When the target client receives the assignment information of the variable to be assigned, the assignment information can be returned to a value editor, and when the editor receives the assigned information, the initial configuration file can be updated to obtain the target configuration file.

Optionally, when the variable to be assigned is displayed in the target client, the variable may be displayed on different interfaces according to the type of the variable, or may be displayed on the same interface.

Alternatively, the stored information of the target profile may be the same as the stored information of the initial profile. That is, the target profile may be stored in a folder that stores the initial profile, or the target profile may overwrite the initial profile.

S204, the editor sends the target configuration file and the target template to the code generator.

S205, the code generator generates a low code of the target batch task according to the target configuration file and the target template.

In the embodiment of the application, when the editor generates the target configuration file, the target template and the target configuration file can be sent to the code generator.

Illustratively, when the code generator receives the target template and the target configuration file, the target configuration file may be parsed to obtain configuration information of the corresponding low code, and the low code may be generated according to the low code type indicated by the target template.

Optionally, in one possible implementation, the method further includes a process of compiling the low code.

Illustratively, the code generator generates a code class of a low code of the target batch task from the target configuration file and the target template; and compiling the code class through a compiler to obtain the executable low code of the target equipment.

Where a class is a concept in the programming of object-oriented languages, the essence of a class is a reference data type, which, because of its nature is a data type, not data, is not in memory and cannot be directly manipulated, but only becomes operational when instantiated as an object. The code class, after compilation, may become code executable by the electronic device.

The code generator can generate code classes corresponding to batch processing tasks according to the target configuration file and the target template, and the low codes can be obtained after a compiler is called to compile the codes.

In another possible implementation, the code generation system further comprises a compiler, by means of which interaction between the editor and the code generator is required.

For example, when the editor generates the target configuration file, the code generation system may run a compiler, and send the target configuration file and the target template to the code generator through the compiler, so that the code generator generates the corresponding code class. The compiler compiles the code classes when the code generator generates the corresponding code classes to obtain low codes which can be executed by the electronic equipment. The compiler may be a Maven compiler, which is also called a Maven compiling plug-in.

According to the code generation method for the batch processing task, the corresponding target configuration file is generated through the corresponding template of the batch processing task preset in the editor and the code generation requirement of the batch processing task of the user, and the target configuration file is processed through the code generator to generate the corresponding low code. The development of low codes with complex logic can be realized, and the development efficiency of codes and the normalization of codes are effectively improved.

Fig. 3 is a second flowchart of a code generation method for a batch task according to an embodiment of the present application, and further describes a process of generating an initial configuration file based on the embodiment shown in fig. 2, as shown in fig. 3, including the following steps:

s301, the editor determines to generate an identification information field and a storage path information field of the initial configuration file according to the target template.

In this embodiment of the present application, the identification information field and the storage path information field of the initial configuration file are used to name the initial configuration file and determine a storage path of the initial configuration file.

When the editor determines the target template, the identification information field and the storage path information field for describing the initial configuration file may be determined according to the type of the target template. Each of the identification information and the storage path information has corresponding interpretation information, so that a user can understand the meaning and filling rules conveniently.

Optionally, the content to be filled in the identification information field and the storage path information field of the initial configuration file may further include optional input items and no-need input items.

S302, the editor sends an acquisition request to the target client to request to acquire the filling content of the identification information field and the storage path information field.

In this embodiment of the present application, the acquiring request may include the entire contents of the identification information field and the storage path information field of the initial configuration file.

When the target client receives the acquisition request sent by the editor, the whole content of the identification information field and the storage path information field of the initial configuration file in the acquisition request can be displayed in a graphical interface mode, so that the user can input corresponding information.

The target client, upon receiving the filler content entered by the user, may return the filler content to the editor.

S303, when the editor receives filling content of at least one field returned by the target client, adding the filling content into a field corresponding to the initial configuration file, generating default filling content for a field not receiving the filling content, and generating the initial configuration file.

In the embodiment of the application, the filling content of the identification information field and the storage path information field can include a necessary input information item, an optional input information item and a no-input information item. Wherein the information item does not need to be input and has corresponding default filling content.

The editor can fill the filling content returned by the target client into the corresponding field, and if the filling content of the optional input information item in the returned filling content is missing, the editor can fill the default content into the content of the field. When the identification information field and the storage path information field are filled, the editor can generate and output a corresponding initial configuration file according to the target template.

According to the code generation method for the batch processing task, the editor obtains the identification information field and the storage information field of the initial configuration file to be generated, and generates the initial configuration file according to the target template. The method can provide marking information for the generated initial configuration file, and can quickly acquire the initial configuration file in subsequent processing, thereby improving the development efficiency of low codes.

The process of generating a target configuration file according to a target template provided in the embodiment of the present application will be described in detail below with reference to the accompanying drawings.

The target template provided by the embodiment of the application comprises: a common batch template, a file batch template, a table structure definition template and a named SQL definition template.

Wherein the table structure definition template is used for describing a low-code basic framework of a batch processing task for creating a data table; the named SQL definition template is used for describing a low-code basic framework of batch query sentences for creating a database; the common batch template is used for creating a low-code basic framework of the data batch task; the file batch template is used to describe a low code infrastructure that creates file batch tasks.

1. If the target template is a table structure definition template.

When the editor determines that the target template is a table structure definition template, the identification information field and the storage path information field of the initial configuration file to be populated may be displayed in the target client.

Illustratively, the identification information field and the storage path information field of the initial configuration file to be populated may be as shown in the following table:

when the editor receives the filling content of each field returned by the target client, the filling content can be added into the field corresponding to the initial configuration file, and if the filling content in unnecessary transmission is not received, the corresponding default filling content is used.

When the editor adds the filling content to the field corresponding to the initial configuration file, an XML configuration file can be generated according to a target template, the configuration file name is "file ID tables. XML", and the storage path is the path displayed by the file field.

And the editor generates an XML configuration file, can determine variables to be assigned in a low-code basic framework of the target template according to the XML file, and displays the corresponding variables to be assigned in the target client so as to acquire the assignment of the variables to be assigned.

Illustratively, the variables to be assigned include basic information of a low code, basic information of a database processed by the data table batch processing task, and basic information of a data table which can be created in batch in the database; the basic information of the low code comprises at least one of packet name information and storage path information of the low code; the basic information of the database comprises at least one of identification information of the database, table name information of the database and Chinese name information; the basic information of the data table which can be created in batch comprises at least one of field information, database field name information, chinese name information, length information, type information, default value information and primary key information of the data table.

Illustratively, as shown in fig. 4, the interface of the target client includes a basic information tab, a table structure definition tab, an index tab and a save control. The basic information tab is used for displaying basic information of a low code, the table structure definition tab is used for displaying basic information of a database processed by a data table batch processing task, and the index tab is used for displaying index information of a data table.

The target client may display packet name information and storage path information of the low code to be assigned in response to a trigger for the basic information tab, and the target client may receive the packet name information and the storage path information of the code input by the user. The packet name information and the storage path information may be selectable entries, and have corresponding default values.

The target client may display information for the database used for data sheet batch task processing in response to triggering of the sheet structure definition tab.

Illustratively, the information of the database for data table batch task processing may be as follows:

ID	must be transported	Table definition ID
			Database table name	Must be transported	Corresponding database table name
Chinese name	Must be transported	Chinese name of table

The target client may display basic information to obtain a data table in the database that may be created in bulk in response to a trigger to add a control in the table structure definition tab.

By way of example, the basic information of a data table in a database that can be created in bulk can be as follows:

fields	Must be transported	Attributes of a table record interface
			Database field name	Must be transported	Data table corresponding field
Chinese name	Must be transported	Field chinese name
			Length of	Must be transported	Field length
Type(s)	Must choose	Corresponding Java data type
			Can be empty	Must choose	Whether or not the field can be empty
Default value	Not necessary to be transported	Field defaults
			Main key	Must choose	Whether or not it is a table primary key

The target client may display index information that retrieves a data table in the database that may be created in bulk in response to a trigger in the index tab.

By way of example, index information for a data table in a database that may be created in bulk may be as shown in the following table:

alternatively, the index tab may be an optional input item, that is, all information in the index tab has a corresponding default value, and if no index information is needed, the index tab may be skipped.

When the target client receives the trigger to the save control, the acquired assignment information of each variable can be returned to the editor, and the editor updates the initial configuration file according to the received assignment information to obtain the target configuration file.

2. If the target template is named Sql definition template.

When the editor determines that the target template is a named Sql definition template, the identification information field and the storage path information field of the initial configuration file to be populated may be displayed in the target client.

when the editor adds the filling content to the field corresponding to the initial configuration file, an XML configuration file can be generated according to a target template, the configuration file name is 'file ID. Nsql. XML', and the storage path is the path displayed by the file field.

Illustratively, the variables include basic information of low codes, basic information of batch query statements of the database; the basic information of the low code comprises at least one of packet name information and storage path information of the low code; the basic information of the batch query statement of the database comprises at least one of identification information, chinese name information, data source information, query type information, database type information to be queried, query parameter information, query statement information and query result input type information of the batch query statement.

Illustratively, the interface of the target client includes a basic information tab, a named Sql definition tab and a save control. The basic information tab is used for displaying basic information of low codes, and the named Sql definition tab is used for displaying basic information of batch query sentences of the database.

The target client may display basic information for a batch query statement of the database in response to triggering of the table structure definition tab.

Illustratively, the basic information of the batch query statement of the database may be as follows:

3. When the editor determines that the target template is a common batch template, the identification information field and the storage path information field of the initial configuration file to be filled in can be displayed in the target client.

/>

When the editor adds the filling content to the field corresponding to the initial configuration file, the XML configuration file can be generated according to the target template, the configuration file name is "file ID. Batch_tran. XML", and the storage path is the path displayed by the file field.

Illustratively, the variables include basic information of the low code, basic information of the data batch task; the basic information of the low code comprises at least one of packet name information and storage path information of the low code; the basic information of the data batch processing task comprises at least one of data secondary splitting information, batch data item information, data grouping strategy information and batch data processor information; wherein the batch data item information is used to indicate a type of batch data.

Illustratively, the interface of the target client comprises a basic information tab, a common batch definition tab and a storage control. The basic information tab is used for displaying basic information of a low code, and the common batch definition tab is used for displaying basic information of a data batch processing task.

The target client may display basic information for the data batch task in response to a trigger to a generic batch definition tab.

By way of example, the basic information of a data batch task may be as follows:

the batch data item can be an associated option of whether to split secondarily, if not, the batch data item is selected to split secondarily, if not, the batch data item is not filled, the batch data item is not split, if not, the batch data item is filled, and the batch data item is indicated to split once.

If the user confirms that the data batch task is not split, the batch task can be configured to not split and fill in batch data items when the batch task does not need to traverse data, and the corresponding generated data processor inherits Batch Data Processor Without Data Item and only executes the process once.

If the user confirms that the data batch task is split once, the batch data items are configured so as to determine the data items processed after the split once. The batch data items herein may be of a compound type or a table type. Regardless of the type configured, the named SQL return type called in the get Batch Walker method in the corresponding Batch transaction generation class is consistent with the Batch data item, otherwise the run will report errors. The data result set is traversed in a vernier manner, and the process method is used for processing batch data item objects of each traversal. The corresponding data processor inherits Abstract Batch Data Process or get Batch Data Walker that requires returning a data result set using name sql, one process per piece of data call.

The amount of transactions split once is excessive (to the millions) and the time spent traversing data items and data item transmissions will increase significantly, taking into account the use of secondary splits. The second split belongs to the logical split and is handled in the job, so that the data item (batch data item) to be handled needs to be associated with the one-time split data (group data item) item. There are three processing methods in the Process class generated by the corresponding batch transaction: get Batch Data Walker returns the first split data result set; the get Job Batch Data Walker method uses each piece of data of the first split result set as a parameter for acquiring the second split result set, and processes the second split result set row by row in the process method.

Optionally, in a possible implementation, the basic information of the data batch task may further include input and attribute interface information.

By way of example, the input and attribute interface information may be as shown in the following table;

4. When the editor determines that the target template is a file batch template, the identification information field and the storage path information field of the initial configuration file to be filled may be displayed in the target client.

Illustratively, the identification information field and the storage path information field of the initial configuration file to be populated may be as follows:

When the editor adds the filling content to the field corresponding to the initial configuration file, an XML configuration file can be generated according to a target template, the configuration file name is "file ID. File_batch_tran. XML", and the storage path is the path displayed by the file field.

Illustratively, the variables include basic information of low codes, and basic information of the file batch task; the basic information of the low code comprises at least one of packet name information and storage path information of the low code; the basic information of the file batch processing task comprises at least one of file batch processing type information, job parameter information, file format information and file structure information; the file batch type information comprises at least one of file batch writing, file batch reading and writing; the file structure information includes at least one of a file header, a file body, and a file trailer.

Illustratively, the interface of the target client includes a basic information tab, a file quantity definition tab and a save control. The basic information tab is used for displaying basic information of the low codes, and the file batch definition tab is used for displaying basic information of the data batch processing task.

The target client may display basic information for a file batch task in response to a trigger to define tabs for the file batch.

By way of example, the basic information of a file batch task may be as follows:

type information of file batch processing: if batch transactions of reading files and writing data into a database need to be developed, selecting a read for the read type of the files; if a batch transaction is required that develops a read database and writes data to a file, the file read-write type selects "write". When a large data amount of the table needs to be read to write the file, parallel library reading and writing of the file can be performed in the form of data packets. If the data packet is needed, filling in a packet data item, wherein the content is the java type of the packet data item, such as string; if the batch transaction to be developed is to read a file and write data to another file, the file read-write type selects "read & write".

Operation parameter information: including the variable parameters of the execution process and whether to generate corresponding attribute interface classes.

File format information: the file format is defined when the file is read and written, and the code is used for analyzing the read-in file content according to the format or writing the file according to the format.

By way of example, the file format information may be as shown in the following table:

file structure information: including at least one of header information, body information, and trailer information.

By way of example, the header information may be as shown in the following table:

by way of example, the file body information may be as shown in the following table:

by way of example, the end-of-file information may be as shown in the following table:

It can be understood that when the target client receives the trigger to the save control, if a certain information is a necessary entry, if the corresponding information is not received, the prompt information can be displayed.

In summary, according to the low code development method for batch processing tasks provided in the embodiment of the present application, the information required for creating codes corresponding to different batch processing tasks is selected or filled in a graphical configuration manner based on the target template, so that corresponding low codes can be generated. The code is not required to be written manually and repeatedly by a user, the normalization and the accuracy of the generated code are ensured, and the development efficiency of the code is effectively improved. The standardized code template is beneficial to reducing the difficulty of reading and modifying codes, and is convenient for iterative development and later maintenance; the stable codes are helpful for improving the satisfaction degree of users and the product quality.

The embodiment of the application also provides a code development system for batch processing tasks.

Fig. 5 is a schematic structural diagram of a code development system 500 for batch processing tasks according to an embodiment of the present application, as shown in fig. 5, including an editor 501 and a code generator 502.

An editor 501, configured to respond to a low code generation requirement of a target client for a target batch task, and determine a target template from the template library according to the low code generation requirement.

An editor 501, configured to generate an initial configuration file of the target batch task according to the target template, where the initial configuration file includes: the method comprises the steps of configuring identification information of a file, storing path information and variables to be assigned in a low-code basic framework of the target template.

And the editor 501 is configured to obtain the assignment of the variable in an interaction manner with the target client, update the initial configuration file based on the assignment of the variable, obtain a target configuration file of the target batch task, and send the target configuration file and the target template to the code generator.

And a code generator 502, configured to generate a low code of the target batch task according to the target configuration file and the target template.

Optionally, the editor 501 is further configured to determine, according to the target template, an identification information field and a storage path information field for generating the initial configuration file; sending an acquisition request to the target client to request to acquire the filling content of the identification information field and the storage path information field; and when the filling content of at least one field returned by the target client is received, adding the filling content into the field corresponding to the initial configuration file, generating default filling content for the field which does not receive the filling content, and generating the initial configuration file.

Optionally, the code generator 502 is further configured to generate a code class of a low code of the target batch task according to the target configuration file and the target template; and the code generator compiles the code class through a compiler to obtain the executable low code of the target equipment.

The target template is used for describing a low-code basic framework of a batch processing task for creating a data table, the variables comprise basic information of a low code, basic information of a database processed by the batch processing task of the data table, and basic information of the data table which can be created in batch in the database; the basic information of the low code comprises at least one of packet name information and storage path information of the low code; the basic information of the database comprises at least one of identification information of the database, table name information of the database and Chinese name information; the basic information of the data table which can be created in batch comprises at least one of field information, database field name information, chinese name information, length information, type information, default value information and primary key information of the data table.

The target template is used for describing a low-code basic framework of a batch query statement for creating a database, the variables comprise basic information of the low code, and the basic information of the batch query statement of the database; the basic information of the low code comprises at least one of packet name information and storage path information of the low code; the basic information of the batch query statement of the database comprises at least one of identification information, chinese name information, data source information, query type information, database type information to be queried, query parameter information, query statement information and query result input type information of the batch query statement.

The target template is used for describing a low-code basic framework for creating a data batch task, the variables comprise basic information of the low code, and the basic information of the data batch task; the basic information of the low code comprises at least one of packet name information and storage path information of the low code; the basic information of the data batch processing task comprises at least one of data secondary splitting information, batch data item information, data grouping strategy information and batch data processor information; wherein the batch data item information is used to indicate a type of batch data.

The target template is used for describing a low-code basic framework for creating a file batch task, the variables comprise basic information of the low code, and the basic information of the file batch task is described; the basic information of the low code comprises at least one of packet name information and storage path information of the low code; the basic information of the file batch processing task comprises at least one of file batch processing type information, job parameter information, file format information and file structure information; the file batch type information comprises at least one of file batch writing, file batch reading and writing; the file structure information includes at least one of a file header, a file body, and a file trailer.

The code generation system for batch processing tasks provided in the embodiment of the present application may be used to execute the technical solution of the code generation method for batch processing tasks provided in any one of the embodiments, and the principle and technical effects thereof are similar, and are not repeated here.

The embodiment of the application also provides electronic equipment.

Fig. 6 is a schematic structural diagram of an electronic device 600 according to an embodiment of the present application, as shown in fig. 6, including:

a processor 601.

A memory 602 for storing executable instructions of the terminal device.

In particular, the program may include program code including computer-operating instructions. The memory 602 may include high-speed RAM memory or may further include non-volatile memory (non-volatile memory), such as at least one disk memory.

The processor 601 is configured to execute computer-executable instructions stored in the memory 602, so as to implement the technical solution of the report processing method embodiment described in the foregoing method embodiment.

The processor 601 may be a central processing unit (Central Processing Unit, abbreviated as CPU), or an application specific integrated circuit (Application Specific Integrated Circuit, abbreviated as ASIC), or one or more integrated circuits configured to implement embodiments of the present application.

Optionally, when the electronic device 60 performs the technical solution of the code generation method embodiment of the batch processing task, the electronic device 60 may further include a display device 603.

The display means 603 are used for displaying assignment information of variables to be assigned and for displaying the generated low code.

Optionally, the electronic device 60 may also include a communication interface 604 to enable communication interaction with external devices, such as user terminals (e.g., cell phones, tablets), via the communication interface 604. In a specific implementation, if the communication interface 604, the memory 602, and the processor 601 are implemented independently, the communication interface 604, the memory 602, and the processor 601 may be connected to each other and perform communication with each other through buses. The bus may be an industry standard architecture (Industry Standard Architecture, abbreviated ISA) bus, an external device interconnect (Peripheral Component, abbreviated PCI) bus, or an extended industry standard architecture (Extended Industry Standard Architecture, abbreviated EISA) bus, among others. Buses may be divided into address buses, data buses, control buses, etc., but do not represent only one bus or one type of bus.

Alternatively, in a specific implementation, if the communication interface 604, the memory 602, and the processor 601 are integrated on a chip, the communication interface 604, the memory 602, and the processor 601 may complete communication through internal interfaces.

The embodiment of the present application further provides a computer readable storage medium, on which a computer program is stored, where the computer program when executed by a processor implements the technical solution of the embodiment of the medical data transmission method, and the implementation principle and the technical effect are similar, and are not repeated herein.

In one possible implementation, the computer readable medium may include random access Memory (Random Access Memory, RAM), read-Only Memory (ROM), compact disk (compact disc Read-Only Memory, CD-ROM) or other optical disk Memory, magnetic disk Memory or other magnetic storage device, or any other medium targeted for carrying or storing the desired program code in the form of instructions or data structures, and accessible by a computer. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (Digital Subscriber Line, DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes optical disc, laser disc, optical disc, digital versatile disc (Digital Versatile Disc, DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

The embodiment of the application further provides a computer program product, which comprises a computer program, and the computer program realizes the technical scheme of the embodiment of the medical data transmission method when being executed by a processor, and the implementation principle and the technical effect are similar, and are not repeated here.

In the specific implementation of the terminal device or the server, it should be understood that the processor may be a central processing unit (in english: central Processing Unit, abbreviated as CPU), or may be other general purpose processors, digital signal processors (in english: digital Signal Processor, abbreviated as DSP), application specific integrated circuits (in english: application Specific Integrated Circuit, abbreviated as ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the embodiments of the present application may be embodied directly in a hardware processor for execution, or in a combination of hardware and software modules in the processor for execution.

Those skilled in the art will appreciate that all or part of the steps of any of the method embodiments described above may be accomplished by hardware associated with program instructions. The foregoing program may be stored in a computer readable storage medium, which when executed, performs all or part of the steps of the method embodiments described above.

The technical solution of the present application, if implemented in the form of software and sold or used as a product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the technical solutions of the present application may be embodied in the form of a software product stored in a storage medium comprising a computer program or several instructions. The computer software product causes a computer device (which may be a personal computer, a server, a network device, or similar electronic device) to perform all or part of the steps of the methods described in embodiments of the present application.

Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.

It is to be understood that the present application is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims

1. A code generation method for a batch processing task, wherein the code generation system comprises: the system comprises an editor and a code generator, wherein a template library is preset in the editor, and the template library comprises: a plurality of templates, each of said templates being for describing a low code infrastructure of a batch task; the method comprises the following steps:

2. The method of claim 1, wherein the editor generating an initial profile of the target batch job from the target template comprises:

3. A method according to any one of claims 1 or 2, wherein the target template is used to describe a low code infrastructure of a batch task for creating a data table, the variables include basic information of a low code, basic information of a database that the batch task of the data table processes, and basic information of a data table that can be created in batch in the database;

4. The method according to any one of claims 1 or 2, wherein the target template is used to describe a low code infrastructure of a batch query statement that creates a database, the variables including basic information of the low code, the basic information of the batch query statement of the database;

5. A method according to any one of claims 1 or 2, wherein the target template is used to describe a low code infrastructure that creates a data batch task, the variables including basic information of the low code, the basic information of the data batch task;

6. The method according to any one of claims 1 or 2, wherein the target template is used to describe a low code infrastructure that creates a file batch task, the variables include basic information of the low code, the basic information of the file batch task;

the basic information of the low code comprises at least one of packet name information and storage path information of the low code; the basic information of the file batch processing task comprises at least one of file batch processing type information, job parameter information, file format information and file structure information;

7. The method of claim 6, wherein the code generator generating low code for the target batch task from the target profile and the target template comprises:

8. A code generation system for batch processing tasks, the code generation system comprising: the system comprises an editor and a code generator, wherein a template library is preset in the editor, and the template library comprises: a plurality of templates, each of said templates being for describing a low code infrastructure of a batch task;

9. An electronic device, comprising: a processor, and a memory communicatively coupled to the processor;

the memory stores computer-executable instructions;

the processor executes computer-executable instructions stored in the memory to implement the method of any one of claims 1 to 7.

10. A computer readable storage medium having stored therein computer executable instructions which when executed by a processor are adapted to carry out the method of any one of claims 1 to 7.