CN117632120A

CN117632120A - Processing system, method, equipment and storage medium for report data

Info

Publication number: CN117632120A
Application number: CN202311651668.8A
Authority: CN
Inventors: 巨秉熠
Original assignee: Agricultural Bank of China
Current assignee: Agricultural Bank of China
Priority date: 2023-12-04
Filing date: 2023-12-04
Publication date: 2024-03-01

Abstract

The invention discloses a processing system, a processing method, processing equipment and a storage medium of report data, wherein the system comprises: the system comprises a service maintenance module, a code generation module, a batch scheduling module and a data display module; the business maintenance module is used for acquiring the report to be processed and the corresponding report processing logic, generating a business logic flow chart of the report to be processed according to the report processing logic, and generating a structural description language corresponding to the report processing logic according to the business logic flow chart; the code generation module is used for generating a processing process code of the report to be processed according to the structured description language; the batch scheduling module is used for acquiring and executing the processing codes; the data display module is used for obtaining the execution result of the batch scheduling module on the processing codes and displaying the execution result. The report data processing system disclosed by the invention can automatically process reports in batches, reduces manual operation, and ensures that the code generation process is more flexible by the business logic flow chart.

Description

Processing system, method, equipment and storage medium for report data

Technical Field

The present invention relates to the field of data processing technologies, and in particular, to a system, a method, an apparatus, and a storage medium for processing report data.

Background

In the business process, a large number of reports generated by the business are often required to be processed. The processing of the report demand at the current stage still meets the demand of a specific report by a service, and then technicians complete the realization of the report through development, test, delivery and other processes. The whole process takes a long time, the code reusability is low, and the delivered report forms still face emergency demands from time to time, so that the current problem can not be well solved according to the original development process.

Meanwhile, in the practical process, a plurality of reports with different dimensions are obtained by processing the same input business table, and the development process still takes the reports with different dimensions as an independent processing process, so that the large-scale integration cannot be realized well.

Disclosure of Invention

The invention provides a processing system, a processing method, processing equipment and a storage medium for report data, which are used for realizing batch automatic processing of the report data.

According to an aspect of the present invention, there is provided a report data processing system including: the system comprises a service maintenance module, a code generation module, a batch scheduling module and a data display module;

the business maintenance module is used for acquiring a report to be processed and corresponding report processing logic, generating a business logic flow chart of the report to be processed according to the report processing logic, and generating a structural description language corresponding to the report processing logic according to the business logic flow chart;

the code generation module is used for generating a processing process code of the report to be processed according to the structured description language;

the batch scheduling module is used for acquiring and executing the machining process codes;

the data display module is used for obtaining the execution result of the batch scheduling module on the processing process code and displaying the execution result.

Optionally, the report to be processed includes a physical data table obtained from a database and a service table generated in response to the front-end operation.

Optionally, the service logic flow chart is composed of at least one flow chart logic block, and each flow chart logic block includes corresponding inflow data, outflow data, logic block operation description information and service data operation information.

Optionally, the service maintenance module is specifically configured to:

extracting business data operation aiming at the report to be processed according to the report processing logic;

establishing a corresponding flow chart logic block for each business data operation, and matching corresponding inflow data, outflow data, logic block operation description information and business data operation information for each flow chart logic block according to the report processing logic;

and combining the flow chart logic blocks to obtain the business logic flow chart.

Optionally, the service maintenance module is further configured to:

extracting target variables related to a processing process in the report to be processed according to the report to be processed and the report processing logic;

and generating a configuration table of the report to be processed according to the target variable.

Optionally, the code generation module is specifically configured to:

analyzing the structured description language, and extracting the report to be processed, and corresponding variable information, configuration information and operation information;

and generating a processing process code of the report to be processed according to the report to be processed and the corresponding variable information, configuration information and operation information.

Optionally, at least one database grammar template is preconfigured in the code generating module, and the code generating module is specifically configured to:

extracting a target database grammar template matched with the structural description language from the at least one database grammar template;

and analyzing the structured description language according to the target database grammar template.

According to another aspect of the present invention, there is provided a report data processing method, the method being applied to a report data processing system, the system including a service maintenance module, a code generation module, a batch scheduling module and a data display module, the method including:

acquiring a report to be processed and corresponding report processing logic through the service maintenance module, generating a service logic flow chart of the report to be processed according to the report processing logic, and generating a structural description language corresponding to the report processing logic according to the service logic flow chart;

generating a processing process code of the report to be processed according to the structured description language through the code generation module;

acquiring and executing the machining process codes through the batch scheduling module;

and acquiring an execution result of the batch scheduling module on the machining process code through the data display module, and displaying the execution result.

Further, the report to be processed comprises a physical data table obtained from a database and a service table generated in response to the front-end operation.

Further, the business logic flow diagram is composed of at least one flow diagram logic block, and each flow diagram logic block comprises corresponding inflow data, outflow data, logic block operation description information and business data operation information.

Further, generating a business logic flow chart of the report to be processed according to the report processing logic, including:

Further, the method further comprises:

extracting target variables related to a processing process in the report to be processed according to the report to be processed and the report processing logic through the service maintenance module;

Further, generating a processing code of the report to be processed according to the structured description language, including:

Further, at least one database grammar template is preconfigured in the code generation module, and the parsing of the structured description language comprises the following steps:

According to another aspect of the present invention, there is provided an electronic apparatus including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the method of processing report data according to any one of the embodiments of the present invention.

According to another aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to execute a method for processing report data according to any one of the embodiments of the present invention.

The invention discloses a report data processing system, which comprises: the system comprises a service maintenance module, a code generation module, a batch scheduling module and a data display module; the business maintenance module is used for acquiring the report to be processed and the corresponding report processing logic, generating a business logic flow chart of the report to be processed according to the report processing logic, and generating a structural description language corresponding to the report processing logic according to the business logic flow chart; the code generation module is used for generating a processing process code of the report to be processed according to the structured description language; the batch scheduling module is used for acquiring and executing the processing codes; the data display module is used for obtaining the execution result of the batch scheduling module on the processing codes and displaying the execution result. The report data processing system disclosed by the invention can automatically process reports in batches, reduces manual operation, ensures that the code generation process is more flexible by a business logic flow chart, meets the timeliness and diversification of report data processing requirements. And because the logic and technology are decoupled, the business logic is separated from the bottom layer, so that the business continuity can be ensured, and the affected degree is reduced.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic diagram of a report data processing system according to a first embodiment of the present invention;

FIG. 2 is a schematic diagram of a logic block of a flowchart provided in accordance with a first embodiment of the present invention;

FIG. 3 is a flowchart of a report data processing method according to a second embodiment of the present invention;

fig. 4 is a schematic structural diagram of an electronic device for implementing a method for processing report data according to the third embodiment of the present invention.

Detailed Description

In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example 1

Fig. 1 is a schematic structural diagram of a report data processing system according to a first embodiment of the present invention, where the present embodiment is applicable to a case of processing report data, the system may execute a report data processing method, and the report data processing system may be implemented in a form of hardware and/or software. As shown in fig. 1, the system includes: the system comprises a business maintenance module 110, a code generation module 120, a batch scheduling module 130 and a data display module 140.

The business maintenance module 110 is configured to obtain a report to be processed and corresponding report processing logic, generate a business logic flow chart of the report to be processed according to the report processing logic, and generate a structured description language corresponding to the report processing logic according to the business logic flow chart.

The report may be in a form of a chart or a table, and the objective data, the statistical data, the analysis data, the comprehensive information, and the like are comprehensively displayed.

In this embodiment, the report to be processed may be a report to be processed according to an actual service requirement, where the corresponding report processing logic is used to indicate a processing operation flow that needs to be executed on the report, and includes a specific variable, an operation name, related configuration information, and so on. The service maintenance module 110 is a module for maintaining and displaying service logic, and the module can convert the acquired report to be processed and report processing logic into a form of a flow chart, and then represent the flow chart in a structural description language, and send the structural description language to the code generation module 120.

The business logic flow chart may be a flow chart graphically representing report processing logic of a report to be processed, and the structured description language may be a programming language which is easy to be read and resolved by a computer, for example, JSON language. There are many forms of structured description language, and the present embodiment is not limited thereto.

Optionally, the report to be processed includes a physical data table obtained from a database and a business table generated in response to the front-end operation.

Specifically, the mode of the service maintenance module 110 to obtain the report to be processed and the corresponding report processing logic may be to obtain the physical data table to be processed from the database in response to the report processing instruction, and use the physical data table as the report to be processed; the service table generated according to the content selected or input by the operation can also be used as the data table to be processed according to the front-end operation. The acquired report to be processed can be split, combined, spliced and the like, and the obtained new report is used as the report to be processed.

Further, the business maintenance module 110 can maintain the pending report after obtaining the pending report, including maintaining dimensions, variables, etc. of the pending report. For example, the service maintenance module 110 may update the dimension, variable, and other data in the report to be processed according to the actual service situation, so that the report to be processed reflects the latest service change.

Optionally, the service logic flow chart is composed of at least one flow chart logic block, and each flow chart logic block comprises corresponding inflow data, outflow data, logic block operation description information and service data operation information.

Specifically, the service logic flow chart may be a combination of one or more flow chart logic blocks according to the data flow direction, and for one flow chart logic block in the service logic flow chart, the inflow data may be the outflow data of another flow chart logic block, and the outflow data may be the inflow data of a third flow chart logic block. The logic block operation description information and the business data operation information in each flow chart logic block can be used for indicating the operation steps and the business data of the operation objects in the report processing logic corresponding to the flow chart logic block. For example, the description information of the logic block operation may be information describing the logic block operation in the logic block of the flowchart, and the operation information of the service data may be operation information of screening, sorting, aggregation, and simultaneous operation of multiple data streams, and includes specific operation of a service data field, such as common numerical calculation, string operation, and multi-field combination operation.

Fig. 2 is a schematic diagram of a logic block of a flowchart according to an embodiment of the present invention, where the logic block of the flowchart includes corresponding inflow data, outflow data, logic block operation description information, and service data operation information.

Optionally, the service maintenance module 110 is specifically configured to:

extracting business data operation aiming at the report to be processed according to the report processing logic; establishing a corresponding flow chart logic block for each business data operation, and matching corresponding inflow data, outflow data, logic block operation description information and business data operation information for each flow chart logic block according to report processing logic; and combining the logic blocks of the flow chart to obtain a business logic flow chart.

Specifically, to generate the business logic flow chart corresponding to the report processing logic, the flow chart logic blocks forming the business logic flow chart can be generated first, and then the flow chart logic blocks are combined into the business logic flow chart. In the generation of the flow chart logic block, the business maintenance module 110 may split the report processing logic according to the operation steps to obtain one or more business data operations, make each business data operation correspond to one flow chart logic block, and analyze the operation object and the operation content in each business data operation to obtain the inflow data, the outflow data, the logic block operation description information and the business data operation information corresponding to the flow chart logic block. For each flow chart logic block, the inflow data is operated by the service data, and the outflow data is generated to enter the next flow chart logic block.

Preferably, a business process template may be configured in the business maintenance module 110, according to the business process template, if the report processing logic is matched with the pre-configured business process template, a complete business logic flow chart may be directly generated according to the template, and no step analysis is required.

Optionally, the service maintenance module 110 is further configured to:

extracting target variables related to the processing process in the report to be processed according to the report to be processed and the report processing logic; and generating a configuration table of the report to be processed according to the target variable.

The configuration table may be a file containing configuration information of the report to be processed, for example, the configuration table may contain description information of each field in the report to be processed.

Specifically, the service maintenance module 110 may assign an existing configuration table to the pending report, or may generate a new configuration table according to the obtained pending report.

The code generation module 120 is configured to generate a machining process code of the pending report according to the structured description language.

In this embodiment, the code generation module 120 may parse the structured description language generated by the service maintenance module 110, extract relevant information of the report processing logic therein, and convert the relevant information into executable code.

Optionally, the code generation module 120 is specifically configured to:

analyzing the structured description language, and extracting a report to be processed and corresponding variable information, configuration information and operation information; and generating a processing process code of the report to be processed according to the report to be processed and the corresponding variable information, configuration information and operation information.

Further, the code generation module 120 may set some code templates for common processing operations, such as step-by-step summarization, aggregation, etc., and when the structured description language matches with the code templates, the corresponding code templates may be directly obtained as executable codes. Preferably, the code generation module 120 may check the syntax of the executable code after it is generated, and send it to the batch scheduling module 130 if there is no syntax error, otherwise, code modification is required to know that there is no syntax error.

Optionally, at least one database grammar template is preconfigured in the code generating module 120, and the code generating module 120 is specifically configured to:

extracting a target database grammar template matched with the structural description language from at least one database grammar template; and analyzing the structured description language according to the grammar template of the target database.

Specifically, in order to adapt to multiple structured description languages, grammar templates adapted to different databases may be preconfigured in the code generating module 120, and when the processing code is generated, templates adapted to the obtained structured description languages are extracted from the grammar templates of the databases, so as to be used for analyzing the structured description languages.

The lot dispatch module 130 is used to obtain and execute the process code.

In this embodiment, the batch scheduling module 130 may obtain the executable code generated by the code generation module 120, and perform batch scheduling on the code.

The data display module 140 is configured to obtain an execution result of the batch scheduling module 130 on the machining process code, and display the execution result.

In this embodiment, the data display module 140 is configured to display the code execution result. The code execution result reflects the execution result of report processing logic of the report to be processed, such as a new report or chart obtained after the report to be processed is processed.

Example two

Fig. 3 is a flowchart of a report data processing method according to a second embodiment of the present invention, where the method may be performed by a report data processing system, where the system includes a service maintenance module, a code generation module, a batch scheduling module, and a data display module. As shown in fig. 3, the method includes:

s210, acquiring a to-be-processed report and corresponding report processing logic through a service maintenance module, generating a service logic flow chart of the to-be-processed report according to the report processing logic, and generating a structural description language corresponding to the report processing logic according to the service logic flow chart.

Optionally, the method for generating the business logic flow chart of the report to be processed according to the report processing logic may be:

Optionally, the method further comprises:

extracting target variables related to the processing process in the report to be processed according to the report to be processed and the report processing logic through a service maintenance module; and generating a configuration table of the report to be processed according to the target variable.

S220, generating a processing process code of the report to be processed according to the structured description language through a code generation module.

Optionally, the method for generating the processing code of the report to be processed according to the structured description language may be:

Optionally, at least one database grammar template is preconfigured in the code generating module, and the method for parsing the structured description language may be:

S230, acquiring and executing the machining process codes through the batch scheduling module.

S240, the execution result of the batch scheduling module on the processing codes is obtained through the data display module, and the execution result is displayed.

The processing method of the report data disclosed by the invention can be executed by the processing system of the report data of any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the system.

Example III

Fig. 4 shows a schematic diagram of the structure of an electronic device 10 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.

As shown in fig. 4, the electronic device 10 includes at least one processor 11, and a memory, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, etc., communicatively connected to the at least one processor 11, in which the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various appropriate actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 may also be stored. The processor 11, the ROM 12 and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.

Various components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, etc.; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.

The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 11 performs the respective methods and processes described above, for example, the processing method of report data.

In some embodiments, the method of processing report data may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the processing of report data described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the method of processing the report data in any other suitable manner (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.

The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.

The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims

1. A system for processing report data, comprising: the system comprises a service maintenance module, a code generation module, a batch scheduling module and a data display module;

2. The system of claim 1, wherein the pending report includes a physical data table obtained from a database and a business table generated in response to a front-end operation.

3. The system of claim 1, wherein the business logic flow diagram is comprised of at least one flow diagram logic block, each flow diagram logic block including corresponding ingress data, egress data, logic block operation description information, and business data operation information.

4. A system according to claim 3, wherein the service maintenance module is specifically configured to:

5. The system of claim 1, wherein the service maintenance module is further configured to:

6. The system according to claim 1, wherein the code generation module is specifically configured to:

7. The system of claim 6, wherein at least one database grammar template is preconfigured in the code generation module, and the code generation module is specifically configured to:

8. The method is applied to a report data processing system, and the system comprises a business maintenance module, a code generation module, a batch scheduling module and a data display module, wherein the method comprises the following steps:

9. An electronic device, the electronic device comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the report data processing method of claim 8.

10. A computer readable storage medium storing computer instructions for causing a processor to execute the method of processing report data of claim 8.