CN111797604A - Report generation method, device, equipment and computer readable storage medium - Google Patents
Report generation method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN111797604A CN111797604A CN202010615369.9A CN202010615369A CN111797604A CN 111797604 A CN111797604 A CN 111797604A CN 202010615369 A CN202010615369 A CN 202010615369A CN 111797604 A CN111797604 A CN 111797604A
- Authority
- CN
- China
- Prior art keywords
- data
- report
- report generation
- component
- source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/177—Editing, e.g. inserting or deleting of tables; using ruled lines
- G06F40/18—Editing, e.g. inserting or deleting of tables; using ruled lines of spreadsheets
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/275—Synchronous replication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/5018—Thread allocation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application belongs to the technical field of data processing, and provides a report generation method, a report generation device, report generation equipment and a computer-readable storage medium, wherein the method comprises the following steps: when a report generation request is received, determining a plurality of source databases related to the report generation request according to pre-configured data source information; respectively creating multiple types of component tasks aiming at the multiple source databases; multithreading is executed in parallel at regular time to obtain the required data of the report generation request; and generating a target report according to the demand data. The method and the device for generating the report improve the flexibility and intelligence of report generation.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a report generation method, apparatus, device, and computer-readable storage medium.
Background
When an enterprise operates, in order to perform statistical analysis on various data, various business reports need to be generated through a reporting system. The traditional report system can only use the data of the same type of database in a single business system to generate a fixed business report.
However, with the increasing expansion of the enterprise scale, a plurality of business systems provide corresponding management and services inside the enterprise, data required by a business report comes from different business systems, the types of databases of different business systems are different, the data structure is complex, and the traditional report system has limitations of poor flexibility and intelligence when generating a report, and cannot meet the report generation requirement.
Disclosure of Invention
The present application mainly aims to provide a report generation method, device, equipment and computer readable storage medium, and aims to solve the technical problem that the conventional report system has poor flexibility and intelligence when generating reports.
In a first aspect, the present application provides a report generation method, where the method includes:
when a report generation request is received, determining a plurality of source databases related to the report generation request according to pre-configured data source information;
respectively creating multiple types of component tasks aiming at the multiple source databases;
multithreading is executed in parallel at regular time to obtain the required data of the report generation request;
and generating a target report according to the demand data.
In a second aspect, the present application further provides a report generating apparatus, where the apparatus includes:
the system comprises a determining module, a generating module and a sending module, wherein the determining module is used for determining a plurality of source databases related to a report generation request according to pre-configured data source information when the report generation request is received;
the creating module is used for creating a plurality of types of component tasks aiming at the plurality of source databases respectively;
the execution module is used for executing the multiple types of component tasks in parallel at fixed time in a multithread manner to obtain the required data of the report generation request;
and the generating module is used for generating a target report according to the demand data.
In a third aspect, the present application further provides a computer device, which includes a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the report generation method described above are implemented.
In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the report generating method as described above.
When a report generation request is received, a plurality of source databases related to the report generation request are determined according to preconfigured data source information, then various types of component tasks are respectively created for the plurality of source databases, and then the various types of component tasks are executed in parallel at regular time in a multithread manner, so that required data of the report generation request can be obtained, and a report is generated according to the required data. By the method, different types of component tasks can be created for different source databases to collect data in various types of databases, so that various reports can be generated by using the data in the various types of databases, the flexibility and intelligence of report generation are improved, and various report generation requirements can be met.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a report generation method according to an embodiment of the present application;
fig. 2 is an exemplary diagram of component tasks for creating machining data for a source database to be machined according to an embodiment of the present application;
fig. 3 is another exemplary diagram of component tasks for creating machining data for a source database to be machined according to an embodiment of the present application;
fig. 4 is a diagram of another example of component tasks for creating machining data for a source database to be machined according to an embodiment of the present application;
fig. 5 is a schematic block diagram of a report generating apparatus according to an embodiment of the present application;
fig. 6 is a block diagram schematically illustrating a structure of a computer device according to an embodiment of the present application.
The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
It is to be understood that the terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
The embodiment of the application provides a report generation method, a report generation device, report generation equipment and a computer-readable storage medium. The report generation method is mainly applied to report generation equipment, the report generation equipment can be equipment with a data processing function, such as a Personal Computer (PC), a server and the like, and the report generation equipment is loaded with an intelligent report system.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating a report generating method according to an embodiment of the present application.
As shown in fig. 1, the report generation method includes steps S101 to S104.
Step S101, when a report generation request is received, a plurality of source databases related to the report generation request are determined according to pre-configured data source information.
Various data source information related to all services is pre-configured in the intelligent reporting system, and the data source information comprises a data source link URL (uniform resource locator), a data source name, a database name corresponding to the data source, a user name, a password and the like.
The business side can send a report generation request to the intelligent reporting system, and when the intelligent reporting system receives the report generation request, the required data of the report generation request is determined from which databases according to the preconfigured data source information. Specifically, the report generation request carries a report type, the report type defines required data of the report generation request, which data sources the required data of the report generation request relates to are determined first, then a plurality of data sources the required data of the report generation request relates to are obtained according to preconfigured data source information, and the required data of the report generation request is derived from databases corresponding to the plurality of data sources. For example, the report generation request is an order report requesting generation of a certain product, it may be determined that the data source related to the required data of the report generation request is multiple data systems corresponding to the product, and the required data of the report generation request is derived from the databases in the multiple data systems corresponding to the product.
Step S102, respectively creating multiple types of component tasks for the multiple source databases.
The intelligent reporting system is provided with data processing components such as a data synchronization component, a groovy component, an sql component and an avapeak component in advance. The data synchronization component is used for synchronizing data, and can realize synchronization between pg databases, synchronization from mongo databases to pg databases, synchronization between files and pg database tables and the like; the groovy component is used for processing data, and data processing such as data extraction, data conversion, data calculation and the like can be completed by writing a groovy script and executing the script; the sql component, similar to the groovy component, is also used to process data; the java bean component may process the customized business logic, such as parsing data, through the interface.
After determining the source database to which the required data of the report generation request relates, in order to obtain the required data of the report generation request, it is necessary to create multiple types of component tasks for the multiple source databases, to complete different processing on the data in the multiple source databases by executing the multiple types of component tasks, and to summarize the processed data to a target database, where the data in the target database is the required data.
In an embodiment, the source databases include a source database to be synchronized and a source database to be processed, and the method specifically includes: and creating a component task of synchronous data aiming at the source database to be synchronized, and creating a component task of processing data aiming at the source database to be processed.
Because the plurality of source databases include the source database to be synchronized and the source database to be processed, the component task for creating the synchronized data for the source database to be synchronized and the component task for creating the processed data for the source database to be processed can be performed.
In an embodiment, the component task for creating the synchronization data for the source database to be synchronized specifically includes: loading a data synchronization component; and configuring the information of the source database to be synchronized, the information of the target database and the synchronization task scheduling parameter in the page of the data synchronization component.
Specifically, a data synchronization component is loaded, information of a source database to be synchronized and information of a target database are configured in a page of the data synchronization component, the information of the source database to be synchronized includes a name of the source database to be synchronized, a name of a source table to be synchronized in the source database to be synchronized, a field of the source table to be synchronized, a where condition of the source table to be synchronized, an order sorting field, and the like, and the information of the target database includes a name of the target database, a target table in the target database, a field of the target table, and the like. And synchronous task scheduling parameters are also configured in a page of the data synchronization component, and the synchronous task scheduling parameters comprise a time attribute (normal scheduling or idle scheduling), a scheduling period, synchronous starting time, synchronous ending time and the like.
In an embodiment, the component task for creating the synchronization data for the source database to be synchronized specifically includes: loading a data synchronization component; and configuring the information of the source database to be synchronized, the information of the target database, the synchronous task scheduling parameter and the paging synchronous data condition in the page of the data synchronization component.
Specifically, considering that the data amount in the source table to be synchronized may be particularly large, in order to improve the synchronization efficiency, in the process of creating the component task of data synchronization for the source database to be synchronized, in addition to configuring the information of the source database to be synchronized, the information of the target database, and the synchronization task scheduling parameter, a condition of paging synchronization data may be configured, for example, the source table to be synchronized, whose data amount is greater than the preset number threshold value in the source database to be synchronized, is screened out, and paging configuration is performed, so that paging synchronization data is implemented when the component task of data synchronization is executed.
In an embodiment, the source database to be synchronized includes a relational database and a non-relational database, so that, during paging configuration, data in the screened source table to be synchronized may be divided according to data types, for example, data in the source table to be synchronized under each data type is scanned, and if the amount of data in the source table to be synchronized reaches a fixed amount, a fixed amount of data belonging to the same data type is placed in one page, so as to ensure that the data types of the data in each page are the same, and further, multiple pieces of pagedata to be synchronized of different data types are obtained.
In an embodiment, the component task for creating the machining data for the source database to be machined specifically includes: loading a data processing component; and configuring a data processing code and a processing task scheduling parameter in a page of the data processing component.
For example, as shown in fig. 2, a Sql component is loaded, and then the corresponding machining task scheduling parameters and Sql code are configured in the page of the Sql component. The processing task scheduling parameters comprise time attributes (normal scheduling or idle scheduling), scheduling periods, processing starting time and finishing time, corn expressions and the like; the Sql code defines the business logic that performs parsing of the process data.
For example, as shown in fig. 3, the Groovy component is loaded, and then the corresponding machining task scheduling parameter and the Groovy code are configured in the page of the Groovy component. The processing task scheduling parameters comprise time attributes (normal scheduling or idle scheduling), scheduling periods, processing starting time and finishing time, corn expressions and the like; the Groovy code defines the business logic that performs parsing of the process data.
For example, as shown in fig. 4, the java bean component is loaded, and corresponding processing task scheduling parameters are configured in a page of the java bean component, where the processing task scheduling parameters include a time attribute (normal scheduler idle scheduling), a scheduling period, a processing start time and end time, a java bean component interface name, a corn expression, and the like. Wherein the interface of the Javabean component defines business logic for executing analysis processing data.
And step S103, multithreading is performed in parallel at regular time to obtain the required data of the report generation request.
The intelligent reporting system is provided with a quartz task scheduling tool in advance, multiple types of created component tasks can be executed in parallel in a multi-thread timing mode through the quartz task scheduling tool, synchronous processing of a source database to be synchronized and analytic processing of the source database to be processed are completed, data obtained after synchronous processing and data obtained after analytic processing are collected to a target database, and the data in the target database is required data.
Specifically, each type of component task is analyzed through a quartz task scheduling tool to obtain the service logic and the execution time of each type of component task, then a thread corresponding to each type of component task is controlled, and when the execution time of each type of component task is reached, each type of component task is executed according to the service logic of each type of component task.
In an embodiment, for a component task of synchronous data, the component task of synchronous data is analyzed through a quartz task scheduling tool to obtain a service logic and an execution time of the synchronous data corresponding to the component task of synchronous data, then a thread corresponding to the component task of synchronous data is controlled, and when the execution time of the component task of synchronous data is reached, the service logic of synchronous data is executed to synchronize data in a source database to be synchronized to a target database, so that the component task of synchronous data is completed.
In one embodiment, the component tasks of the processing data are analyzed through a quartz task scheduling tool aiming at the component tasks of the processing data to obtain service logic and execution time of the processing data corresponding to the component tasks of the processing data, then threads corresponding to the component tasks of the processing data are controlled, when the execution time of the component tasks of the processing data is reached, the service logic of the processing data is executed, the data in a source database to be processed are analyzed and processed, and the data obtained after the analysis and processing are collected to a target database, so that the component tasks of the processing data are completed.
It should be noted that, the multiple types of component tasks are executed in parallel by controlling each thread through the quartz task scheduling tool, and the multiple threads are used, so that the threads run independently without mutual influence, that is, the multiple types of component tasks can be executed in parallel at fixed time by multiple threads, thereby realizing the unified processing of the component tasks of various types, further greatly improving the execution efficiency of the component tasks, and laying a foundation for the subsequent rapid generation of the target report.
In an embodiment, after the execution of the multiple types of component tasks is completed, the execution result may be generated and displayed, for example, after the execution of the component task for data synchronization is completed, the synchronization result is displayed each time, such as the synchronization start time, the synchronization end time, whether the synchronization is successful or not, the total number of synchronization successes, the error log recorded when the synchronization fails, and the like.
And step S104, generating a target report according to the demand data.
And multithreading executes the created various types of component tasks in parallel at regular time, completes the synchronous processing of the source database to be synchronized and the analytic processing of the source database to be processed, and can acquire the required data from the target database to generate a report and return the report to the service party after the data obtained after the synchronous processing and the data obtained after the analytic processing are collected to the target database.
In an embodiment, the generating a target report according to the demand data specifically includes: taking a report type carried by the report generation request, and acquiring a target report template corresponding to the report type; and filling the required data into the target report template to obtain a target report.
Specifically, various types of report templates are configured in advance in the intelligent report system, and a target report template corresponding to the report type carried by the report generation request is extracted according to the preset report type corresponding to each report template, wherein the target report template comprises a plurality of report cells filled with data, and the report cells are provided with data identifiers and data processing formats of the filled data; for each report form cell, extracting corresponding data from the required data according to the data identifier set by the report form cell, and filling the corresponding data into the report form cell; and processing the filled data according to the data processing format set by the report cell to generate a report.
In an embodiment, the data processing format includes a function formula, and the processing of the filled data according to the data processing format set in the report cell specifically includes: and performing function operation on the filled data according to a function formula set in the report form cell.
The intelligent report system provided by the embodiment can create different types of component tasks for different source databases to collect data in various types of databases, so that various different reports can be generated by using the data in the various types of databases, and the intelligent report system is quick, convenient and fast, has higher compatibility, further improves the flexibility and intelligence of report generation, and can meet the report generation requirement.
In the report generation method provided in the above embodiment, when the report generation request is received, the multiple source databases related to the report generation request are determined according to the preconfigured data source information, then multiple types of component tasks are respectively created for the multiple source databases, and then the multiple types of component tasks are executed in parallel at regular time by multiple threads, so that the required data of the report generation request can be obtained, and the report is generated according to the required data. By the method, different types of component tasks can be created for different source databases to collect data in various types of databases, so that various different reports can be generated by using the data in the various types of databases, the compatibility is higher, the flexibility and intelligence of report generation are improved, and various report generation requirements can be met.
Referring to fig. 5, fig. 5 is a schematic block diagram of a report generating apparatus according to an embodiment of the present application.
As shown in fig. 5, the report generation apparatus 400 includes: a determination module 401, a creation module 402, an execution module 403, and a generation module 404.
The determining module 401 is configured to determine, when a report generation request is received, a plurality of source databases related to the report generation request according to preconfigured data source information;
a creating module 402, configured to create multiple types of component tasks for the multiple source databases respectively;
the execution module 403 is configured to execute the multiple types of component tasks in parallel at a fixed time in a multithreading manner, so as to obtain the required data of the report generation request;
and a generating module 404, configured to generate a target report according to the demand data.
It should be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the apparatus and each module and unit described above may refer to the corresponding processes in the foregoing report generation method embodiment, and are not described herein again.
The apparatus provided by the above embodiments may be implemented in the form of a computer program, which can be run on a computer device as shown in fig. 6.
Referring to fig. 6, fig. 6 is a schematic block diagram illustrating a structure of a computer device according to an embodiment of the present disclosure. The computer device may be a Personal Computer (PC), a server, or the like having a data processing function.
As shown in fig. 6, the computer device includes a processor, a memory, and a network interface connected by a system bus, wherein the memory may include a nonvolatile storage medium and an internal memory.
The non-volatile storage medium may store an operating system and a computer program. The computer program includes program instructions that, when executed, cause a processor to perform any one of the report generating methods.
The processor is used for providing calculation and control capability and supporting the operation of the whole computer equipment.
The internal memory provides an environment for running a computer program in the non-volatile storage medium, which, when executed by the processor, causes the processor to perform any one of the report generating methods.
The network interface is used for network communication, such as sending assigned tasks and the like. Those skilled in the art will appreciate that the architecture shown in fig. 6 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
It should be understood that the Processor may be a Central Processing Unit (CPU), and the Processor may be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, etc. Wherein a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
Wherein, in one embodiment, the processor is configured to execute a computer program stored in the memory to implement the steps of:
when a report generation request is received, determining a plurality of source databases related to the report generation request according to pre-configured data source information; respectively creating multiple types of component tasks aiming at the multiple source databases; multithreading is executed in parallel at regular time to obtain the required data of the report generation request; and generating a target report according to the demand data.
In some embodiments, the source databases include a source database to be synchronized and a source database to be processed, and the creating, by the processor, multiple types of component tasks for the source databases includes:
and creating a component task of synchronous data aiming at the source database to be synchronized, and creating a component task of processing data aiming at the source database to be processed.
In some embodiments, the processor implements the component task of creating synchronized data for the source database to be synchronized, including:
loading a data synchronization component;
and configuring the information of the source database to be synchronized, the information of the target database and the synchronization task scheduling parameter in the page of the data synchronization component.
In some embodiments, the processor implements the component task of creating synchronized data for the source database to be synchronized, including:
loading a data synchronization component;
and configuring the information of the source database to be synchronized, the information of the target database, the synchronous task scheduling parameter and the paging synchronous data condition in the page of the data synchronization component.
In some embodiments, the processor implements the component tasks of creating the machining data for the source database to be machined, including:
loading a data processing component;
and configuring processing task scheduling parameters and data processing codes in a page of the data processing assembly.
In some embodiments, the executing, by the processor, the multiple types of component tasks in parallel at the multi-thread timing to obtain the demand data of the report generation request includes:
performing the various types of component tasks in parallel in a multithreading and timing mode through a quartz task scheduling tool so as to perform synchronous processing on the data in the source database to be synchronized and perform analytic processing on the data in the source database to be processed;
and collecting the data after synchronous processing and the data after analytic processing as demand data to a target database.
In some embodiments, the generating a target report according to the demand data by the processor includes:
extracting a report type carried by the report generation request, and acquiring a target report template corresponding to the report type;
and filling the required data into the target report template to obtain a target report.
The embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, where the computer program includes program instructions, and a method implemented when the program instructions are executed can refer to various embodiments of the report generation method of the present application.
The computer-readable storage medium may be an internal storage unit of the computer device described in the foregoing embodiment, for example, a hard disk or a memory of the computer device. The computer readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the computer device.
Further, the computer-readable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to the use of the blockchain node, and the like.
The block chain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments. While the invention has been described with reference to specific embodiments, the scope of the invention is not limited thereto, and those skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A report generation method is characterized by comprising the following steps:
when a report generation request is received, determining a plurality of source databases related to the report generation request according to pre-configured data source information;
respectively creating multiple types of component tasks aiming at the multiple source databases;
multithreading is executed in parallel at regular time to obtain the required data of the report generation request;
and generating a target report according to the demand data.
2. A report generation method according to claim 1, wherein the plurality of source databases include a source database to be synchronized and a source database to be processed;
the creating of the multiple types of component tasks for the multiple source databases respectively includes:
and creating a component task of synchronous data aiming at the source database to be synchronized, and creating a component task of processing data aiming at the source database to be processed.
3. A report generation method according to claim 2, wherein the component task of creating synchronized data for the source database to be synchronized comprises:
loading a data synchronization component;
and configuring the information of the source database to be synchronized, the information of the target database and the synchronization task scheduling parameter in the page of the data synchronization component.
4. A report generation method according to claim 2, wherein the component task of creating synchronized data for the source database to be synchronized comprises:
loading a data synchronization component;
and configuring the information of the source database to be synchronized, the information of the target database, the synchronous task scheduling parameter and the paging synchronous data condition in the page of the data synchronization component.
5. A report generation method according to claim 2, wherein the component task of creating the machining data for the source database to be machined includes:
loading a data processing component;
and configuring processing task scheduling parameters and data processing codes in a page of the data processing assembly.
6. The report generation method according to claim 1, wherein the multithreading periodically and concurrently executes the plurality of types of component tasks to obtain the required data of the report generation request, comprises:
performing the various types of component tasks in parallel in a multithreading and timing mode through a quartz task scheduling tool so as to perform synchronous processing on the data in the source database to be synchronized and perform analytic processing on the data in the source database to be processed;
and collecting the data after synchronous processing and the data after analytic processing as demand data to a target database.
7. The report generation method according to claim 1, wherein generating a target report according to the demand data comprises:
extracting a report type carried by the report generation request, and acquiring a target report template corresponding to the report type;
and filling the required data into the target report template to obtain a target report.
8. A report generation apparatus, characterized by comprising:
the system comprises a determining module, a generating module and a sending module, wherein the determining module is used for determining a plurality of source databases related to a report generation request according to pre-configured data source information when the report generation request is received;
the creating module is used for creating a plurality of types of component tasks aiming at the plurality of source databases respectively;
the execution module is used for executing the multiple types of component tasks in parallel at fixed time in a multithread manner to obtain the required data of the report generation request;
and the generating module is used for generating a target report according to the demand data.
9. A computer arrangement, characterized in that the computer arrangement comprises a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, carries out the steps of the report generating method according to any of the claims 1 to 7.
10. A computer-readable storage medium, having stored thereon a computer program, wherein the computer program, when executed by a processor, performs the steps of the report generation method according to any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010615369.9A CN111797604A (en) | 2020-06-30 | 2020-06-30 | Report generation method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010615369.9A CN111797604A (en) | 2020-06-30 | 2020-06-30 | Report generation method, device, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111797604A true CN111797604A (en) | 2020-10-20 |
Family
ID=72810881
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010615369.9A Pending CN111797604A (en) | 2020-06-30 | 2020-06-30 | Report generation method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111797604A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112330434A (en) * | 2020-11-24 | 2021-02-05 | 东信和平科技股份有限公司 | Financial statement generation method, device, system and storage medium |
| CN112347192A (en) * | 2020-11-16 | 2021-02-09 | 百度在线网络技术（北京）有限公司 | Data synchronization method, device, platform and readable medium |
| CN112528613A (en) * | 2020-12-21 | 2021-03-19 | 金蝶软件（中国）有限公司 | Data table generation method and related equipment thereof |
| CN113139835A (en) * | 2021-04-29 | 2021-07-20 | 北京深演智能科技股份有限公司 | Data processing method, data processing device, nonvolatile storage medium and processor |
| CN113591448A (en) * | 2021-08-03 | 2021-11-02 | 京东科技控股股份有限公司 | Report generation method and device and storage medium |
| CN113626194A (en) * | 2021-08-10 | 2021-11-09 | 上海微盟企业发展有限公司 | Report file generation method, device, equipment and readable storage medium |
-
2020
- 2020-06-30 CN CN202010615369.9A patent/CN111797604A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112347192A (en) * | 2020-11-16 | 2021-02-09 | 百度在线网络技术（北京）有限公司 | Data synchronization method, device, platform and readable medium |
| CN112330434A (en) * | 2020-11-24 | 2021-02-05 | 东信和平科技股份有限公司 | Financial statement generation method, device, system and storage medium |
| CN112528613A (en) * | 2020-12-21 | 2021-03-19 | 金蝶软件（中国）有限公司 | Data table generation method and related equipment thereof |
| CN113139835A (en) * | 2021-04-29 | 2021-07-20 | 北京深演智能科技股份有限公司 | Data processing method, data processing device, nonvolatile storage medium and processor |
| CN113591448A (en) * | 2021-08-03 | 2021-11-02 | 京东科技控股股份有限公司 | Report generation method and device and storage medium |
| CN113626194A (en) * | 2021-08-10 | 2021-11-09 | 上海微盟企业发展有限公司 | Report file generation method, device, equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111797604A (en) | Report generation method, device, equipment and computer readable storage medium | |
| WO2022088804A1 (en) | Message pushing method and apparatus, and electronic device, and storage medium | |
| CN112270550B (en) | New energy power tracing method and system based on blockchain | |
| JP2019523462A (en) | Multitask scheduling method, system, application server, and computer-readable storage medium | |
| JP2010524060A (en) | Data merging in distributed computing | |
| CN111984390A (en) | Task scheduling method, device, equipment and storage medium | |
| CN109753596B (en) | Information source management and configuration method and system for large-scale network data acquisition | |
| CN114722119A (en) | Data synchronization method and system | |
| CN113553313A (en) | Data migration method and system, storage medium and electronic device | |
| CN111381940B (en) | Distributed data processing method and device | |
| Evermann et al. | Big data meets process mining: Implementing the alpha algorithm with map-reduce | |
| EP1217515A1 (en) | Workflow system | |
| CN101751429A (en) | Method and device for synchronizing foreground database and background database | |
| CN110766375A (en) | Work platform task construction system and construction method | |
| CN107844566B (en) | Dump control method and system | |
| CN113886590A (en) | Data summarizing method and device, computer equipment and storage medium | |
| CN109471709B (en) | Scheduling method for flow task processing big data based on Apache Oozie framework | |
| CN105760215A (en) | Map-reduce model based job running method for distributed file system | |
| CN115048456A (en) | User label generation method and device, computer equipment and readable storage medium | |
| CN112667393B (en) | Method and device for building distributed task computing scheduling framework and computer equipment | |
| CN114610803A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN116414801A (en) | Data migration method, device, computer equipment and storage medium | |
| CN114691782A (en) | Database table increment synchronization method and device and storage medium | |
| CN104679740A (en) | Data processing system | |
| CN113010276A (en) | Task scheduling method and device, terminal equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |