CN113190581A - Method and terminal for dynamically generating report form based on big data - Google Patents
Method and terminal for dynamically generating report form based on big data Download PDFInfo
- Publication number
- CN113190581A CN113190581A CN202110484889.5A CN202110484889A CN113190581A CN 113190581 A CN113190581 A CN 113190581A CN 202110484889 A CN202110484889 A CN 202110484889A CN 113190581 A CN113190581 A CN 113190581A
- Authority
- CN
- China
- Prior art keywords
- report
- data
- template
- report data
- cache host
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 16
- 238000012545 processing Methods 0.000 claims abstract description 23
- 238000012544 monitoring process Methods 0.000 claims abstract description 12
- 238000004590 computer program Methods 0.000 claims description 8
- 238000004140 cleaning Methods 0.000 claims description 5
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000006399 behavior Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/177—Editing, e.g. inserting or deleting of tables; using ruled lines
- G06F40/18—Editing, e.g. inserting or deleting of tables; using ruled lines of spreadsheets
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Artificial Intelligence (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a method and a terminal for dynamically generating a report form based on big data, wherein the method comprises the following steps: s1, acquiring a report template configured by a user, wherein the data to be received of the report template is configured by the user, monitoring the data reported by the application in real time, analyzing the reported data by a report template processing engine, reading the required report data according to the configuration of the data to be received of the report template, and sending the read report data to a report cache host; s2, storing the real-time report data sent by the report template processing engine into a machine memory; s3, storing the report data cached in the report cache host into the database at regular time, and then sending a deleting command to the cache host to delete the report data stored in the database. No matter developers or other related personnel, required report templates can be configured in the report cache host according to requirements, and when a user needs report data in the later period, the user only needs to go to the database to obtain the corresponding report data.
Description
Technical Field
The invention relates to the technical field of big data, in particular to a method and a terminal for dynamically generating a report form based on big data.
Background
With the high-speed development of big data technology, data needing to collect user behaviors is larger and larger, data of reports needing to be checked by relevant personnel is different, more research and development personnel are needed to cooperate with the relevant personnel to develop different reports, and because the collected data volume is large, in the process of developing the reports needing to collect corresponding data according to the requirements of the relevant personnel each time, corresponding data needs to be searched in a database and output to the reports, because the data volume in the database is very large, the corresponding data needs to be searched for in a long time, the speed of generating the reports is slow, the requirements of the relevant personnel for checking the relevant reports cannot be met in real time, the efficiency of generating the reports is low, and meanwhile, manpower is wasted.
Disclosure of Invention
Technical problem to be solved
In order to solve the above problems in the prior art, the invention provides a method and a terminal for dynamically generating a report based on big data, so that the generation efficiency of the report is improved.
(II) technical scheme
In order to achieve the purpose, the invention adopts a technical scheme that: a method for dynamically generating reports based on big data comprises the following steps:
s1, acquiring a report template configured by a user, wherein the data to be received of the report template is configured by the user, monitoring the data reported by the application in real time, analyzing the reported data by a report template processing engine, reading the required report data according to the configuration of the data to be received of the report template, and sending the read report data to a report cache host;
s2, storing the real-time report data sent by the report template processing engine into a machine memory;
s3, regularly storing the report data cached in the report cache host into the database, and then sending a deleting command to the cache host to delete the report data stored in the database.
The other technical scheme adopted by the invention is as follows: a terminal for dynamically generating reports based on big data comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor executes the computer program to realize the following steps:
s1, acquiring a report template configured by a user, wherein the data to be received of the report template is configured by the user, monitoring the data reported by the application in real time, analyzing the reported data by a report template processing engine, reading the required report data according to the configuration of the data to be received of the report template, and sending the read report data to a report cache host;
s2, storing the real-time report data sent by the report template processing engine into a machine memory;
s3, regularly storing the report data cached in the report cache host into the database, and then sending a deleting command to the cache host to delete the report data stored in the database.
(III) advantageous effects
The invention has the beneficial effects that: no matter developers or other related personnel, the required report template can be configured in the report cache host according to requirements, after the real-time data are received, the report template processing engine can analyze the data reported by the real-time monitoring application and store the real-time data required by the report template into the report cache host, the report data can be stored into a machine memory, data loss caused by power failure and the like is avoided, the report template processing engine can be backed up into a database at regular time, the generation efficiency and the real-time performance of the report data are improved, and the data backed up into the database in the report cache array can be deleted, so that the situation that the memory of the report cache host is continuously increased is avoided; when the user needs the report data in the later period, the user only needs to go to the database to obtain the corresponding report data, and the real-time report data can be provided, so that additional developers are not needed to adaptively configure the report template according to the requirements of other related personnel to generate the corresponding report data, and the labor is saved.
Drawings
FIG. 1 is a flow chart of a method for dynamically generating reports based on big data according to the present invention;
FIG. 2 is a schematic structural diagram of a terminal for dynamically generating reports based on big data according to the present invention;
[ description of reference ]
1. A terminal for dynamically generating a report form based on big data; 2. a memory; 3. a processor.
Detailed Description
For the purpose of better explaining the present invention and to facilitate understanding, the present invention will be described in detail by way of specific embodiments with reference to the accompanying drawings.
Referring to fig. 1, a method for dynamically generating a report based on big data includes:
s1, acquiring a report template configured by a user, wherein the data to be received of the report template is configured by the user, monitoring the data reported by the application in real time, analyzing the reported data by a report template processing engine, reading the required report data according to the configuration of the data to be received of the report template, and sending the read report data to a report cache host;
s2, storing the real-time report data sent by the report template processing engine into a machine memory;
s3, regularly storing the report data cached in the report cache host into the database, and then sending a deleting command to the cache host to delete the report data stored in the database.
From the above description, the beneficial effects of the present invention are: no matter developers or other related personnel, the required report template can be configured in the report cache host according to requirements, after the real-time data are received, the report template processing engine can analyze the data reported by the real-time monitoring application and store the real-time data required by the report template into the report cache host, the report data can be stored into a machine memory, data loss caused by power failure and the like is avoided, the report template processing engine can be backed up into a database at regular time, the generation efficiency and the real-time performance of the report data are improved, and the data backed up into the database in the report cache array can be deleted, so that the situation that the memory of the report cache host is continuously increased is avoided; when the user needs the report data in the later period, the user only needs to go to the database to obtain the corresponding report data, and the real-time report data can be provided, so that additional developers are not needed to adaptively configure the report template according to the requirements of other related personnel to generate the corresponding report data, and the labor is saved.
Further, the step S2 is followed by:
and after the report data stored in the machine memory is updated for preset times/time, storing the report data into a hard disk, and regularly cleaning the overdue report data in the machine memory.
According to the description, the report data stored in the machine memory can be stored in the hard disk regularly, the overdue report data can be cleaned, and the condition that the machine memory is continuously increased can be ensured.
Further, the S1 includes before:
configuring the report data expiration time limit of the report cache host;
said S2 then includes:
and deleting the overdue report data according to the overdue report data expiration time limit.
According to the description, the report data expiration time limit of the report cache host can be configured according to the user requirement, and the expired report data can be deleted according to the report data expiration time limit, so that the phenomenon that the service performance of the report cache host is influenced due to the fact that the report cache host stores excessive expired report data and the cache occupation is too large is avoided.
Further, the data type of the data to be received by the report template comprises numbers, bitmaps and character strings.
Referring to fig. 2, a terminal for dynamically generating a report based on big data includes a memory, a processor, and a computer program stored in the memory and running on the processor, where the processor implements the following steps when executing the computer program:
s1, acquiring a report template configured by a user, wherein the data to be received of the report template is configured by the user, monitoring the data reported by the application in real time, analyzing the reported data by a report template processing engine, reading the required report data according to the configuration of the data to be received of the report template, and sending the read report data to a report cache host;
s2, storing the real-time report data sent by the report template processing engine into a machine memory;
s3, regularly storing the report data cached in the report cache host into the database, and then sending a deleting command to the cache host to delete the report data stored in the database.
From the above description, the beneficial effects of the present invention are: no matter developers or other related personnel, the required report template can be configured in the report cache host according to requirements, after the real-time data are received, the report template processing engine can analyze the data reported by the real-time monitoring application and store the real-time data required by the report template into the report cache host, the report data can be stored into a machine memory, data loss caused by power failure and the like is avoided, the report template processing engine can be backed up into a database at regular time, the generation efficiency and the real-time performance of the report data are improved, and the data backed up into the database in the report cache array can be deleted, so that the situation that the memory of the report cache host is continuously increased is avoided; when the user needs the report data in the later period, the user only needs to go to the database to obtain the corresponding report data, and the real-time report data can be provided, so that additional developers are not needed to adaptively configure the report template according to the requirements of other related personnel to generate the corresponding report data, and the labor is saved.
Further, the step S2 is followed by:
and after the report data stored in the machine memory is updated for preset times/time, storing the report data into a hard disk, and regularly cleaning the overdue report data in the machine memory.
According to the description, the report data stored in the machine memory can be stored in the hard disk regularly, the overdue report data can be cleaned, and the condition that the machine memory is continuously increased can be ensured.
Further, the S1 includes before:
configuring the report data expiration time limit of the report cache host;
said S2 then includes:
and deleting the overdue report data according to the overdue report data expiration time limit.
According to the description, the report data expiration time limit of the report cache host can be configured according to the user requirement, and the expired report data can be deleted according to the report data expiration time limit, so that the phenomenon that the service performance of the report cache host is influenced due to the fact that the report cache host stores excessive expired report data and the cache occupation is too large is avoided.
Further, the data type of the data to be received by the report template comprises numbers, bitmaps and character strings.
Example one
Referring to fig. 1, a method for dynamically generating a report based on big data includes:
s1, acquiring a report template configured by a user, wherein the data to be received of the report template is configured by the user, monitoring the data reported by the application in real time, analyzing the reported data by a report template processing engine, reading the required report data according to the configuration of the data to be received of the report template, and sending the read report data to a report cache host;
s2, storing the real-time report data sent by the report template processing engine into a machine memory;
s3, regularly storing the report data cached in the report cache host into the database, and then sending a deleting command to the cache host to delete the report data stored in the database.
Wherein, the step S2 is followed by the step:
and after the report data stored in the machine memory is updated for preset times/time, storing the report data into a hard disk, and regularly cleaning the overdue report data in the machine memory.
Wherein the S1 previously comprises:
configuring the report data expiration time limit of the report cache host;
said S2 then includes:
and deleting the overdue report data according to the overdue report data expiration time limit.
The data types cached by the report template comprise numbers, bitmaps and character strings. An example is shown below:
and configuring data to be received through the identifier in the report template, and appointing the data type of each data to be received through a Key to generate the report data.
Example two
Referring to fig. 2, a terminal 1 for dynamically generating a report based on big data includes a memory 2, a processor 3, and a computer program stored on the memory 2 and capable of running on the processor 3, where the processor 3 implements the steps in the first embodiment when executing the computer program.
In summary, according to the method and the terminal for dynamically generating the report based on the big data provided by the present invention, no matter developers or other related personnel, the required report template can be configured in the report cache host according to requirements, after receiving the real-time data, the report template processing engine can analyze the data reported by the real-time monitoring application and store the real-time data required by the report template into the report cache host, and can store the report data into the machine memory, so as to avoid data loss caused by power failure and other situations, and can backup the report data into the database at regular time, thereby improving the generation efficiency and the real-time performance of the report data, and deleting the data backed up into the database in the report cache array, so as to avoid the situation that the memory of the report cache host is continuously increased; when the user needs the report data in the later period, the user only needs to go to the database to obtain the corresponding report data, and the real-time report data can be provided, so that additional developers are not needed to adaptively configure the report template according to the requirements of other related personnel to generate the corresponding report data, and the labor is saved.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent changes made by using the contents of the present specification and the drawings, or applied directly or indirectly to the related technical fields, are included in the scope of the present invention.
Claims (8)
1. A method for dynamically generating a report form based on big data is characterized by comprising the following steps:
s1, acquiring a report template configured by a user, wherein the data to be received of the report template is configured by the user, monitoring the data reported by the application in real time, analyzing the reported data by a report template processing engine, reading the required report data according to the configuration of the data to be received of the report template, and sending the read report data to a report cache host;
s2, storing the real-time report data sent by the report template processing engine into a machine memory;
s3, regularly storing the report data cached in the report cache host into the database, and then sending a deleting command to the cache host to delete the report data stored in the database.
2. The method for dynamically generating reports based on big data according to claim 1, wherein the step S2 is followed by further comprising:
and after the report data stored in the machine memory is updated for preset times/time, storing the report data into a hard disk, and regularly cleaning the overdue report data in the machine memory.
3. The method for dynamically generating reports based on big data according to claim 1, wherein the step of S1 is preceded by:
configuring the report data expiration time limit of the report cache host;
said S2 then includes:
and deleting the overdue report data according to the overdue report data expiration time limit.
4. The method for dynamically generating reports based on big data as claimed in claim 1, wherein the data types of the data to be received by the report template include numbers, bitmaps and character strings.
5. A terminal for dynamically generating reports based on big data comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, and is characterized in that the processor executes the computer program to realize the following steps:
s1, acquiring a report template configured by a user, wherein the data to be received of the report template is configured by the user, monitoring the data reported by the application in real time, analyzing the reported data by a report template processing engine, reading the required report data according to the configuration of the data to be received of the report template, and sending the read report data to a report cache host;
s2, storing the real-time report data sent by the report template processing engine into a machine memory;
s3, regularly storing the report data cached in the report cache host into the database, and then sending a deleting command to the cache host to delete the report data stored in the database.
6. The terminal for dynamically generating reports based on big data according to claim 5, wherein the step S2 is followed by further comprising:
and after the report data stored in the machine memory is updated for preset times/time, storing the report data into a hard disk, and regularly cleaning the overdue report data in the machine memory.
7. The big-data-based dynamic report generation terminal according to claim 5, wherein said S1 is preceded by:
configuring the report data expiration time limit of the report cache host;
said S2 then includes:
and deleting the overdue report data according to the overdue report data expiration time limit.
8. The terminal for dynamically generating reports based on big data according to claim 5, wherein the data types of the data to be received by the report template include numbers, bitmaps and character strings.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110484889.5A CN113190581A (en) | 2021-04-30 | 2021-04-30 | Method and terminal for dynamically generating report form based on big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110484889.5A CN113190581A (en) | 2021-04-30 | 2021-04-30 | Method and terminal for dynamically generating report form based on big data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113190581A true CN113190581A (en) | 2021-07-30 |
Family
ID=76983840
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110484889.5A Pending CN113190581A (en) | 2021-04-30 | 2021-04-30 | Method and terminal for dynamically generating report form based on big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113190581A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101226542A (en) * | 2008-02-01 | 2008-07-23 | 中国建设银行股份有限公司 | Method for caching report |
| CN103699557A (en) * | 2013-09-04 | 2014-04-02 | 中国四维测绘技术有限公司 | Report processing method and report processing system |
| CN104378439A (en) * | 2014-11-24 | 2015-02-25 | 上海许继电气有限公司 | System and method for achieving real-time transmission of transformer substation device information based on shared memory |
| CN104636218A (en) * | 2013-11-15 | 2015-05-20 | 腾讯科技（深圳）有限公司 | Data recovery method and device |
| EP2924588A1 (en) * | 2012-11-26 | 2015-09-30 | ZTE Corporation | Report creation method, device and system |
| CN107451109A (en) * | 2017-07-05 | 2017-12-08 | 北京京东尚科信息技术有限公司 | Report form generation method and system |
| CN109241509A (en) * | 2018-08-20 | 2019-01-18 | 郑州云海信息技术有限公司 | A kind of method and device of the report management based on cloud platform |
| CN109978529A (en) * | 2017-12-27 | 2019-07-05 | 青岛胶南海尔洗衣机有限公司 | Offline electronic payment method |
-
2021
- 2021-04-30 CN CN202110484889.5A patent/CN113190581A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101226542A (en) * | 2008-02-01 | 2008-07-23 | 中国建设银行股份有限公司 | Method for caching report |
| EP2924588A1 (en) * | 2012-11-26 | 2015-09-30 | ZTE Corporation | Report creation method, device and system |
| CN103699557A (en) * | 2013-09-04 | 2014-04-02 | 中国四维测绘技术有限公司 | Report processing method and report processing system |
| CN104636218A (en) * | 2013-11-15 | 2015-05-20 | 腾讯科技（深圳）有限公司 | Data recovery method and device |
| CN104378439A (en) * | 2014-11-24 | 2015-02-25 | 上海许继电气有限公司 | System and method for achieving real-time transmission of transformer substation device information based on shared memory |
| CN107451109A (en) * | 2017-07-05 | 2017-12-08 | 北京京东尚科信息技术有限公司 | Report form generation method and system |
| CN109978529A (en) * | 2017-12-27 | 2019-07-05 | 青岛胶南海尔洗衣机有限公司 | Offline electronic payment method |
| CN109241509A (en) * | 2018-08-20 | 2019-01-18 | 郑州云海信息技术有限公司 | A kind of method and device of the report management based on cloud platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110147411B (en) | Data synchronization method, device, computer equipment and storage medium | |
| CN101645032B (en) | Performance analysis method of application server and application server | |
| CN109710185A (en) | Data processing method and device | |
| CN111858284A (en) | Resource monitoring method and device for artificial intelligence server | |
| CN111736907B (en) | Data analysis method of self-adaptive low-delay memory computing engine | |
| CN114201505A (en) | Data query method and device and database system | |
| CN111309868A (en) | Knowledge graph construction and retrieval method and device | |
| CN103117878A (en) | Design method of Nagios-based distribution monitoring system | |
| CN111666344A (en) | Heterogeneous data synchronization method and device | |
| CN111488736A (en) | Self-learning word segmentation method and device, computer equipment and storage medium | |
| CN110737710A (en) | Distributed data automatic structured warehousing method and system | |
| CN111580932B (en) | Virtual machine disk online migration redundancy removal method | |
| CN114398520A (en) | Data retrieval method, system, device, electronic equipment and storage medium | |
| CN113918532A (en) | Portrait label aggregation method, electronic device and storage medium | |
| CN113190581A (en) | Method and terminal for dynamically generating report form based on big data | |
| CN115098486A (en) | Real-time data acquisition method based on customs service big data | |
| CN114896276A (en) | Data storage method and device, electronic equipment and distributed storage system | |
| CN111143280B (en) | Data scheduling method, system, device and storage medium | |
| CN112398750B (en) | Method for compressing and transmitting operation starting data in parallel computing | |
| CN115328878B (en) | Log data storage system, method, device and medium | |
| CN117997958B (en) | Method and system for pushing internet of things data of charging station | |
| CN116302178B (en) | Acceleration processing method and device for column storage data | |
| CN116644039B (en) | Automatic acquisition and analysis method for online capacity operation log based on big data | |
| CN117632860A (en) | Method and device for merging small files based on Flink engine and electronic equipment | |
| CN115905173A (en) | SQL statement merging method based on final transaction consistency |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210730 |