CN111352947B - Data updating method, device, equipment and storage medium - Google Patents
Data updating method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN111352947B CN111352947B CN202010134977.8A CN202010134977A CN111352947B CN 111352947 B CN111352947 B CN 111352947B CN 202010134977 A CN202010134977 A CN 202010134977A CN 111352947 B CN111352947 B CN 111352947B
- Authority
- CN
- China
- Prior art keywords
- report
- data
- acquired
- dependency
- acquiring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 238000010586 diagram Methods 0.000 claims abstract description 13
- 238000012545 processing Methods 0.000 claims description 9
- 230000001960 triggered effect Effects 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 7
- 238000010276 construction Methods 0.000 claims description 5
- 238000013075 data extraction Methods 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 8
- 230000001419 dependent effect Effects 0.000 description 14
- 238000004891 communication Methods 0.000 description 6
- 238000004140 cleaning Methods 0.000 description 5
- 238000012546 transfer Methods 0.000 description 5
- 239000000284 extract Substances 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- GNFTZDOKVXKIBK-UHFFFAOYSA-N 3-(2-methoxyethoxy)benzohydrazide Chemical compound COCCOC1=CC=CC(C(=O)NN)=C1 GNFTZDOKVXKIBK-UHFFFAOYSA-N 0.000 description 1
- 235000010627 Phaseolus vulgaris Nutrition 0.000 description 1
- 244000046052 Phaseolus vulgaris Species 0.000 description 1
- YTAHJIFKAKIKAV-XNMGPUDCSA-N [(1R)-3-morpholin-4-yl-1-phenylpropyl] N-[(3S)-2-oxo-5-phenyl-1,3-dihydro-1,4-benzodiazepin-3-yl]carbamate Chemical compound O=C1[C@H](N=C(C2=C(N1)C=CC=C2)C1=CC=CC=C1)NC(O[C@H](CCN1CCOCC1)C1=CC=CC=C1)=O YTAHJIFKAKIKAV-XNMGPUDCSA-N 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000026676 system process Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2393—Updating materialised views
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2379—Updates performed during online database operations; commit processing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data updating method, a device, equipment and a storage medium, which relate to the field of financial science and technology, and the method comprises the following steps: acquiring data source description information of a report to be acquired in a report system; acquiring the dependency information of the report to be acquired according to the data source description information, and constructing a data dependency relationship diagram of the report to be acquired according to the dependency information; and acquiring report data corresponding to the data dependency graph in the report system, and generating the report to be acquired according to the report data. According to the invention, in the updating process of the report data, the report system automatically acquires the updated report data in the report system according to the dependency information of the report data, and automatically generates the required report according to the updated report data, so that the report data can be automatically acquired and updated in the report system, and the report system does not need to be waited for periodical updating, thereby improving the updating efficiency and timeliness of the report data.
Description
Technical Field
The present invention relates to the field of data processing technologies in financial technologies (Fintech), and in particular, to a method, an apparatus, a device, and a storage medium for updating data.
Background
With the development of computer technology, more and more technologies are applied in the financial field, and the traditional financial industry is gradually changed to the financial technology (Fintech), and the data processing technology is not exceptional, but due to the requirements of safety and real-time performance of the financial industry, the requirements of the technology are also higher.
The current report data updating method adopts a periodic scheduling mechanism and periodically updates the report data. In the process of updating the report data, the method for periodically updating the report data causes accumulation of a large amount of report data in the report system, and increases the load of the report system. In addition, the method for updating the report data periodically updates a large amount of report data in the report system at one time periodically, so that the update efficiency of the report data in the report system is low, and the report data is not updated timely. Therefore, the current report data updating method has low updating efficiency and poor timeliness.
Disclosure of Invention
The invention mainly aims to provide a data updating method, device, equipment and storage medium, and aims to solve the technical problems of low updating efficiency and poor timeliness of periodically updating report data in the existing report data updating process.
In order to achieve the above object, the present invention provides a data updating method, including the steps of:
acquiring data source description information of a report to be acquired in a report system;
acquiring the dependency information of the report to be acquired according to the data source description information, and constructing a data dependency relationship diagram of the report to be acquired according to the dependency information;
And acquiring report data corresponding to the data dependency graph in the report system, and generating the report to be acquired according to the report data.
Preferably, the step of obtaining report data corresponding to the data dependency graph in the report system and generating the report to be obtained according to the report data further includes:
detecting whether a first warehousing instruction of report data corresponding to the data dependency graph is detected;
and if the first warehousing instruction is detected, triggering a warehousing event, and storing report data corresponding to the data dependency graph into a report system according to the warehousing event.
Preferably, the step of obtaining the dependency information of the report to be obtained according to the data source description information and constructing the data dependency graph of the report to be obtained according to the dependency information includes:
Acquiring a text format of the data source description information, and detecting whether the text format is a preset database text format;
If the text format is detected to be the database text format, acquiring the dependency information through a database text analyzer in the report system;
analyzing a report library in a report system according to the dependency information, and determining a target report with a dependency relationship with the report to be acquired in the report library;
and constructing a data dependency relationship graph of the report to be acquired according to the dependency relationship between the target report and the report to be acquired.
Preferably, after detecting the acquisition instruction for acquiring the report in the report system, before the step of acquiring the data source description information of the report to be acquired in the report system, the method further includes:
Detecting whether a second warehousing instruction triggered by a business system corresponding to the report system is received or not;
and if the second warehousing instruction is received, storing the report data to be warehoused corresponding to the second warehousing instruction into the report system.
Preferably, if the second warehousing instruction is received, the step of storing the report data to be warehoused corresponding to the second warehousing instruction in the reporting system includes:
If the second warehousing instruction is received, acquiring to-be-warehoused report data corresponding to the second warehousing instruction;
And carrying out data extraction operation and processing operation on the report data to be put into storage to obtain processed report data to be put into storage, and storing the processed report data to be put into storage into the report system.
Preferably, after detecting the acquiring instruction for acquiring the report in the reporting system, the step of acquiring the data source description information of the report to be acquired in the reporting system further includes:
detecting whether the data source description information is updated;
If the data source description information is updated, acquiring the data source description information of the report to be acquired after updating;
the step of obtaining the dependency information of the report to be obtained according to the data source description information comprises the following steps:
and acquiring the dependency information of the report to be acquired according to the updated data source description information.
Preferably, the step of obtaining the data source description information of the report to be obtained in the report system includes:
Acquiring a description file of the report to be acquired corresponding to the acquisition instruction, and acquiring a keyword of the description file by analyzing the description file;
And determining the data source description information of the report to be acquired according to the keywords.
Preferably, the step of obtaining report data corresponding to the data dependency graph in the report system and generating the report to be obtained according to the report data further includes:
and sending the report to be acquired to a terminal corresponding to the report code of the report to be acquired, so that a terminal user can check the report to be acquired.
In addition, in order to achieve the above object, the present invention also provides a data updating apparatus, including:
The acquisition module is used for acquiring data source description information of a report to be acquired in the report system and acquiring dependency information of the report to be acquired according to the data source description information;
The construction module is used for constructing a data dependency relationship diagram of the report to be acquired according to the dependency information;
the acquisition module is also used for acquiring report data corresponding to the data dependency graph in the report system;
And the generating module is used for generating the report to be acquired according to the report data.
In addition, in order to achieve the above object, the present invention also provides a data updating apparatus including a memory, a processor, and an updating program stored on the memory and running data on the processor, the updating program of data implementing the steps of the data updating method as described above when executed by the processor.
In addition, in order to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon an update program of data, which when executed by a processor, implements the steps of the data update method as described above.
According to the method, the data source description information of the report to be acquired in the report system is acquired, the dependency information of the report to be acquired is determined through the data source description information, the data dependency relationship graph of the report to be acquired is constructed through the dependency information, and finally the report data corresponding to the data dependency relationship graph is acquired in the report system, so that the report to be acquired is generated. The report system automatically acquires the dependency information of the report data, and then automatically acquires the report data in the report system through the dependency information, and the report data acquired in the report system is automatically generated into a required report, so that the report data can be automatically acquired and automatically updated in the report system, and the report system does not need to be waited for periodical update, thereby improving the update efficiency and timeliness of the report data.
Drawings
FIG. 1 is a flowchart of a first embodiment of a method for updating data according to the present invention;
FIG. 2 is a schematic diagram of a hardware environment of a data update method of the present invention;
FIG. 3 is a schematic diagram of a data dependency graph of a report to be obtained in an embodiment of the present invention;
FIG. 4 is a schematic diagram of a preferred structure of the data updating device according to the present invention;
FIG. 5 is a schematic diagram of a hardware operating environment according to an embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1, fig. 1 is a flow chart of a first embodiment of a data updating method according to the present invention.
The embodiments of the present invention provide embodiments of a method of updating data, it being noted that although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in a different order than that illustrated herein.
The data updating method of the present invention can be applied to a hardware environment composed of the server 102 and the terminal 104 as shown in fig. 2. As shown in fig. 2, the terminal 104 is connected to the server 102 via a connection terminal for data communication. The server 102 is connected to the terminal 104 through a connection including, but not limited to: the terminal 104 is not limited to a PC, tablet computer, laptop, mobile phone, etc., and the server 102 is a reporting system.
The data updating method comprises the following steps:
and step S10, acquiring data source description information of a report to be acquired in the report system.
Before acquiring the data source description information of the report to be acquired in the report system, the report system detects whether an acquisition instruction for acquiring the report is received or not, and after detecting the acquisition instruction, the report system acquires the data source description information of the report to be acquired according to the acquisition instruction. The report system is a business report system running in the server, the report system comprises a report database, a program library and the like, wherein a large number of reports are stored in the report database, a large number of report data are stored in the report database, a plurality of programs are stored in the program library, the report system operates the report system by running the programs, the acquisition instruction is an instruction which is generated when the report system detects that the report is acquired and feeds back a report task to the report system, the acquisition instruction can be triggered by a user or can be automatically triggered by the report system, the acquisition instruction comprises report codes of the report to be acquired in the report database, and each report has unique report codes in the report system. At this time, the report to be acquired is a chart template without any data information in the report library of the report system, the report data in the report library is not contained, the data source description information refers to keywords in the report description file to be acquired, wherein the report description file to be acquired is a design file of the report to be acquired, and is a definition of the report to be acquired, for example, the description file of the report to be acquired defines that the chart type in the report to be acquired is a line chart, the chart title font is Song body font number five, and the report database B is relied on in the report system, so that the data source description information of the report to be acquired is the line chart, the title Song body font number five and the report database B are obtained.
Specifically, after the report system detects an acquisition instruction for acquiring a report, the report system acquires the data source description information in the report to be acquired corresponding to the report code according to the report code in the acquisition instruction.
Further, the step S10 includes:
Step a, acquiring a description file of a report to be acquired corresponding to the acquisition instruction, and acquiring keywords of the description file by analyzing the description file;
And b, determining the data source description information of the report to be acquired according to the keywords.
Specifically, after the report system acquires an acquisition instruction of a report to be acquired, the report system acquires a description file of the report to be acquired, analyzes the description file to obtain keywords in the description file, analyzes and sorts the keywords obtained in the description file, classifies the keywords according to content, properties and characteristics of the keywords, and assembles the keywords according to the classification of the keywords, so that data source description information of the report to be acquired is obtained. For example, in this embodiment, if the description file of the report to be acquired defines that the chart histogram type of the report to be acquired is the histogram type of the report 1 in the dependent report library a, the chart font is the font of the report 2 in the dependent report library B, the chart flow chart type is the flow chart type of the report 3 in the dependent report library a, the report system analyzes the description file of the report to be acquired to obtain keywords, analyzes and sorts the keywords to obtain the histogram type of the report 1 in the dependent report library a and the flow chart type of the report 3, and depends on the font of the report 2 in the report library B, the data source description information of the report to be acquired is the chart histogram type: report 1 in report library A, chart font: report table 2 in report library B, chart flow chart type: report 2 in report library B.
And step 20, acquiring the dependency information of the report to be acquired according to the data source description information, and constructing a data dependency relationship diagram of the report to be acquired according to the dependency information.
After the report system acquires the data source description information of the report to be acquired, the report system acquires the dependency information of the report to be acquired according to the data source description information, after the acquired dependency information, the report system analyzes the report library according to the dependency information to determine the relation between the dependency information and the dependent report in the report library, so that the relation between the report to be acquired and the dependent report in the report library is determined, and a data dependency graph of the report to be acquired is constructed according to the relation between the report to be acquired and the dependent report in the report library. The dependency information is obtained by extracting a report library corresponding to the data source description information by the report system, for example, the data source description information is chart fonts: and (3) a report 2 in the report library B, wherein after the report system extracts the report, the dependency information is the report library B, and the report 2. The data dependency relationship graph is a relationship graph between the report to be acquired and the dependent report in the report library.
Further, the S20 includes:
step c, acquiring a text format of the data source description information, and detecting whether the text format is a preset database text format;
Step d, if the text format is detected to be the database text format, acquiring the dependency information through a database text analyzer in the report system;
step e, analyzing a report library in a report system according to the dependency information, and determining a target report with a dependency relationship with the report to be acquired in the report library;
And f, constructing a data dependency relationship graph of the report to be acquired according to the dependency relationship between the target report and the report to be acquired.
Specifically, after the report system obtains the data source description information of the report to be obtained, the report system obtains the text format of the data source description information, and in this embodiment, the report system has a plurality of preset text formats, such as a database text format, a basic type text format, etc., where the preset text format of the data source description information is the database text format, the database text format is an SQL (Structured Query Language ) text format, the SQL text format is a file format defined by the database system for storing data, including CSV (command-SEPARATED VALUES, character separation value), DBF (Digital Beam Forming, digital beam synthesis), MDB (MESSAGE DRIVEN Bean, message driver), etc., and if the report system detects that the text format is the database text format, the report system analyzes the database text through an operating database text analyzer to obtain the dependency information of the data source description information. The database text parser (Structured Query Language Analyzer) is a graphical parsing tool for parsing the database text, then sending it to the server, and finally outputting the parsing result in a plain text manner. If the report system detects that the text format is other text formats except the text format of the database, the report system directly analyzes and acquires the dependency information of the description information of the data source. After the dependency information is obtained, the report system analyzes the report library according to the dependency information, and determines a target report corresponding to the dependency information in the report library, so that the dependency relationship between the report to be obtained and the target report is determined, and a data dependency relationship graph of the report to be obtained is constructed. The data dependency relationship graph is formed by analyzing the dependency information through an automatic mode by a report system, and constructing the dependency relationship between a report to be acquired and a target report corresponding to the dependency information, rather than maintaining the dependency relationship through a manual entry method. For example, in this embodiment, if the description information of the data source is the report a, the report B, the report C and the report D in the report library 1 of the to-be-acquired report 1 and the report library 2 of the report system, the description information of the data of the to-be-acquired report is acquired and parsed to obtain the dependency information, the data dependency graph of the to-be-acquired report may be represented as fig. 3, where X in the report X represents the number of reports in the report library of the report system.
And step S30, acquiring report data corresponding to the data dependency graph in the report system, and generating the report to be acquired according to the report data.
After the report system builds the data dependency graph of the report to be acquired, the report system acquires report data corresponding to the data dependency graph and generates the report to be acquired according to the acquired report data. It should be noted that, the report to be acquired generated at this time already contains report data, and is no longer a chart template without any data information.
Further, the data updating method further comprises the following steps:
Step g, detecting whether a first warehousing instruction of report data corresponding to the data dependency graph is detected;
And h, triggering a warehousing event if the first warehousing instruction is detected, and storing report data corresponding to the data dependency graph into a reporting system according to the warehousing event.
Specifically, before the report data corresponding to the data dependency graph is acquired in the report system, the report system detects whether a first warehousing instruction of the report data corresponding to the data dependency graph is detected according to the data dependency graph, if the report system detects the first warehousing instruction through a report data source event, the report system triggers a warehousing event, the report data corresponding to the data dependency graph is stored in the report system, the report data corresponding to the data dependency graph is updated, and the updated report data is imported into a report to be acquired to generate the report to be acquired. If the report system does not detect the first warehousing instruction, the report system continues to detect whether the first warehousing instruction is detected. The report data source event is an event driven model, and can actively detect a first warehousing instruction of report data corresponding to the data dependency graph, and immediately make a report data updating response once the first warehousing instruction is detected, wherein the first warehousing instruction refers to whether the report data corresponding to the data dependency graph is warehoused. In this embodiment, the checking time interval is in the millisecond level, and may be set according to needs, for example, the checking time interval is 500ms (milliseconds), and whether the first warehouse-in instruction of the report data corresponding to the data dependency graph is detected according to the data dependency graph.
According to the embodiment, the data source description information of the report to be acquired in the report system is acquired, the dependency information of the report to be acquired is acquired through the data source description information, the data dependency relationship graph of the report to be acquired is constructed according to the dependency information, finally, report data corresponding to the data dependency relationship graph is acquired in the report system, and the report to be acquired is generated according to the report data. The report system automatically acquires the dependency information of the report data, and then automatically acquires the report data in the report system through the dependency information, and the report data acquired in the report system is automatically generated into a required report, so that the report data can be automatically acquired and automatically updated in the report system, and the report system does not need to be waited for periodical update, thereby improving the update efficiency and timeliness of the report data.
Further, a second embodiment of the data updating method of the present invention is provided.
The second embodiment of the data updating method is different from the first embodiment of the data updating method in that the data updating method further includes:
Step i, detecting whether the data source description information is updated;
step j, if the data source description information is updated, acquiring the data source description information of the report to be acquired after updating;
the step of obtaining the dependency information of the report to be obtained according to the data source description information comprises the following steps:
And step k, acquiring the dependency information of the report to be acquired according to the updated data source description information.
Specifically, after the description file of the report to be acquired is acquired, the report system needs to analyze the description file, detects whether the data source description information in the description file acquired after the preset time length of the interval is identical to the original data source description information, if the two information are different, the data source description information of the report description file to be acquired is updated, and if the two information are identical, the data source description information of the report description file to be acquired is not updated. In the process that the report system acquires the dependent information through the report data source description information to be acquired, detecting whether the data source description information is updated or not at preset intervals, triggering an acquisition instruction if the report system detects that the data source description information is updated, acquiring the updated data source description information according to the acquisition instruction, automatically analyzing the updated data source description information to acquire the dependent information, and acquiring the dependent information through the original data source description information if the data source description information is not updated. In this embodiment, the preset interval duration is in the millisecond level, and may be set as required, for example, the data source description information is detected at intervals of 2ms (milliseconds).
According to the report system, after the update of the data source description information is detected, the updated data source description information is obtained, the updated data source description information is analyzed to obtain the dependent information, so that the periodic update acquisition of the report system is not required to be waited, the dependent information of the updated data source description information is automatically acquired when the data source description information is updated, the automatic acquisition of the dependent information of the updated data source description information is realized, and the update efficiency and timeliness of report data are further improved.
Further, the data updating method further comprises the following steps:
And step l, the report to be acquired is sent to the terminal corresponding to the acquisition instruction, so that a terminal user can check the report to be acquired.
After the report system generates the report to be acquired, the report system sends the report to be acquired to a terminal corresponding to the report code of the report to be acquired. After the terminal receives the report to be acquired, the terminal outputs the acquired report to be acquired for the terminal user to check, and the terminal user can check the content of the report to be acquired according to the self-demand mode. For example, if the terminal user selects to view the content in the report to be acquired in a chart mode, the report system will send the report to be acquired to the terminal in a chart mode, and if the terminal user selects to view the content in the report to be acquired in a report data display mode, the report system will send the report to be acquired to the terminal in a report data display mode.
After the report system of the embodiment acquires the report to be acquired, the report to be acquired is sent to the terminal, so that the terminal user can check the content of the report to be acquired, the terminal user can acquire updated report data in time, and the terminal user can check the content of the report to be acquired according to a self-demand mode, so that the diversity of checking the report data is realized.
Further, a third embodiment of the data updating method of the present invention is provided.
The third embodiment of the data updating method is different from the first and/or second embodiments of the data updating method in that the data updating method further includes:
And step n, detecting whether a second warehousing instruction triggered by a business system corresponding to the reporting system is received.
And m, if the second warehousing instruction is received, storing the report data to be warehoused corresponding to the second warehousing instruction into the reporting system.
The report system detects whether a second warehousing instruction triggered by the corresponding service system is received, wherein the second warehousing instruction can be triggered by the corresponding user of the service system or can be triggered automatically by the service system. And if the report system receives the second warehousing instruction, the report system acquires report data to be warehoused corresponding to the second warehousing instruction, and stores the report data to be warehoused in the report system. Further, if the report system does not receive the second warehousing instruction, the report system continues to detect whether the report system receives the second warehousing instruction.
Further, the step m includes:
Step o, if the second warehousing instruction is received, acquiring report data to be warehoused corresponding to the second warehousing instruction;
And step p, carrying out data extraction operation and cleaning operation on the report data to be put into storage to obtain processed report data to be put into storage, and storing the processed report data to be put into storage into the report system.
Specifically, if the report system receives the second warehousing instruction, the report system acquires report data to be warehoused corresponding to the second warehousing instruction. After the report data to be put into storage is obtained, the report system firstly performs extraction operation and cleaning operation on the report data to be put into storage to obtain processed report data to be put into storage, then performs data summarization on the processed report data to be put into storage to obtain report summary data, and finally stores the report summary data into the report system. The method comprises the steps of extracting operation and cleaning operation, wherein the extracting operation is a means of data processing operation, the extracting operation is that a report system extracts report data required by generating a report to be acquired from a report data source to be put in storage, the cleaning operation is that unnecessary data is removed from the data source, and the data processed by the processing operation is summarized. For example, the payment data of a user in a period of time has 100 pieces, including 20 pieces of transfer data, 30 pieces of code scanning payment data, 10 pieces of red packet data and 40 pieces of other data, after the report system requires to obtain the transfer data of the user to other users, the 20 pieces of transfer data of the user can be obtained after the cleaning operation of the report system, and then the 15 pieces of transfer data of the user to other users can be obtained after the extraction operation of the report system, after the data of processing operation is obtained, the data is summarized in the report system, so that the average transfer amount of the user to other users in a period of time can be obtained.
In the embodiment, whether the second warehousing instruction is received in the report system is detected, the corresponding report data to be warehoused is obtained according to the second warehousing instruction, the report system processes the report data to be warehoused, the report data required by the report system is obtained, and all the report data are not required to be summarized into the report system, so that the load of the report system is reduced, and the updating efficiency of the report data is improved.
In addition, the present invention also provides a data updating device, referring to fig. 4, the data updating device includes:
the acquisition module 10 is used for acquiring data source description information of a report to be acquired in the report system, and acquiring dependency information of the report to be acquired according to the data source description information;
The construction module 20 is configured to construct a data dependency graph of the report to be obtained according to the dependency information;
The obtaining module 10 is further configured to obtain report data corresponding to the data dependency graph in the report system;
and the generating module 30 is used for generating the report to be acquired according to the report data.
Further, the data updating device further includes:
The first detection module is used for detecting a second warehousing instruction of report data corresponding to the data dependency graph or not;
And the first storage module is used for triggering a warehousing event if the second warehousing instruction is detected, and storing report data corresponding to the data dependency graph into a reporting system according to the warehousing event.
Further, the acquisition module 10 includes:
the acquisition unit is used for acquiring the text format of the data source description information;
The detection unit is used for detecting whether the text format is a preset database text format or not, and if the text format is detected to be the database text format, the dependency information is acquired through a database text analyzer in the report system;
The determining unit is used for analyzing a report library in the report system according to the dependency information and determining a target report with a dependency relationship with the report to be acquired in the report library
And the construction unit is used for constructing a data dependency relationship graph of the report to be acquired according to the dependency relationship between the target report and the report to be acquired.
Further, the data updating device further includes:
the second detection module is used for detecting whether a first warehousing instruction triggered by a business system corresponding to the report system is received or not;
and the second storage module is used for storing the report data to be warehoused corresponding to the first warehousing instruction into the reporting system if the first warehousing instruction is received.
Further, the obtaining module 10 is further configured to obtain to-be-warehoused report data corresponding to the first warehousing instruction if the first warehousing instruction is received;
the data updating device further comprises:
And the third storage module is used for carrying out data extraction operation and processing operation on the report data to be stored to obtain processed report data to be stored, and storing the processed report data to be stored into the report system.
Further, the data updating device further includes:
A third detection module for detecting whether the data source description information is updated;
The obtaining module 10 is further configured to obtain the updated data source description information of the report to be obtained if the data source description information is updated.
The obtaining module 10 is further configured to obtain the dependency information of the report to be obtained according to the updated data source description information.
Further, the acquisition module 10 includes:
the acquisition unit is used for acquiring the description file of the report to be acquired corresponding to the acquisition instruction, and acquiring the keyword of the description file by analyzing the description file;
and the determining unit is used for determining the data source description information of the report to be acquired according to the keywords.
Further, the data updating device further includes:
And the sending module is used for sending the report to be acquired to the terminal corresponding to the acquisition instruction so as to enable a terminal user to check the report to be acquired.
The specific implementation manner of the data updating device of the present invention is basically the same as that of each embodiment of the data updating method, and will not be described herein.
In addition, the invention also provides a data updating device. As shown in fig. 5, fig. 5 is a schematic structural diagram of a hardware running environment according to an embodiment of the present invention.
It should be noted that fig. 5 is a schematic structural diagram of a hardware running environment of the data updating device.
As shown in fig. 5, the update apparatus of data may include: a processor 1001, such as a CPU (Central Processing Unit ), a memory 1005, a user interface 1003, a network interface 1004, a communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Optionally, the data updating device may further include an RF (Radio Frequency) circuit, a sensor, a WiFi module, and the like.
It will be appreciated by those skilled in the art that the data updating device structure shown in fig. 5 does not constitute a limitation of the data updating device, and may include more or fewer components than shown, or may combine certain components, or may be a different arrangement of components.
As shown in fig. 5, an operating system, a network communication module, a user interface module, and an update program of data may be included in the memory 1005 as one type of data update device. The operating system is a program for managing and controlling the updating equipment hardware and software resources of the data, and supports the updating program of the data and the running of other software or programs.
In the data updating apparatus shown in fig. 5, the user interface 1003 is mainly used for displaying a report to be acquired sent to the terminal by the reporting system and executing an operation in which the terminal user selects in which way to view the content in the report to be acquired; the network interface 1004 is mainly used for a reporting system server and is in data communication with the reporting system server; the processor 1001 may be configured to call an update program of data stored in the memory 1005 and perform the steps of the update method of data as described above.
The specific implementation manner of the data updating device of the present invention is basically the same as the embodiments of the data updating method described above, and will not be described herein again.
In addition, the embodiment of the invention also provides a computer readable storage medium, wherein the computer readable storage medium stores a data updating program, and the data updating program realizes the steps of the data updating method when being executed by a processor.
The specific implementation manner of the computer readable storage medium of the present invention is basically the same as the above embodiments of the data updating method, and will not be described herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (10)
1. A method of updating data, the method comprising the steps of:
acquiring data source description information of a report to be acquired in a report system;
acquiring the dependency information of the report to be acquired according to the data source description information, and constructing a data dependency relationship diagram of the report to be acquired according to the dependency information;
Acquiring report data corresponding to the data dependency graph in the report system, and generating the report to be acquired according to the report data;
The step of obtaining the dependency information of the report to be obtained according to the data source description information and constructing the data dependency relationship graph of the report to be obtained according to the dependency information comprises the following steps:
Acquiring a text format of the data source description information, and detecting whether the text format is a preset database text format;
If the text format is detected to be the database text format, acquiring the dependency information through a database text analyzer in the report system;
analyzing a report library in a report system according to the dependency information, and determining a target report with a dependency relationship with the report to be acquired in the report library;
and constructing a data dependency relationship graph of the report to be acquired according to the dependency relationship between the target report and the report to be acquired.
2. The method for updating data according to claim 1, wherein the step of acquiring report data corresponding to the data dependency graph in the report system and generating the report to be acquired according to the report data further comprises:
detecting whether a first warehousing instruction of report data corresponding to the data dependency graph is detected;
and if the first warehousing instruction is detected, triggering a warehousing event, and storing report data corresponding to the data dependency graph into a report system according to the warehousing event.
3. The method for updating data according to claim 1, wherein before the step of obtaining the data source description information of the report to be obtained in the reporting system, the method further comprises:
Detecting whether a second warehousing instruction triggered by a business system corresponding to the report system is received or not;
and if the second warehousing instruction is received, storing the report data to be warehoused corresponding to the second warehousing instruction into the report system.
4. The method for updating data according to claim 3, wherein the step of storing the report data to be binned corresponding to the second binning instruction into the reporting system if the second binning instruction is received comprises:
If the second warehousing instruction is received, acquiring to-be-warehoused report data corresponding to the second warehousing instruction;
And carrying out data extraction operation and processing operation on the report data to be put into storage to obtain processed report data to be put into storage, and storing the processed report data to be put into storage into the report system.
5. The method for updating data according to claim 1, wherein after the step of obtaining the data source description information of the report to be obtained in the reporting system, the method further comprises:
detecting whether the data source description information is updated;
If the data source description information is updated, acquiring the data source description information of the report to be acquired after updating;
the step of obtaining the dependency information of the report to be obtained according to the data source description information comprises the following steps:
and acquiring the dependency information of the report to be acquired according to the updated data source description information.
6. The method for updating data according to claim 1, wherein the step of obtaining the data source description information of the report to be obtained in the reporting system comprises:
Acquiring a description file of the report to be acquired corresponding to the acquisition instruction, and acquiring a keyword of the description file by analyzing the description file;
And determining the data source description information of the report to be acquired according to the keywords.
7. The method for updating data according to any one of claims 1 to 6, wherein the step of acquiring report data corresponding to the data dependency graph in the report system, and generating the report to be acquired according to the report data, further comprises:
and sending the report to be acquired to a terminal corresponding to the report code of the report to be acquired, so that a terminal user can check the report to be acquired.
8. A data updating apparatus, characterized in that the data updating apparatus comprises:
The acquisition module is used for acquiring data source description information of a report to be acquired in a report system, acquiring dependency information of the report to be acquired according to the data source description information, and specifically comprises an acquisition unit, a database text format detection unit and a database text format detection unit, wherein the acquisition unit is used for acquiring the text format of the data source description information and detecting whether the text format is a preset database text format or not; the detection unit is used for acquiring the dependency information through a database text analyzer in the report system if the text format is detected to be the database text format; the determining unit is used for analyzing a report library in a report system according to the dependency information and determining a target report with a dependency relationship with the report to be acquired in the report library; the construction unit is used for constructing a data dependency relationship diagram of the report to be acquired according to the dependency relationship between the target report and the report to be acquired;
The construction module is used for constructing a data dependency relationship diagram of the report to be acquired according to the dependency information;
the acquisition module is also used for acquiring report data corresponding to the data dependency graph in the report system;
And the generating module is used for generating the report to be acquired according to the report data.
9.A data updating apparatus, characterized in that the data updating apparatus comprises a memory, a processor and a data updating program stored on the memory and running on the processor, which data updating program, when executed by the processor, implements the steps of the data updating method according to any one of claims 1 to 7.
10. A computer-readable storage medium, wherein an update program of data is stored on the computer-readable storage medium, which when executed by a processor, implements the steps of the data update method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010134977.8A CN111352947B (en) | 2020-02-28 | 2020-02-28 | Data updating method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010134977.8A CN111352947B (en) | 2020-02-28 | 2020-02-28 | Data updating method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111352947A CN111352947A (en) | 2020-06-30 |
| CN111352947B true CN111352947B (en) | 2024-05-14 |
Family
ID=71195911
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010134977.8A Active CN111352947B (en) | 2020-02-28 | 2020-02-28 | Data updating method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111352947B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113204416A (en) * | 2021-04-07 | 2021-08-03 | 上海多维度网络科技股份有限公司 | Data report task execution method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103729385A (en) * | 2012-10-16 | 2014-04-16 | 阿里巴巴集团控股有限公司 | Method and device for automatically updating reports |
| CN107248065A (en) * | 2017-06-08 | 2017-10-13 | 中国建设银行股份有限公司 | Line reports table management method, system, device and storage medium |
| CN108984496A (en) * | 2017-06-02 | 2018-12-11 | 北京京东尚科信息技术有限公司 | The method and apparatus for generating report |
| CN109471890A (en) * | 2018-10-16 | 2019-03-15 | 深圳壹账通智能科技有限公司 | Generation method, terminal device and the medium of report file |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100250565A1 (en) * | 2009-01-23 | 2010-09-30 | Salesforce.Com, Inc. | Analytics |
-
2020
- 2020-02-28 CN CN202010134977.8A patent/CN111352947B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103729385A (en) * | 2012-10-16 | 2014-04-16 | 阿里巴巴集团控股有限公司 | Method and device for automatically updating reports |
| CN108984496A (en) * | 2017-06-02 | 2018-12-11 | 北京京东尚科信息技术有限公司 | The method and apparatus for generating report |
| CN107248065A (en) * | 2017-06-08 | 2017-10-13 | 中国建设银行股份有限公司 | Line reports table management method, system, device and storage medium |
| CN109471890A (en) * | 2018-10-16 | 2019-03-15 | 深圳壹账通智能科技有限公司 | Generation method, terminal device and the medium of report file |
Non-Patent Citations (1)
| Title |
|---|
| Web报表开发中的若干关键技术研究与应用;高红艳;中国优秀硕士学位论文全文数据库信息科技辑;20130415;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111352947A (en) | 2020-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109726103B (en) | Test report generation method, device, equipment and storage medium | |
| US20180322341A1 (en) | Method and apparatus for extracting information | |
| CN110263009B (en) | Method, device and equipment for generating log classification rule and readable storage medium | |
| EP2447856A1 (en) | Update notification method and browser | |
| CN107786416B (en) | Information processing method and device | |
| CN108197686B (en) | Method and device for analyzing article bar code and computer readable storage medium | |
| JP2012529688A (en) | Update notification method and system | |
| CN110855555B (en) | Mail sending method, device, equipment and computer readable storage medium | |
| US9092728B2 (en) | Providing rule based analysis of content to manage activation of web extension | |
| CN111338693B (en) | Model construction-based target file generation method, server and storage medium | |
| US20150106928A1 (en) | Screening of email templates in campaign management | |
| CN111352947B (en) | Data updating method, device, equipment and storage medium | |
| CN110414591B (en) | Data processing method and equipment | |
| CN112765003A (en) | Risk prediction method based on APP behavior log | |
| CN113657088A (en) | Interface document analysis method and device, electronic equipment and storage medium | |
| CN116523457A (en) | Workflow processing method, device, equipment and storage medium based on business process | |
| CN113254250B (en) | Database server abnormal cause detection method, device, equipment and storage medium | |
| CN113923181A (en) | Group message processing method, device, system and storage medium | |
| KR20060087735A (en) | System and method for proceeding improved spam message filtering | |
| CN114003818A (en) | Page recommendation method, device, server and storage medium | |
| CN109101515B (en) | Rule configuration method, server and computer-readable storage medium | |
| US9485315B2 (en) | System and method for generating a customized singular activity stream | |
| CN111008066A (en) | Server-side interface analysis system, method, interface analysis device and medium | |
| CN114186977A (en) | Intelligent mail supervising method, device, equipment and storage medium | |
| CN111930772A (en) | Data export method, device and system and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |