CN108614742A - Method of calibration, system and the device of report data - Google Patents
Method of calibration, system and the device of report data Download PDFInfo
- Publication number
- CN108614742A CN108614742A CN201611142361.5A CN201611142361A CN108614742A CN 108614742 A CN108614742 A CN 108614742A CN 201611142361 A CN201611142361 A CN 201611142361A CN 108614742 A CN108614742 A CN 108614742A
- Authority
- CN
- China
- Prior art keywords
- report
- data
- screening conditions
- backstage
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0766—Error or fault reporting or storing
- G06F11/0775—Content or structure details of the error report, e.g. specific table structure, specific error fields
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of method of calibration of report data, system and devices, and the method includes detecting whether newly-increased update the data of background data base corresponding with report has been provided with；Background data base it is newly-increased update the data have been provided with when, load the report；Sectional drawing processing is carried out to the report, obtains the image of the report；The image for handling the report obtains the screening conditions and result data of data from the image of the report；Backstage corresponding with report physical table is inquired according to the screening conditions, obtains Back end data corresponding with the screening conditions；With the result data and Back end data for comparing same screening conditions, the verification of report data is completed.The present invention detects report page data automatically, while reducing testing cost, improves efficiency；The accuracy detection of page data can be carried out by being once synchronized to application database in data, and timeliness is high；And avoid due to independent detection and caused by the incomplete problem of Data Detection.
Description
Technical field
The present invention relates to technical field of data processing, specifically, be related to a kind of method of calibration of report data, system and
Device.
Background technology
Reporting system is a kind of most common data product, and report provides various data for demand personnel, including
Performance appraisal, daily operation, the report etc. of instrument board and analysis mining.Currently, for by data exhibiting, in report, system needs
Complete following below scheme：
Step 1, the programs such as operation Python or Shell, calculation result data is stored in Hdfs files.
Step 2, the result data having been calculated is synchronized in application database, such as Mysql, Impala, Hbase application
Database.
Step 3, it is handled using Java back-end codes and shows logic, or use report tool, as Bo/Biee develops rear end mould
Type.
Step 4, webpage representation logical process is carried out using Java frontend, or uses report tool, as Bo/Biee is developed
Front end carries out webpage representation logical process.
When user logs in reporting system and checks data, including two steps：Step 1, reporting system is logged in, reporting system is sentenced
Whether the user of breaking has permission, and then, step 2, when user has permission, is then obtained according to the account of the user corresponding
Data, and it is presented to user.
From the above process as it can be seen that needing to see data exhibiting to reporting system, user by the processing of four processes
Data to reporting system need the processing by two links, if mistake occurs in any one link therein, that is most
The data that whole user sees are exactly mistake.How to ensure that each link does not go wrong, allow the data that user sees be it is correct,
Always all reporting system R＆D teams are the problem of thinking deeply.
In order to ensure that the data that user sees are correct, major part is monitored logical daily using data quality monitoring system
Whether the data result for crossing the calculating of python/shell programs is correct, so as to solve in the step 1 in data exhibiting flow
The data exception problem being likely to occur.It, can be automatic in existing synchronization file system in the synchronizing process from step 1 to step 2
The consistency of detection data file, it is possible to ensure the data consistency of step 1 and step.
By way of manually writing SQL, the data being likely to occur in step 3, step 4 in data exhibiting flow can be solved
Abnormal problem.User can be solved in conjunction with personal experience and SQL modes using every report on artificial click reporting system
It checks the data exception problem being likely to occur in data flow step 2, ensures data and bottom number that user sees from the page
According to consistent.
Although using the scheme for adapting to stages respectively in different phase, still there is problems with：
1) incomprehensive：Executing the mode of SQL can only judge whether page processing logic correct and rear end bottom data
It is whether correct, it not can determine that whether user opens the data that the page is seen correct.
2) high cost, inefficiencies：The mode of above-mentioned artificial click report, can only confirm whether report can normally be opened and be
It is no to there is data exhibiting to come out, and cannot judge whether the data shown are consistent with the data of rear end bottom.
3) hysteresis quality：Pure manually mode ensures the page and Back end data consistency, there is very serious hysteresis quality, very
Reporting system user first pinpoints the problems when more, and user experience is bad, whether cannot accomplishing advance notice user data accurately.
Invention content
The technical problem to be solved in the present invention is, not comprehensively, deposited using artificial report of clicking to the verification of report data
In high cost, inefficiencies and hysteresis quality, a kind of method of calibration of report data, system and device are provided.
In order to solve the above technical problems, according to an aspect of the invention, there is provided a kind of method of calibration of report data,
Wherein, including：
Whether newly-increased update the data of detection background data base corresponding with report has been provided with；
Background data base it is newly-increased update the data have been provided with when, load the report；
Sectional drawing processing is carried out to the report, obtains the image of the report；
The image for handling the report obtains the screening conditions and result data of data from the image of the report；
Backstage corresponding with report physical table is inquired according to the screening conditions, is obtained corresponding with the screening conditions
Back end data；With
The result data and Back end data for comparing same screening conditions, complete the verification of report data.
Preferably, the detection the newly-increased of background data base corresponding with report updates the data the step of whether having been provided with
Including：
According to the renewal time of the report Back end data, the update mark of the corresponding all backstage physical tables of cycle detection
Position；
When the update flag bit of backstage corresponding with report physical table is all completion status, determine and the report
Newly-increased update the data of corresponding background data base has been provided with.
Preferably, background data base it is newly-increased update the data have been provided with when, the step of loading the report includes：
Log in reporting system homepage；
Open the report link for having had viewing conditions at present；
Load the report data.
Preferably, opening the step of having had the report link of viewing conditions at present includes：
The new report link for having had viewing conditions is assembled into according to report link；
Open the new report link.
Preferably, include the step of the screening conditions and result data of acquisition data from the image of the report：
Identify screening areas, and according to the Rule screening conditions and content of setting；
It identifies data exhibiting corresponding with screening areas region, corresponding data is parsed from data exhibiting area and are made
For the result data of the screening conditions.
Preferably, when identifying data exhibiting region corresponding with the screening areas, judge that the data exhibiting area is two
Dimension table structure or patterned structures；
If it is from patterned structures, legend information and corresponding label value data as a result are obtained；
If it is bivariate table structure, Table Header information and summary information value data as a result are obtained.
Preferably, backstage corresponding with report physical table is inquired according to the screening conditions, obtained and the screening
The step of condition corresponding Back end data includes：
According to the second preset allocation list, after screening conditions name translation that when image that will handle the report obtains is
The physical field title of platform physical table；
According to the incidence relation of report and backstage physical table described in the screening conditions and the second allocation list, assembled dynamic
Query statement；
The dynamic queries sentence is executed, Back end data corresponding with the screening conditions is obtained.
In order to solve the above technical problems, according to another aspect of the present invention, providing a kind of verification system of report data
System, including：
Whether detection module, newly-increased update the data for detecting background data base corresponding with report have been provided with；
Automatic imitation clicks module, for background data base it is newly-increased update the data have been provided with when, log in report system
System, loads the report；
Page screenshot module obtains the image of the report for carrying out sectional drawing processing to the report；
Image processing module, the image for handling the report obtain the screening of data from the image of the report
Condition and result data；
Enquiry module, for inquiring backstage corresponding with report physical table, acquisition and institute according to the screening conditions
State the corresponding Back end data of screening conditions；With
Data match module, the result data for comparing same screening conditions and Back end data, complete report data
Verification.
Preferably, the detection module includes：
First allocation list, the configuration information for recording report, including：Report connection, report parameter, corresponding backstage object
Manage table, report undated parameter and backstage physical table update mark；
Updating unit updates the backstage physical table of first allocation list for the update status according to backstage physical table
Update flag bit；With
Detection unit, according to the undated parameter in the allocation list, cycle detection corresponds to backstage physical table update mark, when
It when the update marks of all backstage physical tables is completed, sends trigger signal and clicks module to the automatic imitation, and by the report
Watch chain connects passes to the automatic imitation click module with report parameter.
Preferably, the automatic imitation click module includes：
Unit, the trigger signal sent according to the detection module and report parameter are logged in, reporting system homepage is logged in；
Receiving unit transmits the report link and report parameter of coming for receiving from the detection module；
Report opening unit is assembled into the new report link for having had viewing conditions according to the report link；Open institute
State new report link；With
Data loading unit, for the data in the physical table of backstage corresponding with the report to be loaded into the report page
Face.
Preferably, described image processing module includes：
Screening area recognition unit, screening areas for identification, and according to the Rule screening conditions and content of setting；
Data exhibiting area recognition unit, for identification data exhibiting corresponding with screening areas region；With
Data resolution unit, for parsing corresponding data as the screening conditions from the data exhibiting area
Result data.
In order to solve the above technical problems, according to another aspect of the present invention, providing a kind of verification dress of report data
It sets, including processor and memory, the memory is for storing data and instruction, the processor execute described instruction, until
Following steps are completed less：
Whether newly-increased update the data of detection background data base corresponding with report has been provided with；
Background data base it is newly-increased update the data have been provided with when, load the report；
Sectional drawing processing is carried out to the report, obtains the image of the report；
The image for handling the report obtains the screening conditions and result data of data from the image of the report；
Backstage corresponding with report physical table is inquired according to the screening conditions, is obtained corresponding with the screening conditions
Back end data；With
The result data and Back end data for comparing same screening conditions, complete the verification of report data.
The present invention detects report page data automatically, while reducing testing cost, improves efficiency；Data once
The accuracy detection of page data can be carried out by being synchronized to application database, and timeliness is high；Moreover, avoiding due to after independence
Number of units evidence and page data individually detection and caused by the incomplete problem of Data Detection.
Description of the drawings
Description by referring to the following drawings to the embodiment of the present invention, the above and other purposes of the present invention, feature and
Advantage will be apparent from, in the accompanying drawings：
Fig. 1 is the method for calibration simple process figure of report data of the present invention；
Fig. 2 is the flow chart that the corresponding background data base of present invention detection report page updates the data；
Fig. 3 is the flow chart that the present invention loads the report；
Fig. 4 is the flow chart of image processing process of the present invention；
Fig. 5 is present invention inquiry back-end data and verifies the flow chart of report；
Fig. 6 is the structural principle block diagram of the check system of report data of the present invention；
Fig. 7 is the structural principle block diagram of one specific embodiment of check system of report data of the present invention.
Specific implementation mode
Below based on embodiment, present invention is described, but the present invention is not restricted to these embodiments.Under
Text to the present invention datail description in, it is detailed to describe some specific detail sections.Do not have for a person skilled in the art
The description of these detail sections can also understand the present invention completely.In order to avoid obscuring the essence of the present invention, well known method, mistake
Journey, flow do not describe in detail.In addition attached drawing is not necessarily drawn to scale.
As shown in Figure 1, for the method for calibration simple process figure of report data of the present invention, the method includes：
Whether step S1, newly-increased update the data for detecting background data base corresponding with report have been provided with；If backstage
Newly-increased update the data of database has been provided with, and thens follow the steps S2, if it is not, continuing to detect.
Step S2, background data base it is newly-increased update the data have been provided with when, load the report.Simulation is artificial at this time
Report is clicked, the report is loaded automatically, shows data in the report.
Step S3 carries out sectional drawing processing to the report, obtains the still image of the report.
Step S4 handles the image of the report, and the screening conditions and result of data are obtained from the image of the report
Data.By the processing of the step, picture unstructured information is converted into structured message, including screening conditions information and right
The result data answered.
Step S5 inquires backstage corresponding with report physical table according to the screening conditions, obtains and the screening
The corresponding Back end data of condition.In this step, backstage physical table is inquired with the screening conditions obtained in step S4, obtained identical
The Back end data of condition.
Step S6 compares the result data and Back end data of same screening conditions, completes the verification of report data.By right
Than may determine that it is whether correct that this report page opens data.
Through the above scheme it is found that the present invention eliminates the reliance on manual type detection page data, testing cost is being reduced
Meanwhile improving efficiency.The present invention has once been synchronized to application database in data can carry out the accuracy inspection of page data
It surveys, data problem could be found by needing not wait for after report operation maintenance personnel clicks report, and the timeliness pinpointed the problems is high.Moreover,
The present invention incorporates the detection of Back end data and page data consistency, avoids to Back end data and page data independent detection
The incomplete problem of Data Detection caused by and.
Specifically, in step 1, in order to detect whether the newly-increased of the corresponding background data base of report page update the data
Through having, one first allocation list is needed, first allocation list is as shown in table 1, including following information：
Table 1
For a report, multiple backstage physical tables may be corresponded to, and the undated parameter of each backstage physical table may
It is identical, it is also possible to it is different, thus, corresponding undated parameter and its flag bit are set for each backstage physical table, when more
It is new complete, then set its flag bit to the mark that update is completed, such as " 1 ".In the present embodiment, two undated parameters are provided with：
" report renewal frequency " and " report renewal time " is arranged for example, " report renewal frequency " is day, week, moon etc. according to front
Whether " report renewal frequency " is to work as the day before yesterday, week, moon etc., or be not in " report renewal time " setting, is to judge currently more
New data provides foundation.These parameters can obtain in scheduling system.It is specific as shown in Figure 2：
Step S11 updates first allocation list.For example, from system control centre or scheduling system in obtain object
The update status of table at that time is managed, and is updated in first allocation list, if whether some physical table updates completion, if
Update is completed, then sets corresponding flag bit in the first allocation list to completion status, if not updating completion, be arranged to not have
There is completion status.
Step S12 scans undated parameter and flag bit in the first allocation list.
Step S13 judges whether renewal frequency is day according to " the report renewal frequency " in undated parameterIf so, holding
Row step S15, if it is not, executing step S14.
Step S14 judges whether be currently renewal time, if so, return to step 15.If it is not, then terminating this stream
Journey.
Step S15, according to flag bit, whether the update flag bit of judgement all backstage physical tables corresponding with the report
It all indicates to complete, if it does, step S16 is executed, if it is not, return to step S11, continues according in the scheduling in system
The heart or scheduling system, by the current update status update of physical table to first allocation list.
Step S16 sends triggering message, loads the report for triggering implementation steps 2, and send relevant information, such as
Report link and report parameter, the account information etc. of the report parameter such as reports user.
As shown in figure 3, to load the particular flow sheet of the report in step 2.The step of load report, wraps
It includes：
Step S21 logs in reporting system homepage according to triggering message and the reports user's account information received；
Step S22 judges log in whether if exception executes step S29 and normally log on to without exception if abnormal
Reporting system homepage then executes next step S23.
Step S23 is assembled into workable new link according to the report link received, which is to have had at present
The report link of standby viewing conditions.
Step S24 opens the report link for having had viewing conditions at present.
Step S25 loads the report data.
Step S26, judges whether the page loads completionIf having loaded completion, next step S27 is executed, if do not had
There is load to complete, executes step S28.
Step S27 sends triggering message, to execute step S3.
Step S28 judges whether load time-out, if be not timed-out, step S25 is continued to execute, if it times out, holding
Row step S29.
Step S29 triggers early warning mechanism, notifies related personnel, handled by related personnel.
By the step S2, report is opened, and show report data on the page.After having loaded data, triggering step
Rapid 3, to carry out sectional drawing processing to the page, the still image of the page is obtained, and picture name is named with report name,
Picture is stored in specified file.After the completion of sectional drawing, closes corresponding report and link window.
In step s 4, the still image obtained in step S3 is handled, it is specific as shown in Figure 4：
Step S41 opens picture identical with the title in specified folder.
Step S42 identifies screening areas, and according to the Rule screening conditions and content of setting, and by the report
Screening conditions store.Wherein, text of the rule comprising image coordinate location where screening conditions and screening conditions
Word range.According to the rule, to identify screening areas.
Step S43 identifies data exhibiting corresponding with screening areas region.
Step S44 judges that the data exhibiting region is figure or table.If it is figure, S45 is thened follow the steps,
If it is table, S46 is thened follow the steps.
Step S45 parses legend information and corresponding data label value from the figure, and records the figure parsed
Example information and corresponding data label value, the result data as the report.Then execute step S47.
Step S46, it is described show area be table when, obtain the Table Header information of the table and corresponding data.Wherein,
As one embodiment, the Table Header information and the first row value of information showed in area only need to be obtained.Since usual first row information is
Summary information, when carrying out comparing, it is only necessary to the summary information, because below in detail without comparing the first row
Data.When the distribution of information in table changes, when remembering Lou summary information such as last column, then the letter of last column is obtained
Breath.In the present embodiment, the Table Header information and the first row value of information, the result data as the report are recorded.
When report heading is long, it is full-time to show one, in step 3 sectional drawing, dilatory scroll bar is needed, cuts several
Image.In step 4, complete Table Header information and data are obtained by identifying more sectional drawings.
Step S47 sends triggering message, is used for implementation steps S5.
It by step S4, no longer needs to obtain report page information by artificial naked eyes, but utilizes image processing techniques,
The screening areas acquisition of information of every report picture comes out, and screening conditions is recorded with structured form, and judge data
It is that bivariate table structure or patterned structures parse corresponding result according to different types from data exhibiting area to show area
Data, it is efficient, accuracy is high.
By above step, the screening conditions and corresponding result data that obtain current report pass through then in step S5
The same screening conditions inquire background data base, to obtain back-end data.
Specifically, the second allocation list is preset in system, for recording the dimension of every report form showing, index and should
Incidence relation between report backstage physical table and table.Wherein, the dimension is to illustrate data, concretely describes an item
Purpose text-string may specify the description attribute or feature of the object of different value.The index is to weigh data, can be by total
Number or ratio weigh specific dimension element, are and the relevant number of dimension.
If the information got in image procossing is as follows：
Time：2016-07-30；Department：Department 1；Personnel：Personnel 1；Sales volume：100, then the second allocation list such as table
2：
Table 2
As shown in figure 5, inquiring back-end data for the present invention and verifying the flow chart of report, specifically include：
Step S51, according to the second preset allocation list, the screening obtained when by the image for handling the report
Conditional name is converted to the physical field title of backstage physical table, i.e., the information of processing result image and allocation list is done one and patrolled
Collect the matching of title and physical name.
Step S52, then, according to being associated with for report described in the screening conditions and allocation list and backstage physical table
System, assembled dynamic queries sentence.By taking upper table as an example, processing result image and the second allocation list are subjected to matching conversion, generation
Dynamic query of SQL sentence is as follows：
1 ' and of select amount from table1where time=' 2016-07-30 ' and dept=' departments
Man=' personnel 1 '；
Certainly, the complexity of every report is different, can be in conjunction with the configuration information of every report, and dynamic generation is various
The query statement of differing complexity.
Step S53 executes the dynamic queries sentence, obtains Back end data corresponding with the screening conditions.
Step S54 returns to the Back end data.
Step S55, the result data and obtained from back-end data library inquiry that the identification under more same screening conditions obtains
Back end data.
Whether step S56, both judge consistent, if some, verifies success, and what report was that user shows is positive exact figures
According to if it is inconsistent, in step S57, triggering early warning mechanism notifies related personnel.
According to methods described above as it can be seen that the present invention can carry out report page result detection in first time, for
Some reporting systems generate workable report in morning, are detected without manually early clicking on report, because may be not present
The problem of detection time morning and evening.Also, the present invention according to processing result image dynamic generation query statement, does not have to again as it every time
It is preceding manually to go in system log to search the SQL query statement of generation or manually write SQL query statement, thus improve effect
Rate has saved manpower.
On the other hand, the present invention also provides the check systems of report data, as shown in fig. 6, being of the present invention
The structural principle block diagram of the check system of report data.
The system comprises detection module 1, automatic imitation click module 2, page screenshot module 3, image processing module 4,
Enquiry module 5 and data match module 6.Wherein, the detection module 1, for detecting background data base corresponding with report
Whether newly-increased update the data has been provided with；Automatic imitation clicks module 2, for being updated the data in the newly-increased of background data base
When having, reporting system is logged in, the report is loaded；Page screenshot module 3 is obtained for carrying out sectional drawing processing to the report
Take the image of the report；Image processing module 4, the image for handling the report are obtained from the image of the report
The screening conditions and result data of data；Enquiry module 5, for according to the screening conditions inquiry it is corresponding with the report after
Platform physical table obtains Back end data corresponding with the screening conditions；Data match module 6, for comparing same screening conditions
Result data and Back end data, complete the verification of report data.
Specifically, as shown in fig. 7, the structural principle of one specific embodiment of check system for report data of the present invention
Block diagram.The detection module 1 includes：First allocation list 11, updating unit 12 and detection unit 13.Wherein, first configuration
Table 11 is used to record the configuration information of report, including：Report link, report parameter, corresponding backstage physical table, report update ginseng
Number and backstage physical table update mark, foregoing table 1.The updating unit 12 is in access scheduling system or scheduling
The heart therefrom obtains the update status of backstage physical table, and the backstage physical table for updating first allocation list updates flag bit, will
The flag bit for completing newer backstage physical table is set as completion status, if not updating completion, is configured without and completes shape
State.For detection unit 13 according to the undated parameter in the allocation list, cycle detection corresponds to backstage physical table update flag bit, works as institute
When to have the update flag bit of backstage physical table all be completion status, send trigger signal and click module 2 to the automatic imitation, and
The report link and report parameter are passed into the automatic imitation and click module 2.
It includes logging in unit 21, receiving unit 22, report opening unit 23 and data to add that the automatic imitation, which clicks module 2,
Carrier unit 24.Wherein, the trigger signal for logging in unit 21 and being sent according to the detection module, receives according to receiving unit
The login account information come logs in reporting system homepage.If there is exception in login process, early warning system is triggered, notifies phase
Pass personnel are handled.Receiving unit 22 receives from the detection module and transmits the report link and report parameter of coming, and by the report
Table parameter, which is sent to, logs in unit 21 and report opening unit 23.After the login unit 21 is successfully logged onto reporting system, institute
It states report opening unit 23 and is assembled into the new report chain for having had viewing conditions according to the report link and related statements parameter
It connects, and opens the new report link, open the report at this time.The data loading unit 24 will be corresponding with the report
Backstage physical table in data be loaded into the report page.After the completion of load, sends trigger signal and cut to the page
Module 3 after page screenshot module 3 receives triggering message, carries out shot operation, picture name is with report name to current page
Claim name, picture is stored in specified file.Sectional drawing is completed, and is closed corresponding report and is linked window.
Described image processing module 4 includes：Screening area recognition unit 41, data exhibiting area recognition unit 42 and data parsing
Unit 43.Wherein, the screening area recognition unit 41 is in open picture recognition screening areas, and according to the Rule of setting
Screening conditions and content.Data exhibiting area recognition unit 42 identifies data exhibiting corresponding with screening areas region, described
Data resolution unit 43 parses result data of the corresponding data as the screening conditions from the data exhibiting area.
The enquiry module 5 obtains handling result, including screening conditions and result data from described image processing module 4, described to look into
It askes module 5 and inquires backstage corresponding with report physical table according to the screening conditions, obtain corresponding with the screening conditions
Back end data.Data match module 6 compares the result data and Back end data of same screening conditions, completes the school of report data
It tests.
On the other hand, the present invention also provides a kind of calibration equipment of report data, including memory and processor, institutes
It states memory for storing data and instruction, the processor is used to, according to described instruction, complete the above method and system.Example
Such as：
Whether newly-increased update the data of detection background data base corresponding with report has been provided with；
Background data base it is newly-increased update the data have been provided with when, load the report；
Sectional drawing processing is carried out to the report, obtains the image of the report；
The image for handling the report obtains the screening conditions and result data of data from the image of the report；
Backstage corresponding with report physical table is inquired according to the screening conditions, is obtained corresponding with the screening conditions
Back end data；With
The result data and Back end data for comparing same screening conditions, complete the verification of report data.
Method of calibration, system and the device of report data provided by the invention solve the disadvantage of some current checkschemas
Disease, such as：Not comprehensively, using artificial click report there are high cost, inefficiencies and hysteresis qualitys etc. to the verification of report data.To report
The verification of table is in time, accurately.
The foregoing is merely preferred embodiments, are not intended to restrict the invention, to those skilled in the art, this hair
It is bright to have various modifications and changes.All any modification, equivalent replacement, improvement within spirit and principles of the present invention
Deng should all be included in the protection scope of the present invention.
Claims (11)
1. a kind of method of calibration of report data, wherein including：
Whether newly-increased update the data of detection background data base corresponding with report has been provided with；
Background data base it is newly-increased update the data have been provided with when, load the report；
Sectional drawing processing is carried out to the report, obtains the image of the report；
The image for handling the report obtains screening conditions and result data from the image of the report；
Backstage corresponding with report physical table is inquired according to the screening conditions, after acquisition is corresponding with the screening conditions
End data；With
The result data and Back end data for comparing same screening conditions, complete the verification of report data.
2. the method for calibration of report data as described in claim 1, wherein described to detect background data base corresponding with report
Newly-increased update the data that the step of whether having been provided with includes：
According to the renewal time of the report Back end data, the update flag bit of the corresponding all backstage physical tables of cycle detection；
When the update flag bit of backstage corresponding with report physical table is all completion status, determination is corresponding with the report
Newly-increased update the data of background data base have been provided with.
3. the method for calibration of report data as described in claim 1, wherein newly-increased in background data base updates the data
When having, the step of loading the report, includes：
Log in reporting system homepage；
Open the report link for having had viewing conditions at present；
Load the report data.
4. the method for calibration of report data as described in claim 1, wherein obtain screening conditions from the image of the report
And the step of result data, includes：
Identify screening areas, and according to the Rule screening conditions and content of setting；
It identifies data exhibiting corresponding with screening areas region, corresponding data conduct is parsed from data exhibiting region
The result data of the screening conditions.
5. the method for calibration of report data as claimed in claim 4, wherein identification data exhibition corresponding with the screening areas
When existing region, judge that the data exhibiting region is bivariate table structure or patterned structures；
If the data exhibiting region is patterned structures, legend information and corresponding label value data as a result are obtained；
If the data exhibiting region is bivariate table structure, Table Header information and summary information value data as a result are obtained.
6. the method for calibration of report data as described in claim 1, wherein according to screening conditions inquiry and the report
Corresponding backstage physical table, obtain Back end data corresponding with the screening conditions the step of include：
According to the second preset allocation list, the screening conditions name translation that when image that will handle the report obtains is backstage object
Manage the physical field title of table；
According to the incidence relation of report and backstage physical table described in the screening conditions and the second allocation list, assembled dynamic queries
Sentence；
The dynamic queries sentence is executed, Back end data corresponding with the screening conditions is obtained.
7. a kind of check system of report data, including：
Whether detection module, newly-increased update the data for detecting background data base corresponding with report have been provided with；
Automatic imitation click module, for background data base it is newly-increased update the data have been provided with when, log in reporting system, add
Carry the report；
Page screenshot module obtains the image of the report for carrying out sectional drawing processing to the report；
Image processing module, the image for handling the report obtain screening conditions and result from the image of the report
Data；
Enquiry module obtains and the sieve for inquiring backstage corresponding with report physical table according to the screening conditions
Select the corresponding Back end data of condition；With
Data match module, the result data for comparing same screening conditions and Back end data, complete the verification of report data.
8. the check system of report data as claimed in claim 7, wherein the detection module includes：
First allocation list, the configuration information for recording report, including：Report connection, report parameter, corresponding backstage physics
Table, report undated parameter and backstage physical table update mark；
Updating unit updates the backstage physical table update of first allocation list for the update status according to backstage physical table
Flag bit；With
Detection unit, according to the undated parameter in the allocation list, cycle detection corresponds to backstage physical table update mark, when all
It when the update mark of backstage physical table is completed, sends trigger signal and clicks module to the automatic imitation, and by the report chain
It connects and passes to the automatic imitation click module with report parameter.
9. the check system of report data as claimed in claim 7, wherein the automatic imitation clicks module and includes：
Unit, the trigger signal sent according to the detection module and report parameter are logged in, reporting system homepage is logged in；
Receiving unit transmits the report link and report parameter of coming for receiving from the detection module；
Report opening unit is assembled into the new report link for having had viewing conditions according to the report link；It opens described new
Report link；With
Data loading unit, for the data in the physical table of backstage corresponding with the report to be loaded into the report page.
10. the check system of report data as claimed in claim 7, wherein described image processing module includes：
Screening area recognition unit, screening areas for identification, and according to the Rule screening conditions and content of setting；
Data exhibiting area recognition unit, for identification data exhibiting corresponding with screening areas region；With
Data resolution unit, for parsing knot of the corresponding data as the screening conditions from the data exhibiting area
Fruit data.
11. a kind of calibration equipment of report data, including processor and memory, the memory for storing data and refers to
It enables, the processor executes described instruction, at least completes following steps：
Whether newly-increased update the data of detection background data base corresponding with report has been provided with；
Background data base it is newly-increased update the data have been provided with when, load the report；
Sectional drawing processing is carried out to the report, obtains the image of the report；
The image for handling the report obtains screening conditions and result data from the image of the report；
Backstage corresponding with report physical table is inquired according to the screening conditions, after acquisition is corresponding with the screening conditions
End data；With
The result data and Back end data for comparing same screening conditions, complete the verification of report data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611142361.5A CN108614742B (en) | 2016-12-12 | 2016-12-12 | Report data verification method, system and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611142361.5A CN108614742B (en) | 2016-12-12 | 2016-12-12 | Report data verification method, system and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108614742A true CN108614742A (en) | 2018-10-02 |
| CN108614742B CN108614742B (en) | 2021-09-14 |
Family
ID=63643675
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611142361.5A Active CN108614742B (en) | 2016-12-12 | 2016-12-12 | Report data verification method, system and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108614742B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109634945A (en) * | 2018-12-06 | 2019-04-16 | 阳光保险集团股份有限公司 | The method and apparatus of Data Detection in a kind of reporting system |
| CN110019042A (en) * | 2019-04-15 | 2019-07-16 | 成都四方伟业软件股份有限公司 | Report file generation method, apparatus and system |
| CN110119426A (en) * | 2019-03-27 | 2019-08-13 | 携程计算机技术（上海）有限公司 | The synchronous method and system of hotel's order report data |
| CN113239770A (en) * | 2021-04-30 | 2021-08-10 | 国网河北省电力有限公司沧州供电分公司 | Financial statement accounting method |
| CN114185624A (en) * | 2021-12-30 | 2022-03-15 | 深圳前海微众银行股份有限公司 | Report loading update detection method, device, equipment and storage medium |
| CN114676190A (en) * | 2022-05-27 | 2022-06-28 | 太平金融科技服务(上海)有限公司深圳分公司 | Data display method and device, computer equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070019855A1 (en) * | 2005-07-21 | 2007-01-25 | Xerox Corporation | Check printing auditing systems and methods |
| CN103198558A (en) * | 2013-02-06 | 2013-07-10 | 深圳宝嘉电子设备有限公司 | Bank counter intelligent processing terminal |
| CN104077373A (en) * | 2014-06-24 | 2014-10-01 | 北京京东尚科信息技术有限公司 | Data consistency checking method |
| US9235819B2 (en) * | 2011-11-04 | 2016-01-12 | Canon Kabushiki Kaisha | Printing system, image forming apparatus, and method |
-
2016
- 2016-12-12 CN CN201611142361.5A patent/CN108614742B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070019855A1 (en) * | 2005-07-21 | 2007-01-25 | Xerox Corporation | Check printing auditing systems and methods |
| US9235819B2 (en) * | 2011-11-04 | 2016-01-12 | Canon Kabushiki Kaisha | Printing system, image forming apparatus, and method |
| CN103198558A (en) * | 2013-02-06 | 2013-07-10 | 深圳宝嘉电子设备有限公司 | Bank counter intelligent processing terminal |
| CN104077373A (en) * | 2014-06-24 | 2014-10-01 | 北京京东尚科信息技术有限公司 | Data consistency checking method |
Non-Patent Citations (1)
| Title |
|---|
| 张建炜: "南京审计学院学生信息管理系统的设计和实现", 《中国优秀硕士学位论文全文数据库-信息科技辑》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109634945A (en) * | 2018-12-06 | 2019-04-16 | 阳光保险集团股份有限公司 | The method and apparatus of Data Detection in a kind of reporting system |
| CN110119426A (en) * | 2019-03-27 | 2019-08-13 | 携程计算机技术（上海）有限公司 | The synchronous method and system of hotel's order report data |
| CN110019042A (en) * | 2019-04-15 | 2019-07-16 | 成都四方伟业软件股份有限公司 | Report file generation method, apparatus and system |
| CN113239770A (en) * | 2021-04-30 | 2021-08-10 | 国网河北省电力有限公司沧州供电分公司 | Financial statement accounting method |
| CN113239770B (en) * | 2021-04-30 | 2022-12-20 | 国网河北省电力有限公司沧州供电分公司 | Financial statement accounting method |
| CN114185624A (en) * | 2021-12-30 | 2022-03-15 | 深圳前海微众银行股份有限公司 | Report loading update detection method, device, equipment and storage medium |
| CN114676190A (en) * | 2022-05-27 | 2022-06-28 | 太平金融科技服务(上海)有限公司深圳分公司 | Data display method and device, computer equipment and storage medium |
| CN114676190B (en) * | 2022-05-27 | 2022-10-11 | 太平金融科技服务(上海)有限公司深圳分公司 | Data display method and device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108614742B (en) | 2021-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108614742A (en) | Method of calibration, system and the device of report data | |
| US10977293B2 (en) | Technology incident management platform | |
| Li et al. | Extracting object-centric event logs to support process mining on databases | |
| US9330369B2 (en) | Resource planning for data protection validation | |
| US10504047B2 (en) | Metadata-driven audit reporting system with dynamically created display names | |
| US8429463B2 (en) | Log management method and apparatus, information processing apparatus with log management apparatus and storage medium | |
| US20110213788A1 (en) | Information fusion for multiple anomaly detection systems | |
| WO2014196129A1 (en) | Fault analysis device, fault analysis method, and recording medium | |
| US20180046956A1 (en) | Warning About Steps That Lead to an Unsuccessful Execution of a Business Process | |
| BR102017003042A2 (en) | COMPUTER IMPLEMENTED METHOD AND COMPUTER SYSTEM | |
| CN108460598A (en) | A kind of real-time automation supervision reporting system based on double-strand framework block chain | |
| Zhang et al. | A data driven approach for discovering data quality requirements | |
| CN112036153A (en) | Work order error correction method and device, computer readable storage medium and computer equipment | |
| WO2017023299A1 (en) | Composing future tests | |
| Pittke et al. | Spotting terminology deficiencies in process model repositories | |
| CN106649312B (en) | The analysis method and system of journal file | |
| CN104123104B (en) | Daily record control system and method | |
| Ge et al. | Data and information quality assessment in information manufacturing systems | |
| CN114090463A (en) | Customizable software test analysis evaluation system based on natural language processing technology | |
| Reidemeister et al. | Diagnosis of recurrent faults using log files | |
| US20200242121A1 (en) | Method and apparatus for analyzing data | |
| US11816112B1 (en) | Systems and methods for automated process discovery | |
| US7225412B2 (en) | Visualization toolkit for data cleansing applications | |
| CN113781068A (en) | Online problem solving method and device, electronic equipment and storage medium | |
| JP5332918B2 (en) | Classification data recommendation method, program, and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |