CN112346911A - Report data statistical function testing method and system - Google Patents
Report data statistical function testing method and system Download PDFInfo
- Publication number
- CN112346911A CN112346911A CN202011333988.5A CN202011333988A CN112346911A CN 112346911 A CN112346911 A CN 112346911A CN 202011333988 A CN202011333988 A CN 202011333988A CN 112346911 A CN112346911 A CN 112346911A
- Authority
- CN
- China
- Prior art keywords
- report
- snapshot
- business data
- incremental business
- environment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3452—Performance evaluation by statistical analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3664—Environments for testing or debugging software
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Computer Hardware Design (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Probability & Statistics with Applications (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Factory Administration (AREA)
Abstract
The invention discloses a method and a system for testing statistical function of report data, which comprises the following steps: s1, the production environment periodically backs up the incremental business data, an incremental business data report is generated, and a production environment snapshot of the incremental business data report is generated; s2, the incremental business data report, the snapshot generating script thereof and the production environment snapshot are automatically deployed to the UAT environment specially used for the report data statistical function test at regular intervals; s3, running and executing the snapshot generating script of the incremental business data report in the UAT environment to generate the UAT environment snapshot of the incremental business data report; and S4, comparing the similarity of the production environment snapshot and the UAT environment snapshot of the incremental business data report, and outputting a comparison result. According to the invention, the comparison of report data is completed through AI image recognition, so that the complex report statistical function test is rapidly completed, and a large amount of labor cost and time cost are saved.
Description
Technical Field
The invention relates to the field of data analysis, in particular to a method and a system for testing statistical function of report data.
Background
The data analysis and data mining system provides a large number of data indexes and calculation formulas to provide business decisions for operation and system analysts. After the data analysis and mining are completed, the correctness of the acquired report data needs to be tested to verify that the statistical function of the report data reaches the expectation.
The traditional report data statistical function test occupies a large amount of test period and test resources, and has large cost input amount of manpower, time and the like, and can not completely cover data verification of all indexes and can not quickly respond to the change of business indexes.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a method and a system for testing the report data statistical function, which finish the comparison of report data by AI image recognition, thereby quickly finishing the complex report statistical function test and saving a large amount of labor cost and time cost.
In order to achieve the purpose, the invention provides the following technical scheme:
on one hand, the report data statistical function test method is provided, and comprises the following steps:
s1, the production environment periodically backs up the incremental business data to generate an incremental business data report, and a snapshot generating script of the incremental business data report is executed to generate a production environment snapshot of the incremental business data report;
s2, the incremental business data report, the snapshot generating script thereof and the production environment snapshot are automatically deployed to the UAT environment specially used for the report data statistical function test at regular intervals;
s3, running and executing the snapshot generating script of the incremental business data report in the UAT environment to generate the UAT environment snapshot of the incremental business data report;
and S4, comparing the similarity of the production environment snapshot and the UAT environment snapshot of the incremental business data report, and outputting a comparison result.
Preferably, step S1 further includes: naming the production environment snapshot.
Preferably, step S2 further includes: and deploying the latest version and configuration of the BI system in the UAT environment.
Preferably, step S4 further includes: and when the comparison result shows that the similarity between the production environment snapshot and the UAT environment snapshot is more than or equal to 95%, the report data in the incremental business data report obtained through statistics is verified to be passed.
Preferably, in step S4, the AI image comparison tool is used to compare the similarity between the production environment snapshot of the incremental business data report and the UAT environment snapshot.
On the other hand, the report data statistical function testing system for realizing the report data statistical function testing method comprises the following steps:
the production environment database is used for periodically backing up the incremental business data and generating an incremental business data report;
the production environment snapshot generating unit is used for executing the snapshot generating script of the incremental business data report to generate the production environment snapshot of the incremental business data report and naming the production environment snapshot;
the UTA environment database is used for periodically receiving the incremental business data report and the snapshot generating script and the production environment snapshot thereof;
the UTA environment snapshot generating unit is used for running in the UAT environment and executing a snapshot generating script of the incremental business data report so as to generate the UAT environment snapshot of the incremental business data report;
and the snapshot comparison unit is used for carrying out similarity comparison on the production environment snapshot and the UAT environment snapshot of the incremental business data report and outputting a comparison result.
Preferably, the report data statistics function test system further includes: and the evaluation unit is used for indicating that the report data in the incremental business data report obtained by statistics passes verification when the comparison result shows that the similarity between the production environment snapshot and the UAT environment snapshot is more than or equal to 95%.
Compared with the prior art, the invention has the following beneficial effects:
according to the method, the similarity comparison is carried out on the production environment snapshot and the UAT environment snapshot of the incremental business data report in the UAT environment through the AIAI picture comparison tool, the report correctness comparison result can be rapidly obtained, whether the report data statistical function is good or not is judged, and the time and labor for testing the report data statistical function are greatly saved.
Drawings
FIG. 1 is a flowchart illustrating the steps of a report statistics testing method according to the present invention;
FIG. 2 is a schematic diagram of a production environment snapshot of an incremental business data report in accordance with the present invention;
FIG. 3 is a schematic diagram of the present invention for deploying the latest version and configuration of a BI system in a UAT environment;
FIG. 4 is a comparison result of similarity between a production environment snapshot and a UAT environment snapshot of an incremental business data report in the present invention;
FIG. 5 is a histogram of similarity comparison results of production environment snapshots and UAT environment snapshots of three incremental business data reports;
FIG. 6 is a schematic structural diagram of a report statistics functional test system according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1:
as shown in fig. 1, the method for testing statistical function of report data in this embodiment includes the following steps:
s1, backing up incremental business data at regular intervals (such as every morning) by a production environment, generating an incremental business data report, executing a snapshot generating script of the incremental business data report through a BI system to generate production environment snapshots of the incremental business data report shown in FIG. 2, and naming the production environment snapshots, wherein each report corresponds to each other according to Pageid, so that a production environment snapshot naming rule is named according to PageidX _ table name _ date;
s2, the incremental business data report, the snapshot generating script thereof and the production environment snapshot are automatically deployed to the UAT environment specially used for the report data statistical function test at regular intervals;
meanwhile, as shown in fig. 3, a tester manually triggers the automatic issue script of the UAT environment through Jenkins automatic continuous integration to deploy the latest version and configuration of the BI system in the UAT environment;
s3, running and executing the snapshot generating script of the incremental business data report through a BI system in the UAT environment to generate the UAT environment snapshot of the incremental business data report;
s4, as shown in FIG. 4, comparing the similarity of the production environment snapshot of the incremental business data report and the UAT environment snapshot by an AI image comparison tool, and outputting a comparison result; for example, the colluding relationship of the incremental business data in the incremental business data report is verified and compared by using open-source python + pytest + alure + selenium and other languages;
and when the comparison result shows that the similarity between the production environment snapshot and the UAT environment snapshot is greater than or equal to 95 percent (preferably greater than or equal to 98 percent), the report data in the incremental business data report obtained by statistics is verified to be passed; for example, fig. 5 shows the similarity comparison results of three groups (i.e., ID1, ID2, and ID3) of production environment snapshots and UAT environment snapshots, which may be output in the form of charts such as bar charts, line charts, etc., where the similarities of ID1 to ID3 groups are 0.926, 0.975, and 0.824, respectively, and the Pass part represents the similarity, which indicates that the report data in the statistically obtained incremental business data report corresponding to ID1 and ID3 is not verified, the data correctness is poor, and further adjustment and processing are required, and the similarity of ID2 group is equal to about 98%, which indicates that the corresponding report data is verified, and the report data statistics function is good.
In this embodiment, because the UTA environment is completely consistent with the production environment and completely isolated from the production environment, after the incremental business data report is deployed in the UAT environment, the actual situation of report data can be reflected more truly, further, the production environment snapshot of the incremental business data report and the UAT environment snapshot are compared in similarity through an AIAI image comparison tool, and a comparison result of report correctness can be obtained quickly, so that whether the report data statistical function is good or not is judged, and time and labor for testing the report data statistical function are saved greatly.
Example 2:
this embodiment provides a report data statistics function test system for implementing the report data statistics function test method in embodiment 1, as shown in fig. 6, the report data statistics function test system includes:
a production environment database 1 configured in a production environment and used for backing up incremental business data periodically (such as every morning) and generating an incremental business data report;
a production environment snapshot generating unit 2 (such as a BI system) for executing a snapshot generating script of the incremental business data report to generate a production environment snapshot of the incremental business data report, and naming the production environment snapshot;
the UTA environment database 3 is configured in the UTA environment and is used for periodically receiving the incremental business data report and the snapshot generating script and the production environment snapshot thereof;
the UTA environment snapshot generating unit 4 (such as a BI system) is configured to run in a UAT environment and execute a snapshot generating script of the incremental business data report to generate a UAT environment snapshot of the incremental business data report;
a snapshot comparison unit 5, configured to perform similarity comparison on the production environment snapshot of the incremental business data report and the UAT environment snapshot, and output a comparison result;
and the evaluation unit 6 is used for indicating that report data in the incremental business data report obtained by statistics passes verification when the comparison result shows that the similarity between the production environment snapshot and the UAT environment snapshot is greater than or equal to 95% (preferably greater than or equal to 98%).
In summary, after the incremental business data report is deployed in the UAT environment, the similarity comparison between the production environment snapshot of the incremental business data report and the UAT environment snapshot is further performed by the AIAI picture comparison tool, so that the comparison result of the correctness of the report can be quickly obtained, whether the statistical function of the report data is good or not is judged, and the time and labor for testing the statistical function of the report data are greatly saved.
It should be noted that the technical features of the above embodiments 1 to 3 can be arbitrarily combined, and the technical solutions obtained by combining the technical features belong to the scope of the present application. And in this document, terms such as "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (7)
1. A report data statistical function test method is characterized by comprising the following steps:
s1, the production environment periodically backs up the incremental business data to generate an incremental business data report, and a snapshot generating script of the incremental business data report is executed to generate a production environment snapshot of the incremental business data report;
s2, the incremental business data report, the snapshot generating script thereof and the production environment snapshot are automatically deployed to the UAT environment specially used for the report data statistical function test at regular intervals;
s3, running and executing the snapshot generating script of the incremental business data report in the UAT environment to generate the UAT environment snapshot of the incremental business data report;
and S4, comparing the similarity of the production environment snapshot and the UAT environment snapshot of the incremental business data report, and outputting a comparison result.
2. The statistical functional test method of report data as in claim 1, wherein the step S1 further comprises: naming the production environment snapshot.
3. The statistical functional test method of report data as in claim 1, wherein the step S2 further comprises: and deploying the latest version and configuration of the BI system in the UAT environment.
4. The statistical functional test method of report data as in claim 1, wherein the step S4 further comprises: and when the comparison result shows that the similarity between the production environment snapshot and the UAT environment snapshot is more than or equal to 95%, the report data in the incremental business data report obtained through statistics is verified to be passed.
5. The report data statistical function testing method of claim 1, wherein in step S4, the similarity comparison is performed between the production environment snapshot and the UAT environment snapshot of the incremental business data report by using an AI image comparison tool.
6. A report data statistical function test system for implementing the report data statistical function test method according to any one of claims 1 to 5, comprising:
the production environment database is used for periodically backing up the incremental business data and generating an incremental business data report;
the production environment snapshot generating unit is used for executing the snapshot generating script of the incremental business data report to generate the production environment snapshot of the incremental business data report and naming the production environment snapshot;
the UTA environment database is used for periodically receiving the incremental business data report and the snapshot generating script and the production environment snapshot thereof;
the UTA environment snapshot generating unit is used for running in the UAT environment and executing a snapshot generating script of the incremental business data report so as to generate the UAT environment snapshot of the incremental business data report;
and the snapshot comparison unit is used for carrying out similarity comparison on the production environment snapshot and the UAT environment snapshot of the incremental business data report and outputting a comparison result.
7. The reporting data statistical functionality test system of claim 6, wherein the reporting data statistical functionality test system further comprises: and the evaluation unit is used for indicating that the report data in the incremental business data report obtained by statistics passes verification when the comparison result shows that the similarity between the production environment snapshot and the UAT environment snapshot is more than or equal to 95%.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011333988.5A CN112346911A (en) | 2020-11-24 | 2020-11-24 | Report data statistical function testing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011333988.5A CN112346911A (en) | 2020-11-24 | 2020-11-24 | Report data statistical function testing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112346911A true CN112346911A (en) | 2021-02-09 |
Family
ID=74364779
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011333988.5A Pending CN112346911A (en) | 2020-11-24 | 2020-11-24 | Report data statistical function testing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112346911A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114896175A (en) * | 2022-07-14 | 2022-08-12 | 深圳市明源云科技有限公司 | Automatic test method, device, equipment and medium for report export function |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012059174A (en) * | 2010-09-13 | 2012-03-22 | Fujitsu Marketing Ltd | Report preparation device and its program |
| CN104461863A (en) * | 2014-10-29 | 2015-03-25 | 中国建设银行股份有限公司 | Service system testing method, device and system |
| US20150339218A1 (en) * | 2014-05-20 | 2015-11-26 | International Business Machines Corporation | Merging automated testing reports |
| US20200272599A1 (en) * | 2019-02-25 | 2020-08-27 | Sage Intacct, Inc. | Report snapshots |
| CN111966847A (en) * | 2020-08-10 | 2020-11-20 | 上海中通吉网络技术有限公司 | Report regression testing method, device and system |
-
2020
- 2020-11-24 CN CN202011333988.5A patent/CN112346911A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012059174A (en) * | 2010-09-13 | 2012-03-22 | Fujitsu Marketing Ltd | Report preparation device and its program |
| US20150339218A1 (en) * | 2014-05-20 | 2015-11-26 | International Business Machines Corporation | Merging automated testing reports |
| CN104461863A (en) * | 2014-10-29 | 2015-03-25 | 中国建设银行股份有限公司 | Service system testing method, device and system |
| US20200272599A1 (en) * | 2019-02-25 | 2020-08-27 | Sage Intacct, Inc. | Report snapshots |
| CN111966847A (en) * | 2020-08-10 | 2020-11-20 | 上海中通吉网络技术有限公司 | Report regression testing method, device and system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114896175A (en) * | 2022-07-14 | 2022-08-12 | 深圳市明源云科技有限公司 | Automatic test method, device, equipment and medium for report export function |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101908020B (en) | Method for prioritizing test cases based on classified excavation and version change | |
| CN107908548B (en) | Method and device for generating test case | |
| CN109344056B (en) | Test method and test device | |
| US7712087B2 (en) | Methods and systems for identifying intermittent errors in a distributed code development environment | |
| CN106708738B (en) | Software test defect prediction method and system | |
| CN110532021B (en) | Processing method of configuration file of distributed control system, client and service device | |
| CN107643956B (en) | Method and apparatus for locating the origin of an anomaly in anomaly data | |
| CN113888480A (en) | MES-based quality tracing method and system | |
| CN114328095A (en) | Task abnormity warning method and device | |
| CN112346911A (en) | Report data statistical function testing method and system | |
| Li et al. | Cost drivers of software corrective maintenance: An empirical study in two companies | |
| CN108898504B (en) | Intelligent training and improving method for mobile survey damage assessment system | |
| CN109767024B (en) | Method and device for predicting quantity of components, electronic equipment and storage medium | |
| CN107391363B (en) | Test resource scheduling method and device and electronic equipment | |
| Ye et al. | Knowledge discovery and knowledge transfer in board-level functional fault diagnosis | |
| Pozin et al. | Models in performance testing | |
| CN115373976A (en) | Insurance testing method and device, computer equipment and storage medium | |
| Schroeder et al. | Predicting and evaluating software model growth in the automotive industry | |
| CN111930611B (en) | Statistical method and device for test data | |
| CN117608903A (en) | Method, device, equipment and storage medium for automatically generating test report | |
| US11255716B2 (en) | Analysis support apparatus, analysis support method, and a computer-readable medium containing an analysis support program | |
| Silva et al. | Towards making safety-critical systems safer: learning from mistakes | |
| CN115237796A (en) | Link abnormity identification method and device, storage medium and electronic equipment | |
| CN111552639B (en) | Software test comprehensive control method and system | |
| CN109978476A (en) | Restrain institute's project task template generation method, device, system and introduction method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |