CN113821575A - Data checking method, device and equipment and computer storage medium - Google Patents
Data checking method, device and equipment and computer storage medium Download PDFInfo
- Publication number
- CN113821575A CN113821575A CN202111158201.0A CN202111158201A CN113821575A CN 113821575 A CN113821575 A CN 113821575A CN 202111158201 A CN202111158201 A CN 202111158201A CN 113821575 A CN113821575 A CN 113821575A
- Authority
- CN
- China
- Prior art keywords
- data
- rule
- checking
- supervision
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 71
- 238000012545 processing Methods 0.000 claims abstract description 49
- 238000004590 computer program Methods 0.000 claims description 15
- 238000012986 modification Methods 0.000 claims description 10
- 230000004048 modification Effects 0.000 claims description 10
- 230000003993 interaction Effects 0.000 claims description 7
- 238000007689 inspection Methods 0.000 claims description 5
- 230000001172 regenerating effect Effects 0.000 claims description 4
- 238000013473 artificial intelligence Methods 0.000 abstract description 3
- 238000007405 data analysis Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 238000013499 data model Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012958 reprocessing Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013075 data extraction Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24564—Applying rules; Deductive queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/02—Banking, e.g. interest calculation or account maintenance
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Technology Law (AREA)
- General Business, Economics & Management (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application relates to the field of data analysis, and provides a data checking method, a device, equipment and a computer storage medium, wherein the method comprises the following steps: acquiring target service data based on a preset data acquisition rule; processing the target service data based on a preset data processing rule to obtain supervision data; checking the supervision data based on a preset checking rule; if the supervision data does not pass the check, adjusting the data acquisition rule based on the check rule; if the supervision data passes the check, generating a supervision result according to the supervision data; and outputting a checking report according to the supervision result, wherein the checking report comprises the supervision result. The data can be automatically checked, and the data checking efficiency is improved. The application also relates to artificial intelligence, and the data checking method can be applied to cloud servers of big data and artificial intelligence platform cloud computing services.
Description
Technical Field
The present application relates to the field of data analysis, and in particular, to a data checking method, apparatus, device, and computer storage medium.
Background
The System includes functions of bank standardized data extraction, field inspection project management, data model generation tool, data model issue and management, etc., and a bank needs to report service data to the monitoring System regularly, such as public information, accounting and accounting information, customer information, credit counterparty information, card information, credit management information, transaction flow information, customer risk statistics, fund service, financing service, etc. In order to prevent reported data from being inaccurate, before business data is reported to a monitoring system, data of the reporting monitoring system needs to be checked, at present, data checking, output of a checking report and processing of data which does not pass through checking are mainly completed manually, checking workload is large, labor cost is high, errors are prone to occurring in the manual checking process, and therefore data checking efficiency is not high. The prior art lacks a method for improving the data checking efficiency.
Disclosure of Invention
The application mainly aims to provide a data checking method, a data checking device, data checking equipment and a computer storage medium, and aims to solve the technical problems that manual data checking is low in efficiency and prone to errors.
In a first aspect, the present application provides a data checking method, including:
acquiring target service data based on a preset data acquisition rule;
processing the target service data based on a preset data processing rule to obtain supervision data;
checking the supervision data based on a preset checking rule;
if the supervision data does not pass the check, based on the check rule, adjusting the data acquisition rule so as to obtain and process the target service data and check the supervision data again according to the adjusted data acquisition rule;
if the supervision data passes the check, generating a supervision result according to the supervision data;
and outputting a checking report according to the supervision result, wherein the checking report comprises the supervision result.
In a second aspect, the present application further provides a data checking apparatus, comprising:
the service data acquisition module is used for acquiring target service data based on a preset data acquisition rule;
the service data processing module is used for processing the target service data based on a preset data processing rule to obtain supervision data;
the supervision data checking module is used for checking the supervision data based on a preset checking rule;
the acquisition rule adjusting module is used for adjusting the data acquisition rule based on the checking rule if the supervision data does not pass the checking, so as to obtain and process the target service data and check the supervision data again according to the adjusted data acquisition rule;
and the supervision result generation module is used for generating a supervision result according to the supervision data if the supervision data passes the check.
In a third aspect, the present application also provides a computer device comprising a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, implements the steps of the data checking method as described above.
In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, where the computer program, when executed by a processor, implements the steps of the data checking method as described above.
The application provides a data checking method, a device, equipment and a computer readable storage medium, and the application acquires target service data based on a preset data acquisition rule; processing the target service data based on a preset data processing rule to obtain supervision data; checking the supervision data based on a preset checking rule; if the supervision data does not pass the check, based on the check rule, adjusting the data acquisition rule so as to obtain and process the target service data and check the supervision data again according to the adjusted data acquisition rule; if the supervision data passes the check, generating a supervision result according to the supervision data; and outputting a checking report according to the supervision result, wherein the checking report comprises the supervision result. The business data are acquired and processed based on the preset data acquisition rule and the preset data processing rule, and then the data are automatically checked through the checking rule, so that the data checking efficiency is improved, the error rate is reduced, the data acquisition rule can be automatically adjusted for the data which do not pass the checking, and the time for the working personnel to process the data which do not pass the checking is saved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a data checking method according to an embodiment of the present application;
fig. 2 is a usage scenario diagram of a data checking method according to an embodiment of the present application;
fig. 3 is a schematic flowchart of a data checking method according to an embodiment of the present application;
fig. 4 is a schematic block diagram of a data checking apparatus according to an embodiment of the present application;
fig. 5 is a block diagram schematically illustrating a structure of a computer device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
The embodiment of the application provides a data checking method, a data checking device, computer equipment and a computer readable storage medium.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a schematic flow chart of a data checking method according to an embodiment of the present application. The data checking method can be used in a terminal or a server to realize the checking of the service data generated by the terminal equipment or the server. The terminal can be an electronic device such as a mobile phone, a tablet computer, a notebook computer, a desktop computer, a personal digital assistant and a wearable device; the server may be an independent server, a server cluster, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a Network service, cloud communication, a middleware service, a domain name service, a security service, a Content Delivery Network (CDN), a big data and artificial intelligence platform, and the like.
As shown in fig. 2, fig. 2 is a usage scenario diagram provided in an embodiment of the present application, where the target service data may be obtained from a terminal device operating a data warehouse based on a preset data obtaining rule, or may be obtained directly from a terminal device operating a service system, which is not limited herein.
As shown in fig. 1, the data checking method includes steps S101 to S106.
And S101, acquiring target service data based on a preset data acquisition rule.
In some embodiments, the data checking method further comprises: and acquiring the relevant data of the service, and storing the acquired relevant data of the service to a data warehouse. The acquiring the target service data based on the preset data acquisition rule includes: determining at least part of business related data in the data warehouse as the target business data based on a preset data acquisition rule; and acquiring the target business data from the data warehouse.
Illustratively, the business related data is stored in a data warehouse and is acquired from the data warehouse according to a preset data acquisition rule when the data warehouse is checked, so that the workload of manually inputting the business data is reduced, and the business related data can be directly searched and acquired from the data warehouse when the data warehouse is subsequently checked. The service related data refers to data generated in the operation process of the service system.
For example, the preset data acquisition rule may be used to indicate a storage location of the target business data that needs to be acquired, such as a destination table and a data item of the target business data in a data warehouse.
For example, the preset data obtaining rule may be set by a user, or may be automatically generated according to a requirement of a check rule on the target service data. For example, if the target service data related to the checking rule is a tax amount in the policy basic information table, the preset data obtaining rule may be: and acquiring business data of which the target table is a policy basic information table and the data item is a tax amount from the data warehouse. According to the requirement of the preset checking rule on the target service data, the data acquisition rule is automatically generated, the time for setting the data acquisition rule is saved, and the data checking efficiency is improved.
In some embodiments, the determining, based on a preset data obtaining rule, at least part of the business-related data in the data warehouse as the target business data includes: and determining the corresponding business related data in the data warehouse as the target business data according to the table name and the data item name in the preset data acquisition rule.
Illustratively, the data warehouse comprises at least one destination table composed of business-related data, such as a policy basic information table, a policy clause information table, a correction information table, a charging list and the like; the at least one destination table composed of business related data includes at least one data item for storing business related data, for example, insurance agency codes, tax amount, etc. may be included in the policy basic information table. The business related data is stored in the data warehouse, and the structure is simpler compared with that of the table stored in the operation type database, so that the later inquiry and the acquisition of the target business data are facilitated.
And S102, processing the target service data based on a preset data processing rule to obtain supervision data.
Illustratively, the data processing rule includes at least one of data export, conversion, splitting, encryption, compression and the like of the service data. And generating the supervision data based on the data processing rule, so that the time for manually processing the service data is saved, and the checking efficiency is improved.
For example, the preset data obtaining rule may be set by a user, or may be automatically generated according to the requirement of the checking rule on the supervision data. For example, if the preset checking rule is: the tax amount in the policy basic information table should be equal to the sum of the tax amounts in the policy term information table, and the preset data processing rule may be: and summing the tax amount in the policy clause information table.
And S103, checking the supervision data based on a preset checking rule.
For example, the preset checking rule may be preset according to an actual requirement, and for example, the checking rule may be: the tax amount in the basic information table of the policy should be equal to the sum of the tax amounts in the terms information table of the policy. By presetting the checking rules and automatically checking the supervision data based on the preset checking rules, the time for manually checking the supervision data is saved, the checking efficiency is improved, and the condition that the manual checking is wrong is avoided.
In some embodiments, the method further comprises: and when the checking rule is changed, determining the preset data acquisition rule and the preset data processing rule according to the changed checking rule. According to the changed checking rule, the corresponding data acquisition rule and the corresponding data processing rule are automatically determined, so that the time for correspondingly modifying the data acquisition rule and the data processing rule when the checking rule is modified is saved, and the data checking efficiency is improved.
And step S104, if the supervision data does not pass the checking, based on the checking rule, adjusting the data acquisition rule so as to obtain and process the target service data and check the supervision data again according to the adjusted data acquisition rule.
For example, if the supervision data does not meet the requirement of the preset checking rule, that is, the supervision data does not pass the checking, it may be determined that the supervision data generated according to the data acquisition rule and the data processing rule is incorrect, and the acquisition of the target service data and the generation of the supervision data need to be performed again.
Illustratively, adjusting the data acquisition rule based on the checking rule includes: and adjusting the identification of the target service data in the data acquisition rule according to the service related data related to the preset check rule.
For example, if the checking rule is: the amount of tax in the basic information table of the policy should be equal to the sum of the amounts of tax in the information table of the terms of the policy, and the supervision data is not checked, which may be because the data items related to the amount of tax in the information table of the terms of the policy in the business-related data are increased or decreased, for example, the original data acquisition rule is to acquire 3 data items related to the amount of tax in the information table of the terms of the policy in the business-related data, and the adjusted data acquisition rule is to acquire 4 data items related to the amount of tax in the information table of the terms of the policy in the business-related data.
By adjusting the identification of the target service data in the data acquisition rule according to the service-related data related to the preset checking rule, the service-related data which does not pass the checking can be automatically processed, the labor cost in the data checking process is reduced, and the data checking efficiency is improved.
In some embodiments, adjusting the data acquisition rule based on the checking rule further comprises: outputting the adjusted data acquisition rule through a human-computer interaction interface; when determining operation of the user on the adjusted data acquisition rule is acquired, determining the adjusted data acquisition rule; and when the modification operation of the user on the adjusted data acquisition rule is acquired, modifying the adjusted data acquisition rule according to the modification operation. The adjusted data acquisition rule is displayed to the user on the human-computer interaction interface, so that the user can determine or modify the adjusted data acquisition rule, the error of the adjusted data acquisition rule is avoided, and the data checking efficiency is improved.
For the supervision data which is not checked, the data acquisition rule is automatically adjusted, so that the corresponding target business data does not need to be manually determined by the data checking staff according to the supervision data which is not checked, the time and labor cost required by data checking are reduced, and the checking efficiency is improved.
Optionally, as shown in fig. 3, if the supervision data fails to pass the checking, the acquisition of the target service data and the generation of the supervision data may be performed again, so that time for manually processing the supervision data that fails to be checked is saved, and the efficiency of data checking is improved.
In some embodiments, after the adjusting the data obtaining rule based on the checking rule if the supervision data fails to be checked, the method further includes: based on the adjusted data acquisition rule, acquiring target service data again; regenerating supervision data according to the newly acquired target service data based on the preset data processing rule; and checking the regenerated supervision data based on the preset checking rule.
For example, if the regenerated supervision data fails to be checked, the operations of step S101 to step S103 are performed again, and will not be described here.
For example, if the number of times that the supervision data fails to be checked is greater than a preset value, the checking is suspended and alarm information for indicating that the supervision data fails to be checked is sent to a worker, so that the worker can process the supervision data that fails to be checked and/or modify a data acquisition rule related to the checking rule.
And S105, if the supervision data passes the checking, generating a supervision result according to the supervision data.
For example, if the supervision data meets the requirement of the checking rule, that is, the supervision data passes the checking, a supervision result is generated according to the supervision data.
Illustratively, the supervision result includes supervision end state data, which is data generated from the supervision data that conforms to the supervision system submission specification.
And S106, outputting a checking report according to the supervision result, wherein the checking report comprises the supervision result.
Illustratively, the check report includes the supervision result, the check rule, the check failure times, and the like. And outputting a checking report to the terminal equipment so that a worker for data checking can know the data checking condition.
Illustratively, a checking report is output according to the supervision result so as to clearly and intuitively display the supervision result.
In some embodiments, the method further comprises: and sending the supervision final state data to the supervision system. The automatically generated final supervision state data are sent to the supervision system to complete data reporting, so that the manual reporting time is saved, the data checking efficiency is improved, and the condition that manual operation is wrong is avoided.
In the data checking method provided in the above embodiment, the target service data is acquired based on a preset data acquisition rule; processing the target service data based on a preset data processing rule to obtain supervision data; checking the supervision data based on a preset checking rule; if the supervision data does not pass the check, based on the check rule, adjusting the data acquisition rule so as to obtain and process the target service data and check the supervision data again according to the adjusted data acquisition rule; if the supervision data passes the check, generating a supervision result according to the supervision data; and outputting a checking report according to the supervision result, wherein the checking report comprises the supervision result. The service data is automatically checked, data which cannot be checked is automatically processed, a checking report is generated, and the data checking efficiency is improved.
Referring to fig. 4, fig. 4 is a schematic diagram of a data checking apparatus according to an embodiment of the present disclosure, where the data checking apparatus may be configured in a server or a terminal, and is used to execute the foregoing data checking method.
As shown in fig. 4, the data processing apparatus includes: the system comprises a business data acquisition module 110, a business data processing module 120, a supervision data checking module 130, an acquisition rule adjustment module 140, a supervision result generation module 150 and a checking report output module 160.
A service data obtaining module 110, configured to obtain target service data based on a preset data obtaining rule;
a service data processing module 120, configured to process the target service data based on a preset data processing rule to obtain supervision data;
the supervision data checking module 130 is configured to check the supervision data based on a preset checking rule;
an obtaining rule adjusting module 140, configured to adjust the data obtaining rule based on the checking rule if the supervision data fails to be checked, so as to obtain and process the target service data and check the supervision data again according to the adjusted data obtaining rule;
and a supervision result generating module 150, configured to generate a supervision result according to the supervision data if the supervision data passes the check.
A checking report output module 160, configured to output a checking report according to the supervision result, where the checking report includes the supervision result.
Illustratively, the data processing apparatus further comprises a rule determination sub-module.
And the rule determining submodule is used for determining the preset data acquisition rule and the preset data processing rule according to the changed checking rule when the checking rule is changed.
Illustratively, the obtaining rule adjusting module 140 further includes a target business data adjusting submodule.
And the target service data adjusting submodule is used for adjusting the identification of the target service data in the data acquisition rule according to the service related data related to the preset check rule.
Illustratively, the data processing device further comprises a man-machine interaction sub-module, an acquisition rule determining sub-module and an acquisition rule modifying sub-module.
And the man-machine interaction submodule is used for outputting the adjusted data acquisition rule through a man-machine interaction interface.
And the acquisition rule determining submodule is used for determining the adjusted data acquisition rule when the determination operation of the user on the adjusted data acquisition rule is acquired.
And the acquisition rule modification sub-module is used for modifying the adjusted data acquisition rule according to the modification operation when the modification operation of the user on the adjusted data acquisition rule is acquired.
Illustratively, the data processing apparatus further includes a service data reacquiring sub-module, a service data reprocessing sub-module, and a supervision data review sub-module.
And the service data reacquisition submodule is used for reacquiring the target service data based on the adjusted data acquisition rule.
And the service data reprocessing sub-module is used for regenerating supervision data according to the target service data which is obtained again based on the preset data processing rule.
And the supervision data rechecking and checking sub-module is used for checking the regenerated supervision data based on the preset checking rule.
Illustratively, the data processing device further comprises a business-related data storage submodule.
And the service related data storage submodule is used for acquiring service related data and storing the acquired service related data to a data warehouse.
Illustratively, the service data acquiring module 110 includes a target service data determining sub-module and a target service data acquiring sub-module.
And the target business data determining submodule is used for determining at least part of business related data in the data warehouse as the target business data based on a preset data acquisition rule.
And the target business data acquisition submodule is used for acquiring the target business data from the data warehouse.
Illustratively, the target business data determination submodule includes a data location determination submodule.
And the data position determining submodule is used for determining corresponding business related data in the data warehouse as the target business data according to the table name and the data item name in the preset data acquisition rule.
It should be noted that, as will be clear to those skilled in the art, for convenience and brevity of description, the specific working processes of the apparatus, the modules and the units described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The application is operational with numerous general purpose or special purpose computing system environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet-type devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like. The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The above-described methods and apparatuses may be implemented, for example, in the form of a computer program that can be run on a computer device as shown in fig. 5.
Referring to fig. 5, fig. 5 is a schematic block diagram of a computer device according to an embodiment of the present disclosure. The computer device may be a server or a terminal.
As shown in fig. 5, the computer device includes a processor, a memory, and a network interface connected by a system bus, wherein the memory may include a storage medium and an internal memory.
The storage medium may store an operating system and a computer program. The computer program comprises program instructions which, when executed, cause a processor to perform any of the data detection methods.
The processor is used for providing calculation and control capability and supporting the operation of the whole computer equipment.
The internal memory provides an environment for the execution of a computer program on a storage medium, which when executed by a processor causes the processor to perform any of a variety of data detection methods.
The network interface is used for network communication, such as sending assigned tasks and the like. Those skilled in the art will appreciate that the architecture shown in fig. 5 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
It should be understood that the Processor may be a Central Processing Unit (CPU), and the Processor may be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, etc. Wherein a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
Wherein, in one embodiment, the processor is configured to execute a computer program stored in the memory to implement the steps of:
acquiring target service data based on a preset data acquisition rule;
processing the target service data based on a preset data processing rule to obtain supervision data;
checking the supervision data based on a preset checking rule;
if the supervision data does not pass the check, based on the check rule, adjusting the data acquisition rule so as to obtain and process the target service data and check the supervision data again according to the adjusted data acquisition rule;
if the supervision data passes the check, generating a supervision result according to the supervision data;
and outputting a checking report according to the supervision result, wherein the checking report comprises the supervision result.
In some embodiments, the processor, when implementing the data checking method, is configured to implement:
and when the checking rule is changed, determining the preset data acquisition rule and the preset data processing rule according to the changed checking rule.
In some embodiments, the processor, when implementing the adjusting the data acquisition rule based on the checking rule, is configured to implement:
and adjusting the identification of the target service data in the data acquisition rule according to the service related data related to the preset check rule.
In some embodiments, the processor, when implementing the data checking method, is configured to implement:
outputting the adjusted data acquisition rule through a human-computer interaction interface;
when determining operation of the user on the adjusted data acquisition rule is acquired, determining the adjusted data acquisition rule;
and when the modification operation of the user on the adjusted data acquisition rule is acquired, modifying the adjusted data acquisition rule according to the modification operation.
In some embodiments, the processor, when implementing the data checking method, is configured to implement:
based on the adjusted data acquisition rule, acquiring target service data again;
regenerating supervision data according to the newly acquired target service data based on the preset data processing rule;
and checking the regenerated supervision data based on the preset checking rule.
In some embodiments, the processor, when implementing the data checking method, is configured to implement:
acquiring service related data and storing the acquired service related data to a data warehouse;
determining at least part of business related data in the data warehouse as the target business data based on a preset data acquisition rule;
and acquiring the target business data from the data warehouse.
In some embodiments, the processor, when implementing the preset data obtaining rule, is configured to implement:
and determining the corresponding business related data in the data warehouse as the target business data according to the table name and the data item name in the preset data acquisition rule.
It should be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the data processing described above may refer to the corresponding process in the foregoing data checking control method embodiment, and details are not described herein again.
Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, where the computer program includes program instructions, and a method implemented when the program instructions are executed may refer to the embodiments of the data checking method in the present application.
The computer-readable storage medium may be an internal storage unit of the computer device described in the foregoing embodiment, for example, a hard disk or a memory of the computer device. The computer readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the computer device.
It is to be understood that the terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items. It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments. While the invention has been described with reference to specific embodiments, the scope of the invention is not limited thereto, and those skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A method of data inspection, the method comprising:
acquiring target service data based on a preset data acquisition rule;
processing the target service data based on a preset data processing rule to obtain supervision data;
checking the supervision data based on a preset checking rule;
if the supervision data does not pass the check, based on the check rule, adjusting the data acquisition rule so as to obtain and process the target service data and check the supervision data again according to the adjusted data acquisition rule;
if the supervision data passes the check, generating a supervision result according to the supervision data;
and outputting a checking report according to the supervision result, wherein the checking report comprises the supervision result.
2. A method of data inspection according to claim 1, the method further comprising:
and when the checking rule is changed, determining the preset data acquisition rule and the preset data processing rule according to the changed checking rule.
3. The data checking method according to claim 1, wherein the adjusting the data obtaining rule based on the checking rule comprises:
and adjusting the identification of the target service data in the data acquisition rule according to the service related data related to the preset check rule.
4. The method according to claim 3, wherein after the adjusting the data obtaining rule based on the checking rule if the supervisory data fails to be checked, further comprising:
outputting the adjusted data acquisition rule through a human-computer interaction interface;
when determining operation of the user on the adjusted data acquisition rule is acquired, determining the adjusted data acquisition rule;
and when the modification operation of the user on the adjusted data acquisition rule is acquired, modifying the adjusted data acquisition rule according to the modification operation.
5. A method for data inspection according to any of claims 1-4, wherein after said adjusting said data acquisition rule based on said inspection rule if said supervisory data fails to be inspected, further comprising:
based on the adjusted data acquisition rule, acquiring target service data again;
regenerating supervision data according to the newly acquired target service data based on the preset data processing rule;
and checking the regenerated supervision data based on the preset checking rule.
6. The data checking method according to any one of claims 1 to 4, wherein before the acquiring the target business data based on the preset data acquisition rule, the method further comprises:
acquiring service related data and storing the acquired service related data to a data warehouse;
the acquiring the target service data based on the preset data acquisition rule includes:
determining at least part of business related data in the data warehouse as the target business data based on a preset data acquisition rule;
and acquiring the target business data from the data warehouse.
7. The data checking method according to claim 6, wherein the determining at least part of the business-related data in the data warehouse as the target business data based on a preset data obtaining rule comprises:
and determining the corresponding business related data in the data warehouse as the target business data according to the table name and the data item name in the preset data acquisition rule.
8. A data checking apparatus, characterized in that the data checking apparatus comprises:
the service data acquisition module is used for acquiring target service data based on a preset data acquisition rule;
the service data processing module is used for processing the target service data based on a preset data processing rule to obtain supervision data;
the supervision data checking module is used for checking the supervision data based on a preset checking rule;
the acquisition rule adjusting module is used for adjusting the data acquisition rule based on the checking rule if the supervision data does not pass the checking, so as to obtain and process the target service data and check the supervision data again according to the adjusted data acquisition rule;
and the supervision result generation module is used for generating a supervision result according to the supervision data if the supervision data passes the check.
And the checking report output module is used for outputting a checking report according to the supervision result, and the checking report comprises the supervision result.
9. A computer arrangement comprising a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, implements the steps of the data checking method according to any one of claims 1 to 7.
10. A computer-readable storage medium, having a computer program stored thereon, wherein the computer program, when being executed by a processor, carries out the steps of the data checking method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111158201.0A CN113821575B (en) | 2021-09-30 | 2021-09-30 | Data checking method, device, equipment and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111158201.0A CN113821575B (en) | 2021-09-30 | 2021-09-30 | Data checking method, device, equipment and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113821575A true CN113821575A (en) | 2021-12-21 |
| CN113821575B CN113821575B (en) | 2024-04-12 |
Family
ID=78919844
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111158201.0A Active CN113821575B (en) | 2021-09-30 | 2021-09-30 | Data checking method, device, equipment and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113821575B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150293969A1 (en) * | 2014-04-14 | 2015-10-15 | Michael Aakolk | In-memory based database view for a business rule management application |
| CN108595597A (en) * | 2018-04-19 | 2018-09-28 | 平安科技（深圳）有限公司 | Data lead-in method, device, computer equipment and storage medium |
| CN111047431A (en) * | 2019-12-11 | 2020-04-21 | 深圳微众信用科技股份有限公司 | Credit service processing device, method and equipment based on big data |
| CN112465656A (en) * | 2020-12-08 | 2021-03-09 | 中国人寿保险股份有限公司 | Insurance detail data sending method and device |
| CN112990741A (en) * | 2021-03-31 | 2021-06-18 | 建信金融科技有限责任公司 | Workload assessment method, device, equipment and storage medium |
-
2021
- 2021-09-30 CN CN202111158201.0A patent/CN113821575B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150293969A1 (en) * | 2014-04-14 | 2015-10-15 | Michael Aakolk | In-memory based database view for a business rule management application |
| CN108595597A (en) * | 2018-04-19 | 2018-09-28 | 平安科技（深圳）有限公司 | Data lead-in method, device, computer equipment and storage medium |
| CN111047431A (en) * | 2019-12-11 | 2020-04-21 | 深圳微众信用科技股份有限公司 | Credit service processing device, method and equipment based on big data |
| CN112465656A (en) * | 2020-12-08 | 2021-03-09 | 中国人寿保险股份有限公司 | Insurance detail data sending method and device |
| CN112990741A (en) * | 2021-03-31 | 2021-06-18 | 建信金融科技有限责任公司 | Workload assessment method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113821575B (en) | 2024-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109241068B (en) | Method and device for comparing foreground and background data and terminal equipment | |
| WO2016141491A1 (en) | Systems and methods for managing data | |
| WO2019006654A1 (en) | Financial self-service equipment maintenance dispatch generation method, hand-held terminal and electronic device | |
| US20120116984A1 (en) | Automated evaluation of compliance data from heterogeneous it systems | |
| CN110597511B (en) | Page automatic generation method, system, terminal equipment and storage medium | |
| CN112183782B (en) | Fault work order processing method and equipment | |
| CN111258832B (en) | Interface parameter verification method, device, equipment and medium | |
| CN107133233B (en) | Processing method and device for configuration data query | |
| US8484724B2 (en) | User permissions in computing systems | |
| CN110851298A (en) | Abnormality analysis and processing method, electronic device, and storage medium | |
| CN112598513A (en) | Method and device for identifying shareholder risk transaction behavior | |
| CN111680104A (en) | Data synchronization method and device, computer equipment and readable storage medium | |
| CN114168682A (en) | Data auditing method, device, equipment and storage medium | |
| CN113902574A (en) | Protocol data processing method, device, computer equipment and storage medium | |
| CN106708869B (en) | Group data processing method and device | |
| CN110704273B (en) | Processing method and device of configuration information, electronic equipment and storage medium | |
| CN112491649A (en) | Interface joint debugging test method and device, electronic equipment and storage medium | |
| CN111640031A (en) | Cross-system claim settlement data processing method and device and related equipment | |
| CN111353763A (en) | Method, device, server and storage medium for processing data | |
| CN113821575A (en) | Data checking method, device and equipment and computer storage medium | |
| CN109828884B (en) | Hanging service data processing method, system, computer equipment and storage medium | |
| CN113515510A (en) | Data processing method, data processing system, electronic device and readable storage medium | |
| CN103778584A (en) | Patent fee auditing system and method | |
| CN108255629B (en) | Breakpoint data obtaining method and terminal equipment | |
| CN111026763A (en) | Data processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240131 Address after: Room 401, Unit 5, Building 4, No. 57 Tailin Road, Xincheng Office, Feicheng City, Tai'an City, Shandong Province, 271600 Applicant after: Li Jian Country or region after: China Address before: 518000 Room 201, building A, No. 1, Qian Wan Road, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong (Shenzhen Qianhai business secretary Co., Ltd.) Applicant before: PING AN PUHUI ENTERPRISE MANAGEMENT Co.,Ltd. Country or region before: China |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240407 Address after: Room 1322, Building A, Hisense Tianchen 9, 299 Tianchen Road, Jinan Area, China (Shandong) Pilot Free Trade Zone, Jinan City, Shandong Province, 250000 Applicant after: Shandong Huashu Information Technology Co.,Ltd. Country or region after: China Address before: Room 401, Unit 5, Building 4, No. 57 Tailin Road, Xincheng Office, Feicheng City, Tai'an City, Shandong Province, 271600 Applicant before: Li Jian Country or region before: China |
|
| TA01 | Transfer of patent application right |