CN112015739A - Data verification and data query method and device - Google Patents
Data verification and data query method and device Download PDFInfo
- Publication number
- CN112015739A CN112015739A CN202010964402.9A CN202010964402A CN112015739A CN 112015739 A CN112015739 A CN 112015739A CN 202010964402 A CN202010964402 A CN 202010964402A CN 112015739 A CN112015739 A CN 112015739A
- Authority
- CN
- China
- Prior art keywords
- service
- data
- archive
- field
- fields
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013524 data verification Methods 0.000 title claims abstract description 91
- 238000000034 method Methods 0.000 title claims abstract description 69
- 238000012795 verification Methods 0.000 claims abstract description 17
- 238000004590 computer program Methods 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 12
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 238000013502 data validation Methods 0.000 claims 10
- 238000010200 validation analysis Methods 0.000 claims 2
- 230000008569 process Effects 0.000 description 16
- 238000010586 diagram Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 9
- 230000006872 improvement Effects 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 229920001296 polysiloxane Polymers 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/03—Credit; Loans; Processing thereof
Abstract
The embodiment of the specification provides a data verification method and a data query method and device. The method comprises the following steps: acquiring one or more archive tables, wherein the archive tables are generated according to original data tables corresponding to data sources determined by a preset service; performing data verification operation on service fields from the same archive table or service fields from among a plurality of archive tables according to a pre-configured data verification rule to obtain a data verification result; and the data verification rule is configured according to the business meaning corresponding to the business field. The technical scheme can be applied to the supervision field, and can realize the verification of the service data before the supervision indexes are output.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a method and an apparatus for data verification and data query.
Background
With the rapid development of network and information technology, the need of governing data generated in the business operation process by various industries is more and more obvious, and the report is a common data display form for collecting and summarizing business data or operation data. The report is subjected to data verification by using the business rules configured by the user, so that some problems in the report can be found, and the problem of compliance is avoided.
In the prior art, taking a supervision data reporting scene as an example, indexes in a report are usually checked after the report is produced, so as to verify whether supervision data is in compliance, but when some reasons of data sources in a business system cause inaccurate produced indexes and further cause the supervision data to check errors, data check needs to be performed again before the index is produced, so that the efficiency of data check is reduced, and the situation of supervision penalty caused by inaccurate supervision indexes is increased.
Disclosure of Invention
The embodiment of the specification provides a data verification method and a data query method and device, and aims to solve the problem that in the prior art, the data verification efficiency is reduced due to the fact that indexes are inaccurate due to the fact that original data cannot be perceived in advance.
In order to solve the above technical problem, the embodiments of the present specification are implemented as follows:
in a first aspect, a data verification method provided in an embodiment of the present specification includes:
acquiring one or more archive tables, wherein the archive tables are generated according to original data tables corresponding to data sources determined by a preset service;
performing data verification operation on service fields from the same archive table or service fields from among a plurality of archive tables according to a pre-configured data verification rule to obtain a data verification result; and the data verification rule is configured according to the business meaning corresponding to the business field.
In a second aspect, a data query method provided in an embodiment of the present specification, the method includes:
receiving a user query request;
and executing data query operation on a preset archive table according to the user query request, wherein the archive table is generated according to an original data table corresponding to the data source determined by the preset service.
In a third aspect, an embodiment of the present specification provides a data verification apparatus, including:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring one or more archive tables, and the archive tables are generated according to an original data table corresponding to a data source determined by a preset service;
the verification module is used for performing data verification operation on the service fields from the same archive table or the service fields from among a plurality of archive tables according to a pre-configured data verification rule to obtain a data verification result; and the data verification rule is configured according to the business meaning corresponding to the business field.
In a fourth aspect, an embodiment of the present specification provides a data query apparatus, including:
the receiving module is used for receiving a user query request;
and the query module is used for executing data query operation on a preset archive table according to the user query request, wherein the archive table is generated according to an original data table corresponding to a data source determined by a preset service.
In a fifth aspect, an electronic device provided in an embodiment of the present specification includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements a data verification method in the first aspect when executing the program.
In a sixth aspect, an electronic device provided in an embodiment of the present specification includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement a data query method in the second aspect.
The embodiment of the specification adopts at least one technical scheme which can achieve the following beneficial effects:
acquiring one or more archive tables, wherein the archive tables are generated according to original data tables corresponding to data sources determined by a preset service; performing data verification operation on service fields from the same file table or service fields from among a plurality of file tables according to a pre-configured data verification rule to obtain a data verification result; the data verification rule is configured according to the business meaning corresponding to the business field. Based on the scheme, the data check rule can be configured in advance according to the business meaning of the business field before the index is output according to the archive table, and the data check is carried out on the business field in the archive table by using the data check rule, so that the problem that the supervision index is inaccurate due to the data source is found in advance before the index is output, the data problem in the data source is found and solved in advance, the problem that the supervision penalty is suffered due to inaccurate produced supervision indexes is avoided, and the supervision data check efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present specification, and for those skilled in the art, other drawings can be obtained according to the drawings without any creative effort.
Fig. 1 is a schematic flowchart of a data processing rule generating method according to a first embodiment of the present disclosure;
fig. 2 is a schematic flowchart of a data processing rule generating method provided in the second embodiment of the present specification;
fig. 3 is a schematic structural diagram of a data processing rule generating device provided in an embodiment of the present specification;
fig. 4 is a schematic structural diagram of another data processing rule generating device provided in an embodiment of this specification.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any inventive step based on the embodiments of the present disclosure, shall fall within the scope of protection of the present application.
As described above, in the field of financial supervision and delivery, it is common to check the supervision index data after the supervision report is generated, that is, in the prior art, after the index is obtained from the big data, the index data is filled into the supervision report and then checked. However, in this data verification method, when a problem of inaccurate supervision indexes of output due to data sources occurs, for example, the problem of inaccurate supervision indexes due to non-uniform service standards or low quality of source data exists in a plurality of data sources, it is often necessary to trace back to before the output of the supervision indexes, check the data fields in the data sources to solve the data quality problem, and produce new supervision indexes again. Obviously, the method cannot find the problem of inaccurate produced indexes caused by the problem of the data source in advance before the indexes are produced, so that the situation that the supervision indexes are inaccurate caused by the problem of the business data, and further, the compliance penalty or the supervision penalty occurs cannot be avoided.
Based on the problems in the prior art, in the embodiment of the present specification, before the index is output according to the archive table, the archive table generated by using the service field in the data source is subjected to data verification, so that the problem of inaccurate index caused by the source data or the archive itself can be found in advance, and the service data in the data source is further treated in advance, so that the problem of inaccurate supervision index when the supervision index is output by using the service data is avoided, and the situation that supervision penalty is incurred due to non-compliance in supervision index due to the quality problem of the original service data is avoided.
Based on the above background, the following description is needed for the application scenario of the present solution, and since the embodiment of the present specification is described in detail by taking a data verification operation in the reporting process of a supervision report in the supervision field as an example, in the following embodiment, data may be regarded as business data in supervision reporting, and a user may be regarded as a person in a financial institution responsible for supervision reporting or data governance. The application scenario of the scheme is not limited by the scenario, the technical scheme is not limited in the field of financial supervision, and other technical scenarios related to checking the business rules of the data are possibly applicable to the scheme.
Based on the above-described scenarios, the following describes the embodiments of the present specification in detail.
Fig. 1 is a schematic flow chart of a data verification method provided in an embodiment of the present disclosure, where the method specifically includes the following steps:
in step S110, one or more archive tables are obtained, wherein the archive tables are generated according to the original data table corresponding to the data source determined by the predetermined service.
In one or more embodiments of the present specification, the archive table may be considered as an archive generated by fusing data in a plurality of data sources, and the data source may be data (such as a data table) in a business system corresponding to a specific business, and the following detailed description of a process of generating an archive by fusing data in a plurality of data sources with reference to a specific embodiment may specifically include the following:
first, a file name is determined according to actual service requirements, the file name corresponds to the actual meaning of the fused service, for example, the file name may be the issuance and payment of a loan service, and each sub-service required for forming the service is determined according to the service flow of the service corresponding to the file name, for example, for the above-mentioned service, the following sub-services may be included: loan issuance service, loan repayment service, and the like; and then, searching a data source (namely an original data table) corresponding to each sub-service from the service system according to each sub-service, and fusing data tables (such as a loan issuing service data table, a loan repayment service data table and the like) corresponding to all the sub-services to generate a file table corresponding to the file name.
The sub-services can be regarded as a series of tasks associated with the services (services to be fused) corresponding to the file names, the data table corresponding to the sub-services can be a data table with external association of components, the data table corresponding to one sub-service can be regarded as one aspect of the service, and the data source based on the sub-services can access one sub-service. The data tables corresponding to the sub-services are fused, so that the plurality of sub-services are connected in series to form a complete service line, namely, the services are connected in series to form a complete service chain according to the flow through the fusion of the data tables, and thus, the data field corresponding to any sub-service in the service chain can be inquired through the fused archive table without respectively accessing the data sources of the sub-services in the service system.
Further, in this embodiment of the present specification, since the service fields in the archive are derived from different data sources (i.e., data tables corresponding to different sub-services), when selecting a corresponding data source according to each sub-service, a basic data platform accessed by each data source and a data access manner (e.g., API access) may be determined first, then the basic data platform of each data source is opened, and after accessing the platform of the data source, a table of basic data corresponding to the sub-service may be selected, so as to obtain the data table corresponding to each sub-service.
In practical application, when the data tables corresponding to all the sub-services are fused to generate the archive table, the fields in the data table of each sub-service are actually extracted, and the extracted fields are fused according to the service flow, so that the archive table can also be regarded as a larger data wide table consisting of the fields in the data tables of a plurality of sub-services; when extracting the fields in the data table of each sub-service, only part of the fields in the data table can be selected to be extracted, but not all the fields. The archive can directly store the business data field and also can store archive data processed by the business data field; since the archive is a wide table generated by fusing a plurality of data tables, the archive may also be regarded as a set of data tables, and the embodiment of the present specification is based on the verification of the business rule performed by the set of data tables, which is the archive.
It should be noted that, in the embodiment of the present specification, the checking and querying of the service data field are realized based on the archive table, and in an actual supervision and delivery scenario, the index is directly collected from the archive table, so that, in the embodiment, the operation of generating and acquiring the archive table is performed before the index is produced, and the checking of the service field in the archive table is also performed before the index is produced.
In step S120, according to a preconfigured data verification rule, performing a data verification operation on a service field from the same archive table or a service field from among a plurality of archive tables to obtain a data verification result; and the data verification rule is configured according to the business meaning corresponding to the business field.
In one or more embodiments of the present specification, since the service corresponding to each profile and the service fields included in each profile may be different, different verification rules may be configured according to the fields in each profile when configuring the data verification rules, and thus the verification rules configured for each profile may be different. In addition, the verification rule is set by the user according to reasonable business requirements, so the verification rule can also be regarded as a business rule. In this specification, a service field in an archive table may be considered as a field of service data, for example: merchant name, merchant number, merchant classification, and the like; the present specification is to perform the verification of the business rule based on the business field in the archive table, so the data verification may include the following two cases, and the following describes the data verification operation of the specific case with reference to the specific embodiment, and the specific content is as follows:
situation one
When the data verification rule is a data verification rule corresponding to a service field in the archive table, configuring the data verification rule according to a service meaning corresponding to the service field, including:
and establishing a data verification rule between the service fields in the file table or the service fields in the file table according to the preset service meaning corresponding to the service field and the data verification strategy of the service meaning corresponding to the service field in the file table.
Specifically, in the embodiment of this specification, when the data check rule performs the service rule check on the fields in the same archive table, the data check rule configured by the user should conform to the check policy of the service meaning corresponding to the fields in the archive table, which is exemplified below, for example: the file table A is a loan basic condition table, and fields in the file table contain the issued amount, so that a data verification rule corresponding to the service field of the issued amount in the file table can be established according to a data verification strategy set by a user (for example, the issued amount is greater than 0, the issued amount is an integer, the issued amount is lower than the per-capita credit amount and the like), and then the issued amount fields in the file table A are verified according to the configured data verification rule; for example, if the established data verification rule is that the per-person credit amount is 500 and the sending amount is not higher than the per-person credit amount, when the field value corresponding to a certain sending amount field in the archive table a is greater than 500, the field obviously does not conform to the business rule.
Situation two
When the data verification rule is a data verification rule corresponding to a service field among a plurality of archive tables, configuring the data verification rule according to a service meaning corresponding to the service field, including:
and establishing a data verification rule between the service fields of different file tables according to the service meaning corresponding to the preset service field and the data verification strategy of the service meaning corresponding to the service field between different file tables.
Specifically, in the embodiment of the present specification, the operation of configuring the data check rule and checking the fields in the archive table in case two is similar to that in case one described above, except that the data check rule configured in case two is for the business check between different archive tables, that is, the configuration of the cross-archive data check rule in case two. The following describes a configuration process of cross-file verification rules with reference to specific embodiments, for example: for example, when one file table is a loan issuance table, the other file table is a loan repayment table, the loan issuance table contains a loan issuance amount field, and the loan repayment table contains a loan repayment amount field, at this time, a data verification rule between the two file tables can be established, for example, the data verification rule is that "the loan issuance amount is equal to the loan repayment amount", and when the data verification rule between the two file tables is established, the corresponding fields in the two file tables can be selected, and the verification rule between the fields can be established.
Further, in the embodiment of the present specification, after the archive table is produced, the operation of performing data verification on the service fields in the archive table or the service fields between multiple archive tables is automatically performed according to the pre-configured data verification rule. The archive table can be produced by day or month, and the preset verification rule can be automatically triggered after the archive table is produced.
In practical application, a user can freely and reasonably configure a data verification rule (namely, a business verification rule) according to actual business requirements, business logic rules and a file list, and after the user configures the data verification rule into a system, the user can automatically execute verification operation according to the configured data verification rule after a file is generated in the system, so as to output a verification result.
In the first embodiment of the present specification, before the index is generated, a file table capable of representing a complete service line is generated based on fusion of data tables corresponding to a plurality of sub-services, the file table includes a plurality of service fields, and a user reasonably configures a data verification rule according to a service requirement and the service fields, so that the service rules are verified for the service fields in the file table or the service fields across the file table by using the configured data verification rule. The embodiment of the specification checks the source data before the index is output, so that the problem that the original service data has a problem, which causes the inaccurate produced index, is avoided, the effect on the compliance review of the supervision report after the index is filled is caused, and the problem that the supervision penalty is caused due to the inaccurate supervision index is avoided.
The above embodiment is an explanation of a process of checking data in an archive table, and a data query process based on the archive table generated in the first embodiment will be explained below, as shown in fig. 2, which shows a flow diagram of a data query method provided in the second embodiment of this specification, where the method specifically includes the following steps:
in step S210, a user query request is received.
In one or more embodiments of the present specification, a user may perform a query of data through a visualization interface, and the concept of the user in this embodiment is the same as that in the first embodiment. When a user inquires data, the user can directly input fields capable of visually representing business meanings in a page, for example, the user can input the following fields: merchant name, loan amount, loan interest rate, etc.; and when the user selects the query field through the page, the user sees the field with the meaning of the visual business data.
In step S220, a data query operation is performed on a predetermined profile table according to the user query request, wherein the profile table is generated according to an original data table corresponding to a data source determined by a predetermined service.
In one or more embodiments of the present specification, the generation and configuration processes of the archive table are completely the same as the operations in the first embodiment, and therefore, no further description is given in this embodiment, and details of the specific implementation process of generating the archive table according to the data source (i.e., the original data table) in the service system may be referred to in the foregoing embodiments.
Further, in this embodiment of the present specification, the archive table may also not include the service data with the specific service meaning, but store the service name and the data field corresponding to the original service data, and after fusing the data tables to generate the archive table, convert the service name and the data field in the archive table to obtain the converted field capable of visually representing the service meaning, and establish a matching relationship between the service field in the archive table and the field with the service meaning.
After the matching relationship is established, after a user directly inputs a field with business meaning through a page, the business field input by the user can be inquired according to the matching relationship to obtain the field with business meaning corresponding to the business field input by the user, and the business detail corresponding to the field with business meaning is used as a data inquiry result.
For example, in a specific embodiment, a field input by a user is a "xxx merchant", the system may determine field data before conversion corresponding to the field according to the field query matching relationship, obtain business data related to the field from big data, and present the converted field having business meaning corresponding to the obtained business data to the user, for example, present detailed information such as a merchant name, merchant basic information, penalty information, and additional information to the user.
In the embodiment of the description, the mapping relation among the business name, the data field and the real data in the big data is defined, the business data field inquired by the user is obtained from the big data according to the mapping relation, and the detailed information with the business meaning is displayed to the user. The technical language data is displayed in a business mode and a supervision mode through the configuration file, so that a user can understand the technical language data conveniently; the user does not need to fill in SQL access sentences to access the database for query, so that the business side can conveniently understand data query operation, the business side does not need to solve the source and difference of the underlying data, and the learning cost is reduced.
Based on the same idea, an embodiment of the present specification further provides a data verification apparatus, and as shown in fig. 3, the apparatus 300 mainly includes:
an obtaining module 301, configured to obtain one or more archive tables, where the archive tables are generated according to an original data table corresponding to a data source determined by a predetermined service;
the verification module 302 is configured to perform data verification operation on the service fields from the same archive table or the service fields from among multiple archive tables according to a preconfigured data verification rule to obtain a data verification result; and the data verification rule is configured according to the business meaning corresponding to the business field.
Further, in this embodiment of the present specification, the service is formed by fusing a plurality of sub-services according to a service flow, and the apparatus further includes:
a generating module 303, configured to determine, according to a service flow of the service, each sub-service constituting the service, determine, according to the sub-service, a data source in a service system corresponding to the sub-service, and generate the archive table according to a service field in an original data table corresponding to the data source of each sub-service.
Based on the same idea, the embodiment of the present specification further provides a data query apparatus, and as shown in fig. 4, a schematic structural diagram of the data query apparatus provided in the embodiment of the present specification is provided, the apparatus 400 mainly includes:
a receiving module 401, configured to receive a user query request;
a query module 402, configured to perform a data query operation on a predetermined archive table according to the user query request, where the archive table is generated according to an original data table corresponding to a data source determined by a predetermined service.
Further, in this embodiment of the present specification, the service is formed by fusing a plurality of sub-services according to a service flow, and the apparatus further includes:
a generating module 403, configured to determine, according to a service flow of the service, each sub-service constituting the service, determine, according to the sub-service, a data source in a service system corresponding to the sub-service, and generate the archive table according to a service field in an original data table corresponding to the data source of each sub-service.
Further, in the embodiment of the present specification, the apparatus further includes:
a converting module 404, configured to convert the service field in the archive table after the archive table is generated, obtain a converted field with a service meaning, and establish a matching relationship between the service field in the archive table and the field with the service meaning.
The embodiment of the present specification further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the data verification method in the first embodiment is implemented.
The embodiment of the present specification further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor executes the computer program to implement the data query method in the second embodiment.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the embodiments of the apparatus, the electronic device, and the nonvolatile computer storage medium, since they are substantially similar to the embodiments of the method, the description is simple, and the relevant points can be referred to the partial description of the embodiments of the method.
The apparatus, the electronic device, the nonvolatile computer storage medium and the method provided in the embodiments of the present description correspond to each other, and therefore, the apparatus, the electronic device, and the nonvolatile computer storage medium also have similar advantageous technical effects to the corresponding method.
In the 90 s of the 20 th century, improvements in a technology could clearly distinguish between improvements in hardware (e.g., improvements in circuit structures such as diodes, transistors, switches, etc.) and improvements in software (improvements in process flow). However, as technology advances, many of today's process flow improvements have been seen as direct improvements in hardware circuit architecture. Designers almost always obtain the corresponding hardware circuit structure by programming an improved method flow into the hardware circuit. Thus, it cannot be said that an improvement in the process flow cannot be realized by hardware physical modules. For example, a Programmable Logic Device (PLD), such as a Field Programmable Gate Array (FPGA), is an integrated circuit whose Logic functions are determined by programming the Device by a user. A digital system is "integrated" on a PLD by the designer's own programming without requiring the chip manufacturer to design and fabricate application-specific integrated circuit chips. Furthermore, nowadays, instead of manually making an Integrated Circuit chip, such Programming is often implemented by "logic compiler" software, which is similar to a software compiler used in program development and writing, but the original code before compiling is also written by a specific Programming Language, which is called Hardware Description Language (HDL), and HDL is not only one but many, such as abel (advanced Boolean Expression Language), ahdl (alternate Hardware Description Language), traffic, pl (core universal Programming Language), HDCal (jhdware Description Language), lang, Lola, HDL, laspam, hardward Description Language (vhr Description Language), vhal (Hardware Description Language), and vhigh-Language, which are currently used in most common. It will also be apparent to those skilled in the art that hardware circuitry that implements the logical method flows can be readily obtained by merely slightly programming the method flows into an integrated circuit using the hardware description languages described above.
The controller may be implemented in any suitable manner, for example, the controller may take the form of, for example, a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, and an embedded microcontroller, examples of which include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320, the memory controller may also be implemented as part of the control logic for the memory. Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may thus be considered a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the various elements may be implemented in the same one or more software and/or hardware implementations in implementing one or more embodiments of the present description.
As will be appreciated by one skilled in the art, the present specification embodiments may be provided as a method, system, or computer program product. Accordingly, embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present description may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.
The description has been presented with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the description. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
This description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only an example of the present specification, and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (20)
1. A method of data verification, the method comprising:
acquiring one or more archive tables, wherein the archive tables are generated according to original data tables corresponding to data sources determined by a preset service;
performing data verification operation on service fields from the same archive table or service fields from among a plurality of archive tables according to a pre-configured data verification rule to obtain a data verification result; and the data verification rule is configured according to the business meaning corresponding to the business field.
2. The method of claim 1, wherein the service is formed by fusing a plurality of sub-services according to a service flow, and the generating the archive table according to the original data table corresponding to the data source determined by the predetermined service comprises:
determining each sub-service forming the service according to the service flow of the service, determining a data source in a service system corresponding to the sub-service according to the sub-service, and generating the archive table according to a service field in an original data table corresponding to the data source of each sub-service.
3. The method according to claim 1, wherein when the data verification rule is a data verification rule corresponding to a service field in the archive table, configuring the data verification rule according to a service meaning corresponding to the service field, including:
and establishing a data verification rule between the service fields in the file table or the service fields in the file table according to the preset service meaning corresponding to the service field and the data verification strategy of the service meaning corresponding to the service field in the file table.
4. The method of claim 1, wherein when the data validation rule is a data validation rule corresponding to a service field among a plurality of archive tables, configuring the data validation rule according to a service meaning corresponding to the service field, comprises:
and establishing a data verification rule between the service fields of different file tables according to the service meaning corresponding to the preset service field and the data verification strategy of the service meaning corresponding to the service field between different file tables.
5. The method of claim 1, wherein performing a data validation operation on a traffic field from within the same archive table or a traffic field from among multiple archive tables according to a pre-configured data validation rule comprises:
and after the archive tables are produced, automatically performing data verification operation on the service fields in the archive tables or the service fields among a plurality of archive tables according to a pre-configured data verification rule.
6. A method of data query, the method comprising:
receiving a user query request;
and executing data query operation on a preset archive table according to the user query request, wherein the archive table is generated according to an original data table corresponding to the data source determined by the preset service.
7. The method of claim 6, wherein the service is formed by fusing a plurality of sub-services according to a service flow, and the generating the archive table according to the original data table corresponding to the data source determined by the predetermined service comprises:
determining each sub-service forming the service according to the service flow of the service, determining a data source in a service system corresponding to the sub-service according to the sub-service, and generating the archive table according to a service field in an original data table corresponding to the data source of each sub-service.
8. The method of claim 7, after generating the dossier table, further comprising:
and converting the service fields in the archive table to obtain the converted fields with the service meanings, and establishing a matching relation between the service fields in the archive table and the fields with the service meanings.
9. The method as claimed in claim 8, wherein the user query request includes a service field input by a user, and the performing of the data query operation on the predetermined profile table according to the user query request includes:
and inquiring the service field input by the user according to the matching relation to obtain a field with service meaning corresponding to the service field input by the user, and taking the service detail corresponding to the field with service meaning as a data inquiry result.
10. A data validation apparatus, the apparatus comprising:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring one or more archive tables, and the archive tables are generated according to an original data table corresponding to a data source determined by a preset service;
the verification module is used for performing data verification operation on the service fields from the same archive table or the service fields from among a plurality of archive tables according to a pre-configured data verification rule to obtain a data verification result; and the data verification rule is configured according to the business meaning corresponding to the business field.
11. The apparatus of claim 10, wherein the service is formed by merging a plurality of sub-services according to a service flow, and the apparatus further comprises:
and the generation module is used for determining each sub-service forming the service according to the service flow of the service, determining a data source in a service system corresponding to the sub-service according to the sub-service, and generating the archive table according to the service field in the original data table corresponding to the data source of each sub-service.
12. The apparatus of claim 10, wherein when the data validation rule is a data validation rule corresponding to a business field in an archive table, the validation module is further configured to:
and establishing a data verification rule between the service fields in the file table or the service fields in the file table according to the preset service meaning corresponding to the service field and the data verification strategy of the service meaning corresponding to the service field in the file table.
13. The apparatus of claim 10, wherein when the data validation rule is a data validation rule corresponding to a business field between a plurality of archival tables, the validation module is further configured to:
and establishing a data verification rule between the service fields of different file tables according to the service meaning corresponding to the preset service field and the data verification strategy of the service meaning corresponding to the service field between different file tables.
14. The apparatus of claim 10, the verification module further to:
and after the archive tables are produced, automatically performing data verification operation on the service fields in the archive tables or the service fields among a plurality of archive tables according to a pre-configured data verification rule.
15. A data query device, the device comprising:
the receiving module is used for receiving a user query request;
and the query module is used for executing data query operation on a preset archive table according to the user query request, wherein the archive table is generated according to an original data table corresponding to a data source determined by a preset service.
16. The apparatus of claim 15, wherein the service is formed by merging a plurality of sub-services according to a service flow, and the apparatus further comprises:
and the generation module is used for determining each sub-service forming the service according to the service flow of the service, determining a data source in a service system corresponding to the sub-service according to the sub-service, and generating the archive table according to the service field in the original data table corresponding to the data source of each sub-service.
17. The apparatus of claim 15, the apparatus further comprising:
and the conversion module is used for converting the business fields in the archive table after the archive table is generated to obtain the converted fields with business meanings and establishing a matching relation between the business fields in the archive table and the fields with business meanings.
18. The apparatus of claim 17, wherein the user query request includes a service field input by a user, and the query module is further configured to:
and inquiring the service field input by the user according to the matching relation to obtain a field with service meaning corresponding to the service field input by the user, and taking the service detail corresponding to the field with service meaning as a data inquiry result.
19. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the method of any one of claims 1 to 5 when executing the program.
20. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the method of any one of claims 6 to 9 when executing the program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010964402.9A CN112015739A (en) | 2020-09-14 | 2020-09-14 | Data verification and data query method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010964402.9A CN112015739A (en) | 2020-09-14 | 2020-09-14 | Data verification and data query method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112015739A true CN112015739A (en) | 2020-12-01 |
Family
ID=73522799
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010964402.9A Pending CN112015739A (en) | 2020-09-14 | 2020-09-14 | Data verification and data query method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112015739A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112540959A (en) * | 2020-12-14 | 2021-03-23 | 建信金融科技有限责任公司 | Data processing method and device |
| CN112579632A (en) * | 2020-12-28 | 2021-03-30 | 中国建设银行股份有限公司 | Data verification method, device, equipment and medium |
| CN112597165A (en) * | 2020-12-28 | 2021-04-02 | 中国建设银行股份有限公司 | Supervision data quality verification method and device, electronic equipment and storage medium |
| CN112613063A (en) * | 2021-03-05 | 2021-04-06 | 支付宝(杭州)信息技术有限公司 | Data verification system construction method and device |
| CN112632622A (en) * | 2020-12-31 | 2021-04-09 | 重庆电子工程职业学院 | Electronic file safety management system |
| CN114780595A (en) * | 2022-05-09 | 2022-07-22 | 马上消费金融股份有限公司 | Verification method, device and system |
| CN115631065A (en) * | 2022-12-21 | 2023-01-20 | 国网江苏省电力有限公司营销服务中心 | File accuracy detection method based on front-end electricity utilization service change |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103488694A (en) * | 2013-09-02 | 2014-01-01 | 用友软件股份有限公司 | Business data inquiry device and business data inquiry method |
| CN106547643A (en) * | 2015-09-21 | 2017-03-29 | 阿里巴巴集团控股有限公司 | The restoration methods and device of abnormal data |
| CN110457294A (en) * | 2019-06-28 | 2019-11-15 | 阿里巴巴集团控股有限公司 | A kind of data processing method and device |
| CN111459911A (en) * | 2020-03-30 | 2020-07-28 | 上海云励科技有限公司 | Service data processing method and device |
-
2020
- 2020-09-14 CN CN202010964402.9A patent/CN112015739A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103488694A (en) * | 2013-09-02 | 2014-01-01 | 用友软件股份有限公司 | Business data inquiry device and business data inquiry method |
| CN106547643A (en) * | 2015-09-21 | 2017-03-29 | 阿里巴巴集团控股有限公司 | The restoration methods and device of abnormal data |
| CN110457294A (en) * | 2019-06-28 | 2019-11-15 | 阿里巴巴集团控股有限公司 | A kind of data processing method and device |
| CN111459911A (en) * | 2020-03-30 | 2020-07-28 | 上海云励科技有限公司 | Service data processing method and device |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112540959A (en) * | 2020-12-14 | 2021-03-23 | 建信金融科技有限责任公司 | Data processing method and device |
| CN112540959B (en) * | 2020-12-14 | 2023-01-10 | 中国建设银行股份有限公司 | Data processing method and device |
| CN112579632A (en) * | 2020-12-28 | 2021-03-30 | 中国建设银行股份有限公司 | Data verification method, device, equipment and medium |
| CN112597165A (en) * | 2020-12-28 | 2021-04-02 | 中国建设银行股份有限公司 | Supervision data quality verification method and device, electronic equipment and storage medium |
| CN112632622A (en) * | 2020-12-31 | 2021-04-09 | 重庆电子工程职业学院 | Electronic file safety management system |
| CN112632622B (en) * | 2020-12-31 | 2022-08-26 | 重庆电子工程职业学院 | Electronic file safety management system |
| CN112613063A (en) * | 2021-03-05 | 2021-04-06 | 支付宝(杭州)信息技术有限公司 | Data verification system construction method and device |
| CN112613063B (en) * | 2021-03-05 | 2022-02-18 | 支付宝(杭州)信息技术有限公司 | Data verification system construction method and device |
| CN114780595A (en) * | 2022-05-09 | 2022-07-22 | 马上消费金融股份有限公司 | Verification method, device and system |
| CN114780595B (en) * | 2022-05-09 | 2023-08-15 | 马上消费金融股份有限公司 | Verification method, verification device and verification system |
| CN115631065A (en) * | 2022-12-21 | 2023-01-20 | 国网江苏省电力有限公司营销服务中心 | File accuracy detection method based on front-end electricity utilization service change |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112015739A (en) | Data verification and data query method and device | |
| CN107038042B (en) | Service execution method and device | |
| CN106899666B (en) | Data processing method and device for service identification | |
| CN110648138B (en) | Transaction query and transaction data processing method, device and equipment based on block chain | |
| CN111967849A (en) | Task processing flow arrangement method and device and electronic equipment | |
| CN110134668B (en) | Data migration method, device and equipment applied to blockchain | |
| CN108599973B (en) | Log association method, device and equipment | |
| CN112241506B (en) | User behavior backtracking method, device, equipment and system | |
| CN110472438B (en) | Transaction data processing and transaction inquiring method, device and equipment based on blockchain | |
| CN110503435B (en) | Transaction early warning method, device and equipment based on blockchain | |
| CN112162915A (en) | Test data generation method, device, equipment and storage medium | |
| CN110992040A (en) | Transaction processing method, device and equipment | |
| CN111158650B (en) | Report template and report generation method and device | |
| CN112003769A (en) | Message processing method, device and equipment | |
| CN113434063B (en) | Information display method, device and equipment | |
| CN110602163A (en) | File uploading method and device | |
| CN116993519A (en) | Bill generation method and device | |
| US10482171B2 (en) | Digital form optimization | |
| CN109597695B (en) | Data processing method, device and equipment | |
| CN112596781A (en) | Service execution and service configuration method and device | |
| CN110245115B (en) | File processing method, engine and system | |
| CN105574056A (en) | Abnormal problem positioning method and apparatus | |
| CN112581141A (en) | Transaction processing method, device and system based on block chain | |
| CN114911750A (en) | Data conversion method and device | |
| CN112015702A (en) | Message file name processing method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |