CN112949278A - Data checking method and device, electronic equipment and readable storage medium - Google Patents
Data checking method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN112949278A CN112949278A CN202110205948.0A CN202110205948A CN112949278A CN 112949278 A CN112949278 A CN 112949278A CN 202110205948 A CN202110205948 A CN 202110205948A CN 112949278 A CN112949278 A CN 112949278A
- Authority
- CN
- China
- Prior art keywords
- service
- data
- node
- nodes
- checking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000011144 upstream manufacturing Methods 0.000 claims abstract description 36
- 238000013507 mapping Methods 0.000 claims abstract description 16
- 238000004590 computer program Methods 0.000 claims description 15
- 238000012163 sequencing technique Methods 0.000 claims description 12
- 238000013506 data mapping Methods 0.000 claims description 10
- 238000001914 filtration Methods 0.000 claims description 8
- 238000013524 data verification Methods 0.000 claims description 6
- 238000012216 screening Methods 0.000 claims description 5
- 239000000126 substance Substances 0.000 claims 1
- 238000007405 data analysis Methods 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 7
- 238000007726 management method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 239000003999 initiator Substances 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/194—Calculation of difference between files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/186—Templates
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention relates to a data analysis technology, and discloses a data checking method, which comprises the following steps: responding to the check request, and determining check nodes and the upstream and downstream relations of the nodes according to the check request; extracting service number information in the check request, and acquiring service data corresponding to each service node in the check nodes according to the service number information; performing data identification mapping on the service data to obtain corresponding standard service data; performing parallel checking on the standard service data corresponding to each service node in the checking nodes according to the upstream and downstream relations of the nodes to obtain a checking result; and sending the checking result to a preset terminal device. The invention also relates to a block chaining technique, the standard service data can be stored in block chain link points. The invention also provides a data checking device, an electronic device and a readable storage medium. The invention can improve the efficiency of data checking.
Description
Technical Field
The present invention relates to the field of data analysis, and in particular, to a data checking method and apparatus, an electronic device, and a readable storage medium.
Background
Nowadays, the financial software system architecture development tends to be micro-servitization, namely, the original huge single application is split into small micro-service applications. Under the architecture, a plurality of micro service applications are often required to complete the service (providing the service) once for the outside, and during the transaction period, due to network congestion, system maintenance, code BUG and other reasons among the micro service applications, service data errors corresponding to different applications are easily caused, so that data check needs to be performed on the service data.
Disclosure of Invention
The invention provides a data checking method, a data checking device, electronic equipment and a computer readable storage medium, and mainly aims to improve the efficiency of data checking.
In order to achieve the above object, the present invention provides a data checking method, including:
responding to the check request, and determining check nodes and the upstream and downstream relations of the nodes according to the check request;
extracting service number information in the check request, and acquiring service data corresponding to each service node in the check nodes according to the service number information;
performing data identification mapping on the service data to obtain corresponding standard service data;
performing parallel checking on the standard service data corresponding to each service node in the checking nodes according to the upstream and downstream relations of the nodes to obtain a checking result;
and sending the checking result to a preset terminal device.
Optionally, the determining a checking node and a node upstream-downstream relationship according to the checking request includes:
extracting the checking type in the checking request;
inquiring all service nodes corresponding to the check type and the sequence of the service nodes corresponding to the check type in a preset rule base according to the check type;
summarizing all service nodes corresponding to the check type to obtain the check node;
and determining the sequence of the service nodes corresponding to the checking type as the upstream and downstream relation of the nodes.
Optionally, the extracting the service number information in the check request, and acquiring service data corresponding to each service node in the check nodes according to the service number information includes:
acquiring a database type of a preset service database corresponding to each service node in the check nodes;
constructing a node query statement according to the service number information and the database type;
and inquiring in a preset service database corresponding to each service node in the check nodes by using the node inquiry statement to obtain the corresponding service data.
Optionally, the performing data identification mapping on the service data to obtain corresponding standard service data includes:
converting the format of the service data into a json format to obtain first service data;
performing field screening on the first service data to obtain second service data;
and mapping and associating the data corresponding to each field in the second service data to the field corresponding to a preset standard data template to obtain the standard service data.
Optionally, the performing parallel checking on the standard service data corresponding to each service node in the checking nodes according to the upstream and downstream relationship of the nodes to obtain a checking result includes:
sequencing all service nodes in the check nodes according to the upstream and downstream relationship of the nodes to obtain a standard service node sequence;
taking a first service node in the standard service node sequence as a target service node;
selecting standard service data corresponding to the target service node as target service data;
filtering a first service node in the standard service node sequence to obtain a first standard service node sequence;
and sequentially selecting the standard service data corresponding to the service node in the first standard service node sequence as comparison data to be compared with the target service data to obtain the checking result.
Optionally, the sequentially selecting the standard service data corresponding to the service node in the first standard service node sequence as comparison data to compare with the target service data to obtain the checking result includes:
acquiring a preset check server cluster, and sequencing according to the priority of each server in the check server cluster to obtain a server sequence;
performing grouping sequencing on the service nodes in the first standard service node sequence according to the number of the servers in the server sequence to obtain a grouping node sequence;
sequentially distributing each group node in the group node sequence to each server in a server sequence to obtain a corresponding target check server;
and performing parallel checking by using the target checking server to obtain the checking result.
Optionally, the performing parallel checking by using the target checking server to obtain the checking result includes:
if the number of the service nodes in the group nodes is equal to one, comparing the standard service data corresponding to the service nodes in the group nodes in each target check server with the target service data to obtain a group comparison result;
if the number of the service nodes in the group nodes is more than one, comparing the standard service data corresponding to each service node in the group nodes in each target check server with each other to obtain a node comparison result;
if the node comparison result is that the data are the same, comparing the standard service data corresponding to any service node in the group nodes in each target check server with the target service data to obtain a group comparison result;
if the node comparison results are different, determining the node comparison results as grouping comparison results;
and analyzing according to all the grouping comparison results to obtain a checking result.
In order to solve the above problem, the present invention also provides a data collation apparatus comprising:
the node query module is used for responding to the check request and determining the check node and the upstream and downstream relations of the node according to the check request;
the data mapping module is used for extracting the service number information in the checking request and acquiring service data corresponding to each service node in the checking nodes according to the service number information; performing data identification mapping on the service data to obtain corresponding standard service data;
the data checking module is used for performing parallel checking on the standard service data corresponding to each service node in the checking nodes according to the upstream and downstream relations of the nodes to obtain a checking result; and sending the checking result to a preset terminal device.
In order to solve the above problem, the present invention also provides an electronic device, including:
a memory storing at least one computer program; and
and a processor for executing the computer program stored in the memory to implement the data collation method described above.
In order to solve the above problem, the present invention also provides a computer-readable storage medium, in which at least one computer program is stored, the at least one computer program being executed by a processor in an electronic device to implement the data collation method described above.
According to the embodiment of the invention, the check node and the upstream and downstream relation of the node are determined according to the check request; extracting service number information in the check request, and acquiring service data corresponding to each service node in the check nodes according to the service number information; performing data identification mapping on the service data to obtain corresponding standard service data, and ensuring that the checked service data has stronger generalization capability and compatibility; performing parallel checking on the standard service data corresponding to each service node in the checking nodes according to the upstream and downstream relations of the nodes to obtain a checking result, and improving the data checking efficiency by using a parallel checking mode; and sending the checking result to a preset terminal device. Therefore, the data checking method, the data checking device, the electronic equipment and the computer readable storage medium provided by the embodiment of the invention improve the data checking efficiency.
Drawings
Fig. 1 is a schematic flow chart illustrating a data checking method according to an embodiment of the present invention;
FIG. 2 is a block diagram of a data verification apparatus according to an embodiment of the present invention;
fig. 3 is a schematic internal structural diagram of an electronic device implementing a data matching method according to an embodiment of the present invention;
the implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The embodiment of the invention provides a data checking method. The execution subject of the data verification method includes, but is not limited to, at least one of electronic devices such as a server and a terminal, which can be configured to execute the method provided by the embodiments of the present application. In other words, the data checking method may be performed by software or hardware installed in the terminal device or the server device, and the software may be a blockchain platform. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, and the like.
Referring to fig. 1, a schematic flow chart of a data verification method according to an embodiment of the present invention is shown, in the embodiment of the present invention, the data verification method includes:
s1, responding to the check request, and determining the check node and the upstream and downstream relations of the node according to the check request;
in an embodiment of the present invention, the check request is a check request of service data corresponding to a certain service, where the check request includes a check type and service number information corresponding to the service, and the service number information is service number information of a service corresponding to the service data to be checked, such as: if the service data is order data, the service number information is order number information, and the check type is a service type corresponding to the service number information, for example: take-out services, travel services, etc.
Further, in the embodiment of the present invention, the check type in the check request is extracted, and all service nodes corresponding to the check type and the sequence of the service nodes corresponding to the check type are queried in a preset rule base according to the check type; summarizing all service nodes corresponding to the check type to obtain the check node; and determining the sequence of the service nodes corresponding to the check type as the upstream and downstream relationship of the nodes, wherein the rule base is a database containing node information required for executing different types of services, optionally, the service nodes are applications for executing the services corresponding to the service number information, the check nodes are all service nodes for executing the services corresponding to the service number information, and the upstream and downstream relationship of the nodes is the sequence of the applications for executing the services corresponding to the service number information. Meanwhile, in detail, applications required for executing services of different checking types and corresponding upstream and downstream relationships of the nodes are different, and therefore the checking nodes and the upstream and downstream relationships of the nodes are determined according to the checking request.
S2, extracting the service number information in the check request, and acquiring service data corresponding to each service node in the check nodes according to the service number information;
in the embodiment of the invention, a plurality of applications are often required to complete one service, but in the service completion process, only the service number information is kept unchanged when being circulated in different applications, so that the service number information in the check request needs to be extracted, and the service data corresponding to each node in the check nodes is obtained according to the check information;
in detail, in the embodiment of the present invention, the types of the service databases storing data corresponding to different service nodes are different, for example: the checking node comprises a service node A and a service node B, the service database corresponding to the service node A is oracle, the service database corresponding to the service node B is MySQL, and in order to better query data in different service databases, the database type of the preset service database corresponding to each service node in the checking node is obtained, a node query statement is constructed by using the service serial number information according to the database type, and the query statement is used for querying the preset service database corresponding to each node in the checking node to obtain corresponding service data.
S3, performing data identification mapping on the service data to obtain corresponding standard service data;
in detail, in the embodiment of the present invention, data types and formats of service data corresponding to each service node may be different, and in order to better utilize service data of different service nodes for checking, data identification mapping is performed on data corresponding to each data field in all the service data, where, for example, a data field in the service data is "deduction amount", and a corresponding data is "100 metadata", so as to obtain standard checking data.
In detail, in the embodiment of the present invention, a format of the service data is converted into a json (javascript Object notation) format to obtain first service data, where the json format refers to a lightweight data exchange format to facilitate data reading and understanding, the json format data includes two parts, an Object in the first service data is a data field in the service data, a median in the first service data is data corresponding to the data field in the service data, the data field in the service data is a "deduction amount", the corresponding data is "100 metadata", the data field in the service data is converted into an Object, the data corresponding to the data field in the service data is converted into a value, and the first service data is { "deduction amount": "100 metadata" }; further, in this embodiment of the present invention, the first service data is filtered to obtain second service data, and the data that does not need to be checked in the first service data is removed by filtering, so as to save system resources, and in detail, in this embodiment of the present invention, the first service data is filtered according to the object in the first service data to obtain the second service data, where: the first service data is { "deduction amount": 100 yuan {, { "service number information": 001"}, and the service number information of each service node is the same and does not need to be checked, so the data with the first service data object being" service number information "is filtered out to obtain the second service data, the efficiency of subsequent checking is ensured, further, the fields and the sequence corresponding to different second service data may be different, and for better checking, the data of each field in the second service data is mapped and associated to the field corresponding to the preset standard data template to obtain the standard service data, for example: and if the first column in the second service data is A field data, the second column is B field data, the first column in the standard data template is B field, and the second column is A field, the second column data in the second service data is mapped to the first column of the standard data template in an associated manner, and the first column data in the second service data is mapped to the second column of the standard data template in an associated manner.
In another embodiment of the present invention, in order to ensure the privacy of the data, the standard service data may be stored in a block link point.
S4, performing parallel check on the standard service data corresponding to each service node in the check nodes according to the upstream and downstream relationship of the nodes to obtain a check result;
in order to check whether all the standard service data corresponding to each service node in the check node are consistent, in an embodiment of the present invention, in order to check data more quickly, the parallel check of the standard service data corresponding to each service node in the check node is performed according to the upstream-downstream relationship of the node, so as to obtain a check result, where the check result includes: sequencing all service nodes in the check nodes according to the upstream and downstream relationship of the nodes to obtain a standard service node sequence; taking a first service node in the standard service node sequence as a target service node, selecting standard service data corresponding to the target service node as target service data, and filtering the first service node in the standard service node sequence to obtain a first standard service node sequence; and comparing the standard service data corresponding to the service node in the first standard service node sequence with the target service data by sequentially selecting the standard service data corresponding to the service node in the first standard service node sequence as comparison data to obtain a check result, and comparing the standard service data corresponding to each service node in the first standard service node sequence with the reference data by using the target service data as the reference data, wherein the data comparison of each service node is mutually independent and does not need to wait for the data comparison result of the previous service node, so that the efficiency is higher.
In detail, in the embodiment of the present invention, the sequentially selecting the standard service data corresponding to the service node in the first standard service node sequence as comparison data to compare with the target service data, so as to obtain a comparison result, where the comparison result includes: acquiring a preset check server cluster, wherein each server in the check server cluster has a corresponding priority, and obtaining a server sequence according to the priority of each server in the check server cluster and sequencing, and further, in order to ensure that the servers can distribute the same number of nodes for balancing load, grouping and sequencing the service nodes in the first standard service node sequence according to the number of the servers in the server sequence to obtain a grouped node sequence, for example: if the number 1 and the number 2 service nodes are divided into a first group of grouping nodes, the number 3 and the number 4 service nodes are divided into a second group of grouping nodes, and the number 5 and the number 6 service nodes are divided into a third group of grouping nodes, a grouping node sequence is obtained; sequentially distributing each group node in the group node sequence to each server in a server sequence to obtain a corresponding target check server; and performing parallel checking by using the target checking server to obtain a checking result.
Further, in the embodiment of the present invention, if the number of service nodes in a group node is equal to one, the standard service data corresponding to the service node in the group node in each target core server is compared with the target service data to obtain a group comparison result; if the number of the service nodes in the group nodes is more than one, comparing the standard service data corresponding to each service node in the group nodes in each target check server with each other to obtain a node comparison result, if the node comparison results are the same, comparing the standard service data corresponding to any service node in the group nodes in each target check server with the target service data to obtain a group comparison result, if the node comparison results are different, determining the node comparison result as the group comparison result, and analyzing according to all the group comparison results to obtain the check result. Further, if all the group comparison results are data consistency, the check result is normal, and if all the group comparison results have group comparison results with inconsistent data, the check result is abnormal, and the corresponding group comparison result is recorded to send an alarm.
By the checking method, high concurrency capability of the server can be guaranteed, and checking efficiency is improved.
And S5, sending the check result to a preset terminal device.
In detail, in the embodiment of the present invention, the preset terminal device is a terminal device corresponding to the verification request initiator, where the terminal device includes but is not limited to: mobile phones, computers, tablets, etc.
FIG. 2 is a functional block diagram of the data verification apparatus according to the present invention.
The data collation apparatus 100 according to the present invention may be installed in an electronic device. According to the implemented functions, the data checking device may include a node query module 101, a data mapping module 102, and a data checking module 103, which may also be referred to as a unit, and refers to a series of computer program segments that can be executed by a processor of an electronic device and can perform fixed functions, and are stored in a memory of the electronic device.
In the present embodiment, the functions regarding the respective modules/units are as follows:
and the node query module 101 is configured to respond to the check request and determine a check node and an upstream-downstream relationship of the node according to the check request.
In an embodiment of the present invention, the check request is a check request of service data corresponding to a certain service, where the check request includes a check type and service number information corresponding to the service, and the service number information is service number information of a service corresponding to the service data to be checked, such as: if the service data is order data, the service number information is order number information, and the check type is a service type corresponding to the service number information, for example: take-out services, travel services, etc.
Further, in the embodiment of the present invention, the node query module 101 extracts the check type in the check request, and queries, according to the check type, all service nodes corresponding to the check type and the sequence of the service nodes corresponding to the check type in a preset rule base; summarizing all service nodes corresponding to the check type to obtain the check node; and determining the sequence of the service nodes corresponding to the check type as the upstream and downstream relationship of the nodes, wherein the rule base is a database containing node information required for executing different types of services, optionally, the service nodes are applications for executing the services corresponding to the service number information, the check nodes are all service nodes for executing the services corresponding to the service number information, and the upstream and downstream relationship of the nodes is the sequence of the applications for executing the services corresponding to the service number information. Meanwhile, in detail, applications required for executing services of different checking types and corresponding upstream and downstream relationships of the nodes are different, and therefore the checking nodes and the upstream and downstream relationships of the nodes are determined according to the checking request.
The data mapping module 102 is configured to extract service number information in the check request, and obtain service data corresponding to each service node in the check nodes according to the service number information; and carrying out data identification mapping on the service data to obtain corresponding standard service data.
In the embodiment of the invention, a plurality of applications are often required to complete one service, but in the service completion process, only the service number information is kept unchanged when being circulated in different applications, so that the service number information in the check request needs to be extracted, and the service data corresponding to each node in the check nodes is obtained according to the check information;
in detail, in the embodiment of the present invention, the types of the service databases storing data corresponding to different service nodes are different, for example: the check node comprises a service node A and a service node B, the service database corresponding to the service node A is oracle, the service database corresponding to the service node B is MySQL, and in order to better query data in different service databases, the data mapping module 102 obtains a database type of a preset service database corresponding to each service node in the check node, constructs a node query statement according to the database type by using the service number information, and queries in the preset service database corresponding to each node in the check node by using the query statement to obtain corresponding service data.
In detail, in the embodiment of the present invention, data types and formats of service data corresponding to each service node may be different, and in order to better utilize service data of different service nodes for checking, the data mapping module 102 performs data identification mapping on data corresponding to each data field in all the service data, where, for example, a data field in the service data is "deduction amount", and a corresponding data field is "100 metadata", to obtain standard checking data.
In detail, in the embodiment of the present invention, the data mapping module 102 converts the format of the service data into json (javascript Object notification) format to obtain the first service data, wherein the json format refers to a lightweight data exchange format which is convenient for reading and understanding of data, the json format data comprises an object part and a value part, the object in the first service data is a data field in the service data, the median in the first service data is data corresponding to the data field in the service data, the data field in the service data is a deduction amount, the corresponding data is "100 yuan", the data mapping module 102 converts the data field in the service data into an object, converts the data corresponding to the data field in the service data into a value, and obtains that the first service data is { "deduction amount": "100 element" }; further, in this embodiment of the present invention, the data mapping module 102 performs filtering and screening on the first service data to obtain second service data, and removes data that does not need to be checked from the first service data through filtering and screening to save system resources, and in detail, in this embodiment of the present invention, the filtering and screening are performed on the first service data according to an object in the first service data to obtain the second service data, where: the first service data is { "deduction amount": 100 yuan {, { "service number information": 001"}, and the service number information of each service node is the same and does not need to be checked, so the data with the first service data object being" service number information "is filtered out to obtain the second service data, and the efficiency of subsequent checking is ensured, further, the fields and the sequence corresponding to different second service data may be different, and for better checking, the data mapping module 102 maps and associates the data of each field in the second service data with the field corresponding to the preset standard data template to obtain the standard service data, for example: and if the first column in the second service data is A field data, the second column is B field data, the first column in the standard data template is B field, and the second column is A field, the second column data in the second service data is mapped to the first column of the standard data template in an associated manner, and the first column data in the second service data is mapped to the second column of the standard data template in an associated manner.
In another embodiment of the present invention, in order to ensure the privacy of the data, the standard service data may be stored in a block link point.
The data checking module 103 is configured to perform parallel checking on the standard service data corresponding to each service node in the checking nodes according to the upstream and downstream relationships of the nodes, so as to obtain a checking result; and sending the checking result to a preset terminal device.
Since it is necessary to check whether all the standard service data corresponding to each service node in the check node are consistent, in order to perform data check more quickly, in the embodiment of the present invention, the data check module 103 performs parallel check on the standard service data corresponding to each service node in the check node according to the upstream-downstream relationship of the node to obtain a check result, including: sequencing all service nodes in the check nodes according to the upstream and downstream relationship of the nodes to obtain a standard service node sequence; taking a first service node in the standard service node sequence as a target service node, selecting standard service data corresponding to the target service node as target service data, and filtering the first service node in the standard service node sequence to obtain a first standard service node sequence; and comparing the standard service data corresponding to the service node in the first standard service node sequence with the target service data by sequentially selecting the standard service data corresponding to the service node in the first standard service node sequence as comparison data to obtain a check result, and comparing the standard service data corresponding to each service node in the first standard service node sequence with the reference data by using the target service data as the reference data, wherein the data comparison of each service node is mutually independent and does not need to wait for the data comparison result of the previous service node, so that the efficiency is higher.
In detail, in the embodiment of the present invention, the data checking module 103 sequentially selects the standard service data corresponding to the service node in the first standard service node sequence as comparison data to compare with the target service data by using the following means, so as to obtain a comparison result, where the means includes: acquiring a preset check server cluster, wherein each server in the check server cluster has a corresponding priority, and obtaining a server sequence according to the priority of each server in the check server cluster and sequencing, and further, in order to ensure that the servers can distribute the same number of nodes for balancing load, grouping and sequencing the service nodes in the first standard service node sequence according to the number of the servers in the server sequence to obtain a grouped node sequence, for example: if the number 1 and the number 2 service nodes are divided into a first group of grouping nodes, the number 3 and the number 4 service nodes are divided into a second group of grouping nodes, and the number 5 and the number 6 service nodes are divided into a third group of grouping nodes, a grouping node sequence is obtained; sequentially distributing each group node in the group node sequence to each server in a server sequence to obtain a corresponding target check server; and performing parallel checking by using the target checking server to obtain a checking result.
Further, in the embodiment of the present invention, if the number of service nodes in a group node is equal to one, the data checking module 103 compares the standard service data corresponding to the service node in the group node in each target checking server with the target service data to obtain a group comparison result; if the number of service nodes in the group node is greater than one, the data checking module 103 compares the standard service data corresponding to each service node in the group node in each target checking server with each other to obtain a node comparison result, if the node comparison result is the same data, the data checking module 103 compares the standard service data corresponding to any service node in the group node in each target checking server with the target service data to obtain a group comparison result, if the node comparison result is different data, the data checking module 103 determines the node comparison result as the group comparison result, and analyzes according to all the group comparison results to obtain the checking result. Further, if all the group comparison results are data consistency, the check result is normal, and if all the group comparison results have group comparison results with inconsistent data, the check result is abnormal, and the corresponding group comparison result is recorded to send an alarm.
By the checking method, high concurrency capability of the server can be guaranteed, and checking efficiency is improved.
In detail, in the embodiment of the present invention, the preset terminal device is a terminal device corresponding to the verification request initiator, where the terminal device includes but is not limited to: mobile phones, computers, tablets, etc.
Fig. 3 is a schematic structural diagram of an electronic device implementing the data matching method according to the present invention.
The electronic device 1 may comprise a processor 10, a memory 11 and a bus, and may further comprise a computer program, such as a data collation program 12, stored in the memory 11 and operable on the processor 10.
The memory 11 includes at least one type of readable storage medium, which includes flash memory, removable hard disk, multimedia card, card-type memory (e.g., SD or DX memory, etc.), magnetic memory, magnetic disk, optical disk, etc. The memory 11 may in some embodiments be an internal storage unit of the electronic device 1, such as a removable hard disk of the electronic device 1. The memory 11 may also be an external storage device of the electronic device 1 in other embodiments, such as a plug-in mobile hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the electronic device 1. Further, the memory 11 may also include both an internal storage unit and an external storage device of the electronic device 1. The memory 11 may be used not only to store application software installed in the electronic device 1 and various types of data, such as codes of a data collation program, but also to temporarily store data that has been output or is to be output.
The processor 10 may be composed of an integrated circuit in some embodiments, for example, a single packaged integrated circuit, or may be composed of a plurality of integrated circuits packaged with the same or different functions, including one or more Central Processing Units (CPUs), microprocessors, digital Processing chips, graphics processors, and combinations of various control chips. The processor 10 is a Control Unit (Control Unit) of the electronic device, connects various components of the whole electronic device by using various interfaces and lines, and executes various functions and processes data of the electronic device 1 by running or executing programs or modules (e.g., data collation programs, etc.) stored in the memory 11 and calling data stored in the memory 11.
The bus may be a PerIPheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. The bus is arranged to enable connection communication between the memory 11 and at least one processor 10 or the like.
Fig. 3 shows only an electronic device with components, and it will be understood by those skilled in the art that the structure shown in fig. 3 does not constitute a limitation of the electronic device 1, and may comprise fewer or more components than those shown, or some components may be combined, or a different arrangement of components.
For example, although not shown, the electronic device 1 may further include a power supply (such as a battery) for supplying power to each component, and preferably, the power supply may be logically connected to the at least one processor 10 through a power management device, so as to implement functions of charge management, discharge management, power consumption management, and the like through the power management device. The power supply may also include any component of one or more dc or ac power sources, recharging devices, power failure detection circuitry, power converters or inverters, power status indicators, and the like. The electronic device 1 may further include various sensors, a bluetooth module, a Wi-Fi module, and the like, which are not described herein again.
Further, the electronic device 1 may further include a network interface, and optionally, the network interface may include a wired interface and/or a wireless interface (such as a WI-FI interface, a bluetooth interface, etc.), which are generally used for establishing a communication connection between the electronic device 1 and other electronic devices.
Optionally, the electronic device 1 may further comprise a user interface, which may be a Display (Display), an input unit (such as a Keyboard), and optionally a standard wired interface, a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, or the like. The display, which may also be referred to as a display screen or display unit, is suitable for displaying information processed in the electronic device 1 and for displaying a visualized user interface, among other things.
It is to be understood that the described embodiments are for purposes of illustration only and that the scope of the appended claims is not limited to such structures.
The data collating program 12 stored in the memory 11 of the electronic device 1 is a combination of a plurality of computer programs which, when run in the processor 10, enable:
responding to the check request, and determining check nodes and the upstream and downstream relations of the nodes according to the check request;
extracting service number information in the check request, and acquiring service data corresponding to each service node in the check nodes according to the service number information;
performing data identification mapping on the service data to obtain corresponding standard service data;
performing parallel checking on the standard service data corresponding to each service node in the checking nodes according to the upstream and downstream relations of the nodes to obtain a checking result;
and sending the checking result to a preset terminal device.
Specifically, the processor 10 may refer to the description of the relevant steps in the embodiment corresponding to fig. 1 for a specific implementation method of the computer program, which is not described herein again.
Further, the integrated modules/units of the electronic device 1, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. The computer readable medium may be non-volatile or volatile. The computer-readable medium may include: any entity or device capable of carrying said computer program code, recording medium, U-disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM).
Embodiments of the present invention may also provide a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor of an electronic device, the computer program may implement:
responding to the check request, and determining check nodes and the upstream and downstream relations of the nodes according to the check request;
extracting service number information in the check request, and acquiring service data corresponding to each service node in the check nodes according to the service number information;
performing data identification mapping on the service data to obtain corresponding standard service data;
performing parallel checking on the standard service data corresponding to each service node in the checking nodes according to the upstream and downstream relations of the nodes to obtain a checking result;
and sending the checking result to a preset terminal device.
Further, the computer usable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to the use of the blockchain node, and the like.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus, device and method can be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional module.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof.
The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference signs in the claims shall not be construed as limiting the claim concerned.
The block chain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.
Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the system claims may also be implemented by one unit or means in software or hardware. The terms second, etc. are used to denote names, but not any particular order.
Finally, it should be noted that the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.
Claims (10)
1. A method for data collation, the method comprising:
responding to the check request, and determining check nodes and the upstream and downstream relations of the nodes according to the check request;
extracting service number information in the check request, and acquiring service data corresponding to each service node in the check nodes according to the service number information;
performing data identification mapping on the service data to obtain corresponding standard service data;
performing parallel checking on the standard service data corresponding to each service node in the checking nodes according to the upstream and downstream relations of the nodes to obtain a checking result;
and sending the checking result to a preset terminal device.
2. The data reconciliation method of claim 1 wherein said determining reconciliation nodes and node upstream and downstream relationships based on said reconciliation request comprises:
extracting the checking type in the checking request;
inquiring all service nodes corresponding to the check type and the sequence of the service nodes corresponding to the check type in a preset rule base according to the check type;
summarizing all service nodes corresponding to the check type to obtain the check node;
and determining the sequence of the service nodes corresponding to the checking type as the upstream and downstream relation of the nodes.
3. The data matching method as claimed in claim 2, wherein said extracting the service number information in the matching request and obtaining the service data corresponding to each service node in the matching node according to the service number information comprises:
acquiring a database type of a preset service database corresponding to each service node in the check nodes;
constructing a node query statement according to the service number information and the database type;
and inquiring in a preset service database corresponding to each service node in the check nodes by using the node inquiry statement to obtain the corresponding service data.
4. The data verification method of claim 3, wherein said performing data identification mapping on said service data to obtain corresponding standard service data comprises:
converting the format of the service data into a json format to obtain first service data;
performing field screening on the first service data to obtain second service data;
and mapping and associating the data corresponding to each field in the second service data to a field corresponding to a preset standard data template to obtain the standard service data.
5. The data checking method according to claim 4, wherein said performing parallel checking on said standard service data corresponding to each service node in said checking nodes according to said upstream and downstream relationship of said nodes to obtain a checking result comprises:
sequencing all service nodes in the check nodes according to the upstream and downstream relationship of the nodes to obtain a standard service node sequence;
taking a first service node in the standard service node sequence as a target service node;
selecting standard service data corresponding to the target service node as target service data;
filtering a first service node in the standard service node sequence to obtain a first standard service node sequence;
and sequentially selecting the standard service data corresponding to the service node in the first standard service node sequence as comparison data to be compared with the target service data to obtain the checking result.
6. The data matching method of claim 5, wherein said sequentially selecting said standard service data corresponding to said service node in said first standard service node sequence as comparison data to be compared with said target service data to obtain said matching result comprises:
acquiring a preset check server cluster, and sequencing according to the priority of each server in the check server cluster to obtain a server sequence;
performing grouping sequencing on the service nodes in the first standard service node sequence according to the number of the servers in the server sequence to obtain a grouping node sequence;
sequentially distributing each group node in the group node sequence to each server in a server sequence to obtain a corresponding target check server;
and performing parallel checking by using the target checking server to obtain the checking result.
7. The data collation method according to claim 6, wherein said performing parallel collation with said object collation server to obtain said collation result includes:
if the number of the service nodes in the group nodes is equal to one, comparing the standard service data corresponding to the service nodes in the group nodes in each target check server with the target service data to obtain a group comparison result;
if the number of the service nodes in the group nodes is more than one, comparing the standard service data corresponding to each service node in the group nodes in each target check server with each other to obtain a node comparison result;
if the node comparison result is that the data are the same, comparing the standard service data corresponding to any service node in the group nodes in each target check server with the target service data to obtain a group comparison result;
if the node comparison results are different, determining the node comparison results as grouping comparison results;
and analyzing according to all the grouping comparison results to obtain a checking result.
8. A data collation apparatus, comprising:
the node query module is used for responding to the check request and determining the check node and the upstream and downstream relations of the node according to the check request;
the data mapping module is used for extracting the service number information in the checking request and acquiring service data corresponding to each service node in the checking nodes according to the service number information; performing data identification mapping on the service data to obtain corresponding standard service data;
the data checking module is used for performing parallel checking on the standard service data corresponding to each service node in the checking nodes according to the upstream and downstream relations of the nodes to obtain a checking result; and sending the checking result to a preset terminal device.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores computer program instructions executable by the at least one processor to enable the at least one processor to perform the data collation method of any one of claims 1 to 7.
10. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the data collation method according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110205948.0A CN112949278A (en) | 2021-02-24 | 2021-02-24 | Data checking method and device, electronic equipment and readable storage medium |
| PCT/CN2021/123885 WO2022179119A1 (en) | 2021-02-24 | 2021-10-14 | Data verification method and apparatus, electronic device, and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110205948.0A CN112949278A (en) | 2021-02-24 | 2021-02-24 | Data checking method and device, electronic equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112949278A true CN112949278A (en) | 2021-06-11 |
Family
ID=76245894
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110205948.0A Pending CN112949278A (en) | 2021-02-24 | 2021-02-24 | Data checking method and device, electronic equipment and readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112949278A (en) |
| WO (1) | WO2022179119A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113515579A (en) * | 2021-06-17 | 2021-10-19 | 自然资源部地图技术审查中心 | Boundary peak data screening method and device |
| WO2022179119A1 (en) * | 2021-02-24 | 2022-09-01 | 深圳壹账通智能科技有限公司 | Data verification method and apparatus, electronic device, and readable storage medium |
| CN115102759A (en) * | 2022-06-21 | 2022-09-23 | 南京质子链科技有限公司 | Interface backtracking system based on block chain |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110008252A (en) * | 2019-03-12 | 2019-07-12 | 阿里巴巴集团控股有限公司 | Verification of data method and device |
| CN110263071A (en) * | 2019-05-31 | 2019-09-20 | 口碑(上海)信息技术有限公司 | Business datum checking method, device, equipment and system architecture |
| CN110750530A (en) * | 2019-09-11 | 2020-02-04 | 口碑(上海)信息技术有限公司 | Service system and data checking method thereof |
| CN111427918A (en) * | 2020-03-27 | 2020-07-17 | 中国工商银行股份有限公司 | Transaction detail data comparison method and device |
| CN111461881A (en) * | 2020-03-30 | 2020-07-28 | 北京三快在线科技有限公司 | Data management method and device, computer equipment and storage medium |
| CN111899105A (en) * | 2020-08-04 | 2020-11-06 | 深圳乐信软件技术有限公司 | System exception handling method and device, computer equipment and storage medium |
| CN112306329A (en) * | 2019-08-29 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Information processing method, device, equipment and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008097305A (en) * | 2006-10-11 | 2008-04-24 | Ricoh Co Ltd | Image forming device, control method, control program, and recording medium |
| CN103971197A (en) * | 2014-03-24 | 2014-08-06 | 世纪禾光科技发展（北京）有限公司 | Cross-border e-commerce reconciliation method and cross-border e-commerce reconciliation |
| CN112232818A (en) * | 2020-10-15 | 2021-01-15 | 金蝶软件（中国）有限公司 | Data reconciliation method and device, computer equipment and storage medium |
| CN112949278A (en) * | 2021-02-24 | 2021-06-11 | 深圳壹账通智能科技有限公司 | Data checking method and device, electronic equipment and readable storage medium |
-
2021
- 2021-02-24 CN CN202110205948.0A patent/CN112949278A/en active Pending
- 2021-10-14 WO PCT/CN2021/123885 patent/WO2022179119A1/en unknown
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110008252A (en) * | 2019-03-12 | 2019-07-12 | 阿里巴巴集团控股有限公司 | Verification of data method and device |
| CN110263071A (en) * | 2019-05-31 | 2019-09-20 | 口碑(上海)信息技术有限公司 | Business datum checking method, device, equipment and system architecture |
| CN112306329A (en) * | 2019-08-29 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Information processing method, device, equipment and storage medium |
| CN110750530A (en) * | 2019-09-11 | 2020-02-04 | 口碑(上海)信息技术有限公司 | Service system and data checking method thereof |
| CN111427918A (en) * | 2020-03-27 | 2020-07-17 | 中国工商银行股份有限公司 | Transaction detail data comparison method and device |
| CN111461881A (en) * | 2020-03-30 | 2020-07-28 | 北京三快在线科技有限公司 | Data management method and device, computer equipment and storage medium |
| CN111899105A (en) * | 2020-08-04 | 2020-11-06 | 深圳乐信软件技术有限公司 | System exception handling method and device, computer equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 任涛，刘莹，张莉，汪德帅主编: "云计算技术与应用 第1版", 31 December 2020, 沈阳：东北大学出版社, pages: 85 - 91 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022179119A1 (en) * | 2021-02-24 | 2022-09-01 | 深圳壹账通智能科技有限公司 | Data verification method and apparatus, electronic device, and readable storage medium |
| CN113515579A (en) * | 2021-06-17 | 2021-10-19 | 自然资源部地图技术审查中心 | Boundary peak data screening method and device |
| CN113515579B (en) * | 2021-06-17 | 2024-01-19 | 自然资源部地图技术审查中心 | Method and device for screening boundary peak data |
| CN115102759A (en) * | 2022-06-21 | 2022-09-23 | 南京质子链科技有限公司 | Interface backtracking system based on block chain |
| CN115102759B (en) * | 2022-06-21 | 2023-09-12 | 南京质子链科技有限公司 | Interface backtracking system based on block chain |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022179119A1 (en) | 2022-09-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112949278A (en) | Data checking method and device, electronic equipment and readable storage medium | |
| CN112052370A (en) | Message generation method and device, electronic equipment and computer readable storage medium | |
| CN112052242A (en) | Data query method and device, electronic equipment and storage medium | |
| CN112418798A (en) | Information auditing method and device, electronic equipment and storage medium | |
| CN112115145A (en) | Data acquisition method and device, electronic equipment and storage medium | |
| CN114185895A (en) | Data import and export method and device, electronic equipment and storage medium | |
| CN112115152A (en) | Data increment updating and querying method and device, electronic equipment and storage medium | |
| CN114881616A (en) | Business process execution method and device, electronic equipment and storage medium | |
| CN114491047A (en) | Multi-label text classification method and device, electronic equipment and storage medium | |
| CN113868528A (en) | Information recommendation method and device, electronic equipment and readable storage medium | |
| CN114979120A (en) | Data uploading method, device, equipment and storage medium | |
| CN114637811A (en) | Data table entity relation graph generation method, device, equipment and storage medium | |
| CN114519084A (en) | Block chain-based medical data inspection method, device, equipment and medium | |
| CN113434542A (en) | Data relation identification method and device, electronic equipment and storage medium | |
| CN113468175A (en) | Data compression method and device, electronic equipment and storage medium | |
| CN112580079A (en) | Authority configuration method and device, electronic equipment and readable storage medium | |
| CN111985194A (en) | Data storage method and device, electronic equipment and storage medium | |
| CN113254446B (en) | Data fusion method, device, electronic equipment and medium | |
| CN114840388A (en) | Data monitoring method and device, electronic equipment and storage medium | |
| CN114547011A (en) | Data extraction method and device, electronic equipment and storage medium | |
| CN114490137A (en) | Service data real-time statistical method and device, electronic equipment and readable storage medium | |
| CN113419718A (en) | Data transmission method, device, equipment and medium | |
| CN112686759A (en) | Account checking monitoring method, device, equipment and medium | |
| CN113377857A (en) | Data distribution method and device, electronic equipment and readable storage medium | |
| CN113469649A (en) | Project progress analysis method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40049991 Country of ref document: HK |