CN112783942A - Block chain-based data acquisition quality verification method, system, device and medium - Google Patents

Block chain-based data acquisition quality verification method, system, device and medium Download PDF

Info

Publication number
CN112783942A
CN112783942A CN202110040372.7A CN202110040372A CN112783942A CN 112783942 A CN112783942 A CN 112783942A CN 202110040372 A CN202110040372 A CN 202110040372A CN 112783942 A CN112783942 A CN 112783942A
Authority
CN
China
Prior art keywords
data
data acquisition
information
source
acquired
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110040372.7A
Other languages
Chinese (zh)
Other versions
CN112783942B (en
Inventor
洪薇
洪键
李京昆
刘文思
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hubei Chenweixi Chain Information Technology Co ltd
Original Assignee
Hubei Chenweixi Chain Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hubei Chenweixi Chain Information Technology Co ltd filed Critical Hubei Chenweixi Chain Information Technology Co ltd
Priority to CN202110040372.7A priority Critical patent/CN112783942B/en
Publication of CN112783942A publication Critical patent/CN112783942A/en
Application granted granted Critical
Publication of CN112783942B publication Critical patent/CN112783942B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2462Approximate or statistical queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/64Protecting data integrity, e.g. using checksums, certificates or signatures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Probability & Statistics with Applications (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention discloses a block chain-based data acquisition quality verification method, a system, a device and a medium, which relate to the field of data acquisition and comprise the following steps: the data source links the data collected by the data collection end; acquiring data information A acquired from a data source in a data acquisition end, and acquiring data information B acquired by the data acquisition end and uploaded by the data source on a chain; verifying whether the data information A is consistent with the data information B; if the data are consistent, the data acquired by the identification data acquisition end are verified successfully; if not, identifying that the data acquired by the data acquisition end fails to be checked; the data acquisition quality verification mode can be approved or accepted by an operated big data system, and is easy to implement and low in implementation difficulty; in addition, the invention can ensure that the data acquired in the data acquisition terminal is consistent with the original data by checking the data of the data acquisition terminal and the access behavior of the external database.

Description

Block chain-based data acquisition quality verification method, system, device and medium
Technical Field
The invention relates to the field of data acquisition, in particular to a block chain-based data acquisition quality verification method, a block chain-based data acquisition quality verification system, a block chain-based data acquisition quality verification device and a block chain-based data acquisition quality verification medium.
Background
1. The existing data acquisition and aggregation management method forms intensive data resource libraries such as a database, a data center, a big data center and the like, and is matched with system tools and methods such as data sharing and exchange and the like. In the data acquisition quality monitoring process, if the data acquisition quality monitoring system directly participates in data reading and writing operations, the data acquisition quality monitoring system is influenced by security risks, stability and trust and cannot be approved or accepted by a large running data system.
2. Key indicators for data acquisition quality monitoring include: the factors of consistency, integrity, availability, and resistance to repudiation of data are basically to ensure that the data input, transmission, storage, and associated roles, behaviors, and the like involved in a complete full-circle of data acquisition from a data source are controllable, reliable, and verifiable. Under the data acquisition architecture based on the network (internet), as the acquisition source, the data aggregation point and the data storage point may or must be relatively independent systems in physical and logical management, the difficulty of ensuring the safety of each link and preventing the data from being influenced by the risk is high.
In summary, the inventors of the present application find that the following technical problems exist in the existing data acquisition quality monitoring method:
(1) the existing data acquisition quality monitoring mode needs to directly participate in data reading and writing operation and cannot be approved or accepted by a large data system which is already operated.
(2) The existing data acquisition quality monitoring mode needs to monitor each link from a data source to a data acquisition end, and the implementation difficulty is high.
Disclosure of Invention
In order to solve the above problems in the background art, the present invention provides a block chain-based data acquisition quality verification method, system, device, and medium, on one hand, the data acquisition quality verification method of the present invention does not need to directly participate in data read-write operations, and can be recognized or accepted by a large data system already in operation, and on the other hand, the data acquisition quality verification method of the present invention does not need to monitor each link from a data source to a data acquisition end, only needs to directly verify data, is easy to implement, and has small implementation difficulty.
In order to achieve the above object, the present invention provides a block chain-based data acquisition quality verification method for verifying the quality of data acquired by a data acquisition end from a data source, the method comprising:
the data source links the data collected by the data collection end;
acquiring data information A acquired from a data source in a data acquisition end, and acquiring data information B acquired by the data acquisition end and uploaded by the data source on a chain;
verifying whether the data information A is consistent with the data information B;
if the verification result is that the data information A is consistent with the data information B, the data acquired by the data acquisition end is identified to be verified successfully;
and if the verification result is that the data information A is inconsistent with the data information B, the data acquired by the data acquisition end is identified to fail to be verified.
The method comprises the following steps: the method links the data collected by the data collection end in the data source, and the block chain is a shared database, and the data or information stored in the database has the characteristics of being incapable of being forged, having trace in the whole process, being traceable, being public and transparent, being maintained collectively and the like. Based on the characteristics, the data chaining of the data source acquired by the data acquisition end ensures the non-falsification, data perfection and accuracy of the acquired data at the side, then the data information acquired from the data source is acquired from the data acquisition end, and the data information acquired from the data source and the data information acquired by the data acquisition end and stored on the block chain are verified in the data acquisition end, so that the purpose of verifying the data acquisition quality is realized.
The verification process of the method does not need to directly participate in data read-write operation, and then the verification method can be approved or accepted by a large data system which is already running.
Furthermore, in the verification process of the method, only the preset data on the block chain and the corresponding data in the data acquisition end need to be verified, the verification mode is simple, quick and convenient, all links from the data source to the data acquisition end do not need to be monitored, only the data need to be verified directly, and the method is easy to implement and low in implementation difficulty.
Preferably, the failure condition that the data information a is inconsistent with the data information B in the method includes: the method comprises the following steps of sending port faults of a data source, port faults of a data acquisition end, data acquisition channel faults and network faults between the data source and the data acquisition end.
If the fault type is a data acquisition channel fault between the data source and the data acquisition end, fault detection is carried out on the data acquisition channel between the data source and the data acquisition end, and the fault detection mode of the data acquisition channel between the data source and the data acquisition end comprises at least one of the following three modes:
the first mode is as follows: carrying out fault detection on a data acquisition channel from a storage machine of a data source to a front-end processor of the data source;
the second mode is as follows: carrying out fault detection on a data acquisition channel from a front-end processor of a data source to a front-end processor of a data acquisition end;
the third mode is as follows: and carrying out fault detection on a data acquisition channel between a front-end processor of the data acquisition end and a storage machine of the data acquisition end.
The method provides a data acquisition channel fault detection mode between various data sources and the data acquisition end, and can ensure that the data acquisition channel fault detection between the data sources and the data acquisition end is comprehensive and accurate.
Preferably, the data acquisition channel fault detection method in the method includes:
capturing packets at a starting port and a receiving port of a data acquisition channel to obtain two packets,
and comparing whether the information in the two packets is consistent, if so, judging that the data acquisition channel has no fault, and if not, judging that the data transmission channel has a fault.
The method comprises the steps of capturing network packet information in a data acquisition channel, analyzing the network packet information to obtain corresponding detailed network packet data, and judging whether the data acquisition channel is in fault or not based on the network packet data analysis.
Preferably, in the method, the data acquisition channel fault detection information between the data source and the data acquisition end is sent to the data source and/or the data acquisition end.
Wherein, through sending fault information to data source and/or data acquisition end, can let to data source and/or data acquisition end know fault information fast, and then carry out the breakdown maintenance fast, guarantee data acquisition efficiency and effect.
Corresponding to the method in the invention, the invention also provides a data acquisition quality verification system based on the block chain, which is used for verifying the data quality acquired by the data acquisition end from the data source, and the system comprises:
the uplink unit is used for the data source to uplink the data acquired by the data acquisition end;
the acquisition unit is used for acquiring data information A acquired from a data source in the data acquisition end and acquiring data information B which is uploaded by the data source on the chain and acquired by the data acquisition end;
the checking unit is used for checking whether the data information A is consistent with the data information B;
the processing unit is used for identifying that the data acquired by the data acquisition end is successfully checked if the checking result is that the data information A is consistent with the data information B; and the data verification module is used for identifying that the data verification acquired by the data acquisition terminal fails if the verification result is that the data information A is inconsistent with the data information B.
Further, the system further includes a fault detection unit, configured to detect a fault type that the data information a is inconsistent with the data information B, where a fault condition that the data information a is inconsistent with the data information B includes: the method comprises the following steps of sending port faults of a data source, port faults of a data acquisition end, data acquisition channel faults and network faults between the data source and the data acquisition end.
Further, when the fault type is a data acquisition channel fault between a data source and a data acquisition end, the fault detection unit is specifically a data acquisition channel fault detection unit, and the data acquisition channel fault detection unit specifically includes at least one of the following three modules:
the first data acquisition channel fault detection module: the data acquisition channel is used for carrying out fault detection on a data acquisition channel from a storage machine of a data source to a front-end processor of the data source;
the second data acquisition channel fault detection module: the data acquisition channel is used for carrying out fault detection on a data acquisition channel from a front-end processor of a data source to a front-end processor of a data acquisition end;
the third data acquisition channel fault detection module: the fault detection device is used for carrying out fault detection on a data acquisition channel between a front-end processor of a data acquisition end and a storage machine of the data acquisition end.
The invention also provides a data acquisition quality verification device based on the block chain, which comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, wherein the processor realizes the steps of the data acquisition quality verification method based on the block chain when executing the computer program.
The invention further provides a computer readable storage medium having stored thereon a computer program which, when being executed by a processor, carries out the steps of the block chain based data acquisition quality verification method.
One or more technical schemes provided by the invention at least have the following technical effects or advantages:
on one hand, the data acquisition quality verification mode does not need to directly participate in data reading and writing operation and can be approved or accepted by an operated big data system, and on the other hand, the data acquisition quality verification mode does not need to monitor all links from a data source to a data acquisition end, only needs to directly verify data, is easy to implement and has small implementation difficulty.
The invention can ensure that the data acquired in the data acquisition terminal is consistent with the original data by checking the data of the data acquisition terminal and the access behavior of the external database.
Drawings
The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention;
FIG. 1 is a schematic flow chart of a block chain-based data acquisition quality verification method;
FIG. 2 is a schematic diagram of the composition of a blockchain-based data acquisition quality verification system;
fig. 3 is a schematic composition diagram of a data acquisition channel fault detection unit.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments of the present invention and features of the embodiments may be combined with each other without conflicting with each other.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described and thus the scope of the present invention is not limited by the specific embodiments disclosed below.
It will be understood by those skilled in the art that in the present disclosure, the terms "longitudinal," "lateral," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in an orientation or positional relationship indicated in the drawings for ease of description and simplicity of description, and do not indicate or imply that the referenced devices or components must be constructed and operated in a particular orientation and thus are not to be considered limiting.
It is understood that the terms "a" and "an" should be interpreted as meaning that a number of one element or element is one in one embodiment, while a number of other elements is one in another embodiment, and the terms "a" and "an" should not be interpreted as limiting the number.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart of a block chain-based data acquisition quality verification method, the present invention provides a block chain-based data acquisition quality verification method for verifying data quality acquired by a data acquisition end from a data source, the method includes:
the data source links the data collected by the data collection end;
acquiring data information A acquired from a data source in a data acquisition end, and acquiring data information B acquired by the data acquisition end and uploaded by the data source on a chain;
verifying whether the data information A is consistent with the data information B;
if the verification result is that the data information A is consistent with the data information B, the data acquired by the data acquisition end is identified to be verified successfully;
and if the verification result is that the data information A is inconsistent with the data information B, the data acquired by the data acquisition end is identified to fail to be verified.
In the embodiment of the present invention, the data source may be any database, server, device, equipment, removable storage, and the like, which stores data, and the specific type and implementation of the data source are not specifically limited in the present invention.
In the embodiment of the present invention, the data acquisition end may be a database or any device, apparatus, server, data storage and the like having a data storage function, and the specific type and implementation manner of the data acquisition end are not specifically limited in the present invention.
In this embodiment, chaining the data acquired by the data acquisition end by the data source specifically means that the data acquired by the data acquisition end is uploaded to the block chain by the data source, wherein the mode of chaining is various, such as content storage certificate, haha storage certificate, link storage certificate, privacy storage certificate, share privacy storage certificate, and the like.
In this embodiment, the data acquisition channel fault detection method in the method includes:
capturing packets at a starting port and a receiving port of a data acquisition channel to obtain two packets,
and comparing whether the information in the two packets is consistent, if so, judging that the data acquisition channel has no fault, and if not, judging that the data transmission channel has a fault.
The mode of verifying whether the data information a is consistent with the data information B in the present invention is a common or conventional mode in the art, and the embodiment of the present invention does not limit the verification mode of verifying whether the specific data is consistent.
In the first embodiment of the present invention, preferably, the failure condition that the data information a and the data information B are inconsistent in the method includes: the method comprises the following steps of sending port faults of a data source, port faults of a data acquisition end, data acquisition channel faults and network faults between the data source and the data acquisition end.
If the fault type is a data acquisition channel fault between the data source and the data acquisition end, fault detection is carried out on the data acquisition channel between the data source and the data acquisition end, and the fault detection mode of the data acquisition channel between the data source and the data acquisition end comprises at least one of the following three modes:
the first mode is as follows: carrying out fault detection on a data acquisition channel from a storage machine of a data source to a front-end processor of the data source;
the second mode is as follows: carrying out fault detection on a data acquisition channel from a front-end processor of a data source to a front-end processor of a data acquisition end;
the third mode is as follows: and carrying out fault detection on a data acquisition channel between a front-end processor of the data acquisition end and a storage machine of the data acquisition end.
In the first embodiment of the present invention, the data acquisition channel fault detection method in the method includes:
capturing packets at a starting port and a receiving port of a data acquisition channel to obtain two packets,
and comparing whether the information in the two packets is consistent, if so, judging that the data acquisition channel has no fault, and if not, judging that the data transmission channel has a fault.
In the first embodiment of the invention, the fault detection information of the data acquisition channel between the data source and the data acquisition end is sent to the data source and/or the data acquisition end.
In the first embodiment of the invention, a packet capturing program similar to wireshark is adopted to detect the transmission data in the channel and detect the problem of transmission failure; other data acquisition channel fault detection modes can be adopted in the embodiment of the invention, and the embodiment of the invention does not specifically limit the data acquisition channel fault detection mode.
The invention can adopt wired communication or wireless communication to send the data acquisition channel fault detection information between the data source and the data acquisition end to the data source and/or the data acquisition end. The failure information may be sent to a monitoring terminal, a monitoring background, a server management terminal, a management platform, or a mobile terminal corresponding to an operation and maintenance worker, and the like, which are not limited in detail.
Example two
Referring to fig. 2, fig. 2 is a schematic diagram illustrating a block chain-based data acquisition quality verification system, and the present invention further provides a block chain-based data acquisition quality verification system for verifying data quality acquired by a data acquisition end from a data source, the system includes:
the uplink unit is used for the data source to uplink the data acquired by the data acquisition end;
the acquisition unit is used for acquiring data information A acquired from a data source in the data acquisition end and acquiring data information B which is uploaded by the data source on the chain and acquired by the data acquisition end;
the checking unit is used for checking whether the data information A is consistent with the data information B;
the processing unit is used for identifying that the data acquired by the data acquisition end is successfully checked if the checking result is that the data information A is consistent with the data information B; and the data verification module is used for identifying that the data verification acquired by the data acquisition terminal fails if the verification result is that the data information A is inconsistent with the data information B.
In a second embodiment of the present invention, the system further includes a fault detection unit, configured to detect a fault type that the data information a and the data information B are inconsistent, where a fault condition that the data information a and the data information B are inconsistent includes: the method comprises the following steps of sending port faults of a data source, port faults of a data acquisition end, data acquisition channel faults and network faults between the data source and the data acquisition end.
In a second embodiment of the present invention, referring to fig. 3, fig. 3 is a schematic diagram illustrating a data acquisition channel fault detection unit, where when the fault type is a data acquisition channel fault between a data source and a data acquisition end, the fault detection unit is specifically a data acquisition channel fault detection unit, and the data acquisition channel fault detection unit specifically includes at least one of the following three modules:
the first data acquisition channel fault detection module: the data acquisition channel is used for carrying out fault detection on a data acquisition channel from a storage machine of a data source to a front-end processor of the data source;
the second data acquisition channel fault detection module: the data acquisition channel is used for carrying out fault detection on a data acquisition channel from a front-end processor of a data source to a front-end processor of a data acquisition end;
the third data acquisition channel fault detection module: the fault detection device is used for carrying out fault detection on a data acquisition channel between a front-end processor of a data acquisition end and a storage machine of the data acquisition end.
EXAMPLE III
The invention also provides a data acquisition quality verification device based on the block chain, which comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, wherein the processor realizes the steps of the data acquisition quality verification method based on the block chain when executing the computer program.
The processor may be a Central Processing Unit (CPU), or other general-purpose processor, a digital signal processor (digital signal processor), an Application Specific Integrated Circuit (Application Specific Integrated Circuit), an off-the-shelf programmable gate array (field programmable gate array) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory may be used to store the computer program and/or the module, and the processor may implement various functions of the device for checking quality of data collection based on block chain in the invention by operating or executing the data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a sound playing function, an image playing function, etc.), and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card, a secure digital card, a flash memory card, at least one magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
Example four
The invention further provides a computer readable storage medium having stored thereon a computer program which, when being executed by a processor, carries out the steps of the block chain based data acquisition quality verification method.
The block chain-based data acquisition quality verification device can be stored in a computer-readable storage medium if the device is implemented in the form of a software functional unit and sold or used as an independent product. Based on such understanding, all or part of the flow in the method of implementing the embodiments of the present invention may also be stored in a computer readable storage medium through a computer program, and when the computer program is executed by a processor, the computer program may implement the steps of the above-described method embodiments. Wherein the computer program comprises computer program code, an object code form, an executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying said computer program code, a recording medium, a usb-disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory, a random access memory, a point carrier signal, a telecommunications signal, a software distribution medium, etc. It should be noted that the computer readable medium may contain content that is appropriately increased or decreased as required by legislation and patent practice in the jurisdiction.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (10)

1. The block chain-based data acquisition quality verification method is used for verifying the data quality acquired by a data acquisition end from a data source, and is characterized by comprising the following steps:
the data source links the data collected by the data collection end;
acquiring data information A acquired from a data source in a data acquisition end, and acquiring data information B acquired by the data acquisition end and uploaded by the data source on a chain;
verifying whether the data information A is consistent with the data information B;
if the verification result is that the data information A is consistent with the data information B, the data acquired by the data acquisition end is identified to be verified successfully;
and if the verification result is that the data information A is inconsistent with the data information B, the data acquired by the data acquisition end is identified to fail to be verified.
2. The blockchain-based data acquisition quality verification method according to claim 1, wherein the failure condition that the data information a is inconsistent with the data information B includes: the method comprises the following steps of sending port faults of a data source, port faults of a data acquisition end, data acquisition channel faults and network faults between the data source and the data acquisition end.
3. The blockchain-based data acquisition quality verification method according to claim 2, wherein if the fault type is a data acquisition channel fault between the data source and the data acquisition end, fault detection is performed on the data acquisition channel between the data source and the data acquisition end, and the data acquisition channel fault detection method between the data source and the data acquisition end includes at least one of the following three methods:
the first mode is as follows: carrying out fault detection on a data acquisition channel from a storage machine of a data source to a front-end processor of the data source;
the second mode is as follows: carrying out fault detection on a data acquisition channel from a front-end processor of a data source to a front-end processor of a data acquisition end;
the third mode is as follows: and carrying out fault detection on a data acquisition channel between a front-end processor of the data acquisition end and a storage machine of the data acquisition end.
4. The blockchain-based data acquisition quality verification method according to claim 3, wherein a data acquisition channel fault detection mode in the method includes:
capturing packets at a starting port and a receiving port of a data acquisition channel to obtain two packets,
and comparing whether the information in the two packets is consistent, if so, judging that the data acquisition channel has no fault, and if not, judging that the data transmission channel has a fault.
5. The blockchain-based data acquisition quality verification method according to claim 2, wherein data acquisition channel fault detection information between the data source and the data acquisition end is sent to the data source and/or the data acquisition end.
6. Data acquisition quality verification system based on block chain for verifying data quality acquired by data acquisition end from data source, characterized in that the system comprises:
the uplink unit is used for the data source to uplink the data acquired by the data acquisition end;
the acquisition unit is used for acquiring data information A acquired from a data source in the data acquisition end and acquiring data information B which is uploaded by the data source on the chain and acquired by the data acquisition end;
the checking unit is used for checking whether the data information A is consistent with the data information B;
the processing unit is used for identifying that the data acquired by the data acquisition end is successfully checked if the checking result is that the data information A is consistent with the data information B; and the data verification module is used for identifying that the data verification acquired by the data acquisition terminal fails if the verification result is that the data information A is inconsistent with the data information B.
7. The blockchain-based data acquisition quality verification system according to claim 6, wherein the system further comprises a fault detection unit for detecting a fault type of the inconsistency between the data information A and the data information B, and the fault condition of the inconsistency between the data information A and the data information B includes: the method comprises the following steps of sending port faults of a data source, port faults of a data acquisition end, data acquisition channel faults and network faults between the data source and the data acquisition end.
8. The system according to claim 7, wherein when the failure type is a failure of a data acquisition channel from a data source to a data acquisition end, the failure detection unit is specifically a data acquisition channel failure detection unit, and the data acquisition channel failure detection unit specifically includes at least one of the following three modules:
the first data acquisition channel fault detection module: the data acquisition channel is used for carrying out fault detection on a data acquisition channel from a storage machine of a data source to a front-end processor of the data source;
the second data acquisition channel fault detection module: the data acquisition channel is used for carrying out fault detection on a data acquisition channel from a front-end processor of a data source to a front-end processor of a data acquisition end;
the third data acquisition channel fault detection module: the fault detection device is used for carrying out fault detection on a data acquisition channel between a front-end processor of a data acquisition end and a storage machine of the data acquisition end.
9. A blockchain based data acquisition quality verification apparatus comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor when executing the computer program implements the steps of the blockchain based data acquisition quality verification method according to any one of claims 1 to 5.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the blockchain based data acquisition quality verification method according to any one of claims 1 to 5.
CN202110040372.7A 2021-01-13 2021-01-13 Block chain-based data acquisition quality verification method, system, device and medium Active CN112783942B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110040372.7A CN112783942B (en) 2021-01-13 2021-01-13 Block chain-based data acquisition quality verification method, system, device and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110040372.7A CN112783942B (en) 2021-01-13 2021-01-13 Block chain-based data acquisition quality verification method, system, device and medium

Publications (2)

Publication Number Publication Date
CN112783942A true CN112783942A (en) 2021-05-11
CN112783942B CN112783942B (en) 2022-12-06

Family

ID=75755583

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110040372.7A Active CN112783942B (en) 2021-01-13 2021-01-13 Block chain-based data acquisition quality verification method, system, device and medium

Country Status (1)

Country Link
CN (1) CN112783942B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113656842A (en) * 2021-08-10 2021-11-16 支付宝(杭州)信息技术有限公司 Data verification method, device and equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200067907A1 (en) * 2018-08-21 2020-02-27 HYPR Corp. Federated identity management with decentralized computing platforms
CN111209600A (en) * 2019-12-31 2020-05-29 阿尔法云计算(深圳)有限公司 Block chain-based data processing method and related product
CN111740838A (en) * 2020-05-22 2020-10-02 青岛万民科技有限公司 Trusted uplink method and system for block chain data
CN112070502A (en) * 2020-11-10 2020-12-11 支付宝(杭州)信息技术有限公司 Data verification method and system based on block chain
CN112100689A (en) * 2020-11-19 2020-12-18 支付宝(杭州)信息技术有限公司 Trusted data processing method, device and equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200067907A1 (en) * 2018-08-21 2020-02-27 HYPR Corp. Federated identity management with decentralized computing platforms
CN111209600A (en) * 2019-12-31 2020-05-29 阿尔法云计算(深圳)有限公司 Block chain-based data processing method and related product
CN111740838A (en) * 2020-05-22 2020-10-02 青岛万民科技有限公司 Trusted uplink method and system for block chain data
CN112070502A (en) * 2020-11-10 2020-12-11 支付宝(杭州)信息技术有限公司 Data verification method and system based on block chain
CN112100689A (en) * 2020-11-19 2020-12-18 支付宝(杭州)信息技术有限公司 Trusted data processing method, device and equipment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ZHICAI HUANG ET AL.: "Blockchain-based Data Security Management Mechanism for Power Terminals", 《2020 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING (IWCMC)》 *
刘峰等: "一种面向双中台双链架构的内生性数据安全交互协议研究", 《华东师范大学学报(自然科学版)》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113656842A (en) * 2021-08-10 2021-11-16 支付宝(杭州)信息技术有限公司 Data verification method, device and equipment
CN113656842B (en) * 2021-08-10 2024-02-02 支付宝(杭州)信息技术有限公司 Data verification method, device and equipment

Also Published As

Publication number Publication date
CN112783942B (en) 2022-12-06

Similar Documents

Publication Publication Date Title
CN113127338A (en) Firmware testing method, server and computer readable storage medium
CN113032792B (en) System business vulnerability detection method, system, equipment and storage medium
CN105787364B (en) Automatic testing method, device and system for tasks
CN113114659B (en) Diagnostic equipment detection method and device, terminal equipment and storage medium
CN110990362A (en) Log query processing method and device, computer equipment and storage medium
CN111339151B (en) Online examination method, device, equipment and computer storage medium
CN111476107A (en) Image processing method and device
CN113448834A (en) Buried point testing method and device, electronic equipment and storage medium
CN112783942B (en) Block chain-based data acquisition quality verification method, system, device and medium
CN112948224B (en) Data processing method, device, terminal and storage medium
CN102866932A (en) Method and device for providing and collecting data related to abnormal terminal
CN113765850B (en) Internet of things abnormality detection method and device, computing equipment and computer storage medium
CN113176968A (en) Safety test method, device and storage medium based on interface parameter classification
CN111885088A (en) Log monitoring method and device based on block chain
CN109542947B (en) Data statistical method, device, computer equipment and storage medium
CN107835174B (en) Account book anti-fraud system and method based on Internet of things
CN115801538A (en) Site server application asset deep identification method, system and equipment
CN112887295B (en) Block chain-based data transmission safety detection method, system, device and medium
CN114780412A (en) Page testing method, system, device and medium
US20170094542A1 (en) Mobile terminal flow identification method and apparatus
CN113868137A (en) Method, device and system for processing buried point data and server
CN108200060B (en) Single sign-on verification method based on web subsystem, server and storage medium
CN111934949A (en) Safety test system based on database injection test
CN113810332A (en) Encrypted data message judgment method and device and computer equipment
CN115050117B (en) Vehicle diagnosis report generation method and device and diagnosis equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant