CN113259489B - Multi-source data sharing system and sharing method based on block chain - Google Patents
Multi-source data sharing system and sharing method based on block chain Download PDFInfo
- Publication number
- CN113259489B CN113259489B CN202110722475.1A CN202110722475A CN113259489B CN 113259489 B CN113259489 B CN 113259489B CN 202110722475 A CN202110722475 A CN 202110722475A CN 113259489 B CN113259489 B CN 113259489B
- Authority
- CN
- China
- Prior art keywords
- data
- node
- layer
- contract
- management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
- H04L67/1078—Resource delivery mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
- H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
- H04L63/045—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload wherein the sending and receiving network entities apply hybrid encryption, i.e. combination of symmetric and asymmetric encryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/50—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols using hash chains, e.g. blockchains or hash trees
Abstract
The invention relates to a multi-source data sharing system and method based on a block chain. The system comprises: the long and short time data processing layer is used for being responsible for node management, data message transceiving, resource scheduling and sandbox scheduling; the blockchain layer is used for node certificate management, intelligent contract management, consensus algorithm management, transaction log uplink management and blockchain inquiry management; the View layer back end and the View layer front end are used for user management, contract record management, data record management and resource utilization rate display; the main node is used for realizing the registration of a data provider, the registration and management of a user and the registration and management of an intelligent contract by using web service; the data node is used for providing data and realizing the sharability of the data through the registration of the data; the computing nodes are used for carrying out data computation; hybrid nodes are used to provide data as well as computing services. The invention effectively eliminates the possible mutual distrust and other problems between the data provider and the data user, and finally realizes the safe sharing of the data.
Description
Technical Field
The invention relates to the field of block chains, Internet and data sharing, in particular to a multi-source data sharing system and a multi-source data sharing method based on the block chains.
Background
In the current data service, processing and exchange field, only a single-source data service strategy exists, and meanwhile, even in the single-source data exchange field, the problem of safe sharing of data still cannot be solved.
Therefore, a multi-source data trusted sharing system is needed to solve the problem of data fusion analysis across time, multiple domains and multiple sources, and simultaneously solve the problems of unreliability and incapability of tracking data usage records in the data exchange process. Powerful support is provided for credible data processing, exchange and service.
Disclosure of Invention
The invention aims to provide a multi-source data sharing system and a multi-source data sharing method based on a block chain, which effectively solve the problems of mutual distrust and the like possibly existing between a data provider and a data user and finally realize the safe sharing of data.
In order to achieve the purpose, the invention provides the following scheme:
a blockchain-based multi-source data sharing system, comprising: the system comprises a long-time data processing layer, a block chain layer, a View layer rear end, a View layer front end, a main node, a data node, a calculation node and a mixed node;
the long and short time data processing layer is used for being responsible for node management, data message transceiving, resource scheduling and sandbox scheduling;
the block chain layer is used for node certificate management, intelligent contract management, consensus algorithm management, transaction log uplink management and block chain inquiry management;
the View layer back end and the View layer front end are used for user management, contract record management, data record management and resource utilization rate display;
the main node is used for realizing the registration of a data provider, the registration and management of a user and the registration and management of an intelligent contract by using web service;
the data node is used for providing data and realizing the sharability of the data through the registration of the data;
the computing nodes are used for carrying out data computation;
the hybrid node is used for providing data and computing services;
when the contract task is executed after the front end of the View layer completes the registration of the contract task, starting the back end of the View layer; utilizing the block chain layer to chain up the execution log of the contract task; meanwhile, the long-time and short-time data processing layer sends the contract task to a corresponding computing node; the computing node puts the contract task into a sandbox task formation in the computing node for analysis, and starts a sandbox program instance in an API (application programming interface) calling mode; the sandbox program example generates a symmetric encryption key, encrypts the symmetric key by using a public key of a corresponding data node in the contract task, and performs data request pulling work; the data node verifies a data pulling request transmitted from a sandbox program example of the computing node, encrypts data by using a symmetric encryption key transmitted from the sandbox program example after the verification is passed, and transmits the data in a fragmentation manner through the long-time data processing layer; the computing node puts the received multi-source data into a specified data directory in a sandbox program example, then starts an intelligent contract, processes the data, and continuously transmits a processing result back to the host node in real time; after receiving a processing result of an intelligent contract, the main node sends the processing result to the front end of the View layer, and simultaneously requests the processing result to a block chain layer for chain winding work; and the main node requests health monitoring messages from all nodes at regular time, judges the processing result according to the received or non-received result, and simultaneously transmits the processing result to the front end of the View layer, the back end of the View layer and the request block chain layer for uplink.
Optionally, the long and short time data processing layer includes: the system comprises a node management module, a data message transceiving module, a resource scheduling module and a sandbox scheduling module;
the node management module comprises: a plurality of timed health monitoring units; the timing health monitoring unit is used for inquiring the health state of the corresponding node from all nodes in the decentralized system at regular time, and simultaneously requesting a log uplink interface provided by a block chain layer to realize uplink of the node health result;
the data message receiving and sending module is used for receiving and sending messages of the nodes;
the resource scheduling module is used for selecting the computing processing nodes of the intelligent contract of the undefined computing node;
the sandbox scheduling module is used for obtaining the intelligent contract from the intelligent contract task queue and executing the task of the intelligent contract.
Optionally, the block chain layer includes: the system comprises a node certificate management module, an intelligent contract management module, a consensus algorithm management module, a transaction log uplink management module and a block chain inquiry management module;
the node certificate management module is used for issuing certificates for each node;
the intelligent contract management module is used for connecting contract use work among the data provider, the calculation provider and the data user;
the consensus algorithm management module is used for realizing the management work of the block chain consensus algorithm;
the transaction log uplink management module is used for realizing uplink work of system use records, and realizing the uplink work of the system work log records by externally specifying use logs with different formats and providing corresponding API (application program interface) services;
and the block chain query management module is used for providing query work of block chain contents for the front end of the View layer.
Optionally, the View layer rear end and the View layer front end include: the system comprises a user management module, a contract record management module, a data record management module and a resource utilization rate display module;
the user management module is used for the creation and query work of a user;
the contract record management module is used for establishing and executing work of an intelligent contract;
the data record management module is used for realizing data uplink recording work of a data provider and realizing data registration and uplink work by providing a visual Web front-end visual interface;
the resource utilization rate display module is used for displaying the resource utilization rate condition of each node in the current decentralized system for the logged user; the resource utilization conditions include: parallel sandbox data, CPU utilization, disk utilization, and GPU number.
A multisource data sharing method based on a block chain comprises the following steps:
the front end of the View layer registers contract tasks;
starting the back end of the View layer when executing the contract task after the front end of the View layer completes the registration of the contract task;
utilizing a block chain layer to chain up the execution log of the contract task; meanwhile, the contract task is sent to a corresponding computing node through a long-time data processing layer and a short-time data processing layer;
the computing node puts the contract task into a sandbox task formation in the computing node for analysis, and starts a sandbox program instance in an API (application programming interface) calling mode;
the sandbox program example generates a symmetric encryption key, encrypts the symmetric key by using a public key of a corresponding data node in the contract task, and performs data request pulling work;
the data node verifies a data pulling request transmitted from a sandbox program example of the computing node, encrypts data by using a symmetric encryption key transmitted from the sandbox program example after the verification is passed, and transmits the data in a fragmentation manner through the long-time data processing layer;
the computing node puts the received multi-source data into a specified data directory in the sandbox program example, then starts an intelligent contract, processes the data, and continuously transmits the processing result back to the main node in real time;
and after receiving the processing result of the intelligent contract, the main node transmits the processing result to the front end of the View layer and simultaneously requests the block chain layer for chain linking work of the processing result.
Optionally, the registering of the contract task by the front end of the View layer specifically includes:
the method comprises the following steps of registering an organization, and simultaneously generating an administrator account and a password of the organization, a public key and a private key of the organization, and the type of an organization node;
the user registers and binds with the corresponding mechanism;
and signing a contract task and finishing the registration of the contract task.
Optionally, after receiving the processing result of the intelligent contract, the main node sends the processing result to the front end of the View layer, and requests the processing result to the block chain layer for uplink operation, and then the method further includes:
and the main node requests health monitoring messages from all nodes at regular time, judges the processing result according to the received or non-received result, and simultaneously transmits the processing result to the front end of the View layer, the back end of the View layer and the request block chain layer for uplink.
According to the specific embodiment provided by the invention, the invention discloses the following technical effects:
according to the multisource data sharing system and method based on the block chain, the same intelligent contract can use data of a plurality of data providers, and therefore data cross-time and cross-block fusion analysis is achieved. When the sandbox receives a task, the encrypted data is pulled from the corresponding multiple data sources simultaneously, and after the data is prepared in the sandbox, the contract is executed. The symmetric encryption key is transmitted by using an asymmetric encryption method, the data encryption pulling work of multiple data sources is realized by using the symmetric encryption key, and after the data of single source and multiple sources are pulled into the sandbox, the data is decrypted and the contract is executed, and the execution result of the intelligent contract is returned to the main node. And after the task is executed, the data is destroyed immediately, so that the trusted processing and exchange work of the data is realized. The invention solves the problem of data fusion analysis of cross-time, multi-domain and multi-source data, and simultaneously solves the problems of unreliability and incapability of tracking data use records in the data exchange process. Powerful support is provided for credible data processing, exchange and service.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.
FIG. 1 is a block chain-based multi-source data sharing system according to the present invention;
FIG. 2 is a diagram of contract execution, data transfer;
FIG. 3 is a log, results chaining diagram.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention aims to provide a multi-source data sharing system and a multi-source data sharing method based on a block chain, which effectively solve the problems of mutual distrust and the like possibly existing between a data provider and a data user and finally realize the safe sharing of data.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Fig. 1 is a schematic structural diagram of a block chain-based multi-source data sharing system provided by the present invention, and as shown in fig. 1, the block chain-based multi-source data sharing system provided by the present invention includes: the system comprises a long-time data processing layer, a block chain layer, a View layer rear end, a View layer front end, a main node, a data node, a calculation node and a mixed node.
The long and short time data processing layer is used for being responsible for node management, data message transceiving, resource scheduling and sandbox scheduling.
The blockchain layer is used for node certificate management, intelligent contract management, consensus algorithm management, transaction log uplink management and blockchain inquiry management.
And the View layer back end and the View layer front end are used for user management, contract record management, data record management and resource utilization rate display.
The main node is used for realizing the registration of a data provider, the registration and management of a user and the registration and management of an intelligent contract by using the web service.
The data node is used for providing data and realizing the sharability of the data through the registration of the data.
The computing nodes are used for data computation.
The hybrid node is used for providing data and computing services.
The four types of nodes are mainly used for distinguishing different roles in the node with the overall decentralized structure and completing division of work for different roles.
When the contract task is executed after the front end of the View layer completes the registration of the contract task, starting the back end of the View layer; utilizing the block chain layer to chain up the execution log of the contract task; meanwhile, the long-time and short-time data processing layer sends the contract task to a corresponding computing node; the computing node puts the contract task into a sandbox task formation in the computing node for analysis, and starts a sandbox program instance in an API (application programming interface) calling mode; the sandbox program example generates a symmetric encryption key, encrypts the symmetric key by using a public key of a corresponding data node in the contract task, and performs data request pulling work; the data node verifies a data pulling request transmitted from a sandbox program example of the computing node, encrypts data by using a symmetric encryption key transmitted from the sandbox program example after the verification is passed, and transmits the data in a fragmentation manner through the long-time data processing layer; the computing node puts the received multi-source data into a specified data directory in a sandbox program example, then starts an intelligent contract, processes the data, and continuously transmits a processing result back to the host node in real time; after receiving a processing result of an intelligent contract, the main node sends the processing result to the front end of the View layer, and simultaneously requests the processing result to a block chain layer for chain winding work; and the main node requests health monitoring messages from all nodes at regular time, judges the processing result according to the received or non-received result, and simultaneously transmits the processing result to the front end of the View layer, the back end of the View layer and the request block chain layer for uplink.
The invention can provide service for multi-source data and mainly realizes encrypted pull reporting of the multi-source data. The key to multi-source data encryption pull is to use different source data of multiple data nodes simultaneously, rather than using only one data node. By pulling data from a plurality of data nodes, the characteristics of cross-time and cross-region fusion and uniform analysis of the data are realized.
The invention can be a safe sandbox processing environment, and mainly works to provide a credible and safe working environment for data exchange and processing. The environment is mainly characterized in that the environment is completely isolated from the outside except for a single data pulling network channel, and data caching service is not provided. The processing of the smart contracts is entirely internal to the sandbox. And simultaneously, returning the processing result of the intelligent contract at regular time.
The long and short time data processing layer comprises: the system comprises a node management module, a data message transceiving module, a resource scheduling module and a sandbox scheduling module. The long and short time data processing layer (LSDT layer) has the core that the long and short time data processing layer realizes the operations of data message receiving and sending, result receiving, resource scheduling and the like in a decentralized system.
The node management module comprises: a plurality of timed health monitoring units; the timing health monitoring unit is used for inquiring the health state of the corresponding node from all the nodes in the decentralized system at regular time, and simultaneously requesting a log uplink interface provided by a block chain layer to realize uplink of the node health result.
The data message receiving and sending module is used for receiving and sending messages of the nodes. The data messaging module includes, but is not limited to, messaging components using rockmq and the like.
The resource scheduling module is used for selecting the computing processing nodes of the intelligent contract of the undefined computing node to work. The core of the intelligent contract management system is that a health monitoring module is used to select a computing node with the optimal health degree, so that an intelligent contract is deployed, executed and returned.
The sandbox scheduling module is used for obtaining the intelligent contract from the intelligent contract task queue and executing the task of the intelligent contract. The main work flow of the method comprises the steps of receiving an encryption task, pulling encrypted data according to the task, decrypting the data, executing an algorithm and returning a result.
The block chain layer includes: the system comprises a node certificate management module, an intelligent contract management module, a consensus algorithm management module, a transaction log uplink management module and a block chain inquiry management module. The blockchain layer (blockchain layer) is mainly responsible for node certificate management, intelligent contract management, consensus algorithm management, transaction log uplink management and blockchain inquiry management.
The node certificate management module is used for issuing certificates for all nodes. The node certificate management module includes, but is not limited to, public and private keys, and the like. Generally, the algorithm of the public and private keys uses an elliptic curve encryption algorithm of asymmetric encryption. The common main work is that a public and private key generation request of the front end of the View layer is received, the generated public and private keys are stored in a View back-end database, and basic encryption and signature work is provided for distribution of intelligent contract tasks.
The intelligent contract management module is used for connecting contract use work among the data providers, the calculation providers and the data users. By providing the user with the contract creation work, the form single-party and multi-party data use protocol is formed. And storing the protocol into a database at the back end of the View. And simultaneously recording the execution dynamic code ID of each contract.
The consensus algorithm management module is used for realizing the management work of the block chain consensus algorithm. The system can simultaneously provide a plurality of sets of consensus algorithms, thereby realizing services selected according to needs, and simultaneously can provide conversion analysis services among each other, thereby realizing the mutual analysis and conversion work of the contents of different blocks.
The transaction log uplink management module is used for realizing uplink work of system use records, and the uplink work of the system work log records is realized by externally specifying use logs with different formats and providing corresponding API (application program interface) services. Thereby enabling a full traceability of the system usage record.
And the block chain query management module is used for providing query work of block chain contents for the front end of the View layer. Querying and parsing of the blockchain content, including but not limited to signature, content, block height, dynamic ID, etc., is achieved by providing an API.
The View layer back end and the View layer front end comprise: the system comprises a user management module, a contract record management module, a data record management module and a resource utilization rate display module. The front layer and the rear layer of the View layer are mainly responsible for user management, contract record management, data record management and resource utilization rate display work.
The user management module is used for the creation and query work of the user. In this system, each node and user belongs to a certain organization.
The contract record management module is used for creating intelligent contracts and executing work. And creating and executing an intelligent contract by providing a visual new interface at the front end of the Web.
The data record management module is used for realizing data uplink recording work of a data provider and realizing data registration and uplink work by providing a visual Web front-end visual interface. And the data registration and uplink work is realized by providing a visual Web front-end visual interface.
The resource utilization rate display module is used for displaying the resource utilization rate condition of each node in the current decentralized system for the logged user; the resource utilization conditions include: parallel sandbox data, CPU utilization, disk utilization, GPU number, and the like.
A multisource data sharing method based on a block chain comprises the following steps:
and S101, registering a contract task at the front end of the View layer.
S102, when the front end of the View layer completes the registration of the contract task and executes the contract task, the back end of the View layer is started.
S103, utilizing a block chain layer to chain up the execution log of the contract task; and simultaneously, sending the contract task to a corresponding computing node through a long-time data processing layer.
And S104, the computing node puts the contract task into a sandbox task formation in the computing node for analysis, and starts a sandbox program instance in an API (application program interface) calling mode.
And S105, the sandbox program example generates a symmetric encryption key, encrypts the symmetric key by using the public key of the corresponding data node in the contract task, and performs data request pulling work. The symmetric key is mainly used for the data node to encrypt transmission data.
The key point is that the public key of each data node in the task is used for encrypting a symmetric encryption key to be transmitted, and the public key of each data node is obtained from the task issued by the main node, so that the safety of the data nodes in the key exchange and data transmission processes is ensured.
And S106, the data node verifies the data pulling request transmitted from the sandbox program example of the computing node, encrypts the data by using the symmetric encryption key transmitted from the sandbox program example after the verification is passed, and transmits the data in a fragmentation manner through the long and short data processing layer.
And each data node verifies the content of the data pulling request by using the private key of the data node.
And S107, the computing node puts the received multi-source data into a specified data directory in the sandbox program example, then starts an intelligent contract, processes the data, and continuously transmits the processing result back to the main node in real time.
And S108, after receiving the processing result of the intelligent contract, the main node sends the processing result to the front end of the View layer, and simultaneously requests the processing result to a block chain layer for uplink work.
S101, specifically comprising:
and the mechanism registers and simultaneously generates an administrator account and a password of the mechanism, a public key and a private key of the mechanism and the type of a mechanism node.
The user registers and is in binding association with the corresponding organization.
And signing a contract task and finishing the registration of the contract task. The user makes an intelligent contract for the data to be used. When a contract is signed, a common recognition algorithm needed to be used by a computing center and a chain link can be selected, the computing center can also be appointed by the system, meanwhile, the contract can be selected to be executed at any time, in the step, a contract ID is distributed for the intelligent contract, and the system distributes a dynamic ID when executing the contract each time. Each smart contract may be executed multiple times.
After S108, further comprising:
and the main node requests health monitoring messages from all nodes at regular time, judges the processing result according to the received or non-received result, and simultaneously transmits the processing result to the front end of the View layer, the back end of the View layer and the request block chain layer for uplink.
As shown in fig. 2, the contract execution and data transmission specifically include the following steps:
and S1, the main node issues an intelligent contract execution request, encrypts the task by using the public key of each node related to the intelligent contract and transmits the task to each node. As shown at 1, 2, 3 in fig. 1.
S2, the computing node obtains the task from the sandbox management module, newly builds the sandbox instance, and encrypts the data pulling request by using the public key of one or more data nodes.
And S3, after the data node verifies the request, the data node encrypts the data by using the transmitted key and transmits the encrypted data to the computing node.
S4, the computing node executes the intelligent contract and transmits the log and result back to the front end of the main node View, and simultaneously performs the uplink operation
As shown in fig. 3, the specific steps of logging and result linking are as follows:
s1, each node receives the uplink request and broadcasts the content block.
And S2, after receiving the block broadcast, each node performs mining work by using a consensus algorithm.
And S3, broadcasting the successfully dug blocks after the ore digging is successful. And finally performing uplink.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the system disclosed by the embodiment, the description is relatively simple because the system corresponds to the method disclosed by the embodiment, and the relevant points can be referred to the method part for description.
The principles and embodiments of the present invention have been described herein using specific examples, which are provided only to help understand the method and the core concept of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed. In view of the above, the present disclosure should not be construed as limiting the invention.
Claims (7)
1. A block chain based multi-source data sharing system, comprising: the system comprises a long-time data processing layer, a block chain layer, a View layer rear end, a View layer front end, a main node, a data node, a calculation node and a mixed node;
the long and short time data processing layer is used for being responsible for node management, data message transceiving, resource scheduling and sandbox scheduling;
the block chain layer is used for node certificate management, intelligent contract management, consensus algorithm management, transaction log uplink management and block chain inquiry management;
the View layer back end and the View layer front end are used for user management, contract record management, data record management and resource utilization rate display;
the main node is used for realizing the registration of a data provider, the registration and management of a user and the registration and management of an intelligent contract by using web service;
the data node is used for providing data and realizing the sharability of the data through the registration of the data;
the computing nodes are used for carrying out data computation;
the hybrid node is used for providing data and computing services;
when the contract task is executed after the front end of the View layer completes the registration of the contract task, starting the back end of the View layer; utilizing the block chain layer to chain up the execution log of the contract task; meanwhile, the long-time and short-time data processing layer sends the contract task to a corresponding computing node; the computing node puts the contract task into a sandbox task formation in the computing node for analysis, and starts a sandbox program instance in an API (application programming interface) calling mode; the sandbox program example generates a symmetric encryption key, encrypts the symmetric key by using a public key of a corresponding data node in the contract task, and performs data request pulling work; the data node verifies a data pulling request transmitted from a sandbox program example of the computing node, encrypts data by using a symmetric encryption key transmitted from the sandbox program example after the verification is passed, and transmits the data in a fragmentation manner through the long-time data processing layer; the computing node puts the received multi-source data into a specified data directory in a sandbox program example, then starts an intelligent contract, processes the data, and continuously transmits a processing result back to the host node in real time; after receiving a processing result of an intelligent contract, the main node sends the processing result to the front end of the View layer, and simultaneously requests the processing result to a block chain layer for chain winding work; and the main node requests health monitoring messages from all nodes at regular time, judges the processing result according to the received or non-received result, and simultaneously transmits the processing result to the front end of the View layer, the back end of the View layer and the request block chain layer for uplink.
2. The block chain-based multi-source data sharing system according to claim 1, wherein the long-time data processing layer comprises: the system comprises a node management module, a data message transceiving module, a resource scheduling module and a sandbox scheduling module;
the node management module comprises: a plurality of timed health monitoring units; the timing health monitoring unit is used for inquiring the health state of the corresponding node from all nodes in the decentralized system at regular time, and simultaneously requesting a log uplink interface provided by a block chain layer to realize uplink of the node health result;
the data message receiving and sending module is used for receiving and sending messages of the nodes;
the resource scheduling module is used for selecting the computing processing nodes of the intelligent contract of the undefined computing node;
the sandbox scheduling module is used for obtaining the intelligent contract from the intelligent contract task queue and executing the task of the intelligent contract.
3. The block chain-based multi-source data sharing system according to claim 1, wherein the block chain layer comprises: the system comprises a node certificate management module, an intelligent contract management module, a consensus algorithm management module, a transaction log uplink management module and a block chain inquiry management module;
the node certificate management module is used for issuing certificates for each node;
the intelligent contract management module is used for connecting contract use work among the data provider, the calculation provider and the data user;
the consensus algorithm management module is used for realizing the management work of the block chain consensus algorithm;
the transaction log uplink management module is used for realizing uplink work of system use records, and realizing the uplink work of the system work log records by externally specifying use logs with different formats and providing corresponding API (application program interface) services;
and the block chain query management module is used for providing query work of block chain contents for the front end of the View layer.
4. The blockchain-based multi-source data sharing system according to claim 1, wherein the View layer back-end and View layer front-end comprise: the system comprises a user management module, a contract record management module, a data record management module and a resource utilization rate display module;
the user management module is used for the creation and query work of a user;
the contract record management module is used for establishing and executing work of an intelligent contract;
the data record management module is used for realizing data uplink recording work of a data provider and realizing data registration and uplink work by providing a visual Web front-end visual interface;
the resource utilization rate display module is used for displaying the resource utilization rate condition of each node in the current decentralized system for the logged user; the resource utilization conditions include: parallel sandbox data, CPU utilization, disk utilization, and GPU number.
5. A multisource data sharing method based on a block chain is characterized by comprising the following steps:
the front end of the View layer registers contract tasks;
starting the back end of the View layer when executing the contract task after the front end of the View layer completes the registration of the contract task;
utilizing a block chain layer to chain up the execution log of the contract task; meanwhile, the contract task is sent to a corresponding computing node through a long-time data processing layer and a short-time data processing layer;
the computing node puts the contract task into a sandbox task formation in the computing node for analysis, and starts a sandbox program instance in an API (application programming interface) calling mode;
the sandbox program example generates a symmetric encryption key, encrypts the symmetric key by using a public key of a corresponding data node in the contract task, and performs data request pulling work;
the data node verifies a data pulling request transmitted from a sandbox program example of the computing node, encrypts data by using a symmetric encryption key transmitted from the sandbox program example after the verification is passed, and transmits the data in a fragmentation manner through the long-time data processing layer;
the computing node puts the received multi-source data into a specified data directory in the sandbox program example, then starts an intelligent contract, processes the data, and continuously transmits the processing result back to the main node in real time;
and after receiving the processing result of the intelligent contract, the main node transmits the processing result to the front end of the View layer and simultaneously requests the block chain layer for chain linking work of the processing result.
6. The block chain-based multi-source data sharing method according to claim 5, wherein the registering of the contract task by the View layer front end specifically comprises:
the method comprises the following steps of registering an organization, and simultaneously generating an administrator account and a password of the organization, a public key and a private key of the organization, and the type of an organization node;
the user registers and binds with the corresponding mechanism;
and signing a contract task and finishing the registration of the contract task.
7. The method of claim 5, wherein after receiving the processing result of the smart contract, the primary node sends the processing result to the front end of the View layer, and requests the block chain layer to perform uplink operation simultaneously, and further comprising:
and the main node requests health monitoring messages from all nodes at regular time, judges the processing result according to the received or non-received result, and simultaneously transmits the processing result to the front end of the View layer, the back end of the View layer and the request block chain layer for uplink.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110722475.1A CN113259489B (en) | 2021-06-29 | 2021-06-29 | Multi-source data sharing system and sharing method based on block chain |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110722475.1A CN113259489B (en) | 2021-06-29 | 2021-06-29 | Multi-source data sharing system and sharing method based on block chain |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113259489A CN113259489A (en) | 2021-08-13 |
| CN113259489B true CN113259489B (en) | 2021-09-14 |
Family
ID=77190077
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110722475.1A Active CN113259489B (en) | 2021-06-29 | 2021-06-29 | Multi-source data sharing system and sharing method based on block chain |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113259489B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114422603A (en) * | 2022-03-30 | 2022-04-29 | 深圳市一航网络信息技术有限公司 | Excitation method and device based on BCDN (binary-coded decimal) network, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109729168A (en) * | 2018-12-31 | 2019-05-07 | 浙江成功软件开发有限公司 | A kind of data share exchange system and method based on block chain |
| CN112446048A (en) * | 2020-11-26 | 2021-03-05 | 平安科技（深圳）有限公司 | Data sharing method, system, terminal and storage medium based on block chain |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107453865B (en) * | 2017-07-18 | 2020-09-11 | 众安信息技术服务有限公司 | Multi-party data sharing method and system for protecting privacy of data sending source |
| US11487851B2 (en) * | 2018-03-19 | 2022-11-01 | International Business Machines Corporation | Using blockchain for flexible application licensing |
-
2021
- 2021-06-29 CN CN202110722475.1A patent/CN113259489B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109729168A (en) * | 2018-12-31 | 2019-05-07 | 浙江成功软件开发有限公司 | A kind of data share exchange system and method based on block chain |
| CN112446048A (en) * | 2020-11-26 | 2021-03-05 | 平安科技（深圳）有限公司 | Data sharing method, system, terminal and storage medium based on block chain |
Non-Patent Citations (1)
| Title |
|---|
| 融入区块链技术的大数据征信平台的设计与应用研究;琚春华 等;《计算机科学》;20181130;第522-526页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113259489A (en) | 2021-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230023857A1 (en) | Data processing method and apparatus, intelligent device, and storage medium | |
| CN106357396B (en) | Digital signature method and system and quantum key card | |
| Tariq et al. | Securing broker-less publish/subscribe systems using identity-based encryption | |
| US6941457B1 (en) | Establishing a new shared secret key over a broadcast channel for a multicast group based on an old shared secret key | |
| CN110601816B (en) | Lightweight node control method and device in block chain system | |
| CN109450843B (en) | SSL certificate management method and system based on block chain | |
| Premkamal et al. | Enhanced attribute based access control with secure deduplication for big data storage in cloud | |
| Bao et al. | A lightweight privacy‐preserving scheme with data integrity for smart grid communications | |
| CN113034135A (en) | Block chain-based information processing method, apparatus, device, medium, and product | |
| CN112883015A (en) | Block chain data management method, device and storage medium | |
| CN113949701A (en) | Ciphertext searching method based on trusted execution environment | |
| CN113259489B (en) | Multi-source data sharing system and sharing method based on block chain | |
| Hong et al. | A secure peer to peer multiparty transaction scheme based on blockchain | |
| Sui et al. | An efficient signcryption protocol for hop-by-hop data aggregations in smart grids | |
| CN114866323B (en) | User-controllable privacy data authorization sharing system and method | |
| CN114244851B (en) | Block chain-based data distribution method | |
| Deng et al. | Policy-based broadcast access authorization for flexible data sharing in clouds | |
| Xiao et al. | Blockchain based multi-authority fine-grained access control system with flexible revocation | |
| CN110519045B (en) | Anti-quantum computing alliance chain transaction method and system based on group asymmetric key pool | |
| WO2023116027A1 (en) | Cross-domain identity verification method in secure multi-party computation, and server | |
| CN116308355A (en) | Block chain-based carbon emission transaction and audit method | |
| CN116112185A (en) | Private data sharing method based on blockchain and zero knowledge proof | |
| Wu et al. | A secure quantum sealed-bid auction protocol based on quantum public key encryption | |
| KR20190139742A (en) | Distributed Ledger for logging inquiry time in blockchain | |
| Sultan et al. | A secure access and accountability framework for provisioning services in named data networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |