CN114780636A - Storage system and method based on block chain and data mart - Google Patents

Storage system and method based on block chain and data mart Download PDF

Info

Publication number
CN114780636A
CN114780636A CN202210339965.8A CN202210339965A CN114780636A CN 114780636 A CN114780636 A CN 114780636A CN 202210339965 A CN202210339965 A CN 202210339965A CN 114780636 A CN114780636 A CN 114780636A
Authority
CN
China
Prior art keywords
data
selling
storage
subsystem
mart
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210339965.8A
Other languages
Chinese (zh)
Inventor
刘寒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sinoits Tech Co ltd
Original Assignee
Beijing Sinoits Tech Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sinoits Tech Co ltd filed Critical Beijing Sinoits Tech Co ltd
Priority to CN202210339965.8A priority Critical patent/CN114780636A/en
Publication of CN114780636A publication Critical patent/CN114780636A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/602Providing cryptographic facilities or services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G06F21/6245Protecting personal data, e.g. for financial or medical purposes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/04Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2221/00Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/21Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/2107File encryption

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioethics (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Accounting & Taxation (AREA)
  • Computer Security & Cryptography (AREA)
  • Finance (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Medical Informatics (AREA)
  • Computing Systems (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Technology Law (AREA)
  • General Business, Economics & Management (AREA)
  • Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)

Abstract

The embodiment of the application provides a storage system and a storage method based on a block chain and a data mart, which relate to the technical field of block chain transaction, and the system comprises: a block chain subsystem and a data mart subsystem; the data mart subsystem is used for acquiring a selling data set of a seller and a data order of a buyer; the data storage module is also used for storing the sales data sets and the data orders based on hierarchical storage; the data processing device is also used for generating a first data information voucher according to the stored selling data set, wherein the first data information voucher is a data information voucher of the selling data set; the block chain subsystem is used for obtaining transaction information according to the first data information voucher, the data order and the selling data set based on the intelligent contract. The method and the system can solve the problem that the existing most of data marts run on a centralized server and have single-point faults and single-point performance bottlenecks, and achieve the effect of introducing the data marts into a block chain and avoiding the single-point faults and the single-point performance bottlenecks.

Description

Storage system and method based on block chain and data mart
Technical Field
The embodiment of the application relates to the technical field of blockchain transaction, in particular to a storage system and method based on blockchain and data mart.
Background
At present, the centralized data mart has some inevitable problems of data security and privacy, data copyright protection, and bottleneck of sharing and circulating performance. Based on this, when the privacy information (e.g. location, chat records, etc.) of the user is stored in the centralized database, the centralized data mart can easily become the target of an attacker, and there is a risk of privacy disclosure and data loss.
In implementing the present invention, the inventors discovered that there is a single point of failure and a single point of performance bottleneck when most existing data marts run on centralized servers.
Disclosure of Invention
The embodiment of the application provides a storage system and a storage method based on a block chain and a data mart, which can solve the problems that most of the existing data marts run on a centralized server and have single-point failure and single-point performance bottleneck.
In a first aspect of the present application, a storage system based on blockchain and data mart is provided, which is applied to blockchain transaction, including: a block chain subsystem and a data mart subsystem;
the data mart subsystem is used for acquiring a selling data set of a seller and a data order of a buyer, wherein the selling data set comprises selling data, and the data order comprises data requirements and computing tasks; further for storing the sales data set and the data order based on tiered storage; the data processing device is also used for generating a first data information certificate according to the stored selling data set, wherein the first data information certificate is the data information certificate of the selling data set;
the block chain subsystem is used for obtaining transaction information according to the first data information voucher, the data order and the selling data set based on an intelligent contract.
By adopting the technical scheme, the data mart subsystem is connected with the block chain subsystem, namely the data mart is introduced into the block chain, the data mart subsystem obtains a selling data set of a seller and a data order of a buyer, then the selling data set and the data order are stored based on layered storage, the stored selling data set is sent to the block chain subsystem for connection, the block chain subsystem receives the first data information voucher and obtains transaction information according to the first data information voucher, the data order and the selling data set based on an intelligent contract; in summary, the data marts are introduced into the block chains by using the decentralized distributed data storage technology of the block chains, so that the problems that a single-point fault and a single-point performance bottleneck exist when most of the existing data marts run on a centralized server can be solved, and the effects of introducing the data marts into the block chains and avoiding the single-point fault and the single-point performance bottleneck are achieved.
In one possible implementation, the data mart subsystem is specifically configured to:
based on layered storage, carrying out encrypted storage on the selling data set to generate a first data information certificate, wherein the first data information certificate comprises a storage address, a hash value and storage time of the selling data set;
and performing distributed storage on the data order based on the layered storage.
In one possible implementation, the block chain subsystem is specifically configured to:
determining a second data information certificate from the first data information certificate according to the data order based on secure multiparty calculation, wherein the second data information certificate is a data information certificate of the selling data;
and obtaining transaction information according to the second data information voucher based on a pricing mechanism, wherein the transaction information comprises the second data information voucher and the data selling price of the selling data.
In one possible implementation, the data mart subsystem is further specifically configured to:
obtaining a calculation result of the calculation task after payment of the buyer, wherein the calculation result is calculated based on safe multiple parties and calculated according to the selling data and the calculation task;
and sending the selling data and the calculation result to the buyer client.
In one possible implementation, the blockchain is a public chain.
In one possible implementation, the data mart subsystem includes an interplanetary file subsystem.
In a second aspect of the present application, there is provided a storage method based on a blockchain and a data mart, comprising:
acquiring a sales data set of a seller and a data order of a buyer, wherein the sales data set comprises sales data, and the data order comprises data requirements and calculation tasks;
storing the sales data set and the data order based on tiered storage;
generating a first data information certificate according to the stored selling data set, wherein the first data information certificate is the data information certificate of the selling data set;
and obtaining transaction information according to the first data information certificate, the data order and the selling data set based on the intelligent contract.
In one possible implementation, the storing the sales data set and the data order based on tiered storage includes:
based on layered storage, carrying out encrypted storage on the selling data set to generate a first data information certificate, wherein the first data information certificate comprises a storage address, a hash value and storage time of the selling data set;
and performing distributed storage on the data order based on the hierarchical storage.
In one possible implementation, the obtaining transaction information according to the first data information voucher, the data order and the sales data set based on the smart contract includes:
determining a second data information certificate from the first data information certificate according to the data order based on secure multiparty calculation, wherein the second data information certificate is a data information certificate of the selling data;
and obtaining transaction information according to the second data information certificate based on a pricing mechanism, wherein the transaction information comprises the second data information certificate and the data selling price of the selling data.
In one possible implementation manner, the method further includes:
after the buyer pays, obtaining a calculation result of the calculation task, wherein the calculation result is calculated based on safe multiple parties and calculated according to the selling data and the calculation task;
and sending the selling data and the calculation result to the buyer client side.
It should be understood that the statements described in this summary are not intended to limit the scope of the disclosure, or the various features described in this summary. Other features of the present application will become apparent from the following description.
Drawings
The above and other features, advantages and aspects of various embodiments of the present application will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like or similar reference characters designate like or similar elements, and wherein:
FIG. 1 is a block diagram illustrating a blockchain and data mart based storage system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a storage system based on blockchain and data marts for conducting transactions in an embodiment of the present application;
FIG. 3 is a flow chart illustrating a method for blockchain and data mart based storage in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application. Moreover, it should be appreciated that such a development effort might be complex and tedious, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure, given the benefit of this disclosure, without departing from the scope of this disclosure.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is to be expressly and implicitly understood by one of ordinary skill in the art that the embodiments described herein may be combined with other embodiments without conflict.
Unless otherwise defined, technical or scientific terms referred to herein should have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The use of the terms "a" and "an" and "the" and similar referents in the context of describing the invention (including a single reference) are to be construed in a non-limiting sense as indicating either the singular or the plural. The present application is directed to the use of the terms "including," "comprising," "having," and any variations thereof, which are intended to cover non-exclusive inclusions; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to only those steps or elements but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Reference to "connected," "coupled," and the like in this application is not intended to be limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. Reference herein to "a plurality" means greater than or equal to two. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. Reference herein to the terms "first," "second," "third," and the like, are merely to distinguish similar objects and do not denote a particular ordering for the objects.
The storage system based on the block chain and the data mart provided by the embodiment of the application can be applied to the technical field of block chain transaction.
Data Mart (Data Mart), also called Data market, is a Data cube which meets the requirements of specific departments or users, is stored in a multidimensional way, and comprises dimensions, indexes to be calculated, dimension levels and the like, and generates a Data cube facing the requirements of decision analysis.
However, most of the current data marts run on a centralized server, and such a system has a single point of failure and a single point of performance bottleneck, so that the centralized data mart has some inevitable problems, such as data security and privacy, data copyright protection, and a sharing and circulation performance bottleneck. Meanwhile, since sensitive information (e.g., location, chat history, etc.) of the user is stored in a centralized database, there is a risk of privacy disclosure and data loss, so centralized data mart is easily targeted by attackers.
At the same time, in blockchain transactions, the intermediary of the data transaction (typically the market platform) must be secure and trusted. The market platform needs to have public trust to ensure that the market platform does not illegally use the data in the transaction and reveal the privacy of the data holder. However, if the market platform has the above-mentioned illegal motivation, it is generally difficult to follow even if the market platform uses and sells data illegally.
To solve this technical problem, embodiments of the present application provide a storage system based on a blockchain and a data mart.
FIG. 1 is a block diagram of a storage system based on blockchains and data marts in an embodiment of the present application. Referring to fig. 1, the storage system based on the blockchain and the data mart in this embodiment includes: a block chain subsystem 101 and a data mart subsystem 102.
The data mart subsystem 102 is configured to obtain a selling data set of a seller and a data order of a buyer, wherein the selling data set includes selling data, and the data order includes data requirements and computing tasks. The data mart subsystem 102 is also operative to store sales data sets and data orders based on tiered storage. The data mart subsystem 102 is further configured to generate a first data information voucher according to the stored selling data set, where the first data information voucher is a data information voucher of the selling data set. The blockchain subsystem 101 is configured to obtain transaction information based on the intelligent contract according to the first data information voucher, the data order, and the sales data set.
By adopting the technical scheme, the data mart subsystem 102 is connected with the block chain subsystem 101, namely the data mart is introduced into the block chain, the data mart subsystem 102 obtains a selling data set of a seller and a data order of a buyer, then the selling data set and the data order are stored based on layered storage, the selling data set is stored again, a first data information certificate is sent to the block chain subsystem connection 101, the block chain subsystem 101 receives the first data information certificate, and then transaction information is obtained according to the first data information certificate, the data order and the selling data set based on an intelligent contract; in summary, the decentralized and distributed data storage technology of the block chain is used to introduce the data mart into the block chain, so that the problem that a single-point fault and a single-point performance bottleneck exist when most of the existing data marts run on a centralized server can be solved, and the effect of introducing the data marts into the block chain and avoiding the single-point fault and the single-point performance bottleneck is achieved.
FIG. 2 is a schematic diagram illustrating transactions performed by the blockchain and data mart based storage system in the embodiment of the present application. Referring to fig. 1 and 2, before a transaction, first, a buyer and a seller need to register an account.
Specifically, if a buyer and a seller want to buy and sell data in a data mart, a user of the buyer and the seller first needs to apply a distributed client running in a decentralized application (DApp) to perform account registration on various block chains (such as etherhouse, EOS or NEO) and register the differentiated identities of the buyer and the seller.
Second, the seller needs to find an administrator to write an intelligent contract for the selling data set (i.e., the information to be sold).
Specifically, the seller needs to add data (namely, a selling data set of the seller) to be sold in a distributed client in a seller decentralized application (DApp), and write the selling data set into an intelligent contract. The buyer adds the data requirement (i.e. the buyer's data order) to be bought in the distributed client 104 in the buyer DApp and writes the data order in an intelligent contract.
Wherein the seller's sales data set includes sales data actually sold by the seller in the transaction, and the buyer's data order includes data requirements and computing tasks actually purchased by the buyer in the transaction.
It should be noted that the seller may be multiple sellers, and the selling data set may be a data set formed by data sold by multiple sellers; the seller can be a seller, and the selling data set can be a data set formed by data sold by the seller. The buyer can be a multi-buyer, the data order is a group of data requirements and computing tasks of the multi-buyer, the buyer can be a single buyer, and the data order is a data requirement and computing task of the single buyer. In one transaction, the selling data and data orders of the buyer and the seller are in one-to-one correspondence to complete the transaction.
When trading, first, in the storage system based on the blockchain and data mart, the data mart subsystem 102 needs to obtain the selling data of the seller from the distributed client 103 in the seller DApp. The data mart subsystem 102 also needs to obtain the buyer's data order from the distributed clients 104 in the buyer DApp.
Secondly, based on the hierarchical storage technology, the data mart subsystem 102 stores the sales data sets and the data orders respectively. After receiving the data order, the data mart subsystem 102 encrypts the data order and uploads the encrypted data order to the data mart subsystem 102. The data mart subsystem 102 uploads the data of the sales data set or a hash value of the data into the data mart subsystem 102. At this point, the sales data set and data orders stored in the data mart subsystem 102 will be registered in the smart contracts. The data mart subsystem 102 will also generate a data-information voucher (i.e., a first data-information voucher) for the sales data set from the stored sales data set.
The first data information credential and the data order are then linked up to the blockchain subsystem 101 based on the intelligent contract. The blockchain subsystem 101 will receive the data hash value (i.e. the first data-information voucher) of the bid data provided by the seller, i.e. the seller of the data selects one or more data items meeting the requirements of the data buyer and settles a packaged price. And finally, the data buyer acquires the real bid of the data seller in the market platform, namely the transaction information, based on the intelligent contract.
It should be noted that, when the buyer and the seller conduct a transaction, the data buyer will stop accepting other sellers to participate in the transaction based on the intelligent contract and start accepting the sellers who have participated in the transaction to disclose their bids. The intelligent contract cannot actively execute commands, needs block chain user triggering, and meanwhile, the data buyer can list some sellers in a blacklist and refuse the bids of the sellers.
It should also be mentioned that the data buyer (buyer) does not usually need all data of all users, but concerns specific data of a specific user (seller). For example, in a crowdsourcing task, a data buyer wants to know the outdoor temperature of a certain location, which may set up a limitation on purchasing data, i.e., the location of a sensor for providing data by a seller needs to be within a certain range, and the provided data also needs to satisfy certain timeliness. The process is called data screening, and buyers can arrange own data requirements into a logic expression or a mathematical function to be stored in a block chain for the query and judgment of sellers.
In some embodiments, the data mart subsystem 102 is specifically configured to:
based on the layered storage, the selling data set is encrypted and stored to generate a first data information certificate, and the first data information certificate comprises a storage address, a hash value and storage time of the selling data set.
And performing distributed storage on the data orders based on the hierarchical storage.
In embodiments of the present application, storing complete data into a blockchain is impractical, but a "data digest" bound to a particular data may be uploaded. Based on this, the introduction of the data mart subsystem 102 for non-real-time and fault-tolerant transaction modes (i.e., blockchain transactions) allows data to be sent to the data backend for longer time intervals.
In the embodiment of the present application, the data mart subsystem 102 is a point-to-point (i.e., P2P) technology, and is a distributed file transfer system. In the data mart subsystem 102, files may be addressed by a hash value of their contents. When the data is successfully stored in the data mart subsystem 102, the user will receive a hash index, which will allow the user to later retrieve the file. Finally, the index stores the data to the intelligent contract instead of the data, so that the burden of the whole system is saved. The data mart subsystem 102 is publicly transparent in transactions throughout the blockchain, where the stored data is encrypted.
At the same time, it is costly if all users participating in the system maintain one data mart subsystem 102 node. Thus, a portion of the system participants may be charged a fee to the user of the uploaded data as a service provider of the distributed file store.
By adopting the technical scheme, the data mart subsystem 102 is introduced into the block chain, and the selling data sets of the sellers and the data orders of the buyers are stored in a layered mode based on the layered storage technology, so that the effects of enabling transactions to be public and transparent and protecting the safety and privacy of the buyers and the sellers can be achieved.
In some embodiments, the block chain subsystem 101 is specifically configured to:
and determining a second data information certificate from the first data information certificate according to the data order based on the secure multiparty calculation, wherein the second data information certificate is the data information certificate of the selling data.
And obtaining transaction information according to the second data information certificate based on a pricing mechanism, wherein the transaction information comprises the second data information certificate and the data selling price of the selling data.
In embodiments of the present application, in order for the data mart subsystem in a blockchain and data mart based storage system to not reveal any additional information about the user and its data throughout the transaction within the marketplace system, there are many ways in which the computational work in the system can be performed safely and correctly while also protecting the privacy of the parties. For example, in the secure multi-party computing, the role of the secure multi-party computing in the system is to complete various computing tasks while protecting characteristics such as privacy and fairness, and the research in different fields can achieve the goal in different degrees and different angles.
In the embodiment of the present application, through secure multi-party computation, the blockchain subsystem 101 may locate some of the sales data in the sales data set that meet the data requirements of the buyer (i.e. meet the conditions preset by the buyer), i.e. based on the secure multi-party computation, determine the second data information voucher from the first data information voucher according to the data requirements in the data order.
In the embodiment of the application, the design of the pricing mechanism is considered in the game theory environment, so that each data holder (seller) has a private evaluation value (namely, the loss of privacy of the data holder is revealed) for the data of the data holder, and a data buyer (buyer) has an evaluation value (namely, the value of the data to the buyer) for the data to be purchased. Wherein bidders may choose to report their valuation of a share of data dishonestly.
In the embodiment of the present application, after the interaction between the data buyer and the data seller, the block chain subsystem 101 in the storage system based on the block chain and the data mart triggers the pricing mechanism, and the pricing mechanism determines the sale data and the price thereof, that is, based on the pricing mechanism, the transaction information is obtained according to the second data information voucher.
Wherein, on the basis of checking the legality of each item of data in the intelligent contract information of data buying and selling, a pricing mechanism is triggered.
By adopting the technical scheme, both trading parties can terminate the trading before the trading result is achieved, namely the pricing mechanism starts to execute, and although the credit value of the participant is possibly reduced, the trading can be ensured to be terminated at any time under the condition that 'regret' happens infrequently. Meanwhile, after a pricing mechanism is started to be executed (namely, after the pricing mechanism is operated on the basis of a storage system of a block chain and a data mart), due to the characteristics of the block chain and safety calculation, both transaction parties cannot prevent the transaction from continuing, and the Ethernet currency transfer and buyer task calculation are executed certainly, so that the non-repudiation of data transaction is ensured, and the fair transaction is ensured.
Meanwhile, in a storage system based on a block chain and a data mart, identity privacy and data privacy of system participants are protected. Identity privacy is achieved based on the anonymity ability of the blockchain, while data privacy is protected in an all-around manner based on the blockchain and data marts, and data encryption, a data selection mechanism and security calculations prevent an attacker from obtaining any additional information of data from the execution of a transaction.
In some embodiments, the data mart subsystem 102 is further specifically configured to:
after the buyer pays, the calculation result of the calculation task is obtained, and the calculation result is calculated based on the safe multiple parties and calculated according to the selling data and the calculation task.
And sending the selling data and the calculation result to the buyer client.
In the embodiment of the present application, according to the rule after the storage system based on the blockchain and the data mart runs the pricing mechanism (that is, after the pricing mechanism starts to execute, "both parties of the transaction cannot prevent the transaction from continuing due to the characteristics of the blockchain and the security calculation, and the ethernet transfer and the buyer task calculation are always executed, so as to ensure the non-repudiation of the data transaction and ensure the fair transaction"), the storage system based on the blockchain and the data mart calculates the calculation task in the data order according to the selling data based on the security multiparty calculation, and delivers the calculation result and the selling data to the buyer client (that is, the buyer needs to be the distributed client 104 in the DApp).
In some embodiments, the blockchain is a public chain.
By adopting the technical scheme, the storage system based on the block chain and the data mart is directly realized based on the ether house and other public chains, and the availability of the data mart subsystem 102 can be improved.
In addition, the storage system based on the block chain and the data mart can also adopt various block chain public chain systems which are more efficient and light.
In some embodiments, the data mart subsystem 102 includes an interplanetary file subsystem.
In the present embodiment, the data mart subsystem 102 requires the assistance of a distributed file store layer.
Optionally, the System providing the distributed File storage layer is an InterPlanetary File subsystem (IPFS).
By adopting the technical scheme, the data mart and the distributed file storage layer are both point-to-point technologies, and a point-to-point data transmission network can be formed in a storage system based on the block chain and the data mart. Based on this, when the data is successfully stored in the IPFS in the data mart subsystem 102, the user will receive a hash index, which will allow the user to retrieve the file at a later time.
In summary, when a data buyer needs some specific data to compute a specific task, it will perform data screening according to the data order and write the data order into the intelligent contract. The whole storage system based on the block chain and the data mart locates some data meeting the conditions in a safe multi-party calculation mode, and triggers a pricing mechanism to determine selling data and price thereof after interaction between a data buyer and a data seller. After the buyer finishes paying, the storage system based on the block chain and the data mart runs the calculation task of the buyer in a safe multi-party calculation mode, and returns the calculation result to the buyer to finish the transaction.
By adopting the technical scheme, the block chain is combined with the data mart, the defect of the centralized data mart can be avoided, a decentralized data mart is obtained, the requirement of relying on a trusted intermediary to intervene in data transaction can be avoided, the single-point fault and the single-point performance bottleneck are eliminated, and the transparency and the credibility are improved. Meanwhile, the blockchain is a decentralized distributed data storage technology, the blockchain decentralized architecture can be used as a bottom architecture of the data mart to provide good support, and the blockchain layer is introduced into a data mart subsystem, so that an individual user can directly achieve transaction with a data demand party without depending on any third party, the user can keep ownership of data, and the public and transparent transaction process is ensured.
It should be noted that, for simplicity of description, the foregoing system embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts, as some acts may, in accordance with the present application, occur in other orders and/or concurrently. Further, those skilled in the art should also appreciate that the embodiments described in the specification are exemplary embodiments and that the acts and modules referred to are not necessarily required in this application.
The foregoing is a description of system embodiments, and the following is a further description of the embodiments of the present application by way of method embodiments.
FIG. 3 is a flow chart illustrating a method for blockchain and data mart based storage in an embodiment of the present application. Referring to fig. 3, the storage method based on the blockchain and the data mart in the embodiment includes:
step S301: a sales data set of a seller is obtained, the sales data set including sales data, and a data order of a buyer, the data order including data requirements and computing tasks.
Step S302: storing the sales data set and the data order based on tiered storage.
Step S303: and generating a first data information certificate according to the stored selling data set, wherein the first data information certificate is the data information certificate of the selling data set.
Step S304: and obtaining transaction information according to the first data information certificate, the data order and the selling data set based on the intelligent contract.
In some embodiments, step S302 includes: step a 1-step a 2.
Step A1: and based on layered storage, encrypting and storing the selling data set to generate a first data information certificate, wherein the first data information certificate comprises a storage address, a hash value and storage time of the selling data set.
Step A2: and performing distributed storage on the data order based on the hierarchical storage.
In some embodiments, step S304 includes: step B1-step B2.
Step B1: and determining a second data information certificate from the first data information certificate according to the data order based on secure multiparty calculation, wherein the second data information certificate is the data information certificate of the selling data.
Step B2: and obtaining transaction information according to the second data information voucher based on a pricing mechanism, wherein the transaction information comprises the second data information voucher and the data selling price of the selling data.
In some embodiments, the method further comprises: step S305-step S306.
Step S305: and after the buyer pays, obtaining a calculation result of the calculation task, wherein the calculation result is calculated based on the safe multiple parties and is calculated according to the selling data and the calculation task.
Step S306: and sending the selling data and the calculation result to the buyer client side.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the described method may refer to the corresponding process in the foregoing system embodiment, and is not described herein again.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless otherwise indicated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
The foregoing is only a few embodiments of the present application and it should be noted that those skilled in the art can make various improvements and modifications without departing from the principle of the present application, and that these improvements and modifications should also be considered as the protection scope of the present application.

Claims (10)

1. A blockchain and data mart based storage system for blockchain transactions, comprising: a block chain subsystem and a data mart subsystem;
the data mart subsystem is used for acquiring a selling data set of a seller and a data order of a buyer, wherein the selling data set comprises selling data, and the data order comprises data requirements and computing tasks; further for storing the sales data set and the data order based on tiered storage; the data processing device is also used for generating a first data information voucher according to the stored selling data set, wherein the first data information voucher is the data information voucher of the selling data set;
the block chain subsystem is used for obtaining transaction information according to the first data information voucher, the data order and the selling data set based on an intelligent contract.
2. The system of claim 1, wherein the data mart subsystem is specifically configured to:
based on layered storage, carrying out encrypted storage on the selling data set to generate a first data information certificate, wherein the first data information certificate comprises a storage address, a hash value and storage time of the selling data set;
and performing distributed storage on the data order based on the hierarchical storage.
3. The system of claim 1, wherein the blockchain subsystem is specifically configured to:
determining a second data information certificate from the first data information certificate according to the data order based on secure multiparty calculation, wherein the second data information certificate is a data information certificate of the selling data;
and obtaining transaction information according to the second data information voucher based on a pricing mechanism, wherein the transaction information comprises the second data information voucher and the data selling price of the selling data.
4. The system of claim 3, wherein the data mart subsystem is further configured to:
obtaining a calculation result of the calculation task after payment of the buyer, wherein the calculation result is calculated based on safe multiple parties and calculated according to the selling data and the calculation task;
and sending the selling data and the calculation result to the buyer client.
5. The system of claim 1, wherein the blockchain is a public chain.
6. The system of claim 1, wherein the data mart subsystem comprises an interplanetary file subsystem.
7. A storage method based on block chain and data mart is applied to block chain transaction, and is characterized by comprising the following steps:
acquiring a sales data set of a seller and a data order of a buyer, wherein the sales data set comprises sales data, and the data order comprises data requirements and calculation tasks;
storing the sales data set and the data order based on tiered storage;
generating a first data information certificate according to the stored selling data set, wherein the first data information certificate is the data information certificate of the selling data set;
and obtaining transaction information according to the first data information certificate, the data order and the selling data set based on the intelligent contract.
8. The method of claim 7, wherein storing the sales data set and the data order based on tiered storage comprises:
based on layered storage, carrying out encrypted storage on the selling data set to generate a first data information certificate, wherein the first data information certificate comprises a storage address, a hash value and storage time of the selling data set;
and performing distributed storage on the data order based on the layered storage.
9. The method of claim 7, wherein obtaining transaction information based on the smart contract from the first data-information voucher, the data order, and the sales data set comprises:
determining a second data information certificate from the first data information certificate according to the data order based on secure multiparty calculation, wherein the second data information certificate is a data information certificate of the selling data;
and obtaining transaction information according to the second data information voucher based on a pricing mechanism, wherein the transaction information comprises the second data information voucher and the data selling price of the selling data.
10. The method of claim 9, further comprising:
obtaining a calculation result of the calculation task after payment of the buyer, wherein the calculation result is calculated based on safe multiple parties and calculated according to the selling data and the calculation task;
and sending the selling data and the calculation result to the buyer client side.
CN202210339965.8A 2022-04-01 2022-04-01 Storage system and method based on block chain and data mart Pending CN114780636A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210339965.8A CN114780636A (en) 2022-04-01 2022-04-01 Storage system and method based on block chain and data mart

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210339965.8A CN114780636A (en) 2022-04-01 2022-04-01 Storage system and method based on block chain and data mart

Publications (1)

Publication Number Publication Date
CN114780636A true CN114780636A (en) 2022-07-22

Family

ID=82427993

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210339965.8A Pending CN114780636A (en) 2022-04-01 2022-04-01 Storage system and method based on block chain and data mart

Country Status (1)

Country Link
CN (1) CN114780636A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107730384A (en) * 2017-11-13 2018-02-23 深圳大学 Art sales method and server, server end and system based on block chain
CN107786339A (en) * 2016-08-31 2018-03-09 陈新 It is layered controllable alliance's block catenary system
CN110298180A (en) * 2019-04-01 2019-10-01 北京深安未来科技有限公司 A kind of notarization management system based on block chain
CN110457319A (en) * 2019-07-31 2019-11-15 阿里巴巴集团控股有限公司 Block chain state date storage method and device, electronic equipment
CN111340492A (en) * 2020-01-07 2020-06-26 弦子科技(北京)有限公司 Transaction method and device based on digital certificate
CN113407550A (en) * 2021-08-19 2021-09-17 支付宝(杭州)信息技术有限公司 Data storage and query method, device and database system
CN113722281A (en) * 2021-08-24 2021-11-30 中国建设银行股份有限公司 Service process processing system and method using multi-level data cache
CN113938498A (en) * 2021-09-18 2022-01-14 北京航空航天大学 Block chain mode combining identification analysis index cloud and hierarchical peer-to-peer network

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107786339A (en) * 2016-08-31 2018-03-09 陈新 It is layered controllable alliance's block catenary system
CN107730384A (en) * 2017-11-13 2018-02-23 深圳大学 Art sales method and server, server end and system based on block chain
CN110298180A (en) * 2019-04-01 2019-10-01 北京深安未来科技有限公司 A kind of notarization management system based on block chain
CN110457319A (en) * 2019-07-31 2019-11-15 阿里巴巴集团控股有限公司 Block chain state date storage method and device, electronic equipment
CN111340492A (en) * 2020-01-07 2020-06-26 弦子科技(北京)有限公司 Transaction method and device based on digital certificate
CN113407550A (en) * 2021-08-19 2021-09-17 支付宝(杭州)信息技术有限公司 Data storage and query method, device and database system
CN113722281A (en) * 2021-08-24 2021-11-30 中国建设银行股份有限公司 Service process processing system and method using multi-level data cache
CN113938498A (en) * 2021-09-18 2022-01-14 北京航空航天大学 Block chain mode combining identification analysis index cloud and hierarchical peer-to-peer network

Similar Documents

Publication Publication Date Title
JP6838000B2 (en) Obfuscation of intentions in transactions using cryptographic techniques
JP6364132B2 (en) Blockchain transaction recording system and method
JP6829242B2 (en) Electricity trading system
CN110930149A (en) Method, proxy node, and medium for determining accounting node in blockchain network
WO2019246072A1 (en) Bid matching for blockchain-based goods/assets systems and methods
KR20190059491A (en) System and method for e-commerce with shared and distributed ledger coupled with outer storage devices
US11488156B2 (en) Confidential asset transaction system
US20230298001A1 (en) Non-fungible token (nft) purchase and transfer system
CN111402043A (en) Internet of vehicles data transaction method based on block chain
Camilo et al. AutAvailChain: Automatic and secure data availability through blockchain
Gupta et al. Towards a blockchain powered IoT data marketplace
Kalvenes et al. Design of robust business-to-business electronic marketplaces with guaranteed privacy
Jaiswal et al. A conceptual framework for trustworthy and incentivized trading of food grains using distributed ledger and smart contracts
CA2637032A1 (en) Method and apparatus for establishing peer-to-peer karma and trust
Ye et al. An anonymous and fair auction system based on blockchain
Liu et al. A blockchain-based spatial data trading framework
Pop et al. An Ethereum-based implementation of English, Dutch and First-price sealed-bid auctions
US8725651B2 (en) System and method for providing private demand-driven pricing
Shih et al. A new reverse auction agent system for m-commerce using mobile agents
CN114780636A (en) Storage system and method based on block chain and data mart
Shih et al. A secure reverse Vickrey auction scheme with bid privacy
Aljohani et al. A framework for a blockchain-based decentralized data marketplace
Wu et al. Privacy-friendly Blockchain Based Data Trading and Tracking
Shih et al. A secure multi-item e-auction mechanism with bid privacy
CN116894727A (en) Data processing method and device based on block chain and related equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination