CN116305000A - Data circulation method, device and storage medium based on distributed file system - Google Patents
Data circulation method, device and storage medium based on distributed file system Download PDFInfo
- Publication number
- CN116305000A CN116305000A CN202310147745.XA CN202310147745A CN116305000A CN 116305000 A CN116305000 A CN 116305000A CN 202310147745 A CN202310147745 A CN 202310147745A CN 116305000 A CN116305000 A CN 116305000A
- Authority
- CN
- China
- Prior art keywords
- data
- node
- owner
- file system
- distributed file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000003860 storage Methods 0.000 title claims abstract description 23
- 238000012790 confirmation Methods 0.000 claims abstract description 17
- 238000010200 validation analysis Methods 0.000 claims abstract description 14
- 238000013500 data storage Methods 0.000 claims description 14
- 238000005192 partition Methods 0.000 claims description 5
- 239000003795 chemical substances by application Substances 0.000 description 56
- 238000012545 processing Methods 0.000 description 12
- 238000009826 distribution Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000012795 verification Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000009193 crawling Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000011158 quantitative evaluation Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013502 data validation Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/10—Protecting distributed programs or content, e.g. vending or licensing of copyrighted material ; Digital rights management [DRM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
- G06F16/137—Hash-based
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/64—Protecting data integrity, e.g. using checksums, certificates or signatures
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Technology Law (AREA)
- Multimedia (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a data circulation method, a data circulation device and a storage medium based on a distributed file system. The data circulation method based on the distributed file system comprises the following steps: the first data owner node performs right confirmation on the data copyright of the first data through the distributed file system; the first data owner node storing the first data of the validation to the blockchain system; and the data user node acquires the data copyright of the first data according to the confirmation information of the first data.
Description
Technical Field
The present invention relates to the field of information technologies, and in particular, to a data circulation method and apparatus based on a distributed file system, and a storage medium.
Background
Data becomes the fifth largest production element beyond land, capital, labor, and technology, playing a decisive role in digital production. Blockchains are integrated as asymmetric encryption, distributed computing, hash pointers, merck trees, and digital signatures, etc., throughout the full lifecycle of data, storage, distribution, and use. Most of the existing digital copyright technologies use the extracted feature codes of the digital copyright as the copyrighted IDs and store the copyrighted IDs into a blockchain, and then the extracted feature codes of the digital resources are compared with the feature codes stored in the blockchain through the whole network crawling in an auxiliary manner, so that the copyrights are judged to be high in similarity. However, for all copyright data, especially larger file data, there is a problem of low efficiency when directly storing the copyright data on a blockchain, and the storage and circulation value of the copyright data lacks a mechanism for quantitative evaluation. In the prior art, the BitSwap protocol in a distributed file system such as IPFS (interstellar file system) defines data exchange rules, manages the distribution of data, and promotes a tradable data market through an incentive mechanism. BitSwap can provide a data-level solution for data storage and circulation, but lacks a mechanism for digital rights validation and circulation link capitalization.
Aiming at the technical problems that the prior art can not simultaneously meet the data copyright right, the data circulation and the data storage, no effective solution is proposed at present.
Disclosure of Invention
The embodiment of the application provides a data circulation method, a data circulation device and a storage medium based on a distributed file system, which at least solve the technical problem that the data copyright right, the data circulation and the data storage cannot be met simultaneously in the prior art.
According to an aspect of an embodiment of the present application, there is provided a data circulation method based on a distributed file system, including: the first data owner node performs right confirmation on the data copyright of the first data through the distributed file system; the first data owner node storing the first data of the validation to the blockchain system; and the data user node acquires the data copyright of the first data according to the confirmation information of the first data.
According to another aspect of the embodiments of the present application, there is also provided a storage medium including a stored program, wherein the method of any one of the above is performed by a processor when the program is run.
According to another aspect of the embodiments of the present application, there is also provided a data circulation device based on a distributed file system, including: the data right confirming module is used for confirming the right of the data copyright of the first data through the distributed file system by the first data owner node; the data storage module is used for storing the first data of the right to the blockchain system by the first data owner node; and the data copyright acquisition module is used for acquiring the data copyright of the first data according to the authority-determining information of the first data by the data user node.
According to another aspect of the embodiments of the present application, there is also provided a data circulation device based on a distributed file system, including: a processor; and a memory, coupled to the processor, for providing instructions to the processor for processing the steps of: the first data owner node performs right confirmation on the data copyright of the first data through the distributed file system; the first data owner node storing the first data of the validation to the blockchain system; and the data user node acquires the data copyright of the first data according to the confirmation information of the first data.
In the embodiment of the application, the data needing to be validated is validated by the distributed file system in a way of comparing the hash values, and the hash values of the validated data are stored on the blockchain, so that the direct storage of larger file data is avoided, and the performance of the blockchain is improved. In addition, according to the technical scheme, the data sharing will of the user is improved by dividing the nodes participating in sharing the data, so that the data flow is enhanced. And further solves the technical problem that the data copyright right, data circulation and data storage cannot be met simultaneously in the prior art.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:
FIG. 1 is a block diagram of the hardware architecture of a computing device for implementing the method according to embodiment 1 of the present application;
FIG. 2 is a schematic diagram of a distributed file system based data flow system according to embodiment 1 of the present application;
FIG. 3 is a flow chart of a data flow method based on a distributed file system according to a first aspect of embodiment 1 of the present application;
FIG. 4a is a schematic flow chart of a further part of a distributed file system based data flow method according to the first aspect of embodiment 1 of the present application;
FIG. 4b is a schematic flow diagram of yet another portion of a distributed file system based data flow method according to the first aspect of embodiment 1 of the present application;
FIG. 5 is a schematic diagram of a distributed file system based data flow apparatus according to embodiment 2 of the present application; and
fig. 6 is a schematic diagram of a data flow device based on a distributed file system according to embodiment 3 of the present application.
Detailed Description
In order to better understand the technical solutions of the present application, the following descriptions of the technical solutions of the embodiments of the present application will be clearly and completely described with reference to the drawings in the embodiments of the present application. It will be apparent that the described embodiments are merely some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
According to the present embodiment, there is provided a method embodiment of a distributed file system-based data flow method, it should be noted that the steps illustrated in the flowchart of the drawings may be performed in a computer system such as a set of computer executable instructions, and that although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different from that herein.
The method embodiments provided by the present embodiments may be performed in a mobile terminal, a computer terminal, a server, or similar computing device. FIG. 1 illustrates a block diagram of a hardware architecture of a computing device for implementing a distributed file system based data flow method. As shown in fig. 1, the computing device may include one or more processors (which may include, but are not limited to, a microprocessor MCU, a programmable logic device FPGA, etc., processing means), memory for storing data, and transmission means for communication functions. In addition, the method may further include: a display, an input/output interface (I/O interface), a Universal Serial Bus (USB) port (which may be included as one of the ports of the I/O interface), a network interface, a power supply, and/or a camera. It will be appreciated by those of ordinary skill in the art that the configuration shown in fig. 1 is merely illustrative and is not intended to limit the configuration of the electronic device described above. For example, the computing device may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
It should be noted that the one or more processors and/or other data processing circuits described above may be referred to herein generally as "data processing circuits. The data processing circuit may be embodied in whole or in part in software, hardware, firmware, or any other combination. Furthermore, the data processing circuitry may be a single stand-alone processing module, or incorporated in whole or in part into any of the other elements in the computing device. As referred to in the embodiments of the present application, the data processing circuit acts as a processor control (e.g., selection of the path of the variable resistor termination to interface).
The memory may be used to store software programs and modules of application software, such as program instructions/data storage devices corresponding to the data circulation method based on the distributed file system in the embodiments of the present application, and the processor executes the software programs and modules stored in the memory, thereby executing various functional applications and data processing, that is, implementing the data circulation method based on the distributed file system of the application program. The memory may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, the memory may further include memory remotely located with respect to the processor, which may be connected to the computing device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission means is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communications provider of the computing device. In one example, the transmission means comprises a network adapter (Network Interface Controller, NIC) connectable to other network devices via the base station to communicate with the internet. In one example, the transmission device may be a Radio Frequency (RF) module, which is used to communicate with the internet wirelessly.
The display may be, for example, a touch screen type Liquid Crystal Display (LCD) that may enable a user to interact with a user interface of the computing device.
It should be noted herein that in some alternative embodiments, the computing device shown in FIG. 1 described above may include hardware elements (including circuitry), software elements (including computer code stored on a computer-readable medium), or a combination of both hardware and software elements. It should be noted that fig. 1 is only one example of a particular specific example and is intended to illustrate the types of components that may be present in the computing devices described above.
Fig. 2 is a schematic diagram of a data flow system based on a distributed file system according to the present embodiment. Referring to fig. 2, the system includes: distributed file system 100 and blockchain system 200. Wherein the distributed file system 100 may be, for example, an interstellar file system, including nodes 110-140. Where nodes 110 and 140 are data owner nodes, node 120 is a data consumer node, and node 130 is an issuing agent node.
And wherein the data owner nodes 110 and 140 are configured to authenticate the data they need to issue, and share the authenticated data they own with the data consumer node 120 and the issuing agent node 130, and collect corresponding copyright charges from the nodes that need to acquire the data through the blockchain system 200.
The data consumer node 140 is configured to obtain data from the data owner nodes 110 and 140 or the distribution agent node 130 and pay a corresponding copyright fee via the blockchain system 200.
The distribution agent node 130 is configured to obtain data from the data owner nodes 110 and 140 and to send the data to the data consumer node 120.
Wherein data owner nodes 110 and 140, data consumer node 120, and publishing agent node 130 are all nodes in distributed file system 100 and the roles of the individual nodes are not unique. For example, node 110 in the context of the present embodiment may act as a data owner node, but in other contexts may also act as a data consumer node or issuing agent node. The node 120 in the context of this embodiment may be a data consumer node, a data owner node, or a distribution agent node, and the node 130 may be a distribution agent node, a data owner node, or a data consumer node.
It should be noted that the above hardware structure may be applied to the distributed file system 100 and the blockchain system 200 in the system.
In the above-described operating environment, according to a first aspect of the present embodiment, there is provided a data circulation method based on a distributed file system. Fig. 3 shows a schematic flow chart of the method, and referring to fig. 3, the method includes:
s302: the first data owner node performs right confirmation on the data copyright of the first data through the distributed file system;
s304: the first data owner node storing the first data of the validation to the blockchain system; and
s306: and the data user node acquires the data copyright of the first data according to the authority information of the first data.
Specifically, the node 110 (i.e., the first data owner node) owns a certain data (i.e., the first data), and then the node 110 (i.e., the first data owner node) publishes the first data in the distributed file system 100 by confirming the data right of the first data. Wherein the distributed file system 100 is, for example, an IPFS distributed file system.
More specifically, the node 110 (i.e., the first data owner node) generates a hash value of the first data and searches in the distributed file system 100 according to the hash value of the first data to determine whether there is the same data as the first data in the distributed file system 100. When the node 110 (i.e., the first data owner node) does not search for the same data as the first data in the distributed file system 100, then the data right of the first data is granted. When the node 110 (i.e., the first data owner node) searches the distributed file system 100 for the same data as the first data, it is determined that the first data has the data right in the distributed file system 100 (S302).
Further, the node 110 (i.e., the first data owner node) stores the hash value of the first data, which has been determined, and the ID of the node 110 (i.e., the first data owner node) into the blockchain system after the data copyright of the first data is determined (S304).
Further, for example, node 110 (i.e., the first data owner node) has already validated the first data in distributed file system 100, thereby completing the publishing of the first data in distributed file system 100. The node 110 (i.e., the first data owner node) then broadcasts the information that the first data has been published, and then the other nodes receive the information that the first data has been authorized, so that the other nodes can request the node 110 (i.e., the first data owner node) to acquire the first data.
When the node 120 (i.e., the data consumer node) needs to obtain the first data, the node 110 (i.e., the first data owner node) is paid a corresponding copyright fee, thereby obtaining the first data. Wherein the copyright charges paid by the node 120 (i.e., the data consumer node) to acquire the first data are set by the node 110 (i.e., the first data owner node). And in the case where the node 120 (i.e., the data consumer node) has acquired the first data, the first data may also be shared as an issuing agent node to other nodes. For example, when the other node obtains the first data from the node 120, the node 120 charges the node for the copyright fee for sharing the first data when sharing the first data with the node, thereby obtaining the partition for sharing the first data (S306).
As described in the background, data becomes the fifth largest production element beyond land, capital, labor, and technology, playing a decisive role in digital production. Blockchains are integrated as asymmetric encryption, distributed computing, hash pointers, merck trees, and digital signatures, etc., throughout the full lifecycle of data, storage, distribution, and use. Most of the existing digital copyright technologies use the extracted feature codes of the digital copyright as the copyrighted IDs and store the copyrighted IDs into a blockchain, and then the extracted feature codes of the digital resources are compared with the feature codes stored in the blockchain through the whole network crawling in an auxiliary manner, so that the copyrights are judged to be high in similarity. However, for all copyright data, especially larger file data, there is a problem of low efficiency when directly storing the copyright data on a blockchain, and the storage and circulation value of the copyright data lacks a mechanism for quantitative evaluation. In the prior art, the BitSwap protocol in the IPFS distributed file system defines data exchange rules, manages the distribution of data, and promotes a tradable data market through an incentive mechanism. BitSwap can provide a data-level solution for data storage and circulation, but lacks a mechanism for digital rights validation and circulation link capitalization.
According to the technical scheme, the distributed file system is used for confirming the data needing to be confirmed by comparing the hash values, and the hash values of the data needing to be confirmed are stored on the block chain system, so that larger file data are prevented from being directly stored, and the performance of the block chain is improved. In addition, according to the technical scheme, the data sharing will of the user is improved by dividing the nodes participating in sharing the data, so that the data flow is enhanced. And further solves the technical problem that the data copyright right, data circulation and data storage cannot be met simultaneously in the prior art.
Optionally, the operation of the first data owner node for determining the right of the data right of the first data through the distributed file system includes: the first data owner node confirms the data copyright of the first data through the distributed file system according to the hash value of the first data; and storing the hash value of the first data to the blockchain system.
Specifically, referring to fig. 4a and 4b, the node 110 (i.e., the first data owner node) issues the first data, such that the first data is to be validated, and the node 110 (i.e., the first data owner node) generates a hash value of the first data from the first data. Thereafter, the node 110 (i.e., the first data owner node) acquires hash values of all data in the distributed file system 100, and sequentially compares the acquired hash values of all data with the hash values of the first data, so that the node 110 (i.e., the first data owner node) can search the distributed file system 100 for hash values of other data identical to the hash values of the first data according to the hash values of the first data, thereby finding whether the data identical to the first data is stored in the distributed file 100 system.
Further, when the node 110 (i.e., the first data owner node) does not search for the same data as the first data in the distributed file system 100, it is indicated that the same data as the first data has not been authorized, and thus the node 110 (i.e., the first data owner node) authenticates the data right of the first data.
Further, the node 110 (i.e., the first data owner node) stores the hash value of the first data, the data version ID of the first data after the validation, and the author ID of the first data (i.e., the data owner node ID) to the blockchain system 200.
The technical scheme carries out the right confirmation of the data needing the right confirmation by utilizing a mode of comparing the hash values through the distributed file system, and the hash values of the data needing the right confirmation are stored on the block chain system, so that the direct storage of larger file data is avoided, and the performance of the block chain system is improved.
Optionally, the method further comprises: the second data owner node determines second data identical to the first data through the distributed file system according to the hash value of the first data; comparing the timestamp of the second data identical to the first data with the timestamp of the first data; and in the case that the time stamp of the second data is different from the time stamp of the first data, the data copyright of the first data is authorized.
Specifically, referring to fig. 4a and 4b, the node 140 (second data owner node) needs to issue data (i.e., second data) in the distributed file system 100, so that the second data is to be validated, the node 140 (second data owner node) may obtain the hash value of the second data, and search the distributed file system 100 for the hash value of the same data as the hash value of the second data. When the node 140 (second data owner node) searches the distributed file system 100 that the same data as the second data is the first data, the timestamp of the first data when the second data is confirmed is obtained from the blockchain system 200, the timestamp of the second data is obtained, then the node 140 (second data owner node) compares the timestamp corresponding to the first data with the timestamp corresponding to the second data, when the timestamp corresponding to the first data is before the timestamp of the second data, it is indicated that the first data is confirmed before the second data is confirmed, and therefore the second data fails to confirm. Since the second data is identical to the first data, the data right of the second data issued by the node 140 (second data owner node) still belongs to the data owner 110, and the node 140 can use the same first data as the second data as the data user node.
Further, after the first data is validated, the node 110 (the first data owner node) updates the first data, resulting in a new version of the first data. The node 110 (first data owner node) then records an association between the first data version and the second data version of the first data in the blockchain system 200. In addition, node 110 (the first data owner node) stores its own private information into blockchain system 200.
Therefore, the technical scheme updates the data version by confirming the data, and associates the data of different versions through the distributed file system, so that the data copyright conflict of the data of different versions is avoided. And private data such as personal information of the author and the like are stored in the blockchain system, and only the author ID participates in the right of the first data, so that the privacy of the user data is ensured.
Optionally, the operation of the data user node to obtain the data copyright of the first data according to the validation information of the first data includes: the data user node pays copyright fees to the data owner node according to the first data; and the data user node obtains corresponding first data from the first data owner node.
Specifically, referring to fig. 4a and 4b, when the node 120 (i.e., the data consumer node) wants to obtain the first data of the node 110 (i.e., the first data owner node), a data obtaining request is sent to the node 110 (i.e., the first data owner node), and the node 120 (i.e., the data consumer node) pays the copyright expense for obtaining the first data to the node 110 (i.e., the first data owner node) through the blockchain system 200. More specifically, node 110 (i.e., the first data owner node) generates a transaction in blockchain system 200 regarding the data right of the first data, after which blockchain system 200 broadcasts the transaction in blockchain system 200 such that participating nodes in blockchain system 200 receive the broadcast, after which participating nodes in blockchain system 200 time stamp the transaction and store it in the block. And then each participating node determines the verification node through the calculation of the workload certification. And then the verification node broadcasts the block to other participation nodes, each participation node performs verification and is connected with the block, the other participation nodes can confirm whether the transaction contained in the block chain is valid or not, and the block is accepted after the confirmation that the transaction is not repeated and has valid digital signature, and the block is just connected with the block chain.
The blockchain system 200 thus completes recording the royalty cost received by the node 120 (i.e., the data consumer node) and the royalty cost paid by the node 120 (i.e., the data consumer node).
Further, after the node 120 (i.e., the data consumer node) pays the copyright fee, the corresponding first data is obtained from the node 110 (i.e., the first data owner node).
Therefore, the technical scheme acquires the data by paying the copyright expense, protects the legal rights and interests of the data owner, and stimulates the data owner so that the data owner is willing to share the data.
Optionally, the operation of the data user node obtaining the corresponding first data from the first data owner node includes: the data user node sends a data acquisition request for acquiring first data to the data owner node; and the data user node acquires the first data from the data owner node under the condition that the data owner node detects that the data user node has acquired the data copyright of the first data according to the data acquisition request.
Specifically, referring to fig. 4a and 4b, when the node 120 (i.e., the data user node) is to obtain the first data, a query request for querying the node to which the first data belongs is sent to the neighboring node, and when the neighboring node does not possess the data right of the first data, a query request for querying the node to which the first data belongs is sent to other neighboring nodes until the node 110 (i.e., the first data owner node) that possesses the data right of the first data is queried. Node 110 (i.e., the first data owner node) then returns a response message to node 120 (i.e., the data consumer node) via the neighboring nodes. Wherein the response information includes the ID of the node 110 (i.e., the first data owner node).
Further, the node 120 (i.e., the data user node) transmits a query request to the blockchain system 200 for querying whether the blockchain system 200 has acquired the data right of the first data, and after receiving the query request, the blockchain system 200 queries whether the node 120 (i.e., the data user node) has acquired the data right of the first data according to the ID of the data right of the first data. Wherein a data table is stored in the blockchain system 200 and is used to record the status of each node in the distributed file system 100, including node IDs and copyrights of data owned by the node.
For example, the blockchain system 200 queries the node 120 (i.e., the data consumer node) from the data table for the data right of the first data, and then sends the query result to the node 120 (i.e., the data consumer node). When the query result is that the node 120 (i.e., the data consumer node) does not acquire the data right of the first data, the node 120 (i.e., the data consumer node) pays the node 110 (i.e., the first data owner node) for the data right of the first data through the blockchain system 200.
Thereafter, the node 120 (i.e., the data consumer node) sends a data acquisition request to the node 110 (i.e., the first data owner node) to acquire the first data, and after the node 110 (i.e., the first data owner node) receives the data acquisition request, the node sends a query request to the blockchain system 200 to query whether the node 120 (i.e., the data consumer node) has acquired the data right of the first data. Upon receiving the query request, the blockchain system 200 queries the data table for whether the node 120 (i.e., the data consumer node) has paid a copyright fee and obtains the data copyright of the first data, and then sends the query result to the node 110 (i.e., the first data owner node). When the query result is that the node 120 (i.e., the data consumer node) has paid the copyright expense and acquired the data copyright of the first data, the node 110 (i.e., the first data owner node) transmits the first data to the node 120 (i.e., the data consumer node) in the distributed file system 100. When the query result is that the node 120 (i.e., the data consumer node) does not pay the copyright expense and thus does not acquire the data copyright of the first data, the node 110 (i.e., the first data owner node) refuses to transmit the first data to the node 120 (i.e., the data consumer node).
Therefore, in the technical scheme, the data security is ensured by detecting whether the data user node has paid the copyright cost.
Optionally, the method further comprises: in the event that the data consumer node detects an issuing agent node associated with the first data, comparing the performance of the issuing agent node with the performance of the first data owner node; and in the event that the performance of the issuing agent node is better than the performance of the first data owner node, obtaining the first data from the issuing agent node.
Specifically, after the node 130 serves as a data consumer node to obtain the data right of the first data from the node 110 (i.e., the first data owner node), the data consumer node applies to the blockchain system 200 to become an issuing agent node, and after the blockchain system 200 requests from the node 130, it is determined whether the node 130 has obtained the data right of the first data. When the blockchain system 200 determines that the node 130 has acquired the data right of the first data, the node 130 is granted an application request to become an issuing agent node, and the information of the node 130 is registered in a data table for storing the issuing agent node information. The node 130 thus becomes an issuing agent node that can proxy for issuing the first data.
Further, referring to fig. 4a and 4b, before the node 120 (i.e., the data consumer node) obtains the data right of the first data, a query request for querying whether there is an issuing agent node that agents issue the first data is sent to the blockchain system 200. After that, the blockchain system 200 receives the query request, queries whether there is an issuing agent node that issues the first data by an agent from the data table according to the ID of the data right of the first data, and returns the query result to the node 120 (i.e., the data user node). Wherein the issuing agent node is also a data consumer node, i.e., it may become the issuing agent node when the data consumer node applies for an agent to issue data to the blockchain system 200.
Further, when the query result is that the blockchain system 200 queries the issuing agent node that has issued the first data by the agent, the node 120 (i.e., the data consumer node) will obtain the node list from the neighboring node. Wherein the node list includes index information such as transmission rate of the node.
Thereafter, the node 120 (i.e., the data consumer node) obtains the index information of the node 110 (i.e., the first data owner node) and the index information of the issuing agent node (e.g., the node 130) from the node list, and calculates the performance value of the node 110 (i.e., the first data owner node) and the performance value of the node 130 (i.e., the issuing agent node) from the index information using the preset weights, respectively. Node 120 (i.e., the data consumer node) then compares the performance value of node 110 (i.e., the first data owner node) to the performance value of node 130 (i.e., the issuing agent node).
When the node 120 (i.e., the data consumer node) determines that the performance of the node 130 (i.e., the issuing agent node) is better than the performance of the node 110 (i.e., the first data owner node), a data acquisition request is sent to the node 130 (i.e., the issuing agent node) to acquire the first data. Upon receiving the data acquisition request, the node 130 (i.e., the issuing agent node) sends a query request to the blockchain system 200 for querying whether the node 120 (i.e., the data consumer node) has acquired the data right of the first data. Upon receiving the query request, the blockchain system 200 queries the data table for whether the node 120 (i.e., the data consumer node) has acquired the data right of the first data, and then sends the query result to the node 130 (i.e., the issuing agent node). When the query result is that the node 120 (i.e., the data consumer node) has acquired the data right of the first data, the issuing agent node transmits the first data to the node 120 (i.e., the data consumer node). When the query result is that the node 120 (i.e., the data consumer node) does not acquire the data right of the first data, the node 130 (i.e., the issuing agent node) refuses to transmit the first data to the node 120 (i.e., the data consumer node).
When node 120 (i.e., the data consumer node) determines that the performance of node 110 (i.e., the first data owner node) is better than the performance of node 130 (i.e., the issuing agent node), a data acquisition request is sent to node 110 (i.e., the first data owner node) to acquire the first data. Upon receiving the data acquisition request, node 110 (i.e., the first data owner node) sends a query request to blockchain system 200 to query whether node 120 (i.e., the data consumer node) has acquired the data rights for the first data. Upon receiving the query request, the blockchain system 200 queries the data table for whether the node 120 (i.e., the data consumer node) has acquired the data right of the first data, and then sends the query result to the node 110 (i.e., the first data owner node). When the query result is that the node 120 (i.e., the data consumer node) has acquired the data right of the first data, the node 110 (i.e., the first data owner node) transmits the first data to the node 120 (i.e., the data consumer node). When the query result is that the node 120 (i.e., the data consumer node) does not acquire the data right of the first data, the node 110 (i.e., the first data owner node) refuses to transmit the first data to the node 120 (i.e., the data consumer node).
Therefore, the first data is acquired through the node with the optimal performance, and the efficiency and the speed for acquiring the data can be improved.
Optionally, the method further comprises: after the data consumer node obtains the first data from the first data owner node, the data consumer node pays the data credit to the first data owner node.
Specifically, the blockchain system is preset with credit rules. Wherein the credit rule is: sending data to other nodes may increase the credit value and receiving data from other nodes decreases the credit value. Thus, while node 110 (i.e., the first data owner node) sends the first data to node 120 (i.e., the data user node), blockchain system 200 reduces the corresponding number of credits for node 120 (i.e., the data user node) in the ledger and increases the corresponding number of credits for node 110 (i.e., the first data owner node).
Therefore, the credit value can be increased by sharing the data to other nodes, and the rules of reducing the credit value of the data are received from other nodes, so that the nodes can be promoted to share the data.
Optionally, the method further comprises: the issuing agent node obtains first data from a first data owner; and the issuing agent node obtains the corresponding partition from the first data owner node under the condition of sharing the first data.
Specifically, after acquiring the first data, the node 140 transmits an application request to the blockchain system 200 to be an issuing agent node that agents issue the first data, and the blockchain system 200 inquires whether the node 140 has paid a copyright fee for acquiring the first data and whether the node 140 has acquired the first data from the node 110 (i.e., the first data owner node) according to the received application request. When the blockchain system 200 inquires that the node 140 has paid the corresponding copyright expense and acquired the first data, the blockchain system 200 makes the record node 140 an issuing agent node for issuing the first data by an agent. When another node also wants to acquire the first data, the first data may be acquired from the data user node, and the node 140 (i.e., the issuing agent node) may charge a copyright fee to the other node that needs to acquire the first data. Wherein the copyright charges charged by the node 140 (i.e., the issuing agent node) are divided into data owners and data users.
In the technical scheme, the data owner node gives part of profit incentive issuing agency nodes to share data from the copyright profit, so that the data can be transmitted forward, and the copyright profit of an author is promoted.
Further, referring to fig. 1, according to a second aspect of the present embodiment, there is provided a storage medium. The storage medium includes a stored program, wherein the method of any one of the above is performed by a processor when the program is run.
Therefore, according to the embodiment, the data needing to be validated is validated by the distributed file system in a way of comparing hash values, and the hash values of the validated data are stored on the blockchain, so that the direct storage of larger file data is avoided, and the performance of the blockchain is improved. In addition, according to the technical scheme, the data sharing will of the user is improved by dividing the nodes participating in sharing the data, so that the data flow is enhanced. And further solves the technical problem that the data copyright right, data circulation and data storage cannot be met simultaneously in the prior art.
It should be noted that, for simplicity of description, the foregoing method embodiments are all described as a series of acts, but it should be understood by those skilled in the art that the present invention is not limited by the order of acts described, as some steps may be performed in other orders or concurrently in accordance with the present invention. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required for the present invention.
From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
Example 2
Fig. 5 shows a distributed file system based data flow arrangement 500 according to the first aspect of the present embodiment, which arrangement 500 corresponds to the method according to the first aspect of embodiment 1. Referring to fig. 5, the apparatus 500 includes: a data right determining module 510, configured to determine, by the first data owner node, right to the data right of the first data that is owned by the first data owner node through the distributed file system; a data storage module 520 for the first data owner node to store the first data of the validation to the blockchain system; and a data copyright acquisition module 530, configured to acquire the data copyright of the first data according to the authorization information of the first data by the data user node.
Optionally, the data validation module 510 includes: the data right confirming sub-module is used for confirming the right of the data copyright of the first data through the distributed file system according to the hash value of the first data by the first data owner node; and a data storage sub-module storing the hash value of the first data to the blockchain system.
Optionally, the apparatus 500 further comprises: the first determining module is used for determining second data identical to the first data through the distributed file system according to the hash value of the first data by the second data owner node; a data comparison module comparing a timestamp of second data identical to the first data with a timestamp of the first data; and the first right confirming module is used for confirming the data copyright of the first data under the condition that the time stamp of the second data is different from the time stamp of the first data.
Optionally, the data rights acquisition module 530 includes: a fee payment sub-module, the data user node paying copyright fee to the data owner node according to the first data; and a data acquisition sub-module, wherein the data user node acquires corresponding first data from the first data owner node.
Optionally, the data acquisition sub-module includes: a request transmitting unit for transmitting a data acquisition request for acquiring first data to a data owner node by a data user node; and a data acquisition unit that, in a case where the data owner node detects that the data user node has acquired the data right of the first data according to the data acquisition request, the data user node acquires the first data from the data owner node.
Optionally, the apparatus 500 further comprises: a first comparison module that compares the performance of the issuing agent node with the performance of the first data owner node if the data consumer node detects the issuing agent node associated with the first data; and a first acquisition module that acquires the first data from the issuing agent node if the performance of the issuing agent node is better than the performance of the first data owner node.
Optionally, the apparatus 500 further comprises: and the point payment module is used for paying the data credit to the first data owner node after the data user node acquires the first data from the first data owner node.
Optionally, the apparatus 500 further comprises: the second acquisition module is used for acquiring the first data from the first data owner by the issuing agent node; and the third acquisition module is used for acquiring the corresponding partition from the first data owner node under the condition that the issuing agent node shares the first data.
Therefore, according to the embodiment, the data needing to be validated is validated by the distributed file system in a way of comparing hash values, and the hash values of the validated data are stored on the blockchain, so that the direct storage of larger file data is avoided, and the performance of the blockchain is improved. In addition, according to the technical scheme, the data sharing will of the user is improved by dividing the nodes participating in sharing the data, so that the data flow is enhanced. And further solves the technical problem that the data copyright right, data circulation and data storage cannot be met simultaneously in the prior art.
Example 3
Fig. 6 shows a distributed file system based data flow arrangement 600 according to the first aspect of the present embodiment, which arrangement 600 corresponds to the method according to the first aspect of embodiment 1. Referring to fig. 6, the apparatus 600 includes: a processor 610; and a memory 620 coupled to the processor 610 for providing instructions to the processor 510 for processing the following processing steps: the first data owner node performs right confirmation on the data copyright of the first data through the distributed file system; the first data owner node storing the first data of the validation to the blockchain system; and the data user node acquires the data copyright of the first data according to the confirmation information of the first data.
Optionally, the operation of the first data owner node for determining the right of the data right of the first data through the distributed file system includes: the first data owner node confirms the data copyright of the first data through the distributed file system according to the hash value of the first data; and storing the hash value of the first data to the blockchain system.
Optionally, the apparatus 600 further comprises: the second data owner node determines second data identical to the first data through the distributed file system according to the hash value of the first data; comparing the timestamp of the second data identical to the first data with the timestamp of the first data; and in the case that the time stamp of the second data is different from the time stamp of the first data, the data copyright of the first data is authorized.
Optionally, the operation of the data user node to obtain the data copyright of the first data according to the validation information of the first data includes: the data user node pays copyright fees to the data owner node according to the first data; and the data user node obtains corresponding first data from the first data owner node.
Optionally, the operation of the data user node obtaining the corresponding first data from the first data owner node includes: the data user node sends a data acquisition request for acquiring first data to the data owner node; and the data user node acquires the first data from the data owner node under the condition that the data owner node detects that the data user node has acquired the data copyright of the first data according to the data acquisition request.
Optionally, the apparatus 600 further comprises: in the event that the data consumer node detects an issuing agent node associated with the first data, comparing the performance of the issuing agent node with the performance of the first data owner node; and in the event that the performance of the issuing agent node is better than the performance of the first data owner node, obtaining the first data from the issuing agent node.
Optionally, the apparatus 600 further comprises: after the data consumer node obtains the first data from the first data owner node, the data consumer node pays the data credit to the first data owner node.
Optionally, the apparatus 600 further comprises: the issuing agent node obtains first data from a first data owner; and the issuing agent node obtains the corresponding partition from the first data owner node under the condition of sharing the first data.
Therefore, according to the embodiment, the data needing to be validated is validated by the distributed file system in a way of comparing hash values, and the hash values of the validated data are stored on the blockchain, so that the direct storage of larger file data is avoided, and the performance of the blockchain is improved. In addition, according to the technical scheme, the data sharing will of the user is improved by dividing the nodes participating in sharing the data, so that the data flow is enhanced. And further solves the technical problem that the data copyright right, data circulation and data storage cannot be met simultaneously in the prior art.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
In the foregoing embodiments of the present invention, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed technology content may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, such as the division of the units, is merely a logical function division, and may be implemented in another manner, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.
Claims (10)
1. A distributed file system-based data flow method, comprising:
the first data owner node performs right confirmation on the data copyright of the first data through the distributed file system;
the first data owner node storing the first data of the validation to the blockchain system; and
and the data user node acquires the data copyright of the first data according to the confirmation information of the first data.
2. The method of claim 1, wherein the operation of the first data owner node to authenticate the data right of the owned first data through the distributed file system comprises:
the first data owner node performs right confirmation on the data copyright of the first data according to the hash value of the first data through the distributed file system; and
storing the hash value of the first data to the blockchain system.
3. The method as recited in claim 2, further comprising:
a second data owner node determines second data identical to the first data through the distributed file system according to the hash value of the first data;
comparing a timestamp of second data identical to the first data with a timestamp of the first data; and
And under the condition that the time stamp of the second data is different from that of the first data, the data copyright of the first data is ensured.
4. The method of claim 1, wherein the operation of the data consumer node obtaining the data right of the first data based on the validation information of the first data comprises:
the data user node pays copyright fees to the data owner node according to the first data; and
the data user node obtains corresponding first data from the first data owner node.
5. The method of claim 4, wherein the operation of the data consumer node obtaining the corresponding first data from the first data owner node comprises:
the data user node sends a data acquisition request for acquiring the first data to a data owner node; and
the data consumer node obtains the first data from the data consumer node in case the data consumer node detects that the data consumer node has obtained the data right of the first data according to the data obtaining request.
6. The method as recited in claim 5, further comprising:
comparing the performance of the issuing agent node with the performance of the first data owner node in the event that the data consumer node detects an issuing agent node associated with the first data; and
the first data is obtained from the issuing agent node if the performance of the issuing agent node is better than the performance of the first data owner node.
7. The method as recited in claim 5, further comprising:
and after the data user node acquires the first data from the first data owner node, paying the data credit number to the first data owner node.
8. The method as recited in claim 1, further comprising:
the issuing agent node obtains the first data from the first data owner; and
and the issuing agent node acquires the corresponding partition from the first data owner node under the condition of sharing the first data.
9. A storage medium comprising a stored program, wherein the method of any one of claims 1 to 8 is performed by a processor when the program is run.
10. A distributed file system based data flow apparatus comprising:
the data right confirming module is used for confirming the right of the data copyright of the first data through the distributed file system by the first data owner node;
a data storage module for the first data owner node to store the first data of the validation to the blockchain system; and
and the data copyright acquisition module is used for acquiring the data copyright of the first data according to the authority confirmation information of the first data by the data user node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310147745.XA CN116305000A (en) | 2023-02-22 | 2023-02-22 | Data circulation method, device and storage medium based on distributed file system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310147745.XA CN116305000A (en) | 2023-02-22 | 2023-02-22 | Data circulation method, device and storage medium based on distributed file system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116305000A true CN116305000A (en) | 2023-06-23 |
Family
ID=86784428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310147745.XA Pending CN116305000A (en) | 2023-02-22 | 2023-02-22 | Data circulation method, device and storage medium based on distributed file system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116305000A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118152999A (en) * | 2024-05-11 | 2024-06-07 | 深圳中科保泰科技有限公司 | Data management platform and data right determining method for data management |
-
2023
- 2023-02-22 CN CN202310147745.XA patent/CN116305000A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118152999A (en) * | 2024-05-11 | 2024-06-07 | 深圳中科保泰科技有限公司 | Data management platform and data right determining method for data management |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7316392B2 (en) | Methods and systems in which blockchain is realized | |
| CN112600841B (en) | Credit record sharing method and device based on block chain and electronic equipment | |
| US10901983B2 (en) | System and method for universal blockchain interoperability | |
| CN109791671B (en) | Method and system for realizing block chain | |
| JP6971019B2 (en) | Data management system, information processing device, program, and data management method | |
| CN114902195B (en) | Application program cooperation method, computer-readable storage medium, and application program cooperation system | |
| WO2020080145A1 (en) | Content contract system, content contract method, rights holder terminal, alienee terminal, content accumulation server, rights holder program, alienee program, control program, and content accumulation program | |
| CN108197944B (en) | Resource transaction method and device based on block chain technology | |
| CN101887549B (en) | A kind of book acquiring system of digital library | |
| US20190268466A1 (en) | Number portability information management system | |
| CN109168139B (en) | WiFi sharing method based on block chain and server | |
| CN108876669B (en) | Course notarization system and method applied to multi-platform education resource sharing | |
| CN109300038B (en) | Resource flow transaction system | |
| CN110517145B (en) | Data transaction method based on multi-block chain and related equipment | |
| KR102113265B1 (en) | Smart contract system based on block chain and its method | |
| CN113256297B (en) | Data processing method, device and equipment based on block chain and readable storage medium | |
| CN110851531B (en) | Cooperative edge computing method, block chain and cooperative edge computing system | |
| CN111784128A (en) | Asset information processing method and system based on block chain | |
| CN116305000A (en) | Data circulation method, device and storage medium based on distributed file system | |
| Sober et al. | A blockchain-based IoT data marketplace | |
| US20220261776A1 (en) | Content delivery systems that use blockchain to manage content | |
| WO2023116790A1 (en) | Method and apparatus for executing computing task, and storage medium and electronic apparatus | |
| KR102320550B1 (en) | Did-based interchain system and method for data exchange/transaction thereof | |
| CN108197918A (en) | A kind of paid subscriptions share system | |
| CN108696587B (en) | Network service implementation method, server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |