CN110032547A - File stores improved method under a kind of distributed environment - Google Patents
File stores improved method under a kind of distributed environment Download PDFInfo
- Publication number
- CN110032547A CN110032547A CN201910086517.XA CN201910086517A CN110032547A CN 110032547 A CN110032547 A CN 110032547A CN 201910086517 A CN201910086517 A CN 201910086517A CN 110032547 A CN110032547 A CN 110032547A
- Authority
- CN
- China
- Prior art keywords
- storage
- data
- distributed
- file
- network
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
- G06F16/134—Distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1834—Distributed file systems implemented based on peer-to-peer networks, e.g. gnutella
- G06F16/1837—Management specially adapted to peer-to-peer storage networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses files under a kind of distributed environment to store improved method, the redundant distributed storage network including using Hash-table distributed versionization storage agreement；S1: the uploader in redundant distributed storage network generates upload request, and the upload request is recorded in the intelligent contract of block chain；S2: in redundant distributed storage network, state data file will be divided into the data block of fixed size；After deblocking by Data Encryption agreement in an encrypted form distributed storage in each resource node；And source synchronous is quickly carried out by P2P network；S3: the storage person in redundant distributed storage network generates storage request, and storage request is recorded in the intelligent contract of block chain；S4: generating uploader in block chain and storage person stores the store transaction of the file fragmentation, while all data carry out redundant backup by Redundancy Replication agreement.
Description
Technical field
The invention belongs to block chain field, it is related to file storage improved method under a kind of distributed environment.
Background technique
The game of block chain to the maximum value of player be based on playability on economic well-being of workers and staff, without centralization game transport
After seeking any control of quotient, role, stage property, equipment, the fictitious assets etc. in game are really worth income and return player.Cause
This, player has rigid demand for the permanent storage of game data.Meanwhile in order to solve in the entire ecological network of Bell's chain
The efficient storage of large-scale static data and effectively calling.
Bell's chain technical team needs using file storage improved method under a kind of distributed environment.
Summary of the invention
It is an object of the invention to: file storage improved method under a kind of distributed environment is provided, solves Bell's chain
The efficient storage of the medium-and-large-sized static data of entire ecological network and effectively calling.
The technical solution adopted by the invention is as follows:
File stores improved method under a kind of distributed environment, including uses Hash-table distributed versionization storage association
The redundant distributed storage network of view；
S1: the uploader in redundant distributed storage network generates upload request, and the upload request is recorded in
In the intelligent contract of block chain；
S2: in redundant distributed storage network, state data file will be divided into the data block of fixed size；Number
According to after piecemeal pass through Data Encryption agreement in an encrypted form distributed storage in each resource node；And pass through
P2P network quickly carries out source synchronous；
S3: the storage person in redundant distributed storage network generates storage request, and storage request is recorded in
In the intelligent contract of block chain；
S4: generating uploader in block chain and storage person stores the store transaction of the file fragmentation, while all numbers
Redundant backup is carried out according to by Redundancy Replication agreement；
S5: storage person stores the file fragmentation, wherein the P2P network uses Kad algorithm, data are according to Hash's
Uniqueness is indexed by Hash-table and file content abstract fragment.
In order to solve the efficient storage of the medium-and-large-sized static data of the entire ecological network of Bell's chain and effectively call, this programme
Bell constructs RDSN network (Redundancy using technologies such as KAD algorithm, DHT, P2P network, Transmission Control Protocol
Distributed Storage Network) i.e. redundant distributed storage network；Net is stored by redundant distributed node
The storage of network, data will become high efficient and reliable.For game, the centralization data of traditional game service operators are avoided
Memory module is swum simultaneously so even being therefore developer runs away, and player is held value, assets will not lose
Opera script body also can be on perpetuity chain.RDSN is a set of distributed versionization storage agreement that Hash-table technology is utilized.At this
In network, state data file will be divided into the data block (every piece be not more than 4MB) of fixed size.Pass through after deblocking
DataEncryption agreement in an encrypted form distributed storage in each resource node, and by P2P network quickly into
Row source synchronous.The P2P network that Bell's chain is built mainly uses the realization of Kad algorithm, and Kad is a kind of distribution Hash-
Table (DHT) technology.Document is a string of information of this file, is stored to the key-value lane database of each node,
Then the key of each file, which is exactly the hash value-of this file this hash value, is calculated by sha256；Value is just
It is the description information of this file.
Further, the state data file includes the resource downloading packet and patch file of game.
Further, the Kad algorithm is that the information of DHT algorithm calls input terminal；DHT algorithm is in resource number and node
Distributed Hash-table has been used to service in number.Namely data can't be in the form of filename
It is indexed, but the uniqueness of Hash is utilized to pass through Hash-table and file content abstract (sha256) point
Piece carries out.Search efficiency will be improved in this way, realize that quickly and accurately data are routed and positioned under distributed environment.Separately
Outside, all data by Redundancy Replication agreement carry out redundant backup, avoid single node file corruption,
Shortage of data, the factors such as network failure influence the integrality of data.In RDSN framework, core is the true verifying of data, height
Effect storage and calling.
Further, the uploader in redundant distributed storage network and storage person pass through Automatic
Compensation and Hash index carry out data validity feedback validation；It is made a summary by Hash and completes partial data feedback；It tests
Redundant distributed storage network could successfully be used by demonstrate,proving.It is authentic and valid in order to ensure each node data, prevent dummy node
Casting.
Further, storage demand is divided into height according to the calling frequency of data by the redundant distributed storage network
Frequently/intermediate frequency/low frequency three classes, and configuration is optimized for the different demand of every class；After each node realizes data classification storage,
Connection is established using Transmission Control Protocol and adjacent node, is recognized when establishing connection by the realization of Automatic Compensation mechanism
The communication process of " shaking hands " is demonstrate,proved, for determining protocol version, software version, node IP or block height, is equipped with for high frequency requirements
Dedicated node " super mine machine " is absorbed in processing high frequency interaction data, to ensure high efficiency and stability；Intermediate frequency demand will lead to
Large-scale high-capacity intelligent hardware is crossed, handles intermediate frequency big data quantity interaction data, such mine machine is entire distributed network framework
In valuable source node energized for the technicalization upgrading of intellectual product with intellectual product Informal development；Low frequency demand will pass through
External distributed network carries out redundant storage, processing low frequency and no frequency demand, since such data user rate is low, general
It is stored in distributed external network, meets contingency and calls demand, it is ensured that the persistence of information.
In conclusion by adopting the above-described technical solution, the beneficial effects of the present invention are:
1. file stores improved method under one of present invention distributed environment, according to data interaction in network after identification
The frequency, distribution data storage resource node path go forward side by side Mobile state update and optimization.
2. file stores improved method under one of present invention distributed environment, compared to traditional cloud storage, in RDSN
In network, data access speed faster, it is safer, more longlasting, then cooperate the redundant distributed storage of Bell's chain super node
Network, so that game resource is permanently online.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached
Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair
The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this
A little attached drawings obtain other relevant attached drawings, in which:
Fig. 1 is inventive algorithm flow chart；
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that described herein, specific examples are only used to explain the present invention, not
For limiting the present invention, i.e., described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is logical
The component for the embodiment of the present invention being often described and illustrated herein in the accompanying drawings can be arranged and be designed with a variety of different configurations.
Therefore, the detailed description of the embodiment of the present invention provided in the accompanying drawings is not intended to limit below claimed
The scope of the present invention, but be merely representative of selected embodiment of the invention.Based on the embodiment of the present invention, those skilled in the art
Member's every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
It should be noted that the relational terms of term " first " and " second " or the like be used merely to an entity or
Operation is distinguished with another entity or operation, and without necessarily requiring or implying between these entities or operation, there are any
This actual relationship or sequence.Moreover, the terms "include", "comprise" or its any other variant be intended to it is non-exclusive
Property include so that include a series of elements process, method, article or equipment not only include those elements, but also
Further include other elements that are not explicitly listed, or further include for this process, method, article or equipment it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including described
There is also other identical elements in the process, method, article or equipment of element.
Feature and performance of the invention are described in further detail below with reference to embodiment.
Embodiment one
According to Fig. 1, file stores improved method under a kind of distributed environment, including uses Hash-table distributed version
Change the redundant distributed storage network of storage agreement；
S1: the uploader in redundant distributed storage network generates upload request, and the upload request is recorded in
In the intelligent contract of block chain；
S2: in redundant distributed storage network, state data file will be divided into the data block of fixed size；Number
According to after piecemeal pass through Data Encryption agreement in an encrypted form distributed storage in each resource node；And pass through
P2P network quickly carries out source synchronous；
S3: the storage person in redundant distributed storage network generates storage request, and storage request is recorded in
In the intelligent contract of block chain；
S4: generating uploader in block chain and storage person stores the store transaction of the file fragmentation, while all numbers
Redundant backup is carried out according to by Redundancy Replication agreement；
S5: storage person stores the file fragmentation, wherein the P2P network uses Kad algorithm, data are according to Hash's
Uniqueness is indexed by Hash-table and file content abstract fragment.
When work: by redundant distributed node storage network, the storage of data will become high efficient and reliable.For game
For, the centralization data model storage of traditional game service operators is avoided, so even it is that developer runs away, and player
Therefore the value held, assets will not lose, while game itself also can be on perpetuity chain.RDSN is a set of is utilized
The distributed versionization of Hash-table technology stores agreement.In the network, state data file will be divided into fixed big
Small data block (every piece is not more than 4MB).By DataEncryption agreement, distribution is deposited in an encrypted form after deblocking
Storage quickly carries out source synchronous in each resource node, and by P2P network.The P2P network that Bell's chain is built is main
Realize that Kad is a kind of distribution Hash-table (DHT) technology using Kad algorithm.
Embodiment two
The present embodiment on the basis of example 1,
It further, preferably, include the resource downloading packet and patch file of game according to file.
Further, preferably, the Kad algorithm is that the information of DHT algorithm calls input terminal；DHT algorithm exists
Distributed Hash-table has been used to service on resource number and node serial number.Namely data can't be in the form of filename
Further, preferably, but the uniqueness of Hash is utilized to pass through Hash-table and file content
(sha256) fragment of making a summary carries out.It will improve search efficiency in this way, and realize under distributed environment quickly and accurately data
Routing and positioning.In addition, all data carry out redundant backup by Redundancy Replication agreement, avoid single
Node file damage, shortage of data, the factors such as network failure influence the integrality of data.In RDSN framework, core is data
It is true verifying, efficiently storage and call.
Further, preferably, the uploader in redundant distributed storage network and storage person pass through
Automatic Compensation and Hash index carry out data validity feedback validation；Complete number is completed by Hash abstract
According to feedback；Redundant distributed storage network could be used by being proved to be successful.It is authentic and valid in order to ensure each node data, it prevents
Dummy node casting.
Further, preferably, the redundant distributed storage network will be deposited according to the calling frequency of data
Storage demand is divided into high frequency/intermediate frequency/low frequency three classes, and optimizes configuration for the different demand of every class；When each node realizes number
After classification storage, connection is established using Transmission Control Protocol and adjacent node, passes through Automatic when establishing connection
Compensation mechanism realizes the communication process of certification " shaking hands ", for determining protocol version, software version, node IP or area
Block height is equipped with dedicated node " super mine machine " for high frequency requirements, processing high frequency interaction data is absorbed in, to ensure high efficiency
With stability；Intermediate frequency demand will handle intermediate frequency big data quantity interaction data, such mine by large-scale high-capacity intelligent hardware
Machine is the valuable source node in entire distributed network framework, is the technicalization liter of intellectual product with intellectual product Informal development
Grade is energized；Low frequency demand will carry out redundant storage by external distributed network, low frequency and no frequency demand be handled, due to this
Class data user rate is low, therefore will be stored in distributed external network, meets contingency and calls demand, it is ensured that the permanent guarantor of information
It deposits.
The foregoing is merely illustrative of the preferred embodiments of the present invention, the protection scope being not intended to limit the invention, any
Those skilled in the art within the spirit and principles in the present invention made by any modifications, equivalent replacements, and improvements etc.,
It should all be included in the protection scope of the present invention.
Claims (5)
1. file stores improved method under a kind of distributed environment, it is characterised in that: including using Hash-table distribution version
The redundant distributed storage network of this change storage agreement；
S1: the uploader in redundant distributed storage network generates upload request, and the upload request is recorded in block
In the intelligent contract of chain；
S2: in redundant distributed storage network, state data file will be divided into the data block of fixed 1M size；Data
After piecemeal by Data Encryption agreement in an encrypted form distributed storage in each resource node；And pass through P2P
Network quickly carries out source synchronous；
S3: the storage person in redundant distributed storage network generates storage request, and storage request is recorded in block
In the intelligent contract of chain；
S4: generating uploader in block chain and storage person stores the store transaction of the file fragmentation, while all data are logical
It crosses Redundancy Replication agreement and carries out redundant backup；
S5: storage person stores the file fragmentation, wherein the P2P network uses Kad algorithm, data are according to the unique of Hash
Property, it is indexed by Hash-table and file content abstract fragment.
2. file stores improved method under a kind of distributed environment according to claim 1, it is characterised in that: the static state
Data file includes the resource downloading packet and patch file of game.
3. file stores improved method under a kind of distributed environment according to claim 1, it is characterised in that: the Kad
Algorithm is that the information of DHT algorithm calls input terminal；DHT algorithm has used distributed Hash- on resource number and node serial number
Table service.
4. file stores improved method under a kind of distributed environment according to claim 1, it is characterised in that: redundant point
Uploader and storage person in cloth storage network is true by Automatic Compensation and Hash index progress data
Reality feedback validation；It is made a summary by Hash and completes partial data feedback；Redundant distributed storage net could be used by being proved to be successful
Network.
5. file stores improved method under a kind of distributed environment according to claim 1, it is characterised in that: the redundancy
Change distributed storage network and storage demand is divided by high frequency/intermediate frequency/low frequency three classes according to the calling frequency of data, and for every
The different demand of class optimizes configuration；After each node realizes data classification storage, established using Transmission Control Protocol and adjacent node
The communication process of certification " shaking hands " is realized in connection by Automatic Compensation mechanism when establishing connection, be used to true
Determine protocol version, software version, node IP or block height.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910086517.XA CN110032547A (en) | 2019-01-29 | 2019-01-29 | File stores improved method under a kind of distributed environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910086517.XA CN110032547A (en) | 2019-01-29 | 2019-01-29 | File stores improved method under a kind of distributed environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110032547A true CN110032547A (en) | 2019-07-19 |
Family
ID=67235615
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910086517.XA Pending CN110032547A (en) | 2019-01-29 | 2019-01-29 | File stores improved method under a kind of distributed environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110032547A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111353177A (en) * | 2020-05-25 | 2020-06-30 | 杭州趣链科技有限公司 | Block chain-based privacy large file storage system |
| CN113127562A (en) * | 2021-03-30 | 2021-07-16 | 河南九域腾龙信息工程有限公司 | Low-redundancy block chain data storage and retrieval method and system |
| CN114091111A (en) * | 2021-09-09 | 2022-02-25 | 深圳前海微众银行股份有限公司 | Method and device for storing intelligent contracts of block chains |
| CN114185866A (en) * | 2022-02-16 | 2022-03-15 | 安翰科技(武汉)股份有限公司 | Data local storage control method and medical data storage system |
| CN115865461A (en) * | 2022-11-25 | 2023-03-28 | 贵州电网有限责任公司 | Method and system for distributing data in high-performance computing cluster |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105790954A (en) * | 2016-03-02 | 2016-07-20 | 布比（北京）网络技术有限公司 | Method and system for constructing electronic evidence |
| CN108076148A (en) * | 2017-12-15 | 2018-05-25 | 成都链网络科技有限公司 | Storage system based on block chain |
| CN108111585A (en) * | 2017-12-15 | 2018-06-01 | 成都链网络科技有限公司 | Distributed storage method based on block chain |
| CN108875422A (en) * | 2018-05-07 | 2018-11-23 | 南京快文信息科技有限公司 | Brain wave data storage method and system based on block chain |
-
2019
- 2019-01-29 CN CN201910086517.XA patent/CN110032547A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105790954A (en) * | 2016-03-02 | 2016-07-20 | 布比（北京）网络技术有限公司 | Method and system for constructing electronic evidence |
| CN108076148A (en) * | 2017-12-15 | 2018-05-25 | 成都链网络科技有限公司 | Storage system based on block chain |
| CN108111585A (en) * | 2017-12-15 | 2018-06-01 | 成都链网络科技有限公司 | Distributed storage method based on block chain |
| CN108875422A (en) * | 2018-05-07 | 2018-11-23 | 南京快文信息科技有限公司 | Brain wave data storage method and system based on block chain |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111353177A (en) * | 2020-05-25 | 2020-06-30 | 杭州趣链科技有限公司 | Block chain-based privacy large file storage system |
| CN113127562A (en) * | 2021-03-30 | 2021-07-16 | 河南九域腾龙信息工程有限公司 | Low-redundancy block chain data storage and retrieval method and system |
| CN114091111A (en) * | 2021-09-09 | 2022-02-25 | 深圳前海微众银行股份有限公司 | Method and device for storing intelligent contracts of block chains |
| CN114091111B (en) * | 2021-09-09 | 2022-11-18 | 深圳前海微众银行股份有限公司 | Method and device for storing intelligent contracts of block chains |
| CN114185866A (en) * | 2022-02-16 | 2022-03-15 | 安翰科技(武汉)股份有限公司 | Data local storage control method and medical data storage system |
| CN114185866B (en) * | 2022-02-16 | 2022-05-03 | 安翰科技(武汉)股份有限公司 | Data local storage control method and medical data storage system |
| CN115865461A (en) * | 2022-11-25 | 2023-03-28 | 贵州电网有限责任公司 | Method and system for distributing data in high-performance computing cluster |
| CN115865461B (en) * | 2022-11-25 | 2024-04-19 | 贵州电网有限责任公司 | Method and system for distributing data in high-performance computing cluster |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110032547A (en) | File stores improved method under a kind of distributed environment | |
| US11899684B2 (en) | System and method for maintaining a master replica for reads and writes in a data store | |
| US10929240B2 (en) | System and method for adjusting membership of a data replication group | |
| CN110163004B (en) | Block chain generation method, related equipment and system | |
| US9367252B2 (en) | System and method for data replication using a single master failover protocol | |
| CN110971663B (en) | Trusted processing method and system for data transaction | |
| JP2024019632A (en) | Computer-implemented system and method for managing large-scale distributed memory pool in block chain network | |
| US9411873B2 (en) | System and method for splitting a replicated data partition | |
| US10248704B2 (en) | System and method for log conflict detection and resolution in a data store | |
| CN113094396B (en) | Data processing method, device, equipment and medium based on node memory | |
| JP2020507866A (en) | Data processing method and device | |
| US20230316273A1 (en) | Data processing method and apparatus, computer device, and storage medium | |
| CN103150394A (en) | Distributed file system metadata management method facing to high-performance calculation | |
| US20230090296A1 (en) | Transaction verification of a transaction based on a blockchain network | |
| Ye et al. | Accuracy, scalability, coverage: A practical configuration verifier on a global wan | |
| CN103001945B (en) | Diversified resource identifier safety access method | |
| CN110493345A (en) | Internet-of-things terminal method for upgrading software and system based on block chain | |
| US20200084041A1 (en) | Automated Blockchain Protocol Update | |
| CN111241589A (en) | Database system, node and method | |
| CN110808839B (en) | Processing method, device, equipment and medium for block chain abnormal data | |
| CN110597922A (en) | Data processing method, device, terminal and storage medium | |
| CN110599175A (en) | Block processing method and related equipment | |
| CN106156319A (en) | Telescopic distributed resource description framework data storage method and device | |
| WO2017067374A1 (en) | Message push method and push server | |
| CN113409047B (en) | Data processing method, device and equipment based on block chain and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190719 |
|
| RJ01 | Rejection of invention patent application after publication |