CN110321326A - A kind of block chained file fragment search method - Google Patents

A kind of block chained file fragment search method Download PDF

Info

Publication number
CN110321326A
CN110321326A CN201910413307.7A CN201910413307A CN110321326A CN 110321326 A CN110321326 A CN 110321326A CN 201910413307 A CN201910413307 A CN 201910413307A CN 110321326 A CN110321326 A CN 110321326A
Authority
CN
China
Prior art keywords
file
fragmentation
memory node
sequence
piece
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910413307.7A
Other languages
Chinese (zh)
Other versions
CN110321326B (en
Inventor
马成龙
金兆康
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Yibi Technology Co Ltd
Original Assignee
Hangzhou Yibi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Yibi Technology Co Ltd filed Critical Hangzhou Yibi Technology Co Ltd
Priority to CN201910413307.7A priority Critical patent/CN110321326B/en
Publication of CN110321326A publication Critical patent/CN110321326A/en
Application granted granted Critical
Publication of CN110321326B publication Critical patent/CN110321326B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/148File search processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/172Caching, prefetching or hoarding of files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

The invention discloses a kind of block chained file fragment search methods, including obtaining source file according to filename, the processing of file fragmentation search method, calculate memory node processing, the combination and verification processing of slicing files, source file is obtained according to filename first, file enters in file fragmentation retrieval device, file fragmentation retrieval device successively carries out file fragmentation algorithm process to file, file addressing, document retrieval, chain where calculating, storage, file after storage will carry out calculating memory node and handle to obtain corresponding file piece and file sequence, finally file piece is handled using slicing files combined method, combined authentication, file is back in file fragmentation retrieval device.The problem of big file is cut into several small documents by block chained file fragment search method of the invention, and when downloading can obtain simultaneously from multiple servers, prevent servers fail and can not download, with high security, the wide advantage of applicability.

Description

A kind of block chained file fragment search method
Technical field
The present invention relates to a kind of document retrieval methods, and in particular to a kind of block chained file fragment search method.
Background technique
Data required for the retrieval of current most systems once can only obtain you from a data center, if this The case where data center breaks down, or is attacked, and similar network application relies on very much backbone network, it may appear that file was lost asks Topic.Therefore, it is necessary to design a kind of block chained file fragment retrieval device, acquisition when, can be obtained simultaneously from multiple servers It takes, can be very good shared Various types of data.
Summary of the invention
The technical problem to be solved in the present invention is that providing a kind of block chained file for the above-mentioned deficiency of the prior art Fragment search method.
The present invention is through the following technical solutions to achieve the above objectives: a kind of block chained file fragment search method, in which: Include the following steps,
Step 1: source file is obtained according to filename;
Step 2: the source file obtained in step 1 is distributed to file to distribute and be retrieved by the processing of file fragmentation search method The processing of file fragmentation search method is carried out in device, through file fragmentation search method, treated that file is distributed into storage chains, It waits and handling in next step;
Step 3: calculating memory node processing, the file in step 2 carried out calculating memory node in storage chains, if Failure is calculated, source file returns in file fragmentation retrieval device, successfully distributes source file to memory node A if calculating, deposits Store up node B, memory node C, in memory node D, Chu Jiedian A, memory node B, memory node C, memory node D generate text respectively Part piece A, file piece B, file piece C, file piece D, file sequence A, file sequence B, file sequence C, file sequence D wait It handles in next step;
Step 4: step 4: the combination and verification processing of slicing files, by file piece A, file piece B, file in step 3 Piece C, file piece D, file sequence A, file sequence B, file sequence C, file sequence D are handled using file combined method, are formed Band composition file, then file combined authentication processing is carried out, if file combined authentication processing failure file to be combined is back to file Fragment is retrieved in device, if file combined authentication is handled successfully, composition file is sent into file fragmentation retrieval device, text is completed The retrieval of part fragment.
As a further optimization solution of the present invention, the processing of file fragmentation search method successively includes at file fragmentation algorithm Reason, document retrieval, calculates place chain, the processing of slicing files combined method at file addressing, if file addressing fails, source file is sent It is back in file fragmentation retrieval device;If file addressing success, carries out document retrieval, obtains file sequence;By resulting file Chain is handled where sequence and source file are calculated, if calculating failure, source file is returned in file fragmentation retrieval device, if meter It is counted as function, source file is stored into storage chains.
The beneficial effects of the present invention are:
By file fragmentation algorithm process, the purpose of administration, branch storage is realized.
By file addressing, file is abstracted into special file directory, it can be as the address HTTP when access Obtain file.
By calculating memory node processing, the target of the storage of decentralization is realized by common recognition mechanism.
Verified by composition file, realize can with operating rate faster, data it is safer.
Detailed description of the invention
Fig. 1 is a kind of flow diagram of block chained file fragment search method of the invention;
Fig. 2 is the specific embodiment flow diagram of Fig. 1.
Specific embodiment
The application is described in further detail with reference to the accompanying drawing, it is necessary to it is indicated herein to be, implement in detail below Mode is served only for that the application is further detailed, and should not be understood as the limitation to the application protection scope, the field Technical staff can make some nonessential modifications and adaptations to the application according to above-mentioned application content.
Embodiment 1
A kind of block chained file fragment search method as shown in Figure 1: including the following steps,
Step 1: source file is obtained according to filename;
Step 2: the source file obtained in step 1 is distributed to file to distribute and be retrieved by the processing of file fragmentation search method The processing of file fragmentation search method is carried out in device, through file fragmentation search method, treated that file is distributed into storage chains, It waits and handling in next step;
Step 3: calculate memory node processing, will be processed in step 2 after source file generate file in storage chains In carry out calculating memory node, if calculate failure, source file return to file fragmentation retrieval device in, if calculating source document successfully Part is distributed into memory node A, memory node B, memory node C, memory node D, Chu Jiedian A, memory node B, memory node C, memory node D generates file piece A, file piece B, file piece C, file piece D, file sequence A, file sequence B, file sequence respectively C, file sequence D are arranged, waits and handling in next step;
Step 4: the combination and verification processing of slicing files, by file piece A, file piece B, file piece C, text in step 3 Part piece D, file sequence A, file sequence B, file sequence C, file sequence D are handled using file combined method, form band combination File, then file combined authentication processing is carried out, if file combined authentication processing failure file to be combined is back to file fragmentation inspection In rope device, if file combined authentication is handled successfully, composition file is sent into file fragmentation retrieval device, file fragmentation is completed Retrieval.
Embodiment 2
A kind of block chained file fragment search method as described in Example 1 is distinguished and is only that, file fragmentation retrieval side Method processing successively includes file fragmentation algorithm process, file addressing, document retrieval, calculates place chain, storage, if file addressing loses It loses, source file returns in file fragmentation retrieval device, if file addressing success, carries out document retrieval, obtain file sequence;It will Chain is handled where resulting file sequence and source file are calculated, if calculating failure, source file returns to file fragmentation retrieval In device, if calculating successfully, source file is stored into storage chains.
Source file is first obtained according to filename as shown in Figure 2, source file enters in file fragmentation retrieval device, file fragmentation It retrieves device and file fragmentation algorithm process, file addressing is carried out to source file, if file addressing fails, file is back to file point Piece is retrieved in device, if file addressing success, file carry out document retrieval.Document retrieval obtains file sequence, to file sequence Chain where being calculated, if calculate where chain failure, file be back to file fragmentation retrieval device in, if calculate where chain at Function, file are stored in storage chains.File carries out calculating memory node in storage chains, if calculating failure, file returns to text Part fragment is retrieved in device, is saved if calculating and successfully distributing source file to memory node A, memory node B, memory node C, storage In point D, Chu Jiedian A, memory node B, memory node C, memory node D generate file piece A, file piece B, file piece C, text respectively Part piece D, file sequence A, file sequence B, file sequence C, file sequence D.File piece A, file piece B, file piece C, file piece D, file sequence A, file sequence B, file sequence C, file sequence D are handled using file combined method, form composition file, then The processing of file combined authentication is carried out, if file combined authentication processing failure file to be combined is back to file fragmentation retrieval device In, if file combined authentication is handled successfully, composition file is sent into file fragmentation retrieval device, file fragmentation retrieval is completed.
The above-described embodiments are merely illustrative of preferred embodiments of the present invention, not to structure of the invention Think and range is defined.Without departing from the design concept of the invention, ordinary people in the field is to technology of the invention The all variations and modifications that scheme is made, should all drop into protection scope of the present invention, the claimed technology contents of the present invention, It is all described in the claims.

Claims (2)

1. a kind of block chained file fragment search method, it is characterised in that: include the following steps,
Step 1: source file is obtained according to filename;
Step 2: the source file obtained in step 1 is distributed to file fragmentation and retrieves device by the processing of file fragmentation search method Middle progress file fragmentation search method processing, through file fragmentation search method, treated that file is stored into storage chains, waits It handles in next step;
Step 3: calculating memory node processing, the file in step 2 carried out calculating memory node in storage chains, if calculating Failure, file returns in file fragmentation retrieval device in step 2, if calculate successfully by source file distribute to memory node A, Memory node B, memory node C, in memory node D, Chu Jiedian A, memory node B, memory node C, memory node D are generated respectively File piece A, file piece B, file piece C, file piece D, file sequence A, file sequence B, file sequence C, file sequence D wait It handles in next step;
Step 4: the combination and verification processing of slicing files, by file piece A, file piece B, file piece C, file piece in step 3 D, file sequence A, file sequence B, file sequence C, file sequence D are handled using file combined method, form composition file, then The processing of file combined authentication is carried out, if file combined authentication processing failure file to be combined is back to file fragmentation retrieval device In, if file combined authentication is handled successfully, composition file is sent into file fragmentation retrieval device, file fragmentation retrieval is completed.
2. a kind of block chained file fragment search method as described in claim 1, it is characterised in that: file fragmentation search method Processing successively includes file fragmentation algorithm process, file addressing, document retrieval, calculates place chain, storage, if file addressing loses It loses, source file returns in file fragmentation retrieval device, if file addressing success, carries out document retrieval, obtain file sequence;
Chain is handled where resulting file sequence and source file are calculated, if calculating failure, source file returns to file point Piece is retrieved in device, if calculating successfully, source file is stored into storage chains.
CN201910413307.7A 2019-05-17 2019-05-17 Block chain file fragment retrieval method Active CN110321326B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910413307.7A CN110321326B (en) 2019-05-17 2019-05-17 Block chain file fragment retrieval method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910413307.7A CN110321326B (en) 2019-05-17 2019-05-17 Block chain file fragment retrieval method

Publications (2)

Publication Number Publication Date
CN110321326A true CN110321326A (en) 2019-10-11
CN110321326B CN110321326B (en) 2021-08-10

Family

ID=68113141

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910413307.7A Active CN110321326B (en) 2019-05-17 2019-05-17 Block chain file fragment retrieval method

Country Status (1)

Country Link
CN (1) CN110321326B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111694809A (en) * 2020-06-11 2020-09-22 杭州云链趣链数字科技有限公司 File filtering method and device based on block chain and computer equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170116693A1 (en) * 2015-10-27 2017-04-27 Verimatrix, Inc. Systems and Methods for Decentralizing Commerce and Rights Management for Digital Assets Using a Blockchain Rights Ledger
US20180300382A1 (en) * 2017-04-12 2018-10-18 Vijay K. Madisetti Method and System for Tuning Blockchain Scalability for Fast and Low-Cost Payment and Transaction Processing
CN109086139A (en) * 2018-08-15 2018-12-25 昧来网络科技(上海)有限公司 Dynamic Program Slicing method, equipment and computer storage medium
CN109246211A (en) * 2018-08-30 2019-01-18 南方科技大学 A kind of resource in block chain uploads and resource request method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170116693A1 (en) * 2015-10-27 2017-04-27 Verimatrix, Inc. Systems and Methods for Decentralizing Commerce and Rights Management for Digital Assets Using a Blockchain Rights Ledger
US20180300382A1 (en) * 2017-04-12 2018-10-18 Vijay K. Madisetti Method and System for Tuning Blockchain Scalability for Fast and Low-Cost Payment and Transaction Processing
CN109086139A (en) * 2018-08-15 2018-12-25 昧来网络科技(上海)有限公司 Dynamic Program Slicing method, equipment and computer storage medium
CN109246211A (en) * 2018-08-30 2019-01-18 南方科技大学 A kind of resource in block chain uploads and resource request method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111694809A (en) * 2020-06-11 2020-09-22 杭州云链趣链数字科技有限公司 File filtering method and device based on block chain and computer equipment

Also Published As

Publication number Publication date
CN110321326B (en) 2021-08-10

Similar Documents

Publication Publication Date Title
US11822657B2 (en) Machine learning-based malware detection system and method
CN104221003B (en) Utilize data de-duplication based on stream of the asynchronous data dictionary in the infrastructure that multi-tenant is shared
CN104820717B (en) A kind of storage of mass small documents and management method and system
US20100088752A1 (en) Identifier Binding for Automated Web Processing
AU2001288650A1 (en) Systems and method for interacting with users over a communications network
CN103391312B (en) Resource offline method for down loading and device
DE10196732T1 (en) PEER-TO-PEER software distribution system
CN109246190B (en) Network addressing method, data editing method, device and storage medium
CN109617964B (en) Big data storage method and device based on block chain
CN108881354A (en) A kind of pushed information storage method, device, server and computer storage medium
CN101158954A (en) Method for recognizing repeat data in computer storage
CN104008199B (en) A kind of data query method
CN104521183B (en) It is scanned using the BIT TORRENT of the cross validation monitored for robust data
CN111164934A (en) Pruning of authentication trees
CN110321326A (en) A kind of block chained file fragment search method
CN108573026A (en) A kind of data circulation method and device, storage medium, server
CN104679798B (en) Page detection method and device
CN103309873B (en) The processing method of data, apparatus and system
US10567399B2 (en) Fragmented malware hash lookup in cloud repository
CN108809929B (en) Rural financial system based on block chain technology
CN102750287B (en) Include method and the download authentication server of index information
CN102638577A (en) Method, equipment and system for collecting seed files
CN105681892B (en) The method, apparatus and system of differential data transmission
CN105656769B (en) Business data processing method, apparatus and system
Goztepe et al. A decision framework for combat cloud computing strategy

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant