CN107844542A - A kind of distributed document storage method and device - Google Patents
A kind of distributed document storage method and device Download PDFInfo
- Publication number
- CN107844542A CN107844542A CN201711013180.7A CN201711013180A CN107844542A CN 107844542 A CN107844542 A CN 107844542A CN 201711013180 A CN201711013180 A CN 201711013180A CN 107844542 A CN107844542 A CN 107844542A
- Authority
- CN
- China
- Prior art keywords
- file
- storage system
- storage
- information
- api interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003860 storage Methods 0.000 title claims abstract description 461
- 238000000034 method Methods 0.000 title claims abstract description 101
- 230000006399 behavior Effects 0.000 claims description 2
- 230000009471 action Effects 0.000 description 16
- 230000008569 process Effects 0.000 description 9
- 230000008859 change Effects 0.000 description 4
- 230000006837 decompression Effects 0.000 description 4
- 238000009434 installation Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 238000012217 deletion Methods 0.000 description 3
- 230000037430 deletion Effects 0.000 description 3
- 238000000151 deposition Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000014759 maintenance of location Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- VQLYBLABXAHUDN-UHFFFAOYSA-N bis(4-fluorophenyl)-methyl-(1,2,4-triazol-1-ylmethyl)silane;methyl n-(1h-benzimidazol-2-yl)carbamate Chemical compound C1=CC=C2NC(NC(=O)OC)=NC2=C1.C=1C=C(F)C=CC=1[Si](C=1C=CC(F)=CC=1)(C)CN1C=NC=N1 VQLYBLABXAHUDN-UHFFFAOYSA-N 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000004064 recycling Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0876—Network architectures or network communication protocols for network security for authentication of entities based on the identity of the terminal or configuration, e.g. MAC address, hardware or software configuration or device fingerprint
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/10—Network architectures or network communication protocols for network security for controlling access to devices or network resources
Abstract
The invention provides a kind of distributed document storage method and device, this method to include：At least one document storage system is set；Certificate server is built in application layer；At least one api interface is set；Utilize the storage information of the certificate server certification outside input；The storage information certification by when, according to the storage information, file destination storage system is determined at least one document storage system and at least one target api interface is determined at least one api interface；Using the file destination storage system and at least one target api interface, file to be stored corresponding to the storage information is obtained, and distributed storage is carried out to acquired file to be stored.Therefore, scheme provided by the invention can improve the security of file.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of distributed document storage method and device.
Background technology
With the fast development of informationization, all trades and professions would generally produce substantial amounts of file when carrying out business activity.For
Effectively management is carried out to business activity, it is necessary to stored to caused file.
At present, no matter what type of file to be stored is produced in business activity, deposit caused file to be stored
Storage is in specified storage device.But storage device is in the process of running it is possible that failure, and to storage file
When being managed, management cost is higher.
It can be seen that existing mode, when storage device breaks down, its file stored may be lost or damage.Cause
This, the security of file is relatively low.
The content of the invention
The embodiments of the invention provide a kind of distributed document storage method and device, the security of file can be improved.
In a first aspect, the embodiments of the invention provide a kind of distributed document storage method, this method includes：
At least one document storage system is set；
Certificate server is built in application layer；
At least one api interface is set；
Utilize the storage information of the certificate server certification outside input；
The storage information certification by when, according to the storage information, at least one document storage system
It is middle to determine file destination storage system and at least one target api interface is determined at least one api interface；
Using the file destination storage system and at least one target api interface, the storage information is obtained
Corresponding file to be stored, and distributed storage is carried out to acquired file to be stored.
Preferably,
The certificate server includes at least one authentication method；
The storage information includes user profile, file to be stored attribute information and at least one operation and required；
The storage information using the certificate server certification outside input, including：
Target authentication method is determined at least one authentication method；
The user profile included using the target authentication method to the storage information is authenticated.
Preferably,
At least one authentication method includes：The authority of digital signature, OAUTH Valuation Standards and based role accesses
Control at least one of RBAC or a variety of.
Preferably,
Each described document storage system corresponds to a kind of storage demand respectively；
Each described api interface corresponds to a kind of operational motion；
The storage information includes user profile, file to be stored attribute information and at least one operation and required；
It is described according to the storage information, file destination storage system is determined at least one document storage system
And at least one target api interface is determined at least one api interface, including：
It is performed both by for document storage system each described, judges that storage needs corresponding to presently described document storage system
The no file to be stored attribute information included with the storage information of Seeking Truth matches, if it is, presently described file is stored
System is defined as file destination storage system；
Be performed both by for api interface each described, judge operational motion corresponding to presently described api interface whether with institute
Any one operation requirement that stating storage information includes matches, if it is, presently described api interface is defined as into target API
Interface.
Preferably,
Each described document storage system is respectively corresponding to a few memory node；
It is described to carry out distributed storage to acquired file to be stored, including：
Acquired file to be stored is cut at least two data blocks；
Corresponding at least one backup block is formed for data block each described；
By at least two data block and each backup block, distributed storage stores in the file destination is
In at least one memory node corresponding to system.
Preferably,
Further comprise：
Receive the first access information of outside input；
Utilize access information described in the certificate server certification；
The access information certification by when, at least one API to be used is determined at least one api interface
Interface, and determine document storage system to be visited at least one document storage system；
Using at least one api interface to be used and the document storage system to be visited, access and the visit
Ask file to be visited corresponding to information；
Cache the file to be visited；
The access information of outside input second is being received, and is determining second access information and the first access information phase
Meanwhile the file to be visited of direct access cache.
Second aspect, the embodiments of the invention provide a kind of distributed document storage device, the device includes：
Storage system setup module, for setting at least one document storage system；
Module is built, for building certificate server in application layer；
Interface setup module, for setting at least one api interface；
Authentication module, the storage letter for the certificate server certification outside input built for building module described in utilization
Breath；
Determining module, for the storage information certification by when, according to the storage information, in the storage system
File destination storage system is determined at least one document storage system that setup module is set and is set in the interface
Put at least one api interface of module setting and determine at least one target api interface；
Memory module, for the file destination storage system and described at least one determined using the determining module
Individual target api interface, file to be stored corresponding to the storage information is obtained, and acquired file to be stored is distributed
Formula stores.
Preferably,
The certificate server includes at least one authentication method, the storage information includes user profile, to be stored
When file attribute information and at least one operation require,
The authentication module, for determining target authentication method at least one authentication method；Utilize the mesh
The user profile that mark authentication method includes to the storage information is authenticated.
Preferably,
A kind of storage demand, each described api interface corresponding one are corresponded to respectively in each described document storage system
When kind operational motion, the storage information require including user profile, file to be stored attribute information and at least one operation,
The determining module includes：System determination sub-module and interface determination sub-module；
The system determination sub-module, for being performed both by for document storage system each described, judge presently described
The file to be stored attribute information whether storage demand corresponding to document storage system includes with the storage information matches, such as
Fruit is that presently described document storage system is defined as into file destination storage system；
The interface determination sub-module, for being performed both by for api interface each described, judge that presently described API connects
Whether any one the operation requirement included with the storage information matches operational motion corresponding to mouthful, if it is, will be current
The api interface is defined as target api interface.
Preferably,
When each described document storage system is respectively corresponding to a few memory node,
The memory module includes：Backup submodule and sub-module stored；
The backup submodule, for acquired file to be stored to be cut into at least two data blocks；For each
The data block forms corresponding at least one backup block；
The sub-module stored, for by least two data block and each backup block, distributed storage
In at least one memory node corresponding to the file destination storage system.
Preferably,
Further comprise：Access modules；
The access modules include：Access submodule, cache sub-module and determination sub-module；
The access submodule, for utilizing access information described in the certificate server certification；In the access information
Certification by when, at least one api interface to be used is determined at least one api interface, and described at least one
Document storage system to be visited is determined in kind document storage system；Utilize at least one api interface to be used and described
Document storage system to be visited, access file to be visited corresponding with the access information；
The cache sub-module, for caching the file to be visited；
The determination sub-module, for receiving the access information of outside input second, and determine second access information
When identical with first access information, the file to be visited of direct access cache.
The embodiments of the invention provide a kind of distributed document storage method and device, at least one file is set to deposit first
Storage system.Then certificate server is built in application layer, and at least one api interface is set.Receiving depositing for outside input
When storing up information, certificate server certification storage information is utilized.Storage information certification by when, according to storage information in setting
File destination storage system is determined in various document storage systems and determines at least one mesh in the various api interfaces of setting
Mark api interface.File destination storage system and each target api interface are finally utilized, obtains and waits to deposit corresponding to storage information
File is stored up, and distributed storage is carried out to acquired file to be stored.By above-mentioned, when receiving storage information,
It can determine file destination storage system and each target api interface, and utilize file destination storage system and each
Target api interface carries out distributed storage to file to be stored corresponding to storage information.Therefore side provided in an embodiment of the present invention
Case can improve the security of file.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are the present invention
Some embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis
These accompanying drawings obtain other accompanying drawings.
Fig. 1 is a kind of flow chart for distributed document storage method that one embodiment of the invention provides；
Fig. 2 is a kind of flow chart for distributed document storage method that another embodiment of the present invention provides；
Fig. 3 is a kind of hardware knot of equipment where a kind of distributed document storage device that one embodiment of the invention provides
Composition；
Fig. 4 is a kind of structural representation for distributed document storage device that one embodiment of the invention provides；
It is a kind of including system determination sub-module and interface determination sub-module that Fig. 5 is that one embodiment of the invention provides
The structural representation of distributed document storage device；
Fig. 6 is a kind of distributed document including backup submodule and sub-module stored that one embodiment of the invention provides
The structural representation of storage device；
Fig. 7 is a kind of structure for distributed document storage device including access modules that one embodiment of the invention provides
Schematic diagram.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
Part of the embodiment of the present invention, rather than whole embodiments, based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment obtained on the premise of creative work is not made, belongs to the scope of protection of the invention.
As shown in figure 1, the embodiments of the invention provide a kind of distributed document storage method, this method can include following
Step：
Step 101：At least one document storage system is set；
Step 102：Certificate server is built in application layer；
Step 103：At least one api interface is set；
Step 104：Utilize the storage information of the certificate server certification outside input；
Step 105：The storage information certification by when, according to the storage information, at least one file
File destination storage system is determined in storage system and at least one target API is determined at least one api interface
Interface；
Step 106：Using the file destination storage system and at least one target api interface, described in acquisition
File to be stored corresponding to storage information, and distributed storage is carried out to acquired file to be stored.
Embodiment according to Fig. 1, at least one document storage system is set first.Then certification is built in application layer
Server, and at least one api interface is set.When receiving the storage information of outside input, certificate server certification is utilized
Storage information.Storage information certification by when, target is determined in the various document storage systems of setting according to storage information
Document storage system and at least one target api interface is determined in the various api interfaces of setting.Finally utilize file destination
Storage system and each target api interface, file to be stored corresponding to storage information is obtained, and to acquired text to be stored
Part carries out distributed storage.By above-mentioned, when receiving storage information, it may be determined that go out file destination storage system with
And each target api interface, and using file destination storage system and each target api interface to being treated corresponding to storage information
Storage file carries out distributed storage.Therefore scheme provided in an embodiment of the present invention can improve the security of file.
In an embodiment of the invention, the quantity of at least one document storage system and pattern can be according to business
It is required that determine.For example at least one document storage system could be arranged to the lightweight distributed file system increased income
FastDFS, TFS (TaobaoFileSystem, Taobao's file system), expansible distributed file system GFS, Hadoop point
At least one of cloth file system HDFS, parallel distributive file system Lustre or a variety of.
In an embodiment of the invention, the certificate server involved by the step 102 in flow chart shown in above-mentioned Fig. 1
Believe including the storage information involved by step 104 in flow chart shown at least one authentication method, above-mentioned Fig. 1 including user
When breath, file to be stored attribute information and at least one operation require,
Step 104, can using the storage information of the certificate server certification outside input in flow chart shown in above-mentioned Fig. 1
With including：
Target authentication method is determined at least one authentication method；
The user profile included using the target authentication method to the storage information is authenticated.
In the present embodiment, user profile can include user name and login password.File to be stored attribute information can
To be identified including file to be stored, the file type of file to be stored, the file size of file to be stored.At least one operation will
Asking to include：At least one of access, storage, renewal, deletion and modification are a variety of.
In the present embodiment, can be determined according to the certification complexity of outside input at least one authentication method
Target authentication method.Wherein, the target authentication method of the higher determination of certification complexity is stricter.Determined in target authentication method
Afterwards, the user name and login password included using target authentication method to user profile is authenticated, to judge user
Whether information is legal information.
According to above-described embodiment, target authentication method is determined in the various authentication methods that certificate server includes, and
The user profile that storage information includes is authenticated using target authentication method, to ensure storage information as legal information, from
And improve security.
In an embodiment of the invention, at least one authentication method that certificate server includes can include：Numeral
At least one of signature, OAUTH Valuation Standards and RBAC or a variety of.
In the present embodiment, authentication method can determine according to business need.But at least one authentication method include but
It is not limited at least one of digital signature, OAUTH Valuation Standards and RBAC or a variety of.Wherein OAUTH Valuation Standards can be with
Different versions is selected according to business need, such as, from OAUTH2.0 Valuation Standards.
According to above-described embodiment, at least one authentication method can select digital signature, OAUTH certifications according to business need
At least one of standard and RBAC are a variety of.Therefore, business is with strong applicability.
In an embodiment of the invention, described in each involved by the step 101 in flow chart shown in above-mentioned Fig. 1
Document storage system corresponds to a kind of storage demand respectively, described in each in flow chart shown in above-mentioned Fig. 1 involved by step 103
Api interface corresponds to a kind of operational motion, the storage information in flow chart shown in above-mentioned Fig. 1 involved by step 104 can include using
When family information, file to be stored mark and operational motion,
It is then involved according to the storage information in the step 105 in flow chart shown in Fig. 1 described above, it is described extremely
File destination storage system is determined in a kind of few document storage system and determines at least one at least one api interface
Individual target api interface, including：
It is performed both by for document storage system each described, judges that storage needs corresponding to presently described document storage system
The no file to be stored attribute information included with the storage information of Seeking Truth matches, if it is, presently described file is stored
System is defined as file destination storage system；
Be performed both by for api interface each described, judge operational motion corresponding to presently described api interface whether with institute
Any one operation requirement that stating storage information includes matches, if it is, presently described api interface is defined as into target API
Interface.
In the present embodiment, can be set according to the characteristics of each document storage system for each document storage system
Put corresponding memory requirement.Wherein, memory requirement can be the file to be stored of storage default file type, storage file size
File to be stored in default value section, file to be stored of the storage with default access, storage are advised from preset term
Any one in the file to be stored of mould.
In the present embodiment, file to be stored attribute information can include file to be stored mark, the text of file to be stored
Part type, the file size of file to be stored., can be in file to be stored attribute information it is determined that during file destination storage system
In determine occurrence, wherein, occurrence can be file to be stored mark, the file type of file to be stored, text to be stored
Any one in the file size of part.Then occurrence storage demand corresponding with each document storage system is compared
It is right, to determine the storage demand to match with occurrence.It is and document storage system corresponding to identified storage demand is true
It is set to file destination storage system.
Illustrated below exemplified by document storage system 1 and document storage system 2 are set.The correspondence of document storage system 1
Storage demand be file to be stored of the storage file size in default value section, stored corresponding to document storage system 2
Demand is the file to be stored of storage default file type.The file to be stored attribute information of the storage information received includes
File to be stored mark A, the file type B of file to be stored, the file size C of file to be stored.So it is determined that target is literary
During part storage system, the file type B of the file to be stored in file to be stored attribute information is defined as occurrence, then judged
Whether storage demand corresponding to document storage system 1 matches with file type B, by judging, because document storage system 1 is right
The storage demand answered is file to be stored of the storage file size in default value section, is mismatched with file type B, then not
Document storage system 1 is defined as file destination storage system.Whether continue to judge storage demand corresponding to document storage system 2
Match with file type B, by judging, because storage demand corresponding to document storage system 2 is storage default file type
File to be stored, match with file type B, then document storage system 2 be defined as file destination storage system.
In the present embodiment, can be each API (Application Programming according to business need
Interface, application programming interface) operational motion corresponding to interface setting.Wherein, operational motion can be to upload, deposit
Any one in storing up, share and managing.Wherein, management can be any one in modification, renewal and deletion.
In the present embodiment, file to be stored attribute information can include file to be stored mark, the text of file to be stored
Part type, the file size of file to be stored., can be in file to be stored attribute information really it is determined that during target api interface
At least one matching action is made, wherein, it can be to access, in storage, renewal, deletion and modification that at least one matching, which acts,
Any one or more.Then at least one matching action is compared with operational motion corresponding to each api interface,
To determine at least one operational motion to match with least one matching action.And by corresponding to identified operational motion
Api interface is defined as target api interface.
Illustrated below exemplified by api interface 1 and A PI interfaces 2 are set.Operational motion corresponding to api interface 1 is
Storage, operational motion corresponding to api interface 2 are management.The operation requirement that the storage information received includes is storage.So
It is determined that during target api interface, the storage in file to be stored attribute information is defined as matching action, then the correspondence of api interface 1
Operational motion whether with matching action " storage " match, through judgement, operational motion " storage " corresponding to api interface 1 and
Matching action " storage " matches, then api interface 1 is defined as into target api interface.Continue to judge to operate corresponding to api interface 2
Whether action matches with matching action " storage ", and by judging, operational motion " management " corresponding to api interface 2 is dynamic with matching
Make " storage " to mismatch, then api interface 2 is not defined as target api interface.
According to above-described embodiment, because file destination storage system is the storage according to corresponding to each document storage system
What the file to be stored attribute information that demand and storage information include was determined, it is thus determined that file destination storage out
The matching degree of system and storage information is higher.It is the behaviour according to corresponding to each api interface additionally, due to each target api interface
Act and what storage system included operates what requirement was determined, it is thus determined that target api interface out and storage letter
The matching degree of breath is higher.
In an embodiment of the invention, described in each involved by the step 101 in flow chart shown in above-mentioned Fig. 1
When document storage system is respectively corresponding to a few memory node,
It is then involved in the step 106 in flow chart shown in above-mentioned Fig. 1 that acquired file to be stored is distributed
Formula stores, and can include：
Acquired file to be stored is cut at least two data blocks；
Corresponding at least one backup block is formed for data block each described；
By at least two data block and each backup block, distributed storage stores in the file destination is
In at least one memory node corresponding to system.
In the present embodiment, the quantity of memory node can be according to business need corresponding to each document storage system
It is determined that.And the specific pattern of memory node can also determine according to business need.For example each memory node is that solid-state is hard
Disk.
In the present embodiment, the file to be stored mark included using at least one target api interface according to storage information
Know, obtain file to be stored corresponding to storage information.Then utilize file destination storage system according to business need by acquired in
File to be stored be cut into predetermined number data block.And each data block is backed up.Formed for each data block
Predetermined number backup block.Then by each data block and each backup block, distributed storage is in file destination storage system
In corresponding each memory node.Accordingly even when when any one data block goes out active, will not also file to be stored be caused to go out
Existing incomplete situation.
According to above-described embodiment, file to be stored is cut into setting number of data blocks, and be the equal shape of each data block
Into corresponding backup block.When carrying out distributed storage to file to be stored, each data and each backup block are distributed
Formula is stored in each memory node corresponding to file destination storage system, to carry out disaster-tolerant backup to file to be stored, so as to
Reduce the probability that file to be stored is lost.
In an embodiment of the invention, distributed document storage method may further include：
Further comprise：
Receive the first access information of outside input；
Utilize access information described in the certificate server certification；
The access information certification by when, at least one API to be used is determined at least one api interface
Interface, and determine document storage system to be visited at least one document storage system；
Using at least one api interface to be used and the document storage system to be visited, access and the visit
Ask file to be visited corresponding to information；
Cache the file to be visited；
The access information of outside input second is being received, and is determining second access information and the first access information phase
Meanwhile the file to be visited of direct access cache.
In the present embodiment, when user conducts interviews to the file stored, it is necessary to send access information.Wherein, visit
Ask user profile, file identification to be visited and the access action that can include conducting interviews in information.In order to ensure it is each
Storage file to access information by unauthorized users to access, it is necessary to not be authenticated.Wherein, the step of certification can be：In certification
Target authentication method is determined at least one authentication method that server includes, using target authentication method to being wrapped in access information
The user profile included is authenticated, to determine whether access information is legal information.
Certification by when, the api interface that operational motion and access action match is determined in each api interface,
Identified api interface is defined as api interface to be used.Then determine that file to be visited is deposited according to file identification to be visited
Storage system.The file to be visited for recycling each api interface to be used to go to access in document storage system to be visited.And cache and treat
Access file.
When receiving access information again, judgement is currently received access information is with the access information received before
It is no consistent.If consistent, the file to be visited of direct access cache, to reduce the access for accessing document storage system
Amount.If it is inconsistent, performing above-mentioned access process, file to be visited corresponding with current accessed information is accessed.
According to above-described embodiment, when having access to file to be visited according to access information, file to be visited is cached.When again
When receiving with access information identical access information, the file to be visited of direct access cache, so as to reduce text
The visit capacity of part storage system.
Below exemplified by receiving storage information A.Expansion explanation distributed document storage method, as shown in Fig. 2 the distribution
Formula file memory method may include steps of：
Step 201：At least one document storage system is set, wherein, each document storage system is respectively corresponding to few
One memory node, each document storage system correspond to a kind of storage demand respectively.
In this step, there is provided document storage system 1 and document storage system 2, wherein, document storage system 1 is right
The storage demand answered is " file to be stored of the storage file size in preset data section ", and corresponding 5 memory nodes.Text
Storage demand corresponding to part storage system 2 is " file to be stored of storage default file type ", and corresponds to 10 memory nodes.
In this step, the operating system disposed in each memory node can determine according to business need.
Below exemplified by document storage system 1 is set, the setting up procedure of document storage system is illustrated：File stores
System 1 is FastDFS, its corresponding 5 memory node, and centos7 operating systems are deployed in each memory node.
The setting up procedure of document storage system 1 is as follows：
Software kit prepares as follows：
FastDFS_v5.05.tar.gz
libfastcommon-1.0.7.tar.gz
Download：wget https://github.com/happyfish100/libfastcommon/archive/
V1.0.7.tar.gz
Change name：mv V1.0.7libfastcommon-1.0.7.tar.gz
Decompression：tarzxvf libfastcommon-1.0.7.tar.gz
Catalogue after into decompression：cd libfastcommon-1.0.7/
Compiling：./make.sh
Installation：./make.sh install
Several soft links are set：ln-s/usr/lib64/libfastcommon.so/usr/local/lib/
libfastcommon.so
Several soft links are set：ln-s/usr/lib64/libfastcommon.so/usr/lib/
libfastcommon.so
Several soft links are set：ln-s/usr/lib64/libfdfsclient.so/usr/local/lib/
libfdfsclient.so
Several soft links are set：ln-s/usr/lib64/libfdfsclient.so/usr/lib/
libfdfsclient.so
Tracker (tracker) services FastDFS_v5.05.tar.gz is installed
Download：wget https://github.com/happyfish100/FastDFS/archive/
V5.05.tar.gz
Change name：mv V5.05FastDFS_v5.05.tar.gz
Decompression：tarzxvf FastDFS_v5.05.tar.gz
Catalogue after into decompression：cd FastDFS-5.05/
Compiling：./make.sh
Installation：./make.sh install
Installation results：
/ usr/bin storages have the file/etc/fdfs storages of compiling out to have configuration file.
In addition, in order that obtaining file operating system 1 can communicate, then tracker is configured in document storage system 1 takes
Business.
Tracker service configuration processes are as follows：
Make a configuration file：cp/etc/fdfs/tracker.conf.sample/etc/fdfs/tracker.conf
Editor：Vim/etc/fdfs/tracker.conf, content of edit see following Chinese annotation, and key configuration section is as follows：
Whether # is effective
Disabled=false
Bind_addr=
# serve ports
Port=22122
# connection time-out times
Connect_timeout=30
# services time-out time
Network_timeout=60
This path is under preserving store data and log place, it is necessary to change below #, points to us existing for one
Catalogue
# creaties directory：mkdir-p/opt/FastDFS/tracker/data-and-log
Base_path=/opt/FastDFS/tracker/data-and-log
Start tracker services：/usr/bin/fdfs_trackerd/etc/fdfs/tracker.conf
Restart tracker services：/usr/bin/fdfs_trackerd/etc/fdfs/tracker.confrestart
Finally, service arrangement is carried out in each memory node corresponding to document storage system 1.Torage can be disposed
(memory node) service arrangement, the process of deployment are as follows：
Replicate a configuration file：cp/etc/fdfs/storage.conf.sample/etc/fdfs/
storage.conf
Editor：Vim/etc/fdfs/storage.conf, content of edit see following Chinese annotation, and key configuration section is as follows：
Whether # configurations are effective
Disabled=false
# group names
Group_name=group1
# bind address
Bind_addr=
Client_bind=true
# bundling ports
Port=23000
This path is under preserving store data and log place, it is necessary to change, to point to an existing catalogue below #
# creaties directory：Mkdir-p/opt/FastDFS/storage/data-and-logbase_path=/opt/
FastDFS/storage/data-and-log
Max_connections=256
Store_path_count=1
The actual storage path of # pictures, if multiple, can there is multirow here：
#store_path0=/opt/FastDFS/storage/images-data0
#store_path1=/opt/FastDFS/storage/images-data1
#store_path2=/opt/FastDFS/storage/images-data2
# creaties directory：Mkdir-p/opt/FastDFS/storage/images-datastore_path0=/opt/
FastDFS/storage/images-data
Subdir_count_per_path=256
# specifies IP and the port of tracker servers
Tracker_server=192.168.1.114:22122
Start storage services：/ usr/bin/fdfs_storaged/etc/fdfs/storage.conf,
Restart storage services：/usr/bin/fdfs_storaged/etc/fdfs/storage.confrestart
Step 202：Certificate server is built in application layer, wherein, certificate server includes at least one authentication method.
In this step, the authentication method that certificate server includes be respectively digital signature, OAUTH Valuation Standards and
RBAC。
Illustrated below exemplified by OAUTH is set：From a server, built in selected certificate server
Certificate server, installation OAUTH service layers use cas authentication frameworks in the server.Configured java development environments and
After tomcat, cas war bags are installed.
Step 203：At least one api interface is set, wherein, each api interface corresponds to a kind of operational motion.
In this step, there is provided api interface 1 and A PI interfaces 2.Wherein, operational motion corresponding to api interface 1 is
Storage, operational motion corresponding to api interface 2 are access.
Service interface with api interface 1 for RESTful below, document storage system be FastDFS exemplified by api interface
Setting up procedure illustrate：
When developing API, it is necessary to rely on as follows using FastDFS java clients jdk, maven：
<dependency>
<groupId>org.csource</groupId>
<artifactId>FastDFS-client-java</artifactId>
<version>1.27-SNAPSHOT</version>
</dependency>
Upper transmitting file key code：
Step 204：The storage information of outside input is received, wherein, storage information includes user profile, file to be stored
Attribute information and at least one operation require.
In the present embodiment, storage information A is received, wherein, storage information A includes user name A, login password A, waits to deposit
Storage file identification A, the file type A of file to be stored, the file size A of file to be stored, operation are required as storage.
Step 205：Target authentication method is determined at least one authentication method that certificate server includes.
In this step, it is OAUTH Valuation Standards to determine target authentication method.
Step 206：The user profile that storage information includes is authenticated using target authentication method, certification is by holding
Row step 207；Otherwise, current process is terminated.
In this step, the user profile included using target authentication method " OAUTH Valuation Standards " to storage information A
" user name A and login password A " are authenticated, and certification is by performing step 207.
Step 207：A document storage system is selected at least one document storage system successively as current file
Storage system.
Step 208：It is to be stored to judge whether storage demand corresponding to current file storage systems includes with storage information
File attribute information matches, if it is, performing step 210；Otherwise, step 209 is performed.
In this step, illustrated using document storage system 1 as current file storage systems：It is determined that file destination
During storage system, the file size A of the file to be stored in file to be stored attribute information is defined as occurrence, then judges text
Storage demand corresponding to part storage system 1 " file to be stored of the storage file size in preset data section " whether with file
Size A matches, and by judging, storage demand corresponding to document storage system 1 matches with file size A, performs step 210.
Step 209：Judge whether current file storage systems are last document storage system, if it is, terminating to work as
Preceding flow；Otherwise, step 207 is performed.
Step 210：Current file storage systems are defined as file destination storage system.
In this step, document storage system 1 is defined as file destination storage system.
Step 211：An api interface is selected at least one api interface successively as current api interface.
Step 212：It is any to judge whether operational motion corresponding to presently described api interface includes with the storage information
One operation requirement matches, if it is, performing step 214；Otherwise, step 213 is performed.
In this step, illustrated so that current api interface is api interface 1 as an example：, will it is determined that during target api interface
File to be stored attribute information " storage " is defined as matching action, then whether operational motion corresponding to api interface 1 acts with matching
" storage " matches, and by judging, operational motion " storage " corresponding to api interface 1 matches with matching action " storage ", performs
Step 214.
In this step, when current api interface is api interface 2, determine operational motion corresponding to api interface not with depositing
Any one operation requirement that storage information includes matches, and performs step 213.
Step 213：Judge whether current file storage systems are last document storage system, if it is, step
215；Otherwise, step 211 is performed.
Step 214：Current api interface is defined as target api interface.
In this step, api interface 1 is defined as target api interface.
Step 215：Using each target api interface, the file to be stored attribute information included according to storage information, obtain
File to be stored corresponding to storage information.
In this step, using target api interface, " api interface 1 ", the file to be stored included according to storage information identify
A, obtain file to be stored A corresponding to storage information A.
Step 216：Acquired file to be stored is cut at least two data blocks.
In this step, using file destination storage system, " file to be stored A is cut into 10 by document storage system 1 "
Data block.
Step 217：Corresponding at least one backup block is formed for each data block.
In this step, using file destination storage system, " document storage system 1 " is respectively that each data block is formed
Corresponding 5 backup blocks.
Step 218：At least two data blocks and each backup block are incited somebody to action, distributed storage is in file destination storage system pair
In at least one memory node answered.
In this step, file destination storage system " document storage system 1 " and target api interface " api interface are utilized
1 " by each data block and each backup block, and distributed storage is " in 5 memory nodes corresponding to document storage system 1 ".
Step 219：Judge whether to receive the first access information, if it is, performing step 220；Otherwise, current stream is terminated
Journey.
In this step, access information B is have received, wherein, user profile B that access information B includes conducting interviews,
File identification B to be visited and access action B.
Step 220：Authentication method is determined at least one authentication method that certificate server includes.
In this step, OAUTH Valuation Standards are determined in the various authentication methods that certificate server includes.
Step 221：Using identified authentication method certification current accessed information, certification is by the way that execution step 222 is no
Then, current process is terminated.
In this step, the user profile " user included using authentication method " OAUTH Valuation Standards " to access information B
Name B and login password B " is authenticated.Certification is by performing step 222.
Step 222：Current accessed authentification of message by when, determine at least one to wait to make at least one api interface
With api interface, and document storage system to be visited is determined at least one document storage system.
In this step, in access information access action B determine api interface to be used for " api interface 2 ",
File identification B to be visited in access information determines that document storage system to be visited is " document storage system 2 ".
Step 223：Using at least one api interface to be used and document storage system to be visited, access and believe with accessing
File to be visited corresponding to breath.
In this step, text to be visited corresponding with access information B is accessed using api interface 2 and document storage system 2
Part B.
Step 224：Cache file to be visited.
In this step, file B to be visited is cached.
Step 225：Judge whether to receive the second access information, if it is, performing step 226；Otherwise, current stream is terminated
Journey.
In this step, access information C is have received, wherein, user profile B that access information C includes conducting interviews,
File identification B to be visited and access action B.
Step 226：Judge whether the second access information is consistent with the first access information, if it is, performing step 227；It is no
Then, step 221 is performed.
In this step, judge that access information C is consistent with access information B, perform step 228.
Step 227：The file to be visited of direct access cache.
In this step, the file B to be visited of direct access cache.
As shown in Figure 3, Figure 4, the embodiments of the invention provide a kind of distributed document storage device.Device embodiment can be with
Realized, can also be realized by way of hardware or software and hardware combining by software.For hardware view, as shown in figure 3,
A kind of hardware structure diagram of equipment where distributed document storage device provided in an embodiment of the present invention, except shown in Fig. 3
Outside processor, internal memory, network interface and nonvolatile memory, equipment in embodiment where device generally can be with
Including other hardware, the forwarding chip of such as responsible processing message.Exemplified by implemented in software, as shown in figure 4, being patrolled as one
The device in meaning is collected, is to be read corresponding computer program instructions in nonvolatile memory by the CPU of equipment where it
Get what operation in internal memory was formed.The distributed document storage device that the present embodiment provides, including：
Storage system setup module 401, for setting at least one document storage system；
Module 402 is built, for building certificate server in application layer；
Interface setup module 403, for setting at least one api interface；
Authentication module 404, the certificate server certification outside input built for building module 402 described in utilization
Storage information；
Determining module 405, for the storage information certification by when, according to the storage information, in the storage
File destination storage system is determined at least one document storage system that system setup module 401 is set and described
At least one target api interface is determined at least one api interface that interface setup module 403 is set；
Memory module 406, for the file destination storage system and described determined using the determining module 405
At least one target api interface, file to be stored corresponding to the storage information is obtained, and acquired file to be stored is entered
Row distributed storage.
Embodiment according to Fig. 4, at least one document storage system is set first with storage system setup module.
Then certificate server is built in application layer using building module, and at least one api interface is set using interface setup module.
When receiving the storage information of outside input, authentication module utilizes certificate server certification storage information.Recognize in storage information
Card is when passing through, determining module determined according to storage information in the various document storage systems of setting file destination storage system with
And at least one target api interface is determined in the various api interfaces of setting.Last memory module utilizes file destination storage system
System and each target api interface, file to be stored corresponding to storage information is obtained, and acquired file to be stored is carried out
Distributed storage.By above-mentioned, when receiving storage information, it may be determined that go out file destination storage system and each
Target api interface, and using file destination storage system and each target api interface to text to be stored corresponding to storage information
Part carries out distributed storage.Therefore scheme provided in an embodiment of the present invention can improve the security of file.
In an embodiment of the invention, at least one authentication method, the storage letter are included in the certificate server
Breath include user profile, file to be stored attribute information and it is at least one operate when requiring,
The authentication module 404, for determining target authentication method at least one authentication method；Using described
The user profile that target authentication method includes to the storage information is authenticated.
In an embodiment of the invention, at least one authentication method that building module 402 includes can include：Numeral
At least one of the right access control RBAC or a variety of of signature, OAUTH Valuation Standards, based role.
In an embodiment of the invention, deposited as shown in figure 5, corresponding to one kind respectively in each described document storage system
Storage demand, each described api interface correspond to a kind of operational motion, the storage information includes user profile, file to be stored
When attribute information and at least one operation require,
The determining module 405 can include：System determination sub-module 501 and interface determination sub-module 502；
The system determination sub-module 501, for being performed both by for document storage system each described, judge current institute
The file to be stored attribute information whether state storage demand corresponding to document storage system includes with the storage information matches,
If it is, presently described document storage system is defined as file destination storage system；
The interface determination sub-module 502, for being performed both by for api interface each described, judge presently described API
Whether any one the operation requirement included with the storage information matches operational motion corresponding to interface, if it is, ought
The preceding api interface is defined as target api interface.
In an embodiment of the invention, as shown in fig. 6, being respectively corresponding to few one in each described document storage system
During individual memory node,
The memory module 406 can include：Backup submodule 601 and sub-module stored 602；
The backup submodule 601, for acquired file to be stored to be cut into at least two data blocks；To be each
The individual data block forms corresponding at least one backup block；
The sub-module stored 602, at least two data block and each backup block, distribution to be deposited
Storage is at least one memory node corresponding to the file destination storage system.
In an embodiment of the invention, as shown in fig. 7, further comprising：Access modules 701；
The access modules 701 include：Access submodule 7011, cache sub-module 7012 and determination sub-module 7013；
The access submodule 7011, for utilizing access information described in the certificate server certification；In the access
Authentification of message by when, determine at least one api interface to be used at least one api interface, and it is described extremely
Document storage system to be visited is determined in a kind of few document storage system；Using at least one api interface to be used and
The document storage system to be visited, access file to be visited corresponding with the access information；
The cache sub-module 7012, for caching the file to be visited；
The determination sub-module 7013, for receiving the access information of outside input second, and determine that described second accesses
When information is identical with first access information, the file to be visited of direct access cache.
A kind of storage control is provided in one embodiment of the invention, the storage control includes：Processor, memory
And bus；The memory is used to store execute instruction；The processor is connected with the memory by the bus；Work as institute
When stating storage control operation, the execute instruction of memory storage described in the computing device, so that the storage control
Device processed performs the distributed document storage method described in any of the above-described.
The contents such as the information exchange between each unit, implementation procedure in said apparatus, due to implementing with the inventive method
Example is based on same design, and particular content can be found in the narration in the inventive method embodiment, and here is omitted.
In summary, each embodiment of the present invention can at least realize following beneficial effect：
1st, in embodiments of the present invention, at least one document storage system is set first.Then certification is built in application layer
Server, and at least one api interface is set.When receiving the storage information of outside input, certificate server certification is utilized
Storage information.Storage information certification by when, target is determined in the various document storage systems of setting according to storage information
Document storage system and at least one target api interface is determined in the various api interfaces of setting.Finally utilize file destination
Storage system and each target api interface, file to be stored corresponding to storage information is obtained, and to acquired text to be stored
Part carries out distributed storage.By above-mentioned, when receiving storage information, it may be determined that go out file destination storage system with
And each target api interface, and using file destination storage system and each target api interface to being treated corresponding to storage information
Storage file carries out distributed storage.Therefore scheme provided in an embodiment of the present invention can improve the security of file.
2nd, in embodiments of the present invention, target authentication side is determined in the various authentication methods that certificate server includes
Method, and the user profile that storage information includes is authenticated using target authentication method, to ensure storage information as legal letter
Breath, so as to improve security.
3rd, in embodiments of the present invention, at least one authentication method can select digital signature, OAUTH according to business need
At least one of Valuation Standard and RBAC are a variety of.Therefore, business is with strong applicability.
4th, in embodiments of the present invention, because file destination storage system is according to corresponding to each document storage system
What the file to be stored attribute information that storage demand and storage information include was determined, it is thus determined that file destination out
The matching degree of storage system and storage information is higher.It is corresponding according to each api interface additionally, due to each target api interface
Operational motion and the operation that includes of storage system require to determine, it is thus determined that target api interface out is with depositing
The matching degree for storing up information is higher.
5th, in embodiments of the present invention, file to be stored is cut into setting number of data blocks, and is each data block
It has been respectively formed corresponding backup block.When carrying out distributed storage to file to be stored, by each data and each backup block
Distributed storage is in each memory node corresponding to file destination storage system, to carry out disaster-tolerant backup to file to be stored,
So as to reduce the probability of file to be stored loss.
6th, in embodiments of the present invention, when having access to file to be visited according to access information, file to be visited is cached.When
When receiving again with access information identical access information, the file to be visited of direct access cache, so as to subtract
The visit capacity of few document storage system.
It should be noted that herein, such as first and second etc relational terms are used merely to an entity
Or operation makes a distinction with another entity or operation, and not necessarily require or imply and exist between these entities or operation
Any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant be intended to it is non-
It is exclusive to include, so that process, method, article or equipment including a series of elements not only include those key elements,
But also the other element including being not expressly set out, or also include solid by this process, method, article or equipment
Some key elements.In the absence of more restrictions, the key element limited by sentence " including one ", is not arranged
Except other identical factor in the process including the key element, method, article or equipment being also present.
One of ordinary skill in the art will appreciate that：Realizing all or part of step of above method embodiment can pass through
Programmed instruction related hardware is completed, and foregoing program can be stored in computer-readable storage medium, the program
Upon execution, the step of execution includes above method embodiment；And foregoing storage medium includes：ROM, RAM, magnetic disc or light
Disk etc. is various can be with the medium of store program codes.
It is last it should be noted that：Presently preferred embodiments of the present invention is the foregoing is only, is merely to illustrate the skill of the present invention
Art scheme, is not intended to limit the scope of the present invention.Any modification for being made within the spirit and principles of the invention,
Equivalent substitution, improvement etc., are all contained in protection scope of the present invention.
Claims (10)
- A kind of 1. distributed document storage method, it is characterised in thatAt least one document storage system is set；Certificate server is built in application layer；At least one api interface is set；Also include：Utilize the storage information of the certificate server certification outside input；The storage information certification by when, according to the storage information, at least one document storage system really Set the goal and document storage system and determine at least one target api interface at least one api interface；Using the file destination storage system and at least one target api interface, it is corresponding to obtain the storage information File to be stored, and distributed storage is carried out to acquired file to be stored.
- 2. according to the method for claim 1, it is characterised in thatThe certificate server includes at least one authentication method；The storage information includes user profile, file to be stored attribute information and at least one operation and required；The storage information using the certificate server certification outside input, including：Target authentication method is determined at least one authentication method；The user profile included using the target authentication method to the storage information is authenticated.
- 3. according to the method for claim 2, it is characterised in thatAt least one authentication method includes：The right access control of digital signature, OAUTH Valuation Standards and based role At least one of RBAC or a variety of.
- 4. according to the method for claim 1, it is characterised in thatEach described document storage system corresponds to a kind of storage demand respectively；Each described api interface corresponds to a kind of operational motion；The storage information includes user profile, file to be stored attribute information and at least one operation and required；It is described according to the storage information, determined at least one document storage system file destination storage system and At least one target api interface is determined at least one api interface, including：It is performed both by for document storage system each described, judges that storage demand corresponding to presently described document storage system is The no file to be stored attribute information included with the storage information matches, if it is, by presently described document storage system It is defined as file destination storage system；It is performed both by for api interface each described, judges whether operational motion corresponding to presently described api interface is deposited with described Any one operation requirement that storage information includes matches, if it is, presently described api interface is defined as into target api interface.
- 5. according to the method for claim 1, it is characterised in thatEach described document storage system is respectively corresponding to a few memory node；It is described to carry out distributed storage to acquired file to be stored, including：Acquired file to be stored is cut at least two data blocks；Corresponding at least one backup block is formed for data block each described；By at least two data block and each backup block, distributed storage is in the file destination storage system pair In at least one memory node answered.
- 6. method according to any one of claims 1 to 5, it is characterised in thatFurther comprise：Receive the first access information of outside input；Utilize access information described in the certificate server certification；The access information certification by when, determine that at least one API to be used connects at least one api interface Mouthful, and determine document storage system to be visited at least one document storage system；Using at least one api interface to be used and the document storage system to be visited, access and believe with described access File to be visited corresponding to breath；Cache the file to be visited；The access information of outside input second is being received, and is determining that second access information is identical with first access information When, the file to be visited of direct access cache.
- A kind of 7. distributed document storage device, it is characterised in thatStorage system setup module, for setting at least one document storage system；Module is built, for building certificate server in application layer；Interface setup module, for setting at least one api interface；Authentication module, the storage information for the certificate server certification outside input built for building module described in utilization；Determining module, for the storage information certification by when, according to the storage information, set in the storage system File destination storage system is determined at least one document storage system that module is set and mould is set in the interface At least one target api interface is determined at least one api interface that block is set；Memory module, for the file destination storage system determined using the determining module and at least one mesh Api interface is marked, obtains file to be stored corresponding to the storage information, and distribution is carried out to acquired file to be stored and deposited Storage.
- 8. device according to claim 7, it is characterised in thatInclude user profile, file to be stored including at least one authentication method, the storage information in the certificate server When attribute information and at least one operation require,The authentication module, for determining target authentication method at least one authentication method；Recognized using the target The user profile that card method includes to the storage information is authenticated.
- 9. device according to claim 7, it is characterised in thatA kind of storage demand, a kind of corresponding behaviour of each described api interface are corresponded to respectively in each described document storage system Act, the storage information includes user profile, file to be stored attribute information and at least one operation be when requiring,The determining module includes：System determination sub-module and interface determination sub-module；The system determination sub-module, for being performed both by for document storage system each described, judge presently described file The file to be stored attribute information whether storage demand corresponding to storage system includes with the storage information matches, if It is that presently described document storage system is defined as file destination storage system；The interface determination sub-module, for being performed both by for api interface each described, judge presently described api interface pair Whether any one the operation requirement included with the storage information matches the operational motion answered, if it is, will be presently described Api interface is defined as target api interface；And/orWhen each described document storage system is respectively corresponding to a few memory node,The memory module includes：Backup submodule and sub-module stored；The backup submodule, for acquired file to be stored to be cut into at least two data blocks；For described in each Data block forms corresponding at least one backup block；The sub-module stored, for by least two data block and each backup block, distributed storage to be in institute State at least one memory node corresponding to file destination storage system.
- 10. according to any described device of claim 7 to 9, it is characterised in thatFurther comprise：Access modules；The access modules include：Access submodule, cache sub-module and determination sub-module；The access submodule, for utilizing access information described in the certificate server certification；In the access information certification By when, determine at least one api interface to be used at least one api interface, and at least one text Document storage system to be visited is determined in part storage system；Using at least one api interface to be used and described wait to visit Document storage system is asked, accesses file to be visited corresponding with the access information；The cache sub-module, for caching the file to be visited；The determination sub-module, for receiving the access information of outside input second, and determine second access information and institute State the first access information it is identical when, the file to be visited of direct access cache.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711013180.7A CN107844542A (en) | 2017-10-26 | 2017-10-26 | A kind of distributed document storage method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711013180.7A CN107844542A (en) | 2017-10-26 | 2017-10-26 | A kind of distributed document storage method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107844542A true CN107844542A (en) | 2018-03-27 |
Family
ID=61662769
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711013180.7A Pending CN107844542A (en) | 2017-10-26 | 2017-10-26 | A kind of distributed document storage method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107844542A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108595591A (en) * | 2018-04-19 | 2018-09-28 | 国云科技股份有限公司 | A kind of method of mixed file storage |
| CN110968259A (en) * | 2018-09-30 | 2020-04-07 | 武汉斗鱼网络科技有限公司 | Step-by-step object storage system, object storage method and storage medium |
| CN111581158A (en) * | 2020-05-04 | 2020-08-25 | 上海维信荟智金融科技有限公司 | Distributed file storage method and system |
| CN112380178A (en) * | 2020-11-25 | 2021-02-19 | 北京明略软件系统有限公司 | File storage and management method and system |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1464453A (en) * | 2002-06-06 | 2003-12-31 | 联想(北京)有限公司 | File access method based on a distributed file storage system |
| CN101944124A (en) * | 2010-09-21 | 2011-01-12 | 卓望数码技术（深圳）有限公司 | Distributed file system management method, device and corresponding file system |
| CN102375853A (en) * | 2010-08-24 | 2012-03-14 | 中国移动通信集团公司 | Distributed database system, method for building index therein and query method |
| CN102394894A (en) * | 2011-11-28 | 2012-03-28 | 武汉大学 | Network virtual disk file safety management method based on cloud computing |
| CN102457555A (en) * | 2010-10-28 | 2012-05-16 | 中兴通讯股份有限公司 | Security system and method for distributed storage |
| CN102546664A (en) * | 2012-02-27 | 2012-07-04 | 中国科学院计算技术研究所 | User and authority management method and system for distributed file system |
| US8504565B2 (en) * | 2004-09-09 | 2013-08-06 | William M. Pitts | Full text search capabilities integrated into distributed file systems— incrementally indexing files |
| CN104239125A (en) * | 2014-09-28 | 2014-12-24 | 北京奇艺世纪科技有限公司 | Object processing method, distributive file system and client device |
| CN105190622A (en) * | 2013-03-15 | 2015-12-23 | 亚马逊科技公司 | Fast crash recovery for distributed database systems |
-
2017
- 2017-10-26 CN CN201711013180.7A patent/CN107844542A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1464453A (en) * | 2002-06-06 | 2003-12-31 | 联想(北京)有限公司 | File access method based on a distributed file storage system |
| US8504565B2 (en) * | 2004-09-09 | 2013-08-06 | William M. Pitts | Full text search capabilities integrated into distributed file systems— incrementally indexing files |
| CN102375853A (en) * | 2010-08-24 | 2012-03-14 | 中国移动通信集团公司 | Distributed database system, method for building index therein and query method |
| CN101944124A (en) * | 2010-09-21 | 2011-01-12 | 卓望数码技术（深圳）有限公司 | Distributed file system management method, device and corresponding file system |
| CN102457555A (en) * | 2010-10-28 | 2012-05-16 | 中兴通讯股份有限公司 | Security system and method for distributed storage |
| CN102394894A (en) * | 2011-11-28 | 2012-03-28 | 武汉大学 | Network virtual disk file safety management method based on cloud computing |
| CN102546664A (en) * | 2012-02-27 | 2012-07-04 | 中国科学院计算技术研究所 | User and authority management method and system for distributed file system |
| CN105190622A (en) * | 2013-03-15 | 2015-12-23 | 亚马逊科技公司 | Fast crash recovery for distributed database systems |
| CN104239125A (en) * | 2014-09-28 | 2014-12-24 | 北京奇艺世纪科技有限公司 | Object processing method, distributive file system and client device |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108595591A (en) * | 2018-04-19 | 2018-09-28 | 国云科技股份有限公司 | A kind of method of mixed file storage |
| CN110968259A (en) * | 2018-09-30 | 2020-04-07 | 武汉斗鱼网络科技有限公司 | Step-by-step object storage system, object storage method and storage medium |
| CN111581158A (en) * | 2020-05-04 | 2020-08-25 | 上海维信荟智金融科技有限公司 | Distributed file storage method and system |
| CN112380178A (en) * | 2020-11-25 | 2021-02-19 | 北京明略软件系统有限公司 | File storage and management method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109478149B (en) | Access services in a hybrid cloud computing system | |
| US10749985B2 (en) | Custom communication channels for application deployment | |
| CN111198848B (en) | Distributed file access method, system, server and storage medium | |
| US8756418B1 (en) | System and method for automatically detecting and then self-repairing corrupt, modified or non-existent files via a communication medium | |
| CN109479062B (en) | Usage tracking in hybrid cloud computing systems | |
| CN108289098B (en) | Authority management method and device of distributed file system, server and medium | |
| CN107844542A (en) | A kind of distributed document storage method and device | |
| CN107395659A (en) | A kind of method and device of service handling and common recognition | |
| CN106506587A (en) | A kind of Docker image download methods based on distributed storage | |
| US7584228B1 (en) | System and method for duplication of virtual private server files | |
| Calcote et al. | Istio: Up and running: Using a service mesh to connect, secure, control, and observe | |
| CN106254466B (en) | HDFS distributed file sharing method based on local area network | |
| CN106909325A (en) | Daily record Method of printing and device and daily record print system | |
| CN110213290A (en) | Data capture method, API gateway and storage medium | |
| Reantongcome et al. | Securing and trustworthy blockchain-based multi-tenant cloud computing | |
| US11494493B1 (en) | Software verification for network-accessible applications | |
| WO2021226854A1 (en) | Blockchain machine, blockchain data access authentication method, and computer-readable storage medium | |
| Liao et al. | Last-hdfs: Location-aware storage technique for hadoop distributed file system | |
| US11361055B1 (en) | Protection of a content repository using dynamic watermarking | |
| CN106855872A (en) | The method for quickly retrieving of the mass picture based on Hadoop platform | |
| CN113760725A (en) | Data processing method, device and storage medium | |
| US10853057B1 (en) | Software library versioning with caching | |
| US10452837B1 (en) | Inbound link handling | |
| CN116339767B (en) | Application resource allocation method, device, computer equipment and storage medium | |
| US11593498B2 (en) | Distribution of user specific data elements in a replication environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180327 |