CN110362535A - A kind of file management method, apparatus and system - Google Patents
A kind of file management method, apparatus and system Download PDFInfo
- Publication number
- CN110362535A CN110362535A CN201910631173.6A CN201910631173A CN110362535A CN 110362535 A CN110362535 A CN 110362535A CN 201910631173 A CN201910631173 A CN 201910631173A CN 110362535 A CN110362535 A CN 110362535A
- Authority
- CN
- China
- Prior art keywords
- file
- server
- index
- checked
- inquiry
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
- G06F16/137—Hash-based
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/14—Details of searching files based on file metadata
- G06F16/148—File search processing
- G06F16/152—File search processing using file content signatures, e.g. hash values
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The application proposes a kind of file management method, apparatus and system, and this method can be applied to file server, and the file server generates the index of newly-increased file according to the setting period, and the index of generation is sent to application server；Wherein, the token of file server described in unique identification is carried in the index；The described method includes: whether having inquiry corresponding with file server label in inquiry application server；Wherein, corresponding with file server inquiry label, for the mark information for the file for indicating the file server is needed to inquire and feeding back setting；If receiving the inquiry label of application server transmission, retrieval obtains file cocurrent corresponding with the inquiry label and gives the application server.Above-mentioned treatment process can make application server that file query requests are accurately sent to the file server for storing file to be checked, and network and memory source when application server file polling can be made rationally to be utilized, the wasting of resources is avoided.
Description
Technical field
This application involves art file management technology field more particularly to a kind of file management methods, apparatus and system.
Background technique
Distributed document storage is the preferred embodiment for solving mass file storage.Such as shown in Fig. 1, positioned at different location
Document storing section point of the file server as entire file management system, for being stored to file；Application server can
To initiate file query requests to each file server node, to read the file of needs from file server node.
In general, when application server needs to obtain file from file server node, to all texts in the form of broadcast
Part server node sends file request information.When each file server node receives file request, inquiry is requested
File whether be stored in this node, if being stored in this node, requested file is sent to application server, otherwise
It is not responding to application server request.It is appreciated that the requested a certain file of application server can only be stored in some file
In server, above-mentioned file query requests mode will cause a large amount of inactive file request.Assuming that file management system has N
Then there is N-1 invalidation request in each file request of application server in a file server node, this will certainly bring huge
Big network and memory source waste.
Summary of the invention
Defect and deficiency based on the above-mentioned prior art, the application propose a kind of file management method, apparatus and system, energy
Enough make server file request more accurate, to avoid waste memory source.
A kind of file management method is applied to file server, and the file server is generated according to the setting period increases text
The index of part, and the index of generation is sent to application server；Wherein, the clothes of file described in unique identification are carried in the index
The token of business device；The described method includes:
Whether inquire has inquiry corresponding with file server label in the application server；Wherein, with institute
File server corresponding inquiry label is stated, for the label for the file for indicating the file server is needed to inquire and feeding back setting
Information；
If receiving the inquiry label that the application server is sent, retrieval obtains corresponding with the inquiry label
File cocurrent gives the application server.
Optionally, the index that newly-increased file is generated according to the setting period, comprising:
At the end of daily work newly file was increased to the same day and carry out hash calculation process, obtains file hash value；
Utilize the token of the file hash value and the file server, the index of composing document.
Optionally, file progress hash calculation process was being increased to the same day newly, after obtaining file hash value, the method is also wrapped
It includes:
Compression processing is carried out to the file hash value.
Optionally, the file server updates newly-increased file into application server caching according further to the setting period.
A kind of file management method, is applied to application server, and the application server receives what file server was sent
File index, and received file index is subjected to merger storage；Wherein, it is taken in the file index comprising unique identification file
The token of business device；The described method includes:
File query requests based on the received generate the index of file to be checked；
From the file index of storage, file index identical with the index of the file to be checked is retrieved；
When retrieving file index identical with the index of the file to be checked, determine that this document indexes the order for including
Board, and determine the file server for storing the file to be checked；
Inquiry label is generated, the inquiry is labeled as the file server for indicating to need to store the file to be checked inquiry
The mark information of the file to be checked；
When receiving the inquiry request that the file server for storing the file to be checked is sent, the inquiry is marked
It is sent to the file server for storing the file to be checked, so that the file server of the storage file to be checked feeds back institute
State file to be checked.
Optionally, the method also includes:
When retrieval is less than file index identical with the index of the file to be checked, cached from the application server
The middle inquiry file to be checked.
Optionally, the file query requests based on the received, generate the index of file to be checked, comprising:
File query requests based on the received determine file to be checked；
Hash calculation process is carried out to the file to be checked, file hash value is obtained, as the file to be checked
Index.
A kind of document management apparatus, is applied to file server, and described device includes:
Information uploading unit for generating the index of newly-increased file according to the setting period, and the index of generation is sent to
Application server；Wherein, the token of file server described in unique identification is carried in the index；
Query processing unit, for inquiring in the application server whether there is look into corresponding with the file server
Ask label；Wherein, inquiry label corresponding with the file server, to indicate that the file server is needed to inquire and feeding back
The mark information of the file of setting；
File uploading unit, for when receiving the inquiry label that the application server is sent, retrieval obtains and institute
Stating inquiry marks corresponding file cocurrent to give the application server.
A kind of document management apparatus, is applied to application server, and described device includes:
Information memory cell for receiving the file index of file server transmission, and received file index is carried out
Merger storage；It wherein, include the token of unique identification file server in the file index；
Generation unit is indexed, for file query requests based on the received, generates the index of file to be checked；
Indexed search unit, for retrieving identical with the index of the file to be checked from the file index of storage
File index；
Information determination unit, for determining when retrieving file index identical with the index of the file to be checked
This document indexes the token for including, and determines the file server for storing the file to be checked；
Generation unit is marked, for generation inquiry label, the inquiry needs to store the text to be checked labeled as expression
The file server of part inquires the mark information of the file to be checked；
Transmission unit is marked, for when the inquiry request for receiving the file server for storing the file to be checked transmission
When, the inquiry label is sent to the file server for storing the file to be checked, so that the storage file to be checked
File server feed back the file to be checked.
A kind of file management system, comprising:
File server and application server；
Wherein, the file server, for generating the index of newly-increased file according to the setting period, and by the index of generation
It is sent to application server；Wherein, the token of file server described in unique identification is carried in the index；Inquire the application
Whether there is inquiry corresponding with file server label in server；Wherein, corresponding with the file server to look into
Label is ask, for the mark information for the file for indicating the file server is needed to inquire and feeding back setting；Receiving described answer
When the inquiry label sent with server, retrieval obtains file cocurrent corresponding with the inquiry label and gives the application service
Device；
The application server, for receive file server transmission file index, and by received file index into
Row merger storage；File query requests based on the received generate the index of file to be checked；From the file index of storage, inspection
Rope file index identical with the index of the file to be checked；When retrieving text identical with the index of the file to be checked
When part indexes, determine that this document indexes the token for including, and determine the file server for storing the file to be checked；It generates
Inquiry label, the file server that the inquiry needs to store the file to be checked labeled as expression inquire the text to be checked
The mark information of part；When receiving the inquiry request that the file server for storing the file to be checked is sent, looked into described
It askes label and is sent to the file server for storing the file to be checked.
The file management method that the application proposes, setting file server, which actively sends the index of the file of storage to, answers
The text for storing file to be checked is determined using the file index of storage when application server needs to inquire file with server
Part server, and generate inquiry label corresponding with this document server.When this document server is looked into application server transmission
When asking request, start inquiry label to give this document server, this document server is made to inquire to obtain file to be checked and anti-
It feeds application server.It is to be checked that above-mentioned treatment process can make application server that file query requests are accurately sent to storage
The technical solution is applied in branch's formula document storage system by the file server for asking file, and application server can be made literary
Network and memory source are rationally utilized when part is inquired, and avoid the wasting of resources.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of application for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of schematic diagram of distributed file storage system provided by the embodiments of the present application；
Fig. 2 is that the picture file provided by the embodiments of the present application applied to distributed file storage system shown in FIG. 1 is looked into
Ask treatment process schematic diagram；
Fig. 3 is picture file query processing process schematic provided by the embodiments of the present application；
Fig. 4 is bank's serial number picture management system schematic diagram provided by the embodiments of the present application；
Fig. 5 is a kind of flow diagram of file management method provided by the embodiments of the present application；
Fig. 6 is file hash value schematic diagram provided by the embodiments of the present application；
Fig. 7 is the schematic diagram provided by the embodiments of the present application that merger storage is carried out to file index；
Fig. 8 is a kind of structural representation of document management apparatus applied to file server provided by the embodiments of the present application
Figure；
Fig. 9 is a kind of structural representation of document management apparatus applied to application server provided by the embodiments of the present application
Figure；
Figure 10 is a kind of structural schematic diagram of file management system provided by the embodiments of the present application.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on
Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall in the protection scope of this application.
The embodiment of the present application proposes a kind of file management method, and this method can be applied to distributed document as shown in Figure 1
Storage system, the system include at least one file server, as file server node, are used for storage file, and packet
An application server is included, is requested for response file, requested file is read from file server.
Wherein, above-mentioned file can be the file of any one type in the files such as picture, video, audio, text.?
In the embodiment of the present application, by taking picture file as an example, the specific processed of the file management method of the embodiment of the present application proposition is introduced
Journey.It is appreciated that being also referred to the embodiment of the present application technical solution when above-mentioned file is other kinds of file, realize
File management, the embodiment of the present application are no longer described in detail one by one.
It is shown in Figure 2, the existing picture file query processing applied to distributed file storage system shown in FIG. 1
Process substantially can be summarized as:
After user initiates picture query request by web terminal, (1) application server is sent to each file server node
Inquiry request；(2) after each file server node receives inquiry request, picture retrieval is locally being carried out；(3) when certain file takes
Picture is uploaded into application server after business device Nodes Retrieval to pictorial information；(4) text of eligible picture is not retrieved
Part server node is empty result by request response or overtime return inquiry；(5) user is retrieved by the asynchronous downloading of web
Picture.
It is appreciated that above-mentioned file polling process is the file polling process of broadcast type, and in fact, application server institute
The file of inquiry is only stored in some file server, therefore there is a large amount of invalid inquiry, band in each inquiry
Come very big network and memory source waste.
In order to solve or improve the above problem, the embodiment of the present application proposes a kind of file management method, specially to file
The processing method for being managed and inquiring.This method is similarly applied to Fig. 1 and distributed file management system shown in Fig. 2.
Treatment process shown in Figure 3, the file management method that the embodiment of the present application proposes may be implemented to be taken by application
Business device gets the file for needing to obtain, and the process from any one file server node in file server cluster
It does not need application server and sends file request to all file server nodes, but can be accurately by file request
It is sent to the file server for storing requested file.Based on treatment process shown in Fig. 3, the embodiment of the present application is with application clothes
Device be engaged in for some file server acquisition file in file server cluster, introduces the file pipe that the application is proposed
The concrete processing procedure of reason method.
Corresponding with treatment process shown in Fig. 3, the embodiment of the present application technical solution can be used for silver as shown in Figure 4
Row serial number picture management system, within the system, the PC machine of various regions site is equivalent to file server node, can acquire
Serial number picture simultaneously stores, and level-one branch deployment web server can then be equivalent to application server can be to each site
The serial number picture of PC machine storage makes requests, obtains.The embodiment of the present application is obtained from file server with application server
For taking serial number picture, the treatment process of the file management method of the embodiment of the present application proposition is introduced.
It is shown in Figure 5, the concrete processing procedure for the file management method that the embodiment of the present application proposes, comprising:
When file server cluster is added in S501, newly-increased file server, distributed file storage system is newly-increased text
Part server establishes token, and the token of foundation is uploaded application server；
S502, application server save the token of newly-increased file server；
Specifically, the token of above-mentioned file server, the unique identification as file server.Each newly-increased text
When file server cluster shown in Fig. 3 is added as a file server node in part server, distributed document storage system
System system is that newly-increased file server establishes token, is used for unique identification this document server.
Newly-increased file server uploads to application server after getting token, by the token, and application server will
The token saves, i.e., stores the identification information of this document server in the application server, can be used for this document service
Device carries out identification etc..
S503, file server update newly-increased picture into application server caching according to the setting period；
Illustratively, the embodiment of the present application set it is above-mentioned set the period as daily work at the end of, be as unit of day
Period.
File server is as unit of day, and in the daily course of work, application server is arrived in newly-increased file update
In caching.After darg, application server deletes the file of the previous day stored in caching, only retains the same day more
New file.
For example, serial number picture can be generated during bank outlets' PC machine daylight trading, for recording bill circulation
Situation.At the end of same day work, site PC machine, which updates the same day newly-generated serial number picture to application server, to be cached
In.Correspondingly, after application server caching receives the serial number picture that the same day increases newly, by the previous day storage into caching
Serial number picture is deleted.
S504, file server carry out hash calculation process to newly-increased file according to the setting period, obtain file hash value；
Likewise, the embodiment of the present application sets above-mentioned at the end of setting the period as daily work, it is as unit of day
Period.
At the end of daily work, i.e., in file server idle, such as at night, file server increases the same day newly
File carries out hash calculation process, obtains file hash value.Unique identification of this document hash value as this document, for marking
This document.
Illustratively, for serial number picture, the embodiment of the present application is obtained by carrying out hash operation to serial number
Hash value of the hash value as serial number picture.
For example, using first 4 of serial number+centre 1+rear 4 calculated result as the hash of serial number picture
Value.
It should be noted that the concrete operation process of above-mentioned carry out hash operation, it can be with flexible choice, setting.Such as it can
To be determined according to file server performance, or directly by serial number, everybody is added the file hash as serial number picture
Value.
S505, file server carry out compression processing to file hash value；
Specifically, file server is after increasing file generated file hash value newly on the same day, to there is part hash value position
For sky, such as shown in Fig. 6.File hash value is carried out compression processing by the embodiment of the present application, will wherein be compressed for empty position, can
To optimize file storage, memory space is saved.
Illustratively, when compressing to file hash value, difference, run length, bit coding etc. specifically can be used
Compaction coding method is realized.
S506, file server utilize the token of the file hash value and the file server, the rope of composing document
Draw；
Specifically, file hash value and file server token are combined by file server, a combination thereof result conduct
The index of this document.
Illustratively, file server is when carrying out compression processing to file hash value, by the token of this document server
It compresses together, obtained compression result is used as the index of this document.
The file index of generation is sent to application server by S507, file server；
S508, application server receive the file index that file server is sent, and received file index is returned
And it stores；
Specifically, file index is parsed after application server receives the file index that file server is sent,
Such as decompressed, therefrom obtain each file index and corresponding file server token.
On this basis, such as shown in Fig. 7, application server is to each file index stored, including existing text
The file index that part is indexed and newly received carries out merger storage, i.e., arrives identical file index merger storage together, meanwhile,
Under the corresponding token of each file index also corresponding storage to file index.
It is appreciated that application server stores above-mentioned file index merger, it is ensured that identical in storage region
File only one, but the corresponding token of this document can but have it is multiple, i.e., expression this document in corresponding multiple token institutes
There is storage in the file server of mark.
The processing of S501~S508 through the above steps, the index of the file that application server uploads file server into
Row storage, and the token of the file server of storage file is stored, then in the application server, clearly have recorded each
Storage location where file.
According to above-mentioned treatment process, application server can record All Files in distributed file storage system daily
Storage location.
At the same time, in the distributed file storage system course of work shown in Fig. 3, when user by web terminal to answering
When sending file query requests with server, application server and file server cooperation execute following treatment process, realize text
The acquisition of part:
S509, application server file query requests based on the received, determine file to be checked；
Specifically, application server parses received file query requests, identifies, it can determine that this document is inquired
The file of inquiry is specifically requested in request.
Illustratively, when application server receives the request of serial number picture query, by identifying requested hat
Font size code can determine specifically which serial number picture request inquires.
S510, application server carry out hash calculation process to file to be checked, file hash value are obtained, as to be checked
The index of file；
Specifically, the embodiment of the present application is set, application server carries out the tool of hash operation post-processing to file to be checked
Body processing mode is introduced with above-mentioned steps S504, and file server carries out the processing of hash calculation process to newly-increased file
Mode is identical.
For example, when application server receive serial number picture query request when, equally with first 4 of serial number+
Hash value of 1 intermediate+rear 4 calculated result as serial number picture to be checked, and as prefix to be checked
The index of number picture.
S511, application server retrieve file rope identical with the index of file to be checked from the file index of storage
Draw；
Specifically, application server, from all file indexes of storage, inquiry whether there is above-mentioned file to be checked
Index.It, then can be true if retrieving file index identical with the index of file to be checked from the file index of storage
The index of fixed file to be checked is stored in application server.
If application server from the file index of storage, does not retrieve the index of file to be checked, then executes step
Rapid S512, the file to be checked is inquired from application server caching；
Specifically, application server retrieves the index less than file to be checked from the file index of storage, it can be said that
The index of this document is not present in bright application server, can also think each file server connecting with application server
In, do not store the file to be checked.
At this point, application server inquires file to be checked from own cache.If still inquired less than file to be checked,
Then can determination can not obtain the file to be checked；If the file to be checked has been inquired from caching, by what is inquired
File feeds back to user.
When application server retrieves file index identical with the index of file to be checked from the file index of storage
When, it executes step S513, determine that this document indexes the token for including, and determine the file server for storing file to be checked；
Specifically, since the file index itself that application server receives includes file server token, and apply
The token that file index includes can be corresponded to storage when storage file indexes by server.Therefore, when application server from itself
When retrieving file index in storage, the token of storage corresponding with this document index can be correspondingly determined, that is, determining should
The token that file index includes.
Since token is the identification information of unique identification file server, when application server passes through step S512
When determining the token that the file index retrieved includes, also determines that and sent the file server that this document indexes, and this article
Part server exactly stores the file server of above-mentioned file to be checked.
S514, application server generate inquiry label；
Wherein, the file server that above-mentioned inquiry needs to store above-mentioned file to be checked labeled as expression inquires text to be checked
The mark information of part.
For example, it is assumed that serial number picture to be checked is the picture comprising serial number " 0123456789 ", and answer
It has been determined that storing the file server of the serial number picture is T1 and T3 file server with server, then generating " needs T1, T3
The inquiry label of inquiry " 0123456789 " serial number picture ".
Whether there is inquiry corresponding with file server mark in S515, file server inquiry application server
Note；
Wherein, above-mentioned inquiry label corresponding with the file server indicates to need the file server inquiry
And the mark information of the file of setting is fed back, that is, indicate the label for needing the file server to execute file polling task
Information.
The embodiment of the present application is set, and in distributed file storage system shown in Fig. 3, each file server can week
The access application server of phase property is inquired in application server and is marked with the presence or absence of inquiry corresponding with itself, that is, inquires
With the presence or absence of the mark information for indicating that itself is needed to execute file polling task.
In order to intuitively introduce the embodiment of the present application technical solution, the embodiment of the present application sets above-mentioned file server i.e.
For the file server for the storage file to be checked that application server in step S514 determines.Correspondingly, above-mentioned take with this document
The corresponding inquiry label of business device as indicates that this document server is needed to inquire and feeds back the label letter of above-mentioned file to be checked
Breath.
Illustratively, the embodiment of the present application is set, and file server is in a manner of heartbeat inspecting, timer access application service
Whether device, inquiry have inquiry corresponding with itself to mark.
At application server end, when the inquiry request for receiving the file server transmission for storing above-mentioned file to be checked
When, that is, when whether the inquiry that receives file server transmission has the inquiry request of corresponding inquiry label, apply
Server executes step S516, the inquiry label of generation is sent to the file server for storing above-mentioned file to be checked；
S517, file server retrieve to obtain file cocurrent corresponding with label is inquired and give application server.
Specifically, when application server sends out inquiry label corresponding with the file server for storing above-mentioned file to be checked
When giving this document server, this document server is retrieved to obtain the indicated file inquired of inquiry label from itself memory block,
And the file that retrieval obtains is fed back into application server.File further can be fed back to user by application server.
For example, it is assumed that the inquiry label that application server " will need T1, T3 to inquire " 0123456789 " serial number picture "
It is sent to the file server that token is T1 and T3, then token is that the file server of T1 and T3 is retrieved from itself memory block
" 0123456789 " serial number picture, and feed back to application server.
By above-mentioned introduction as it can be seen that the file management method that the embodiment of the present application proposes, setting file server actively will
The index of the file of storage is sent to application server, when application server needs to inquire file, utilizes the file rope of storage
Draw the file server for determining and storing file to be checked, and generates inquiry label corresponding with this document server.Work as this document
When server sends inquiry request to application server, starts inquiry label to give this document server, make this document service
Device is inquired to obtain file to be checked and feeds back to application server.Above-mentioned treatment process can make application server by file polling
Request is accurately sent to the file server for storing file to be checked, which is applied to branch's formula file storage system
In system, network and memory source when application server file polling can be made rationally to be utilized, avoid the wasting of resources.
Summarize above-mentioned technical proposal introduction, it can be deduced that the file applied to file server that the embodiment of the present application proposes
Management method, comprising:
Whether inquire has inquiry corresponding with file server label in the application server；Wherein, with institute
File server corresponding inquiry label is stated, for the label for the file for indicating the file server is needed to inquire and feeding back setting
Information；
If receiving the inquiry label that the application server is sent, retrieval obtains corresponding with the inquiry label
File cocurrent gives the application server.
And the file management method applied to application server for showing that the embodiment of the present application proposes can be summarized, packet
It includes:
File query requests based on the received generate the index of file to be checked；
From the file index of storage, file index identical with the index of the file to be checked is retrieved；
When retrieving file index identical with the index of the file to be checked, determine that this document indexes the order for including
Board, and determine the file server for storing the file to be checked；
Inquiry label is generated, the inquiry is labeled as the file server for indicating to need to store the file to be checked inquiry
The mark information of the file to be checked；
When receiving the inquiry request that the file server for storing the file to be checked is sent, the inquiry is marked
It is sent to the file server for storing the file to be checked, so that the file server of the storage file to be checked feeds back institute
State file to be checked.
Corresponding with above-mentioned file management method, another embodiment of the application also discloses a kind of applied to file clothes
The document management apparatus of business device, shown in Figure 8, which includes:
Information uploading unit 100 is sent for generating the index of newly-increased file according to the setting period, and by the index of generation
To application server；Wherein, the token of file server described in unique identification is carried in the index；
Query processing unit 110, for whether inquiring in the application server with corresponding with the file server
Inquiry label；Wherein, inquiry label corresponding with the file server, to indicate to need the file server inquiry simultaneously
Feed back the mark information of the file of setting；
File uploading unit 120, for when receiving the inquiry label that the application server is sent, retrieval obtain with
The inquiry marks corresponding file cocurrent to give the application server.
Wherein, when the information uploading unit 100 generates the index of newly-increased file according to the setting period, it is specifically used for:
At the end of daily work newly file was increased to the same day and carry out hash calculation process, obtains file hash value；
Utilize the token of the file hash value and the file server, the index of composing document.
Hash calculation process, after obtaining file hash value, the information uploading unit 100 are carried out increasing file newly to the same day
It is also used to:
Compression processing is carried out to the file hash value.
Optionally, it being also disclosed in another embodiment of the application, the file server further includes file storage unit,
For newly-increased file to be updated into application server caching according to the setting period.
In another embodiment of the application, a kind of document management apparatus applied to application server is also disclosed, referring to
Shown in Fig. 9, which includes:
Information memory cell 200, for receive file server transmission file index, and by received file index into
Row merger storage；It wherein, include the token of unique identification file server in the file index；
Generation unit 210 is indexed, for file query requests based on the received, generates the index of file to be checked；
Indexed search unit 220, for retrieving identical as the index of the file to be checked from the file index of storage
File index；
Information determination unit 230, for when retrieving file index identical with the index of the file to be checked, really
Determine this document and index the token for including, and determines the file server for storing the file to be checked；
Generation unit 240 is marked, for generating inquiry label, the inquiry is described to be checked labeled as indicating to need to store
The file server of file inquires the mark information of the file to be checked；
Transmission unit 250 is marked, for when the inquiry for receiving the file server for storing the file to be checked transmission
When request, the inquiry label is sent to the file server for storing the file to be checked, so that storage is described to be checked
The file server of file feeds back the file to be checked.
Wherein, the index generation unit 210 file query requests based on the received, generate the index of file to be checked
When, it is specifically used for:
File query requests based on the received determine file to be checked；
Hash calculation process is carried out to the file to be checked, file hash value is obtained, as the file to be checked
Index.
Optionally, it is also disclosed in another embodiment of the application, described device further include:
Document retrieval unit, for when retrieval less than file index identical with the index of the file to be checked when, from
The file to be checked is inquired in the application server caching.
Specifically, the specific works content of each unit in the embodiment of above-mentioned each document management apparatus, refers to
The content of above method embodiment, details are not described herein again.
Another embodiment of the application also proposes a kind of file management system, shown in Figure 10, this document management system packet
It includes:
At least one file server 300 and application server 310；
Wherein, the file server 300, for generating the index of newly-increased file according to the setting period, and by generation
Index is sent to application server；Wherein, the token of file server described in unique identification is carried in the index；Described in inquiry
Whether there is inquiry corresponding with file server label in application server；Wherein, corresponding with the file server
Inquiry label, for the mark information for the file for indicating the file server is needed to inquire and feeding back setting；Receiving
When stating the inquiry label of application server transmission, retrieval obtains file cocurrent corresponding with the inquiry label and gives the application
Server；
The application server 310, for receiving the file index of file server transmission, and by received file index
Carry out merger storage；File query requests based on the received generate the index of file to be checked；From the file index of storage,
Retrieve file index identical with the index of the file to be checked；It is identical with the index of the file to be checked when retrieving
When file index, determine that this document indexes the token for including, and determine the file server for storing the file to be checked；It is raw
It is marked at inquiry, the file server inquiry that the inquiry needs to store the file to be checked labeled as expression is described to be checked
The mark information of file；It, will be described when receiving the inquiry request that the file server for storing the file to be checked is sent
Inquiry label is sent to the file server for storing the file to be checked.
Specifically, at least one above-mentioned 300 composing document server cluster of file server is distributed in different location, and collect
Each file server 300 in group is connect as file server node with application server 310.
It may include document management apparatus shown in Fig. 8 in 300 structure of file server, it can in 310 structure of application server
Including document management apparatus shown in Fig. 9, file server 300 and application server 310 cooperate with each other realization the application
The file management method as shown in Figure 5 that embodiment proposes, the specific works mistake of file server 300 and application server 310
Journey, reference can be made to the embodiment content of above-mentioned file management method, details are not described herein again.
For the various method embodiments described above, for simple description, therefore, it is stated as a series of action combinations, but
Be those skilled in the art should understand that, the application is not limited by the described action sequence because according to the application, certain
A little steps can be performed in other orders or simultaneously.Secondly, those skilled in the art should also know that, it is retouched in specification
The embodiment stated belongs to preferred embodiment, necessary to related actions and modules not necessarily the application.
It should be noted that all the embodiments in this specification are described in a progressive manner, each embodiment weight
Point explanation is the difference from other embodiments, and the same or similar parts between the embodiments can be referred to each other.
For device class embodiment, since it is basically similar to the method embodiment, so being described relatively simple, related place ginseng
See the part explanation of embodiment of the method.
Step in each embodiment method of the application can be sequentially adjusted, merged and deleted according to actual needs.
Each embodiment kind device of the application and module in terminal and submodule can be merged according to actual needs, be drawn
Divide and deletes.
In several embodiments provided herein, it should be understood that disclosed terminal, device and method, Ke Yitong
Other modes are crossed to realize.For example, terminal embodiment described above is only schematical, for example, module or submodule
Division, only a kind of logical function partition, there may be another division manner in actual implementation, for example, multiple submodule or
Module may be combined or can be integrated into another module, or some features can be ignored or not executed.Another point is shown
The mutual coupling, direct-coupling or communication connection shown or discussed can be through some interfaces, between device or module
Coupling or communication connection are connect, can be electrical property, mechanical or other forms.
Module or submodule may or may not be physically separated as illustrated by the separation member, as mould
The component of block or submodule may or may not be physical module or submodule, it can and it is in one place, or
It may be distributed on multiple network modules or submodule.Some or all of mould therein can be selected according to the actual needs
Block or submodule achieve the purpose of the solution of this embodiment.
In addition, each functional module or submodule in each embodiment of the application can integrate in a processing module
In, it is also possible to modules or submodule physically exists alone, it can also be integrated with two or more modules or submodule
In a module.Above-mentioned integrated module or submodule both can take the form of hardware realization, can also use software function
Energy module or the form of submodule are realized.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond scope of the present application.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor
The combination of capable software unit or the two is implemented.Software unit can be placed in random access memory (RAM), memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology
In any other form of storage medium well known in field.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that the process, method, article or equipment for including a series of elements not only includes that
A little elements, but also including other elements that are not explicitly listed, or further include for this process, method, article or
The intrinsic element of equipment.In the absence of more restrictions, the element limited by sentence "including a ...", is not arranged
Except there is also other identical elements in the process, method, article or apparatus that includes the element.
The foregoing description of the disclosed embodiments makes professional and technical personnel in the field can be realized or use the application.
Various modifications to these embodiments will be readily apparent to those skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the application.Therefore, the application
It is not intended to be limited to the embodiments shown herein, and is to fit to and the principles and novel features disclosed herein phase one
The widest scope of cause.
Claims (10)
1. a kind of file management method, which is characterized in that be applied to file server, the file server is according to the setting period
The index for increasing file is generated, and the index of generation is sent to application server；Wherein, unique identification institute is carried in the index
State the token of file server；The described method includes:
Whether inquire has inquiry corresponding with file server label in the application server；Wherein, with the text
The corresponding inquiry label of part server, to indicate that the label for the file for needing the file server to inquire and feeding back setting is believed
Breath；
If receiving the inquiry label that the application server is sent, retrieval obtains file corresponding with the inquiry label
And it is sent to the application server.
2. the method according to claim 1, wherein the index for generating newly-increased file according to the setting period,
Include:
At the end of daily work newly file was increased to the same day and carry out hash calculation process, obtains file hash value；
Utilize the token of the file hash value and the file server, the index of composing document.
3. according to the method described in claim 2, it is characterized in that, being obtained increasing file progress hash calculation process newly to the same day
To after file hash value, the method also includes:
Compression processing is carried out to the file hash value.
4. the method according to claim 1, wherein the file server is according further to the setting period by newly-increased text
Part is updated into application server caching.
5. a kind of file management method, which is characterized in that be applied to application server, the application server receives file service
The file index that device is sent, and received file index is subjected to merger storage；Wherein, unique mark is included in the file index
Know the token of file server；The described method includes:
File query requests based on the received generate the index of file to be checked；
From the file index of storage, file index identical with the index of the file to be checked is retrieved；
When retrieving file index identical with the index of the file to be checked, determine that this document indexes the token for including,
And determine the file server for storing the file to be checked；
Inquiry label is generated, the inquiry is labeled as described in the file server for indicating to need to store the file to be checked inquiry
The mark information of file to be checked；
When receiving the inquiry request that the file server for storing the file to be checked is sent, the inquiry is marked and is sent
To the file server for storing the file to be checked so that the file server feedback of the storage file to be checked it is described to
Inquire file.
6. according to the method described in claim 5, it is characterized in that, the method also includes:
When retrieval is less than file index identical with the index of the file to be checked, looked into from application server caching
Ask the file to be checked.
7. according to the method described in claim 5, it is characterized in that, the file query requests based on the received, generate to be checked
Ask the index of file, comprising:
File query requests based on the received determine file to be checked；
Hash calculation process is carried out to the file to be checked, obtains file hash value, the index as the file to be checked.
8. a kind of document management apparatus, which is characterized in that be applied to file server, described device includes:
The index of generation for generating the index of newly-increased file according to the setting period, and is sent to application by information uploading unit
Server；Wherein, the token of file server described in unique identification is carried in the index；
Whether query processing unit has inquiry corresponding with file server mark for inquiring in the application server
Note；Wherein, inquiry label corresponding with the file server, to indicate that the file server is needed to inquire and feeding back setting
File mark information；
File uploading unit, for when receiving the inquiry label that the application server is sent, retrieval to obtain looking into described
It askes and corresponding file cocurrent is marked to give the application server.
9. a kind of document management apparatus, which is characterized in that be applied to application server, described device includes:
Information memory cell carries out merger for receiving the file index of file server transmission, and by received file index
Storage；It wherein, include the token of unique identification file server in the file index；
Generation unit is indexed, for file query requests based on the received, generates the index of file to be checked；
Indexed search unit, for retrieving file identical with the index of the file to be checked from the file index of storage
Index；
Information determination unit, for determining this article when retrieving file index identical with the index of the file to be checked
Part indexes the token for including, and determines the file server for storing the file to be checked；
Generation unit is marked, for generation inquiry label, the inquiry needs to store the file to be checked labeled as expression
File server inquires the mark information of the file to be checked；
Mark transmission unit, for when receive store the file to be checked file server transmission inquiry request when,
The inquiry label is sent to the file server for storing the file to be checked, so that the text of the storage file to be checked
File to be checked described in part server feedback.
10. a kind of file management system characterized by comprising
File server and application server；
Wherein, the file server is sent for generating the index of newly-increased file according to the setting period, and by the index of generation
To application server；Wherein, the token of file server described in unique identification is carried in the index；Inquire the application service
Whether there is inquiry corresponding with file server label in device；Wherein, inquiry mark corresponding with the file server
Note, for the mark information for the file for indicating the file server is needed to inquire and feeding back setting；Receiving the application clothes
When the inquiry label that business device is sent, retrieval obtains file cocurrent corresponding with the inquiry label and gives the application server；
The application server for receiving the file index of file server transmission, and received file index is returned
And it stores；File query requests based on the received generate the index of file to be checked；From the file index of storage, retrieval with
The identical file index of index of the file to be checked；When retrieving file rope identical with the index of the file to be checked
When drawing, determine that this document indexes the token for including, and determine the file server for storing the file to be checked；Generate inquiry
Label, the file server that the inquiry needs to store the file to be checked labeled as expression inquire the file to be checked
Mark information；When receiving the inquiry request that the file server for storing the file to be checked is sent, the inquiry is marked
Note is sent to the file server for storing the file to be checked.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910631173.6A CN110362535B (en) | 2019-07-12 | 2019-07-12 | File management method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910631173.6A CN110362535B (en) | 2019-07-12 | 2019-07-12 | File management method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110362535A true CN110362535A (en) | 2019-10-22 |
| CN110362535B CN110362535B (en) | 2022-05-31 |
Family
ID=68219252
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910631173.6A Active CN110362535B (en) | 2019-07-12 | 2019-07-12 | File management method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110362535B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113852682A (en) * | 2021-09-23 | 2021-12-28 | 中国农业银行股份有限公司 | Data transmission method and intermediate transmission layer server |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1633084A (en) * | 2004-12-28 | 2005-06-29 | 北京邮电大学 | Token-based fine granularity access control system and method for application server |
| JP2005310126A (en) * | 2004-03-26 | 2005-11-04 | Ntt Neomate Corp | Distributed data storage device, data constitution management server therefor, client terminal, and job consignment system comprising distributed data storage device |
| US20060004892A1 (en) * | 2004-06-14 | 2006-01-05 | Christopher Lunt | Visual tags for search results generated from social network information |
| CN103248695A (en) * | 2013-05-07 | 2013-08-14 | 北京奇虎科技有限公司 | File downloading method and system and server node in CDN |
| CN104008199A (en) * | 2014-06-16 | 2014-08-27 | 北京京东尚科信息技术有限公司 | Data inquiring method |
| CN104731516A (en) * | 2013-12-18 | 2015-06-24 | 腾讯科技（深圳）有限公司 | Method and device for accessing files and distributed storage system |
| CN107291826A (en) * | 2017-05-26 | 2017-10-24 | 北京金山安全管理系统技术有限公司 | File search processing method and processing device |
-
2019
- 2019-07-12 CN CN201910631173.6A patent/CN110362535B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005310126A (en) * | 2004-03-26 | 2005-11-04 | Ntt Neomate Corp | Distributed data storage device, data constitution management server therefor, client terminal, and job consignment system comprising distributed data storage device |
| US20060004892A1 (en) * | 2004-06-14 | 2006-01-05 | Christopher Lunt | Visual tags for search results generated from social network information |
| CN1633084A (en) * | 2004-12-28 | 2005-06-29 | 北京邮电大学 | Token-based fine granularity access control system and method for application server |
| CN103248695A (en) * | 2013-05-07 | 2013-08-14 | 北京奇虎科技有限公司 | File downloading method and system and server node in CDN |
| CN104731516A (en) * | 2013-12-18 | 2015-06-24 | 腾讯科技（深圳）有限公司 | Method and device for accessing files and distributed storage system |
| CN104008199A (en) * | 2014-06-16 | 2014-08-27 | 北京京东尚科信息技术有限公司 | Data inquiring method |
| CN107291826A (en) * | 2017-05-26 | 2017-10-24 | 北京金山安全管理系统技术有限公司 | File search processing method and processing device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113852682A (en) * | 2021-09-23 | 2021-12-28 | 中国农业银行股份有限公司 | Data transmission method and intermediate transmission layer server |
| CN113852682B (en) * | 2021-09-23 | 2024-06-14 | 中国农业银行股份有限公司 | Data transmission method and intermediate transmission layer server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110362535B (en) | 2022-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4997950B2 (en) | Network management system, network management program, and network management method | |
| DE602005005312T2 (en) | Method and system for managing electronic messages | |
| DE19747583B4 (en) | Communication system and method | |
| CN102244774B (en) | There is the surveillance of immediate data storehouse service memory | |
| CN109542595B (en) | Data acquisition method, device and system | |
| CN106303557A (en) | The live content methods of exhibiting of network direct broadcasting and device | |
| EP1351141A3 (en) | Method and system for managing data records on a computer network | |
| EP0983665A2 (en) | Method and apparatus for providing remote site administrators with user hits on mirrored web sites | |
| KR100449497B1 (en) | Apparatus and method for providing realtime information | |
| DE202010018478U1 (en) | Caching of information | |
| CN100383794C (en) | Searching method, holding method and searching system for dictionary-like data | |
| CN106777905A (en) | The method that many image center service systems of tele-medicine and its terminal obtain data | |
| CN105868251A (en) | Cache data updating method and device | |
| CN107612982B (en) | A kind of method, storage medium, equipment and system reducing function pages request number of times | |
| CN113553310B (en) | Data acquisition method and device, storage medium and electronic equipment | |
| CN107241614A (en) | A kind of live broadcast system | |
| CN110362535A (en) | A kind of file management method, apparatus and system | |
| US8788572B1 (en) | Caching proxy server for a peer-to-peer photosharing system | |
| CN100477582C (en) | Method and system for processing real-time multi-media information in instant telecommunication | |
| CN108228625A (en) | A kind of PUSH message processing method and processing device | |
| JP4894253B2 (en) | Metadata generating apparatus and metadata generating method | |
| CN109582659A (en) | Request recording method, system, device and the readable storage medium storing program for executing of processing links | |
| CN102104581A (en) | Network karaoke on-demand system and method thereof | |
| US20120331381A1 (en) | Systems and Methods for Communicating Information | |
| US5768514A (en) | Cooperative activity system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |