CN105959420A - Multi-client metadata synchronous update method and device - Google Patents
Multi-client metadata synchronous update method and device Download PDFInfo
- Publication number
- CN105959420A CN105959420A CN201610561399.XA CN201610561399A CN105959420A CN 105959420 A CN105959420 A CN 105959420A CN 201610561399 A CN201610561399 A CN 201610561399A CN 105959420 A CN105959420 A CN 105959420A
- Authority
- CN
- China
- Prior art keywords
- client
- file attribute
- data server
- meta data
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a multi-client metadata synchronous update method. The method comprises the steps of obtaining a session list in a metadata server, wherein the session list is the list of connection established between the metadata server and multiple clients; sending a file attribute modification request to the metadata server, and modifying the file attribute information stored in the metadata server according to the file attribute medication request; judging whether modification is successful or not, and generating native modification commands if the modification is successful; carrying out corresponding modification on the file attribute information in the native caches of the clients according to the native modification commands, and moreover generating file attribute update commands; and sending the file attribute update commands to the multiple clients at the same time according to the session list, and updating the native caches of the multiple clients. The modification synchronism of the file attribute information in the metadata server and the multiple clients is realized; and the modification accuracy of the file attribute information of the multiple clients is improved. The invention also discloses a multi-client metadata synchronous update system.
Description
Technical field
The present invention relates to technical field of data storage, more particularly, it relates to a kind of multi-client metadata
Synchronous updating method, further relates to a kind of multi-client metadata synchronization and updates system.
Background technology
In current large-scale storage systems, often through the file system on client-access storage server
System, client can be from meta data server (MDS, preservation All Files to the access first of a file
Attribute information) obtain file metadata information, be saved in the local cache of client, to this article
The subsequent access of part directly uses the metadata in local cache.
For the application scenarios of single client, when revising the access rights of file on the client, can be to
MDS initiates amendment request, feeds back to client after MDS is successfully modified, and it is local that client revises oneself again
The authority information of caching.After amendment, when the file in file system is conducted interviews by client next time,
Have only to check the authority information of client local cache.
But, for the application scenarios of multi-client, each client has the most independent metadata and delays
Deposit, when revising the access rights of certain file wherein in a client, only MDS and initiation amendment
Metadata in the client of request can update, and during other client-access same file, still can make
Judge access rights by the old metadata of respective local cache, cause access to make mistakes.
Therefore, the metadata how making multi-client synchronized update local cache is those skilled in the art
The anxious technical issues that need to address.
Summary of the invention
For solving above-mentioned technical problem, the present invention provides a kind of multi-client metadata synchronization update method,
Make the metadata of multi-client synchronized update local cache.
For achieving the above object, the present invention provides following technical scheme:
A kind of multi-client metadata synchronization update method, including:
Obtain the session list in meta data server, described session list be described meta data server with
The connection list that multiple clients are set up;
Send file attribute amendment request extremely described meta data server, please according to the amendment of described file attribute
The file attribute information to being stored in described meta data server is asked to modify;
Judge whether successfully modified, if successfully modified, then generate locally modified order;
According to described locally modified order, the file attribute information in client local cache is carried out accordingly
Amendment, generates file attribute more newer command simultaneously;
Send the more newer command of described file attribute to multiple clients, respectively according to described session list simultaneously
Multiple client local caches are updated.
Preferably, in above-mentioned multi-client metadata synchronization update method, described acquisition Metadata Service
Before session list in device, also include:
By file system mounted in local directory so that the plurality of client in described local directory
It is able to access that described file system;
By the plurality of client and meta data server be attached.
Preferably, in above-mentioned multi-client metadata synchronization update method, described file attribute information is
Access authority information.
Present invention also offers a kind of multi-client metadata synchronization and update system, including:
Session list acquisition module, for obtaining the session list in meta data server, described session column
Table is the connection list that described meta data server is set up with multiple clients;
Send request module, be used for sending file attribute amendment request to described meta data server;
Server modified module, for asking being stored in described metadata according to the amendment of described file attribute
File attribute information in server is modified;
Judge module, is used for judging whether successfully modified, if successfully modified, then generates locally modified order;
Locally modified module, is used for according to described locally modified order the file in client local cache
Attribute information is revised accordingly, generates file attribute more newer command simultaneously;
More new module, for sending described file attribute according to described session list to multiple clients simultaneously
Multiple client local caches are updated by more newer command respectively.
Preferably, in above-mentioned multi-client metadata synchronization renewal system, also include:
Access modules, is used for file system mounted in local directory so that in described local directory
The plurality of client is able to access that described file system;
Link block, for by the plurality of client and meta data server be attached.
Preferably, in above-mentioned multi-client metadata synchronization renewal system, described meta data server includes
Centralized meta data server and distributing meta data server.
From technique scheme it can be seen that a kind of multi-client metadata synchronization provided by the present invention more
New method, obtains the session list in meta data server, and described session list is described Metadata Service
The connection list that device is set up with multiple clients;Send file attribute amendment request to described Metadata Service
Device, according to the described file attribute amendment request file attribute letter to being stored in described meta data server
Breath is modified;Judge whether successfully modified, if successfully modified, then generate locally modified order;According to
File attribute information in client local cache is revised by described locally modified order accordingly, with
The more newer command of Shi Shengcheng file attribute;Send described literary composition to multiple clients according to described session list simultaneously
Multiple client local caches are updated by part attribute more newer command respectively.
Being connected owing to meta data server establishes with client, client obtains from meta data server
The connection list that meta data server is set up with multiple clients, i.e. session list, when there being a client
End local cache in file attribute information be modified, then this client will according to session list to
Other client sends more newer command, and the file attribute in respective local cache is also believed by other client
Breath is modified, simultaneously as when the file attribute information in client local cache is modified,
Modifying firstly the need of to the meta data server established a connection, therefore, the application achieves unit
The synchronicity of the file attribute information amendment in data server and multiple client, improves work effect
Rate, and the accuracy rate of the file attribute information amendment of multi-client.
Present invention also offers a kind of multi-client metadata synchronization and update system, it is achieved that Metadata Service
The synchronicity of the file attribute information amendment in device and multiple client.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to reality
Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that below,
Accompanying drawing in description is only embodiments of the invention, for those of ordinary skill in the art, not
On the premise of paying creative work, it is also possible to obtain other accompanying drawing according to the accompanying drawing provided.
A kind of multi-client metadata synchronization update method schematic diagram that Fig. 1 provides for the present invention;
A kind of multi-client metadata synchronization that Fig. 2 provides for the present invention updates system schematic.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out
Clearly and completely describe, it is clear that described embodiment is only a part of embodiment of the present invention, and
It is not all, of embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art are not doing
Go out the every other embodiment obtained under creative work premise, broadly fall into the scope of protection of the invention.
Refer to a kind of multi-client metadata synchronization update method signal that Fig. 1, Fig. 1 provide for the present invention
Figure.
In a kind of specific embodiment, it is provided that a kind of multi-client metadata synchronization update method,
Mainly comprise the steps that
Step S1: obtaining the session list in meta data server, described session list is described metadata
The connection list that server is set up with multiple clients.Meta data server saves the meeting of all clients
Words connect, and define session list.A certain client obtains session list, it is simple to follow-up to other visitors
Family end sends order.
Step S2: send file attribute amendment request extremely described meta data server, belong to according to described file
Property amendment request the file attribute information being stored in described meta data server is modified.
File attribute amendment request can be the amendment request etc. of access rights, it is desirable to meta data server is pressed
Modify according to file attribute amendment request, after meta data server receives file attribute amendment request, right
The file attribute information being stored in described meta data server is modified.
Step S3: judge whether successfully modified, if successfully modified, then generates locally modified order;
Concrete, meta data server receives the file attribute amendment request of client, amendment metadata clothes
Business device on preserve associated documents attribute, backward initiation request client return amendment object information,
According to amendment object information, client judges whether that the file attribute revising in local cache is believed after receiving response
Breath.Concrete, amendment object information is returned and the most then generates locally modified order by meta data server,
According to the file attribute information in locally modified order amendment local cache, do not revise.
Step S4: the file attribute information in client local cache is entered according to described locally modified order
The corresponding amendment of row, generates file attribute more newer command simultaneously.
After the file attribute information being stored in described meta data server has been modified, will amendment
The result completed feeds back to client, if result is successfully modified, generates locally modified order, client
Termination receives locally modified order, and carries out the file attribute information in client local cache accordingly
Amendment.
Step S5: send described file attribute according to described session list to multiple clients simultaneously update life
Multiple client local caches are updated by order respectively.
Owing to session list is the connection list that described meta data server is set up with multiple clients, if
Meta data server successfully have modified file attribute information, then according to session list, client to all its
Its client initiates file attribute more newer command, and the content of file attribute more newer command is that the file updated belongs to
Property information, after other client receives file attribute more newer command, replaces with old file attribute information
Amended file attribute information, reaches the corresponding file attribute in each self refresh client local cache
Information, has reached the file attribute information in all client local caches and the literary composition in meta data server
Part attribute information keeps synchronous vacations to update.
Being connected owing to meta data server establishes with client, client obtains from meta data server
The connection list that meta data server is set up with multiple clients, i.e. session list, when there being a client
End local cache in file attribute information be modified, then this client will according to session list to
Other client sends more newer command, and the file attribute in respective local cache is also believed by other client
Breath is modified, simultaneously as when the file attribute information in client local cache is modified,
Modifying firstly the need of to the meta data server established a connection, therefore, the application achieves unit
The synchronicity of the file attribute information amendment in data server and multiple client, improves work effect
Rate, and the accuracy rate of the file attribute information amendment of multi-client.
Further, before the session list in described acquisition meta data server, also include:
By file system mounted in local directory so that the plurality of client in described local directory
It is able to access that described file system;
By the plurality of client and meta data server be attached.
Under the application scenarios of multiple clients, the file system on client-access storage server needs
First being mounted to local directory, during carry, client and meta data server are set up and are connected.
Further, described file attribute information is access authority information.
Meta data server is the information providing Information locating, big including the description of information, such as data
Little, use authority etc., therefore, the file attribute information in meta data server can be the big of data
Little or access authority information etc..
Refer to Fig. 2, Fig. 2 and update system signal for a kind of multi-client metadata synchronization that the present invention provides
Figure.
In another kind of specific embodiment, present invention also offers a kind of multi-client metadata synchronization
Renewal system, including:
Session list acquisition module 06, for obtaining the session list in meta data server, described session
List is the connection list that described meta data server is set up with multiple clients;
Send request module 01, be used for sending file attribute amendment request to described meta data server;
Server modified module 02, for asking being stored in described unit number according to the amendment of described file attribute
Modify according to the file attribute information in server;
Judge module 03, is used for judging whether successfully modified, if successfully modified, then generates locally modified life
Order;
Locally modified module 04, is used for according to described locally modified order the literary composition in client local cache
Part attribute information is revised accordingly, generates file attribute more newer command simultaneously;
More new module 05, belongs to for sending described file according to described session list to multiple clients simultaneously
Multiple client local caches are updated by property more newer command respectively.Session list acquisition module 06 with
More new module 05 is connected, it will words list sends to more new module 05.
Further, in above-mentioned multi-client metadata synchronization renewal system, also include:
Access modules, is used for file system mounted in local directory so that in described local directory
The plurality of client is able to access that described file system;
Link block, for by the plurality of client and meta data server be attached.
Further, in above-mentioned multi-client metadata synchronization renewal system based on file system, institute
State meta data server and include centralized meta data server and distributing meta data server.Centralized
Meta data server be exactly storage network in only one of which metadata server node, all of unit number
It is believed that breath converges in this, simple in construction, transmission data speed is fast.Distributing meta data server has many
Individual metadata server node, can the most mutually copy metadata information, a large amount of unit of shell storage between node
Data message.Any one server is selected with specific reference to needs.
In this specification, each embodiment uses the mode gone forward one by one to describe, and each embodiment stresses
Being the difference with other embodiments, between each embodiment, identical similar portion sees mutually.
Described above to the disclosed embodiments, makes professional and technical personnel in the field be capable of or uses
The present invention.Multiple amendment to these embodiments will be aobvious and easy for those skilled in the art
See, generic principles defined herein can without departing from the spirit or scope of the present invention,
Realize in other embodiments.Therefore, the present invention is not intended to be limited to the embodiments shown herein,
And it is to fit to the widest scope consistent with principles disclosed herein and features of novelty.
Claims (6)
1. a multi-client metadata synchronization update method, it is characterised in that including:
Obtain the session list in meta data server, described session list be described meta data server with
The connection list that multiple clients are set up;
Send file attribute amendment request extremely described meta data server, please according to the amendment of described file attribute
The file attribute information to being stored in described meta data server is asked to modify;
Judge whether successfully modified, if successfully modified, then generate locally modified order;
According to described locally modified order, the file attribute information in client local cache is carried out accordingly
Amendment, generates file attribute more newer command simultaneously;
Send the more newer command of described file attribute to multiple clients, respectively according to described session list simultaneously
Multiple client local caches are updated.
2. the method for claim 1, it is characterised in that in described acquisition meta data server
Before session list, also include:
By file system mounted in local directory so that the plurality of client in described local directory
It is able to access that described file system;
By the plurality of client and meta data server be attached.
3. method as claimed in claim 1 or 2, it is characterised in that described file attribute information is for visiting
Ask authority information.
4. a multi-client metadata synchronization updates system, it is characterised in that including:
Session list acquisition module, for obtaining the session list in meta data server, described session column
Table is the connection list that described meta data server is set up with multiple clients;
Send request module, be used for sending file attribute amendment request to described meta data server;
Server modified module, for asking being stored in described metadata according to the amendment of described file attribute
File attribute information in server is modified;
Judge module, is used for judging whether successfully modified, if successfully modified, then generates locally modified order;
Locally modified module, is used for according to described locally modified order the file in client local cache
Attribute information is revised accordingly, generates file attribute more newer command simultaneously;
More new module, for sending described file attribute according to described session list to multiple clients simultaneously
Multiple client local caches are updated by more newer command respectively.
5. system as claimed in claim 4, it is characterised in that also include:
Access modules, is used for file system mounted in local directory so that in described local directory
The plurality of client is able to access that described file system;
Link block, for by the plurality of client and meta data server be attached.
6. system as claimed in claim 5, it is characterised in that described meta data server includes concentrating
Formula meta data server and distributing meta data server.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610561399.XA CN105959420A (en) | 2016-07-15 | 2016-07-15 | Multi-client metadata synchronous update method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610561399.XA CN105959420A (en) | 2016-07-15 | 2016-07-15 | Multi-client metadata synchronous update method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105959420A true CN105959420A (en) | 2016-09-21 |
Family
ID=56900849
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610561399.XA Pending CN105959420A (en) | 2016-07-15 | 2016-07-15 | Multi-client metadata synchronous update method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105959420A (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106845259A (en) * | 2017-02-28 | 2017-06-13 | 郑州云海信息技术有限公司 | A kind of distributed document access limit method to set up |
CN109033363A (en) * | 2018-07-26 | 2018-12-18 | 广东浪潮大数据研究有限公司 | A kind of method, device and equipment of customer in response end request |
CN109857747A (en) * | 2018-12-18 | 2019-06-07 | 百度在线网络技术(北京)有限公司 | Data synchronization updating method, system and computer equipment |
CN111125038A (en) * | 2019-12-31 | 2020-05-08 | 成都驰通数码系统有限公司 | Intelligent data synchronization method and system based on cloud storage |
CN112286890A (en) * | 2020-09-02 | 2021-01-29 | 北京意匠文枢科技有限公司 | Method and equipment for synchronizing revision information of target document |
CN116938961A (en) * | 2023-09-15 | 2023-10-24 | 北京趋动智能科技有限公司 | System and method for data synchronization and data reading method |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101051925A (en) * | 2006-04-04 | 2007-10-10 | 腾讯科技(深圳)有限公司 | Method for realizing network communication list data synchronization |
CN101888393A (en) * | 2009-05-13 | 2010-11-17 | 上海首恒电子科技有限公司 | Non-uniform cooperative system and method based on component middleware platforms under network environment |
CN103095687A (en) * | 2012-12-19 | 2013-05-08 | 华为技术有限公司 | Method and device of metadata processing |
CN103152398A (en) * | 2013-02-07 | 2013-06-12 | 中国科学院计算技术研究所 | Method and system for file synchronization among multiple terminal files |
CN103491055A (en) * | 2012-06-12 | 2014-01-01 | 中兴通讯股份有限公司 | Method for synchronizing information among clients, clients and server |
-
2016
- 2016-07-15 CN CN201610561399.XA patent/CN105959420A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101051925A (en) * | 2006-04-04 | 2007-10-10 | 腾讯科技(深圳)有限公司 | Method for realizing network communication list data synchronization |
CN101888393A (en) * | 2009-05-13 | 2010-11-17 | 上海首恒电子科技有限公司 | Non-uniform cooperative system and method based on component middleware platforms under network environment |
CN103491055A (en) * | 2012-06-12 | 2014-01-01 | 中兴通讯股份有限公司 | Method for synchronizing information among clients, clients and server |
CN103095687A (en) * | 2012-12-19 | 2013-05-08 | 华为技术有限公司 | Method and device of metadata processing |
CN103152398A (en) * | 2013-02-07 | 2013-06-12 | 中国科学院计算技术研究所 | Method and system for file synchronization among multiple terminal files |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106845259A (en) * | 2017-02-28 | 2017-06-13 | 郑州云海信息技术有限公司 | A kind of distributed document access limit method to set up |
CN109033363A (en) * | 2018-07-26 | 2018-12-18 | 广东浪潮大数据研究有限公司 | A kind of method, device and equipment of customer in response end request |
CN109857747A (en) * | 2018-12-18 | 2019-06-07 | 百度在线网络技术(北京)有限公司 | Data synchronization updating method, system and computer equipment |
CN111125038A (en) * | 2019-12-31 | 2020-05-08 | 成都驰通数码系统有限公司 | Intelligent data synchronization method and system based on cloud storage |
CN111125038B (en) * | 2019-12-31 | 2023-04-07 | 成都驰通数码系统有限公司 | Intelligent data synchronization method and system based on cloud storage |
CN112286890A (en) * | 2020-09-02 | 2021-01-29 | 北京意匠文枢科技有限公司 | Method and equipment for synchronizing revision information of target document |
CN116938961A (en) * | 2023-09-15 | 2023-10-24 | 北京趋动智能科技有限公司 | System and method for data synchronization and data reading method |
CN116938961B (en) * | 2023-09-15 | 2024-03-01 | 北京趋动智能科技有限公司 | System and method for data synchronization and data reading method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105959420A (en) | Multi-client metadata synchronous update method and device | |
CN102333029B (en) | Routing method in server cluster system | |
TWI220713B (en) | System and method for synchronizing documents between multi-nodes | |
CN105099761B (en) | A kind of method and system of configuration information that managing client concentratedly | |
CN106713391B (en) | Session information sharing method and sharing system | |
CN109753364A (en) | A kind of implementation method, equipment and the medium of network-based distributed lock | |
CN105684377A (en) | System and method for creating a distributed transaction manager supporting repeatable read isolation level in a mpp database | |
AU2015316450B2 (en) | Method for updating data table of KeyValue database and apparatus for updating table data | |
CN103297529A (en) | Timestamp-based tree structure data synchronization method | |
CN115599870B (en) | Data synchronization method based on fusion of stock data and incremental data of message queue | |
CN105516284B (en) | A kind of method and apparatus of Cluster Database distributed storage | |
CN112291298B (en) | Data transmission method, device, computer equipment and storage medium of heterogeneous system | |
CN109639773B (en) | Dynamically constructed distributed data cluster control system and method thereof | |
US20160323238A1 (en) | Ip management method, client and server | |
US9401957B2 (en) | System and method for synchronization between servers | |
CN106095911A (en) | Search system and method for data synchronization | |
CN105338095A (en) | Conversation data processing method and device | |
CN102082800A (en) | User request processing method and server | |
US20190251096A1 (en) | Synchronization of offline instances | |
CN107451853A (en) | Method, apparatus, system and the storage medium that a kind of red packet distributes in real time | |
CN105208060A (en) | Service data synchronization method, service data synchronization device and service data synchronization system | |
CN105007193A (en) | Multi-layer information processing method, system thereof and cluster management node | |
CN103986789A (en) | Method for realizing dual redundant of NFS (network file system) nodes in HADOOP HA (home address) cluster based on NFS | |
CN105790963A (en) | Method for managing multi-user control virtual meeting interface, server and client | |
CN105760391A (en) | Data dynamic redistribution method and system, data node and name node |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160921 |
|
RJ01 | Rejection of invention patent application after publication |