CN105959420A - Multi-client metadata synchronous update method and device - Google Patents

Multi-client metadata synchronous update method and device Download PDF

Info

Publication number
CN105959420A
CN105959420A CN201610561399.XA CN201610561399A CN105959420A CN 105959420 A CN105959420 A CN 105959420A CN 201610561399 A CN201610561399 A CN 201610561399A CN 105959420 A CN105959420 A CN 105959420A
Authority
CN
China
Prior art keywords
client
file attribute
data server
meta data
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610561399.XA
Other languages
Chinese (zh)
Inventor
刘健鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Beijing Electronic Information Industry Co Ltd
Original Assignee
Inspur Beijing Electronic Information Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Beijing Electronic Information Industry Co Ltd filed Critical Inspur Beijing Electronic Information Industry Co Ltd
Priority to CN201610561399.XA priority Critical patent/CN105959420A/en
Publication of CN105959420A publication Critical patent/CN105959420A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/565Conversion or adaptation of application format or content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a multi-client metadata synchronous update method. The method comprises the steps of obtaining a session list in a metadata server, wherein the session list is the list of connection established between the metadata server and multiple clients; sending a file attribute modification request to the metadata server, and modifying the file attribute information stored in the metadata server according to the file attribute medication request; judging whether modification is successful or not, and generating native modification commands if the modification is successful; carrying out corresponding modification on the file attribute information in the native caches of the clients according to the native modification commands, and moreover generating file attribute update commands; and sending the file attribute update commands to the multiple clients at the same time according to the session list, and updating the native caches of the multiple clients. The modification synchronism of the file attribute information in the metadata server and the multiple clients is realized; and the modification accuracy of the file attribute information of the multiple clients is improved. The invention also discloses a multi-client metadata synchronous update system.

Description

Multi-client metadata synchronization update method and system
Technical field
The present invention relates to technical field of data storage, more particularly, it relates to a kind of multi-client metadata Synchronous updating method, further relates to a kind of multi-client metadata synchronization and updates system.
Background technology
In current large-scale storage systems, often through the file system on client-access storage server System, client can be from meta data server (MDS, preservation All Files to the access first of a file Attribute information) obtain file metadata information, be saved in the local cache of client, to this article The subsequent access of part directly uses the metadata in local cache.
For the application scenarios of single client, when revising the access rights of file on the client, can be to MDS initiates amendment request, feeds back to client after MDS is successfully modified, and it is local that client revises oneself again The authority information of caching.After amendment, when the file in file system is conducted interviews by client next time, Have only to check the authority information of client local cache.
But, for the application scenarios of multi-client, each client has the most independent metadata and delays Deposit, when revising the access rights of certain file wherein in a client, only MDS and initiation amendment Metadata in the client of request can update, and during other client-access same file, still can make Judge access rights by the old metadata of respective local cache, cause access to make mistakes.
Therefore, the metadata how making multi-client synchronized update local cache is those skilled in the art The anxious technical issues that need to address.
Summary of the invention
For solving above-mentioned technical problem, the present invention provides a kind of multi-client metadata synchronization update method, Make the metadata of multi-client synchronized update local cache.
For achieving the above object, the present invention provides following technical scheme:
A kind of multi-client metadata synchronization update method, including:
Obtain the session list in meta data server, described session list be described meta data server with The connection list that multiple clients are set up;
Send file attribute amendment request extremely described meta data server, please according to the amendment of described file attribute The file attribute information to being stored in described meta data server is asked to modify;
Judge whether successfully modified, if successfully modified, then generate locally modified order;
According to described locally modified order, the file attribute information in client local cache is carried out accordingly Amendment, generates file attribute more newer command simultaneously;
Send the more newer command of described file attribute to multiple clients, respectively according to described session list simultaneously Multiple client local caches are updated.
Preferably, in above-mentioned multi-client metadata synchronization update method, described acquisition Metadata Service Before session list in device, also include:
By file system mounted in local directory so that the plurality of client in described local directory It is able to access that described file system;
By the plurality of client and meta data server be attached.
Preferably, in above-mentioned multi-client metadata synchronization update method, described file attribute information is Access authority information.
Present invention also offers a kind of multi-client metadata synchronization and update system, including:
Session list acquisition module, for obtaining the session list in meta data server, described session column Table is the connection list that described meta data server is set up with multiple clients;
Send request module, be used for sending file attribute amendment request to described meta data server;
Server modified module, for asking being stored in described metadata according to the amendment of described file attribute File attribute information in server is modified;
Judge module, is used for judging whether successfully modified, if successfully modified, then generates locally modified order;
Locally modified module, is used for according to described locally modified order the file in client local cache Attribute information is revised accordingly, generates file attribute more newer command simultaneously;
More new module, for sending described file attribute according to described session list to multiple clients simultaneously Multiple client local caches are updated by more newer command respectively.
Preferably, in above-mentioned multi-client metadata synchronization renewal system, also include:
Access modules, is used for file system mounted in local directory so that in described local directory The plurality of client is able to access that described file system;
Link block, for by the plurality of client and meta data server be attached.
Preferably, in above-mentioned multi-client metadata synchronization renewal system, described meta data server includes Centralized meta data server and distributing meta data server.
From technique scheme it can be seen that a kind of multi-client metadata synchronization provided by the present invention more New method, obtains the session list in meta data server, and described session list is described Metadata Service The connection list that device is set up with multiple clients;Send file attribute amendment request to described Metadata Service Device, according to the described file attribute amendment request file attribute letter to being stored in described meta data server Breath is modified;Judge whether successfully modified, if successfully modified, then generate locally modified order;According to File attribute information in client local cache is revised by described locally modified order accordingly, with The more newer command of Shi Shengcheng file attribute;Send described literary composition to multiple clients according to described session list simultaneously Multiple client local caches are updated by part attribute more newer command respectively.
Being connected owing to meta data server establishes with client, client obtains from meta data server The connection list that meta data server is set up with multiple clients, i.e. session list, when there being a client End local cache in file attribute information be modified, then this client will according to session list to Other client sends more newer command, and the file attribute in respective local cache is also believed by other client Breath is modified, simultaneously as when the file attribute information in client local cache is modified, Modifying firstly the need of to the meta data server established a connection, therefore, the application achieves unit The synchronicity of the file attribute information amendment in data server and multiple client, improves work effect Rate, and the accuracy rate of the file attribute information amendment of multi-client.
Present invention also offers a kind of multi-client metadata synchronization and update system, it is achieved that Metadata Service The synchronicity of the file attribute information amendment in device and multiple client.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to reality Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that below, Accompanying drawing in description is only embodiments of the invention, for those of ordinary skill in the art, not On the premise of paying creative work, it is also possible to obtain other accompanying drawing according to the accompanying drawing provided.
A kind of multi-client metadata synchronization update method schematic diagram that Fig. 1 provides for the present invention;
A kind of multi-client metadata synchronization that Fig. 2 provides for the present invention updates system schematic.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out Clearly and completely describe, it is clear that described embodiment is only a part of embodiment of the present invention, and It is not all, of embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art are not doing Go out the every other embodiment obtained under creative work premise, broadly fall into the scope of protection of the invention.
Refer to a kind of multi-client metadata synchronization update method signal that Fig. 1, Fig. 1 provide for the present invention Figure.
In a kind of specific embodiment, it is provided that a kind of multi-client metadata synchronization update method, Mainly comprise the steps that
Step S1: obtaining the session list in meta data server, described session list is described metadata The connection list that server is set up with multiple clients.Meta data server saves the meeting of all clients Words connect, and define session list.A certain client obtains session list, it is simple to follow-up to other visitors Family end sends order.
Step S2: send file attribute amendment request extremely described meta data server, belong to according to described file Property amendment request the file attribute information being stored in described meta data server is modified.
File attribute amendment request can be the amendment request etc. of access rights, it is desirable to meta data server is pressed Modify according to file attribute amendment request, after meta data server receives file attribute amendment request, right The file attribute information being stored in described meta data server is modified.
Step S3: judge whether successfully modified, if successfully modified, then generates locally modified order;
Concrete, meta data server receives the file attribute amendment request of client, amendment metadata clothes Business device on preserve associated documents attribute, backward initiation request client return amendment object information, According to amendment object information, client judges whether that the file attribute revising in local cache is believed after receiving response Breath.Concrete, amendment object information is returned and the most then generates locally modified order by meta data server, According to the file attribute information in locally modified order amendment local cache, do not revise.
Step S4: the file attribute information in client local cache is entered according to described locally modified order The corresponding amendment of row, generates file attribute more newer command simultaneously.
After the file attribute information being stored in described meta data server has been modified, will amendment The result completed feeds back to client, if result is successfully modified, generates locally modified order, client Termination receives locally modified order, and carries out the file attribute information in client local cache accordingly Amendment.
Step S5: send described file attribute according to described session list to multiple clients simultaneously update life Multiple client local caches are updated by order respectively.
Owing to session list is the connection list that described meta data server is set up with multiple clients, if Meta data server successfully have modified file attribute information, then according to session list, client to all its Its client initiates file attribute more newer command, and the content of file attribute more newer command is that the file updated belongs to Property information, after other client receives file attribute more newer command, replaces with old file attribute information Amended file attribute information, reaches the corresponding file attribute in each self refresh client local cache Information, has reached the file attribute information in all client local caches and the literary composition in meta data server Part attribute information keeps synchronous vacations to update.
Being connected owing to meta data server establishes with client, client obtains from meta data server The connection list that meta data server is set up with multiple clients, i.e. session list, when there being a client End local cache in file attribute information be modified, then this client will according to session list to Other client sends more newer command, and the file attribute in respective local cache is also believed by other client Breath is modified, simultaneously as when the file attribute information in client local cache is modified, Modifying firstly the need of to the meta data server established a connection, therefore, the application achieves unit The synchronicity of the file attribute information amendment in data server and multiple client, improves work effect Rate, and the accuracy rate of the file attribute information amendment of multi-client.
Further, before the session list in described acquisition meta data server, also include:
By file system mounted in local directory so that the plurality of client in described local directory It is able to access that described file system;
By the plurality of client and meta data server be attached.
Under the application scenarios of multiple clients, the file system on client-access storage server needs First being mounted to local directory, during carry, client and meta data server are set up and are connected.
Further, described file attribute information is access authority information.
Meta data server is the information providing Information locating, big including the description of information, such as data Little, use authority etc., therefore, the file attribute information in meta data server can be the big of data Little or access authority information etc..
Refer to Fig. 2, Fig. 2 and update system signal for a kind of multi-client metadata synchronization that the present invention provides Figure.
In another kind of specific embodiment, present invention also offers a kind of multi-client metadata synchronization Renewal system, including:
Session list acquisition module 06, for obtaining the session list in meta data server, described session List is the connection list that described meta data server is set up with multiple clients;
Send request module 01, be used for sending file attribute amendment request to described meta data server;
Server modified module 02, for asking being stored in described unit number according to the amendment of described file attribute Modify according to the file attribute information in server;
Judge module 03, is used for judging whether successfully modified, if successfully modified, then generates locally modified life Order;
Locally modified module 04, is used for according to described locally modified order the literary composition in client local cache Part attribute information is revised accordingly, generates file attribute more newer command simultaneously;
More new module 05, belongs to for sending described file according to described session list to multiple clients simultaneously Multiple client local caches are updated by property more newer command respectively.Session list acquisition module 06 with More new module 05 is connected, it will words list sends to more new module 05.
Further, in above-mentioned multi-client metadata synchronization renewal system, also include:
Access modules, is used for file system mounted in local directory so that in described local directory The plurality of client is able to access that described file system;
Link block, for by the plurality of client and meta data server be attached.
Further, in above-mentioned multi-client metadata synchronization renewal system based on file system, institute State meta data server and include centralized meta data server and distributing meta data server.Centralized Meta data server be exactly storage network in only one of which metadata server node, all of unit number It is believed that breath converges in this, simple in construction, transmission data speed is fast.Distributing meta data server has many Individual metadata server node, can the most mutually copy metadata information, a large amount of unit of shell storage between node Data message.Any one server is selected with specific reference to needs.
In this specification, each embodiment uses the mode gone forward one by one to describe, and each embodiment stresses Being the difference with other embodiments, between each embodiment, identical similar portion sees mutually.
Described above to the disclosed embodiments, makes professional and technical personnel in the field be capable of or uses The present invention.Multiple amendment to these embodiments will be aobvious and easy for those skilled in the art See, generic principles defined herein can without departing from the spirit or scope of the present invention, Realize in other embodiments.Therefore, the present invention is not intended to be limited to the embodiments shown herein, And it is to fit to the widest scope consistent with principles disclosed herein and features of novelty.

Claims (6)

1. a multi-client metadata synchronization update method, it is characterised in that including:
Obtain the session list in meta data server, described session list be described meta data server with The connection list that multiple clients are set up;
Send file attribute amendment request extremely described meta data server, please according to the amendment of described file attribute The file attribute information to being stored in described meta data server is asked to modify;
Judge whether successfully modified, if successfully modified, then generate locally modified order;
According to described locally modified order, the file attribute information in client local cache is carried out accordingly Amendment, generates file attribute more newer command simultaneously;
Send the more newer command of described file attribute to multiple clients, respectively according to described session list simultaneously Multiple client local caches are updated.
2. the method for claim 1, it is characterised in that in described acquisition meta data server Before session list, also include:
By file system mounted in local directory so that the plurality of client in described local directory It is able to access that described file system;
By the plurality of client and meta data server be attached.
3. method as claimed in claim 1 or 2, it is characterised in that described file attribute information is for visiting Ask authority information.
4. a multi-client metadata synchronization updates system, it is characterised in that including:
Session list acquisition module, for obtaining the session list in meta data server, described session column Table is the connection list that described meta data server is set up with multiple clients;
Send request module, be used for sending file attribute amendment request to described meta data server;
Server modified module, for asking being stored in described metadata according to the amendment of described file attribute File attribute information in server is modified;
Judge module, is used for judging whether successfully modified, if successfully modified, then generates locally modified order;
Locally modified module, is used for according to described locally modified order the file in client local cache Attribute information is revised accordingly, generates file attribute more newer command simultaneously;
More new module, for sending described file attribute according to described session list to multiple clients simultaneously Multiple client local caches are updated by more newer command respectively.
5. system as claimed in claim 4, it is characterised in that also include:
Access modules, is used for file system mounted in local directory so that in described local directory The plurality of client is able to access that described file system;
Link block, for by the plurality of client and meta data server be attached.
6. system as claimed in claim 5, it is characterised in that described meta data server includes concentrating Formula meta data server and distributing meta data server.
CN201610561399.XA 2016-07-15 2016-07-15 Multi-client metadata synchronous update method and device Pending CN105959420A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610561399.XA CN105959420A (en) 2016-07-15 2016-07-15 Multi-client metadata synchronous update method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610561399.XA CN105959420A (en) 2016-07-15 2016-07-15 Multi-client metadata synchronous update method and device

Publications (1)

Publication Number Publication Date
CN105959420A true CN105959420A (en) 2016-09-21

Family

ID=56900849

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610561399.XA Pending CN105959420A (en) 2016-07-15 2016-07-15 Multi-client metadata synchronous update method and device

Country Status (1)

Country Link
CN (1) CN105959420A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106845259A (en) * 2017-02-28 2017-06-13 郑州云海信息技术有限公司 A kind of distributed document access limit method to set up
CN109033363A (en) * 2018-07-26 2018-12-18 广东浪潮大数据研究有限公司 A kind of method, device and equipment of customer in response end request
CN109857747A (en) * 2018-12-18 2019-06-07 百度在线网络技术(北京)有限公司 Data synchronization updating method, system and computer equipment
CN111125038A (en) * 2019-12-31 2020-05-08 成都驰通数码系统有限公司 Intelligent data synchronization method and system based on cloud storage
CN112286890A (en) * 2020-09-02 2021-01-29 北京意匠文枢科技有限公司 Method and equipment for synchronizing revision information of target document
CN116938961A (en) * 2023-09-15 2023-10-24 北京趋动智能科技有限公司 System and method for data synchronization and data reading method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101051925A (en) * 2006-04-04 2007-10-10 腾讯科技(深圳)有限公司 Method for realizing network communication list data synchronization
CN101888393A (en) * 2009-05-13 2010-11-17 上海首恒电子科技有限公司 Non-uniform cooperative system and method based on component middleware platforms under network environment
CN103095687A (en) * 2012-12-19 2013-05-08 华为技术有限公司 Method and device of metadata processing
CN103152398A (en) * 2013-02-07 2013-06-12 中国科学院计算技术研究所 Method and system for file synchronization among multiple terminal files
CN103491055A (en) * 2012-06-12 2014-01-01 中兴通讯股份有限公司 Method for synchronizing information among clients, clients and server

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101051925A (en) * 2006-04-04 2007-10-10 腾讯科技(深圳)有限公司 Method for realizing network communication list data synchronization
CN101888393A (en) * 2009-05-13 2010-11-17 上海首恒电子科技有限公司 Non-uniform cooperative system and method based on component middleware platforms under network environment
CN103491055A (en) * 2012-06-12 2014-01-01 中兴通讯股份有限公司 Method for synchronizing information among clients, clients and server
CN103095687A (en) * 2012-12-19 2013-05-08 华为技术有限公司 Method and device of metadata processing
CN103152398A (en) * 2013-02-07 2013-06-12 中国科学院计算技术研究所 Method and system for file synchronization among multiple terminal files

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106845259A (en) * 2017-02-28 2017-06-13 郑州云海信息技术有限公司 A kind of distributed document access limit method to set up
CN109033363A (en) * 2018-07-26 2018-12-18 广东浪潮大数据研究有限公司 A kind of method, device and equipment of customer in response end request
CN109857747A (en) * 2018-12-18 2019-06-07 百度在线网络技术(北京)有限公司 Data synchronization updating method, system and computer equipment
CN111125038A (en) * 2019-12-31 2020-05-08 成都驰通数码系统有限公司 Intelligent data synchronization method and system based on cloud storage
CN111125038B (en) * 2019-12-31 2023-04-07 成都驰通数码系统有限公司 Intelligent data synchronization method and system based on cloud storage
CN112286890A (en) * 2020-09-02 2021-01-29 北京意匠文枢科技有限公司 Method and equipment for synchronizing revision information of target document
CN116938961A (en) * 2023-09-15 2023-10-24 北京趋动智能科技有限公司 System and method for data synchronization and data reading method
CN116938961B (en) * 2023-09-15 2024-03-01 北京趋动智能科技有限公司 System and method for data synchronization and data reading method

Similar Documents

Publication Publication Date Title
CN105959420A (en) Multi-client metadata synchronous update method and device
CN102333029B (en) Routing method in server cluster system
TWI220713B (en) System and method for synchronizing documents between multi-nodes
CN105099761B (en) A kind of method and system of configuration information that managing client concentratedly
CN106713391B (en) Session information sharing method and sharing system
CN109753364A (en) A kind of implementation method, equipment and the medium of network-based distributed lock
CN105684377A (en) System and method for creating a distributed transaction manager supporting repeatable read isolation level in a mpp database
AU2015316450B2 (en) Method for updating data table of KeyValue database and apparatus for updating table data
CN103297529A (en) Timestamp-based tree structure data synchronization method
CN115599870B (en) Data synchronization method based on fusion of stock data and incremental data of message queue
CN105516284B (en) A kind of method and apparatus of Cluster Database distributed storage
CN112291298B (en) Data transmission method, device, computer equipment and storage medium of heterogeneous system
CN109639773B (en) Dynamically constructed distributed data cluster control system and method thereof
US20160323238A1 (en) Ip management method, client and server
US9401957B2 (en) System and method for synchronization between servers
CN106095911A (en) Search system and method for data synchronization
CN105338095A (en) Conversation data processing method and device
CN102082800A (en) User request processing method and server
US20190251096A1 (en) Synchronization of offline instances
CN107451853A (en) Method, apparatus, system and the storage medium that a kind of red packet distributes in real time
CN105208060A (en) Service data synchronization method, service data synchronization device and service data synchronization system
CN105007193A (en) Multi-layer information processing method, system thereof and cluster management node
CN103986789A (en) Method for realizing dual redundant of NFS (network file system) nodes in HADOOP HA (home address) cluster based on NFS
CN105790963A (en) Method for managing multi-user control virtual meeting interface, server and client
CN105760391A (en) Data dynamic redistribution method and system, data node and name node

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160921

RJ01 Rejection of invention patent application after publication