CN107395721B - Method and system for expanding metadata cluster - Google Patents
Method and system for expanding metadata cluster Download PDFInfo
- Publication number
- CN107395721B CN107395721B CN201710597970.8A CN201710597970A CN107395721B CN 107395721 B CN107395721 B CN 107395721B CN 201710597970 A CN201710597970 A CN 201710597970A CN 107395721 B CN107395721 B CN 107395721B
- Authority
- CN
- China
- Prior art keywords
- metadata
- file
- increased
- nodes
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 239000012634 fragment Substances 0.000 claims abstract description 33
- 230000005012 migration Effects 0.000 claims description 12
- 238000013508 migration Methods 0.000 claims description 12
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013523 data management Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/14—Details of searching files based on file metadata
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/185—Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Library & Information Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a metadata cluster capacity expansion method, which comprises the steps of stopping cluster pressure when detecting that metadata nodes increase; migrating the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition; and splitting the file according to the number of the increased metadata nodes, and correspondingly transferring the split fragment file to each increased metadata node. In the capacity expansion of the metadata cluster, after the metadata nodes are increased, the original fragment files are collected to one metadata node and then split again according to the number of the increased metadata nodes, so that the load balance of the cluster is realized, the initial load level on the newly increased metadata nodes is improved, and the performance of the whole distributed file system is further improved. The application also provides a system for expanding the metadata cluster, which has the beneficial effects and is not repeated herein.
Description
Technical Field
The present application relates to the field of distributed file systems, and in particular, to a method and system for metadata cluster expansion.
Background
The existing distributed file system is mainly divided into two parts: metadata management and data management. The metadata requests are more than 50% of all requests of the file system, so that the processing performance of the metadata requests is improved, and the performance of the whole distributed file system can be effectively improved.
In a system with a plurality of metadata nodes, each metadata node has a directory structure in charge of itself, and a newly-built subdirectory belongs to the metadata node load of a father directory. If the access amount of directory contents under certain metadata is increased, hotspot data are formed, the load pressure of the metadata node is increased, and the hotspot metadata node is formed. To solve this problem, there is a method to refine the minimum split unit and automatically allocate the metadata node to which the minimum split unit belongs.
In practical applications, a client may need to later expand the capacity of the metadata node. The former splitting mechanism enables the load of each node of the old metadata cluster to be relatively balanced, but the load pressure on the newly added metadata node is too small, and the performance of the whole distributed file system is reduced.
Disclosure of Invention
The application aims to provide a method and a system for capacity expansion of a metadata cluster, which can enable the expanded metadata cluster to achieve load balance and improve the performance of the whole distributed file system.
In order to solve the above technical problem, the present application provides a method for capacity expansion of a metadata cluster, including:
stopping cluster pressure when an increase in metadata nodes is detected;
migrating the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition;
and splitting the file according to the number of the increased metadata nodes, and correspondingly transferring the split fragment file to each increased metadata node.
Wherein, migrating the fragmented files on all metadata nodes before the adding to a set metadata node after the adding includes:
and migrating the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition, and merging all the fragmented files into a single directory file on the set metadata node.
The file splitting is performed according to the number of the increased metadata nodes, and migrating the split fragmented files to the increased metadata nodes includes:
splitting the file of the single directory file according to the number of the increased metadata nodes, and recording the corresponding relation between the split fragment file and each increased metadata node;
and migrating the split fragment files to each increased metadata node according to the corresponding relation.
Wherein the set metadata node is a metadata node before addition.
The file splitting is performed according to the number of the increased metadata nodes, and migrating the split fragmented files to the increased metadata nodes includes:
and splitting the file according to the number of the increased metadata nodes and a relative average principle, and transferring the split fragment file to each increased metadata node.
The present application further provides a system for metadata cluster expansion, including:
the capacity expansion preparation module is used for stopping cluster pressure when the increase of the metadata nodes is detected;
the file migration module is used for migrating the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition;
and the file splitting module is used for splitting the file according to the number of the increased metadata nodes and correspondingly transferring the split fragment file to each increased metadata node.
The file migration module is a module for migrating the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition, and merging all the fragmented files into a single directory file on the set metadata node.
Wherein, the file splitting module comprises:
the information recording submodule is used for splitting the single directory file according to the number of the increased metadata nodes and recording the corresponding relation between the split fragment file and each increased metadata node;
and the file migration submodule is used for migrating the split fragment files to each added metadata node according to the corresponding relation.
The file splitting module splits the added metadata nodes according to a relative average principle according to the number of the added metadata nodes, and migrates the split fragmented files to the added metadata nodes.
The application provides a metadata cluster capacity expansion method, which comprises the steps of stopping cluster pressure when detecting that metadata nodes increase; migrating the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition; and splitting the file according to the number of the increased metadata nodes, and correspondingly transferring the split fragment file to each increased metadata node. In the capacity expansion of the metadata cluster, after the metadata nodes are increased, the original fragment files are collected to one metadata node and then split again according to the number of the increased metadata nodes, so that the load balance of the cluster is realized, the initial load level on the newly increased metadata nodes is improved, and the performance of the whole distributed file system is further improved. The application also provides a system for expanding the metadata cluster, which has the beneficial effects and is not repeated herein.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a method for capacity expansion of a metadata cluster according to an embodiment of the present application;
fig. 2 is a schematic diagram of a cluster when a metadata node is added according to an embodiment of the present application;
fig. 3 is a schematic diagram of a cluster when fragmented files on all metadata nodes before addition are migrated to a set metadata node after addition according to an embodiment of the present application;
fig. 4 is a schematic diagram of a cluster when a split fragment file is correspondingly migrated to each added metadata node according to the embodiment of the present application;
FIG. 5 is a system diagram illustrating metadata cluster expansion.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a flowchart of a method for capacity expansion of a metadata cluster according to an embodiment of the present application, where the technical method includes:
s101: stopping cluster pressure when an increase in metadata nodes is detected;
when a metadata cluster is ready to be expanded, cluster pressure needs to be stopped, i.e., access to the cluster is stopped. When capacity is expanded, the access is carried out on the cluster, which easily causes disorder of the cluster system. Thus, when an increase in metadata nodes is detected, cluster pressure is stopped.
S102: migrating the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition;
at this time, the fragmented files on all the metadata nodes before the addition are migrated to the set metadata node after the addition. For example, as shown in FIG. 2, the old cluster has four metadata nodes, respectively No. 0 to No. 3, before the metadata nodes are added, and there are about 250 ten thousand files on each metadata node. At this time, the number 4 of the metadata node is added, and the fragment files on the metadata nodes from the number 0 to the number 3 are migrated to the added setting node. This setting node may be a metadata node before addition, for example, any one of numbers 0 to 3, or may be an added metadata node, i.e., number 4. Of course, the metadata node before the migration to the addition will migrate one less fragmented file during the migration process. Of course, several metadata nodes may be added, and here, an example of adding one metadata node is described.
The fragment file is a part of a certain complete single-directory file, for example, the single-directory file a is composed of four parts, i.e., a.1, a.2, a.3, and a.4, and a.1, a.2, a.3, and a.4 are split from the single-directory file a, so that a.1, a.2, a.3, and a.4 can be referred to as fragment files.
In addition, after the migration to a set node, all the fragmented files can be merged into a single directory file. Because the splitting is needed next, for example, as shown in fig. 2, it is easy to split a complete single-directory file into five fragmented files after merging, and if not merged, the splitting of four fragmented files into five fragmented files is easy to cause file loss. Of course, if the number of the added metadata nodes is a multiple relation with the original number of the metadata nodes, the added metadata nodes may not be combined, and the added metadata nodes may be directly split.
S103: and splitting the file according to the number of the increased metadata nodes, and correspondingly transferring the split fragment file to each increased metadata node.
After the above steps, file splitting needs to be performed according to the number of the increased metadata nodes, and the split fragmented files are correspondingly migrated to the increased metadata nodes. For example, as shown in fig. 2, assuming that the metadata node in step S102 is set to be metadata node 0, as shown in fig. 3, there are about 1000 million files at this time, and the number of the added metadata nodes is 5, so the split is performed on the condition of 5 metadata nodes, and the split fragmented files are correspondingly migrated to the added metadata nodes, at this time, the split is completed as shown in fig. 4.
In addition, the single directory file can be split according to the number of the increased metadata nodes, and the corresponding relation between the split fragment file and each increased metadata node is recorded. For example, if there are 5 fragmented files, which are respectively a.1, a.2, a.3, a.4, and a.5, there are 5 metadata nodes in the cluster at this time, which are respectively 0, 1, 2, 3, and 4, and the corresponding relationship between each fragment and the metadata node, such as 0-a.1, 1-a.2, 2-a.3, 3-a.4, and 4-a.5, may also have other corresponding relationships, which is not limited herein. And migrating the split fragment files to each increased metadata node according to the corresponding relation. The corresponding relation is established, and the method has the advantages that when the metadata nodes are added next time, the fragment files are required to be combined into the single directory file more conveniently, if the fragment files have sequences, the corresponding relation can be indexed and combined into the single directory according to the sequence and then split, and the files in the cluster are not disordered.
In splitting, the splitting is usually performed according to a relatively average principle. Therefore, load pressure on each metadata node can be balanced, and the performance of the whole distributed file system can be improved. Of course, on the premise of not reducing the system performance, other splitting methods may be available, and the present application is not limited herein.
The embodiment of the application provides a metadata cluster capacity expansion method, and by the method, each metadata node bears corresponding load when cluster capacity expansion is realized, load balance is achieved by a new metadata cluster, and performance of the whole distributed file system is improved.
Example two
The present embodiment is based on the above embodiment, and the number of the added metadata nodes is two. For example, the numbers 4 and 5 of the metadata nodes are added, and the total number of the added metadata nodes is six. And splitting the single directory file A into six parts, and migrating each fragment file to six metadata nodes.
EXAMPLE III
Based on the above embodiment, the present embodiment explains that the existing four metadata nodes are respectively No. 0, No. 1, No. 2, and No. 3, and the number of the added metadata nodes is specifically two, and the specific technical solution is as follows:
s201: adding two metadata nodes and stopping cluster pressure;
s202: migrating the fragmented files on the first four added metadata nodes to the number 0 metadata node and combining the fragmented files into a single directory file;
s203: splitting the single directory file according to a relative average principle by taking six metadata nodes as conditions, and recording the corresponding relation between the split fragment file and each increased metadata node;
s204: and migrating the split fragment files to six metadata nodes according to the corresponding relation.
In the following, a metadata cluster capacity expansion system provided in an embodiment of the present application is introduced, and a metadata cluster capacity expansion system described below and a metadata cluster capacity expansion method described above may be referred to in a corresponding manner.
An embodiment of the present application provides a system for metadata cluster expansion, including:
a capacity expansion preparation module 100, configured to stop cluster pressure when detecting an increase in metadata nodes;
the file migration module 200 is configured to migrate the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition;
the file splitting module 300 is configured to split a file according to the number of the increased metadata nodes, and correspondingly migrate the split fragmented file to each increased metadata node.
Based on the above embodiment, the file migration module may be a module that migrates the fragmented files on all the metadata nodes before the addition to one set metadata node after the addition, and merges all the fragmented files into a single directory file on the set metadata node.
Based on the above embodiment, the file splitting module may include:
the information recording submodule is used for splitting the single directory file according to the number of the increased metadata nodes and recording the corresponding relation between the split fragment file and each increased metadata node;
and the file migration submodule is used for migrating the split fragment files to each added metadata node according to the corresponding relation.
Based on the above embodiment, the file splitting module may be a module that splits according to the number of the increased metadata nodes and a relative average principle, and migrates the split fragmented file to each of the increased metadata nodes.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the system disclosed by the embodiment, the description is relatively simple because the system corresponds to the method disclosed by the embodiment, and the relevant points can be referred to the method part for description.
The metadata cluster capacity expansion method and system provided by the present application are described in detail above. The principles and embodiments of the present application are explained herein using specific examples, which are provided only to help understand the method and the core idea of the present application. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (7)
1. A method for metadata cluster capacity expansion is characterized by comprising the following steps:
stopping cluster pressure when an increase in metadata nodes is detected;
migrating the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition;
splitting the file according to the number of the increased metadata nodes, and correspondingly migrating the split fragment file to each increased metadata node;
wherein, migrating the fragmented files on all metadata nodes before the adding to a set metadata node after the adding includes:
and migrating the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition, and merging all the fragmented files into a single directory file on the set metadata node.
2. The method according to claim 1, wherein the splitting the file according to the number of the increased metadata nodes, and the migrating the split fragmented file to each increased metadata node comprises:
splitting the file of the single directory file according to the number of the increased metadata nodes, and recording the corresponding relation between the split fragment file and each increased metadata node;
and migrating the split fragment files to each increased metadata node according to the corresponding relation.
3. The method of claim 1, wherein the metadata node is set to be a pre-added metadata node.
4. The method according to any one of claims 1 to 3, wherein the splitting the file according to the number of the increased metadata nodes, and the migrating the split fragmented file to each increased metadata node comprises:
and splitting the file according to the number of the increased metadata nodes and a relative average principle, and migrating the split fragment file to each increased metadata node.
5. A system for capacity expansion of a metadata cluster, comprising:
the capacity expansion preparation module is used for stopping cluster pressure when the increase of the metadata nodes is detected;
the file migration module is used for migrating the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition;
the file splitting module is used for splitting the file according to the number of the increased metadata nodes and correspondingly transferring the split fragment file to each increased metadata node;
the file migration module is a module for migrating the fragmented files on all the metadata nodes before the addition to a set metadata node after the addition, and merging all the fragmented files into a single directory file on the set metadata node.
6. The system of claim 5, wherein the file splitting module comprises:
the information recording submodule is used for splitting the single directory file according to the number of the increased metadata nodes and recording the corresponding relation between the split fragment file and each increased metadata node;
and the file migration submodule is used for migrating the split fragment files to each added metadata node according to the corresponding relation.
7. The system according to claim 5 or 6, wherein the file splitting module is a module that splits according to the number of the added metadata nodes and a relative average principle, and migrates the split fragmented file to each of the added metadata nodes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710597970.8A CN107395721B (en) | 2017-07-20 | 2017-07-20 | Method and system for expanding metadata cluster |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710597970.8A CN107395721B (en) | 2017-07-20 | 2017-07-20 | Method and system for expanding metadata cluster |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107395721A CN107395721A (en) | 2017-11-24 |
| CN107395721B true CN107395721B (en) | 2021-06-29 |
Family
ID=60336535
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710597970.8A Active CN107395721B (en) | 2017-07-20 | 2017-07-20 | Method and system for expanding metadata cluster |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107395721B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109521958B (en) * | 2018-10-22 | 2022-02-18 | 郑州云海信息技术有限公司 | Delay processing method and device for data distribution |
| CN111104057B (en) * | 2018-10-25 | 2022-03-29 | 华为技术有限公司 | Node capacity expansion method in storage system and storage system |
| CN110213326B (en) * | 2019-04-15 | 2022-03-01 | 浙江大华技术股份有限公司 | Method, system, equipment and storage medium for capacity expansion of metadata node cluster |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013090640A1 (en) * | 2011-12-13 | 2013-06-20 | Microsoft Corporation | Load balancing in cluster storage systems |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9344287B2 (en) * | 2013-01-23 | 2016-05-17 | Nexenta Systems, Inc. | Scalable transport system for multicast replication |
| US9088584B2 (en) * | 2011-12-16 | 2015-07-21 | Cisco Technology, Inc. | System and method for non-disruptive management of servers in a network environment |
| US8930648B1 (en) * | 2012-05-23 | 2015-01-06 | Netapp, Inc. | Distributed deduplication using global chunk data structure and epochs |
| CN102968503B (en) * | 2012-12-10 | 2015-10-07 | 曙光信息产业(北京)有限公司 | The data processing method of Database Systems and Database Systems |
| CN103973583B (en) * | 2013-01-28 | 2017-11-07 | 中兴通讯股份有限公司 | Distributed file system optimizes the method and system of load balancing |
| CN104615657A (en) * | 2014-12-31 | 2015-05-13 | 天津南大通用数据技术股份有限公司 | Expanding and shrinking method for distributed cluster with nodes supporting multiple data fragments |
| CN105205154B (en) * | 2015-09-24 | 2021-06-22 | 浙江宇视科技有限公司 | Data migration method and device |
| CN106844510B (en) * | 2016-12-28 | 2021-01-15 | 北京五八信息技术有限公司 | Data migration method and device for distributed database cluster |
-
2017
- 2017-07-20 CN CN201710597970.8A patent/CN107395721B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013090640A1 (en) * | 2011-12-13 | 2013-06-20 | Microsoft Corporation | Load balancing in cluster storage systems |
Non-Patent Citations (2)
| Title |
|---|
| 云环境下虚拟机集群系统动态负载均衡机制;李立耀;《计算机应用》;20141231;全文 * |
| 大数据存储系统中负载均衡的数据迁移算法;李甜甜;《中兴通讯技术》;20161231;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107395721A (en) | 2017-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20170220614A1 (en) | Consistent ring namespaces facilitating data storage and organization in network infrastructures | |
| WO2018121120A1 (en) | Data migration method and system | |
| EP3564835B1 (en) | Data redistribution method and apparatus, and database cluster | |
| CN107395721B (en) | Method and system for expanding metadata cluster | |
| WO2019001017A1 (en) | Inter-cluster data migration method and system, server, and computer storage medium | |
| US11113155B1 (en) | Archiving and restoration of distributed database log records | |
| EP3125501B1 (en) | File synchronization method, server, and terminal | |
| CN109194711B (en) | Synchronization method, client, server and medium for organization architecture | |
| CN104794123A (en) | Method and device for establishing NoSQL database index for semi-structured data | |
| US10783163B2 (en) | Instance-based distributed data recovery method and apparatus | |
| CN103229173A (en) | Metadata management method and system | |
| US9110820B1 (en) | Hybrid data storage system in an HPC exascale environment | |
| CN106326239A (en) | Distributed file system and file meta-information management method thereof | |
| CN103744875B (en) | Data quick migration method and system based on file system | |
| CN105069152B (en) | data processing method and device | |
| CN107451176B (en) | Data copying method and device | |
| CN109165112B (en) | Fault recovery method, system and related components of metadata cluster | |
| CN106897345B (en) | Data storage method and device | |
| CN103559224A (en) | Method and device for hashing metadata objects | |
| CN108008913B (en) | Management node-based capacity expansion method and device and storage system | |
| CN103365740A (en) | Data cold standby method and device | |
| CN101483668A (en) | Network storage and access method, device and system for hot spot data | |
| WO2017028721A1 (en) | Data update method and device in distributed file system | |
| CN110895545B (en) | Shared data synchronization method and device | |
| CN107888430B (en) | Virtual machine management operation synchronization method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |