CN112527767B - Method and system for completely repairing multiple region tables after restarting distributed database - Google Patents
Method and system for completely repairing multiple region tables after restarting distributed database Download PDFInfo
- Publication number
- CN112527767B CN112527767B CN202011407375.1A CN202011407375A CN112527767B CN 112527767 B CN112527767 B CN 112527767B CN 202011407375 A CN202011407375 A CN 202011407375A CN 112527767 B CN112527767 B CN 112527767B
- Authority
- CN
- China
- Prior art keywords
- cluster
- data
- region
- distribution
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000005192 partition Methods 0.000 claims abstract description 37
- 238000013508 migration Methods 0.000 claims abstract description 31
- 230000005012 migration Effects 0.000 claims abstract description 31
- 238000005457 optimization Methods 0.000 claims abstract description 17
- 238000012544 monitoring process Methods 0.000 claims abstract description 9
- 230000008439 repair process Effects 0.000 claims description 7
- 230000009471 action Effects 0.000 claims description 6
- 238000012546 transfer Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and a system for completely repairing a multi-region table after restarting a distributed database, wherein the method comprises the following steps: creating a new table, and recording node distribution of all the region tables in the cluster and the position of a distributed storage block corresponding to each region table; after the cluster is restarted by planning or unplanned accident, monitoring whether the distribution of the region table and the distributed storage blocks after restarting is disordered; and if the distribution is disordered, the current load condition of the cluster is periodically acquired, if the distribution is disordered, the cluster migration optimization is performed by taking the data table as granularity, and if the distribution is busy, the cluster migration optimization is suspended. The system comprises: the system comprises a creation module, a monitoring module and an equalization module. The invention carries out the repairable migration of the areas and the blocks through the recorded table partitions and the backup blocks, and solves the problem that the single table data partitions are inclined due to the migration of the data partitions after restarting and the problem that the cluster performance is reduced due to uneven distribution of the partitions and the blocks.
Description
Technical Field
The invention relates to the technical field of data table repair processing, in particular to a method and a system for completely repairing a multi-region table after restarting a distributed database.
Background
In theory, the table area distribution of the newly built multi-region data table in the distributed database is the most reasonable distribution mode, and among all the backup data of all the data blocks under the same data partition, the first backup data is stored in the data node where the data partition is located, and other backup data are respectively stored in two data nodes with the least data partition in other data nodes, which are respectively called a first backup node and a second backup node. After planned or unplanned restarting of the partition server node, under the condition that hardware power failure occurs to all machine equipment or the cluster is restarted in a plan, the most reasonable distribution of a plurality of region tables after restarting is completely disturbed, data partition transfer causes tilting of a single-table data partition, and partition and block distribution are uneven after restarting, so that the cluster performance is reduced.
Disclosure of Invention
Therefore, an objective of the embodiments of the present invention is to provide a method and a system for completely repairing a multi-region table after restarting a distributed database, which can solve the problem of reduced cluster performance caused by uneven partition and block distribution after restarting.
In a first aspect, an embodiment of the present invention provides a method for completely repairing a multi-region table after restarting a distributed database, including:
Creating a new table, and recording node distribution of all the region tables in the cluster and the position of the distributed storage block corresponding to each region table.
After the cluster is restarted by planning or unplanned accident, whether the distribution of the region table and the distributed storage blocks after restarting is disordered or not is monitored.
And if the distribution is disordered, the current load condition of the cluster is periodically acquired, if the distribution is disordered, the cluster migration optimization is performed by taking the data table as granularity, and if the distribution is busy, the cluster migration optimization is suspended.
With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where the creating a new table, recording node distribution of all region tables in a cluster, and a location of a distributed storage block corresponding to each region table, includes:
The data table is initially created and the distribution locations of the distributed storage blocks to which the region table belongs.
In each data of all distributed storage blocks under the same database cluster, a first data table is stored in the data node where the first data table is located, and other data tables are respectively stored in the data nodes with the least data partitions in other data nodes.
And recording the distribution of the region table of each data table in all nodes and the positions of all distributed storage blocks corresponding to each region table.
With reference to the first aspect, an embodiment of the present invention provides a second possible implementation manner of the first aspect, where the idling is that the CPU and the memory state reach below a preset value.
With reference to the first aspect, an embodiment of the present invention provides a third possible implementation manner of the first aspect, where the performing cluster migration optimization with granularity of a data table includes:
and performing the repairable migration of the area and the distributed storage blocks through the recorded table partition and the record of the backup block.
The region tables of each data table in the cluster are uniformly distributed in each node, so that the number of each region table in each node is consistent, and the inclination of a single data table is avoided.
The sum of the number of region tables in each node balances.
In a second aspect, an embodiment of the present invention further provides a system for complete repair of a multiple region table after restarting a distributed database, including:
The creation module is used for creating a new table and recording node distribution of all the region tables in the cluster and the position of the distributed storage block corresponding to each region table.
And the monitoring module is used for monitoring whether the distribution of the region table and the distributed storage blocks after restarting is disordered after the cluster is restarted by planning or unplanned unexpected restarting.
And the balancing module is used for periodically collecting the current load condition of the cluster when the distribution is disordered, carrying out cluster migration optimization by taking the data table as granularity if the cluster is idle, and suspending the cluster migration optimization action if the cluster is busy.
With reference to the second aspect, an embodiment of the present invention provides a first possible implementation manner of the second aspect, where the creating module includes:
and the initial creating unit is used for initially creating the data table and the distribution position of the distributed storage block to which the region table belongs.
The distribution unit is used for storing the first data table in the data node where the first data table is located in each data of all distributed storage blocks in the same database cluster, and storing other data tables in the data nodes with the least data partition in other data nodes respectively.
And the recording unit is used for recording the distribution of the region table of each data table in all nodes and the positions of all distributed storage blocks corresponding to each region table.
With reference to the second aspect, an embodiment of the present invention provides a second possible implementation manner of the second aspect, where the equalization module includes:
and the migration unit is used for carrying out the repairable migration of the area and the distributed storage blocks through the recorded table partition and the record of the backup block.
And the load unit is used for uniformly distributing the region tables of each data table in the cluster in each node, so that the number of each region table in each node is consistent, and the inclination of a single data table is avoided.
And the balancing unit is used for balancing the sum of the numbers of the region tables in each node.
The embodiment of the invention has the beneficial effects that:
the invention carries out the repairable migration of the areas and the blocks through the table partition recorded by the partition server and the record of the backup block, and solves the problem that the data partition is inclined due to the transfer of the data partition after the planned or unplanned restarting of the partition server node and the problem that the cluster performance is reduced due to uneven distribution of the partition and the block after the restarting.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for complete repair of a multi-region table after a distributed database restart in accordance with the present invention.
FIG. 2 is a schematic diagram of a reparative migration structure of a method for complete repair of a multi-region table after restarting a distributed database according to the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. The components of the embodiments of the present invention generally described and illustrated in the figures herein can be arranged and designed in a wide variety of different configurations.
Referring to fig. 1 to 2, a first embodiment of the present invention provides a method for repairing a multi-region table after a distributed database is restarted, comprising:
Creating a new table, and recording node distribution of all the region tables in the cluster and the position of the distributed storage block corresponding to each region table.
After the cluster is restarted by planning or unplanned accident, whether the distribution of the region table and the distributed storage blocks after restarting is disordered or not is monitored.
And if the distribution is disordered, the current load condition of the cluster is periodically acquired, if the distribution is disordered, the cluster migration optimization is performed by taking the data table as granularity, and if the distribution is busy, the cluster migration optimization is suspended.
The creating a new table, recording node distribution of all the region tables in the cluster and the position of the distributed storage block corresponding to each region table, includes:
The data table is initially created and the distribution locations of the distributed storage blocks to which the region table belongs.
In each data of all distributed storage blocks under the same database cluster, a first data table is stored in the data node where the first data table is located, and other data tables are respectively stored in the data nodes with the least data partitions in other data nodes.
And recording the distribution of the region table of each data table in all nodes and the positions of all distributed storage blocks corresponding to each region table.
Wherein, the idle state is that the states of the CPU and the memory reach below the preset value.
The cluster migration optimization is performed with the data table as granularity, and the method comprises the following steps:
and performing the repairable migration of the area and the distributed storage blocks through the recorded table partition and the record of the backup block.
The region tables of each data table in the cluster are uniformly distributed in each node, so that the number of each region table in each node is consistent, and the inclination of a single data table is avoided.
The sum of the number of region tables in each node balances.
Based on the implementation of the above method, a specific application example is given below.
At least three nodes of the distributed cluster are provided, and the implementation takes a three-node cluster as an example. The distributed database and the distributed storage system are provided with three slave nodes, and the priorities of the nodes are equal. As shown in fig. 2, there are three nodes in the cluster, node 1, node 2, node 3, respectively, with two data tables TABLEA and TABLEB. Of which TABLEA has 6 regions and TABLEB has three regions, after the creation of TABLAEA and TABLEB, regions of TABLEA and TABLEB are uniformly distributed among the three nodes, as shown in the upper graphical representation of fig. 2, due to the newly created data table.
After a planned restart of the distributed cluster, some regions of the table migrate. After the cluster is stable, the distributed database automatically performs the balancing action of the balance action of 9 of the sum of the regions of TABLEA and TABLEB on the whole cluster level, so that each node of three nodes in the cluster can be ensured to hold 3 regions, and the load balance of the whole cluster is achieved. Of the 6 regions of TABLEA, three are in node 1, two are in node 2, and one is in node 3. TABLEB have one in node 2, two in node 3, and no TABLEB in node 1. This results in an average load of 0 for node 1, 33 for node 2, and 66 for node 3 when performing a large data volume write operation to data table B, even though the overall cluster's region holds a balanced number. The single data table region is inclined and the load is unbalanced.
In the method, an original region distribution table is maintained for each newly built table, when the cluster is restarted and the cluster state is judged to be in an idle state, a maintenance action is started, TABLEA _region3 in a first node is migrated to an original node 2, TABLEB _region1 in the node 2 is migrated to the node, TABLEA _region5 is migrated to the node 3, TABLEB _region2 in the node 3 is migrated to a second node, so that the number of regions held in the nodes 1,2 and 3 is 3, the regions of each data table are uniformly distributed in each node, and the problem of single data table region inclination is avoided.
Referring to fig. 1 to 2, a second embodiment of the present invention provides a system for complete repair of a multi-region table after a restart of a distributed database, comprising:
The creation module is used for creating a new table and recording node distribution of all the region tables in the cluster and the position of the distributed storage block corresponding to each region table.
And the monitoring module is used for monitoring whether the distribution of the region table and the distributed storage blocks after restarting is disordered after the cluster is restarted by planning or unplanned unexpected restarting.
And the balancing module is used for periodically collecting the current load condition of the cluster when the distribution is disordered, carrying out cluster migration optimization by taking the data table as granularity if the cluster is idle, and suspending the cluster migration optimization action if the cluster is busy.
Wherein the creation module comprises:
and the initial creating unit is used for initially creating the data table and the distribution position of the distributed storage block to which the region table belongs.
The first data table is stored in the data node where the first data table is located, and other data tables are respectively stored in the data nodes with the least data partitions in other data nodes.
And the recording unit is used for recording the distribution of the region table of each data table in all nodes and the positions of all distributed storage blocks corresponding to each region table.
Wherein, the equalization module includes:
and the migration unit is used for carrying out the repairable migration of the area and the distributed storage blocks through the recorded table partition and the record of the backup block.
And the load unit is used for uniformly distributing the region tables of each data table in the cluster in each node, so that the number of each region table in each node is consistent, and the inclination of a single data table is avoided.
And the balancing unit is used for balancing the sum of the numbers of the region tables in each node.
The embodiment of the invention aims to protect a method and a system for completely repairing a multi-region table after restarting a distributed database, and has the following effects:
the invention carries out the repairable migration of the areas and the blocks through the table partition recorded by the partition server and the record of the backup block, and solves the problem that the data partition is inclined due to the transfer of the data partition after the planned or unplanned restarting of the partition server node and the problem that the cluster performance is reduced due to uneven distribution of the partition and the block after the restarting.
The computer program product of the method and apparatus for complete restoration of a multi-region table after restarting a distributed database provided by the embodiments of the present invention includes a computer readable storage medium storing program codes, and the instructions included in the program codes may be used to execute the method in the foregoing method embodiment, and specific implementation may refer to the method embodiment and will not be described herein.
Specifically, the storage medium can be a general storage medium, such as a mobile disk, a hard disk, and the like, and when the computer program on the storage medium is run, the method for completely repairing the multi-region table after restarting the distributed database can be executed, so that the problem of cluster performance degradation caused by uneven partition and block distribution after restarting can be solved.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer readable storage medium executable by a processor. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Finally, it should be noted that: the above examples are only specific embodiments of the present invention, and are not intended to limit the scope of the present invention, but it should be understood by those skilled in the art that the present invention is not limited thereto, and that the present invention is described in detail with reference to the foregoing examples: any person skilled in the art may modify or easily conceive of the technical solution described in the foregoing embodiments, or perform equivalent substitution of some of the technical features, while remaining within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention, and are intended to be included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (3)
1. A method for complete repair of a multi-region table after a distributed database restart, comprising:
Creating a new table, and recording node distribution of all the region tables in the cluster and the position of a distributed storage block corresponding to each region table;
after the cluster is restarted by planning or unplanned accident, monitoring whether the distribution of the region table and the distributed storage blocks after restarting is disordered;
If the distribution is disordered, the current load condition of the cluster is periodically acquired, if the cluster is idle, the cluster migration optimization is performed by taking the data table as granularity, and if the cluster is busy, the cluster migration optimization is suspended; the creating a new table, recording node distribution of all the region tables in the cluster and the position of the distributed storage block corresponding to each region table, including:
Initially creating a data table and the distribution position of a distributed storage block to which the region table belongs;
in each data of all distributed storage blocks under the same database cluster, a first data table is stored in a data node where the first data table is located, and other data tables are respectively stored in data nodes with the least data partitions in other data nodes;
Recording the distribution of the region table of each data table in all nodes and the positions of all distributed storage blocks corresponding to each region table;
The cluster migration optimization is performed by taking the data table as granularity, and comprises the following steps:
Performing restorative migration of the area and the distributed storage blocks through the recorded table partition and the record of the backup block;
The region tables of each data table in the cluster are uniformly distributed in each node, so that the number of each region table in each node is consistent, and the inclination of a single data table is avoided;
The sum of the number of region tables in each node balances.
2. The method of claim 1, wherein the idling is when the CPU and memory states are below a predetermined value.
3. A system for complete repair of a multi-region table after a distributed database restart, comprising:
the creation module is used for creating a new table and recording node distribution of all the region tables in the cluster and the position of the distributed storage block corresponding to each region table;
the monitoring module is used for monitoring whether the distribution of the region table and the distributed storage blocks after restarting is disordered after the cluster is restarted by planning or unplanned unexpected restarting;
The balancing module is used for periodically collecting the current load condition of the cluster when the distribution is disordered, carrying out cluster migration optimization by taking a data table as granularity if the cluster is idle, and suspending the cluster migration optimization action if the cluster is busy;
the creation module comprises:
the initial creating unit is used for initially creating a data table and the distribution position of the distributed storage block to which the region table belongs;
The distribution unit is used for storing a first data table in the data node where the first data table is located in each data of all distributed storage blocks in the same database cluster, and storing other data tables in the data nodes with the least data partition in other data nodes respectively;
The recording unit is used for recording the distribution of the region table of each data table in all nodes and the positions of all distributed storage blocks corresponding to each region table;
The equalization module includes:
the migration unit is used for carrying out restorative migration of the area and the distributed storage blocks through the recorded table partition and the record of the backup block;
The load unit is used for uniformly distributing the region tables of each data table in the cluster in each node, so that the number of each region table in each node is consistent, and the inclination of a single data table is avoided;
And the balancing unit is used for balancing the sum of the numbers of the region tables in each node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011407375.1A CN112527767B (en) | 2020-12-03 | 2020-12-03 | Method and system for completely repairing multiple region tables after restarting distributed database |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011407375.1A CN112527767B (en) | 2020-12-03 | 2020-12-03 | Method and system for completely repairing multiple region tables after restarting distributed database |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112527767A CN112527767A (en) | 2021-03-19 |
| CN112527767B true CN112527767B (en) | 2024-05-10 |
Family
ID=74997587
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011407375.1A Active CN112527767B (en) | 2020-12-03 | 2020-12-03 | Method and system for completely repairing multiple region tables after restarting distributed database |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112527767B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105187512A (en) * | 2015-08-13 | 2015-12-23 | 航天恒星科技有限公司 | Method and system for load balancing of virtual machine clusters |
| CN105190622A (en) * | 2013-03-15 | 2015-12-23 | 亚马逊科技公司 | Fast crash recovery for distributed database systems |
| CN107085539A (en) * | 2017-04-27 | 2017-08-22 | 北京邮电大学 | A kind of cloud Database Systems and cloud database resource dynamic adjusting method |
| CN107943615A (en) * | 2017-11-06 | 2018-04-20 | 许继集团有限公司 | Data processing method and system based on distributed type assemblies |
| CN108628874A (en) * | 2017-03-17 | 2018-10-09 | 北京京东尚科信息技术有限公司 | Method, apparatus, electronic equipment and the readable storage medium storing program for executing of migrating data |
| CN110019528A (en) * | 2017-12-26 | 2019-07-16 | 中国移动通信集团湖北有限公司 | Database manipulation load-balancing method, device, equipment and medium |
| CN111061557A (en) * | 2018-10-16 | 2020-04-24 | 杭州海康威视数字技术股份有限公司 | Method and device for balancing distributed memory database load |
| CN111327681A (en) * | 2020-01-21 | 2020-06-23 | 北京工业大学 | Cloud computing data platform construction method based on Kubernetes |
| CN111538719A (en) * | 2020-04-30 | 2020-08-14 | 深圳前海微众银行股份有限公司 | Data migration method, device, equipment and computer storage medium |
| CN111694518A (en) * | 2020-05-29 | 2020-09-22 | 苏州浪潮智能科技有限公司 | Method, device and equipment for automatically migrating data after cluster expansion or contraction |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009045526A1 (en) * | 2007-10-03 | 2009-04-09 | Scaleout Software, Inc. | A method for implementing highly available parallel operations on a computational grip |
| US8600944B2 (en) * | 2010-09-24 | 2013-12-03 | Hitachi Data Systems Corporation | System and method for managing integrity in a distributed database |
| US9690829B2 (en) * | 2013-04-15 | 2017-06-27 | Vmware, Inc. | Dynamic load balancing during distributed query processing using query operator motion |
-
2020
- 2020-12-03 CN CN202011407375.1A patent/CN112527767B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105190622A (en) * | 2013-03-15 | 2015-12-23 | 亚马逊科技公司 | Fast crash recovery for distributed database systems |
| CN105187512A (en) * | 2015-08-13 | 2015-12-23 | 航天恒星科技有限公司 | Method and system for load balancing of virtual machine clusters |
| CN108628874A (en) * | 2017-03-17 | 2018-10-09 | 北京京东尚科信息技术有限公司 | Method, apparatus, electronic equipment and the readable storage medium storing program for executing of migrating data |
| CN107085539A (en) * | 2017-04-27 | 2017-08-22 | 北京邮电大学 | A kind of cloud Database Systems and cloud database resource dynamic adjusting method |
| CN107943615A (en) * | 2017-11-06 | 2018-04-20 | 许继集团有限公司 | Data processing method and system based on distributed type assemblies |
| CN110019528A (en) * | 2017-12-26 | 2019-07-16 | 中国移动通信集团湖北有限公司 | Database manipulation load-balancing method, device, equipment and medium |
| CN111061557A (en) * | 2018-10-16 | 2020-04-24 | 杭州海康威视数字技术股份有限公司 | Method and device for balancing distributed memory database load |
| CN111327681A (en) * | 2020-01-21 | 2020-06-23 | 北京工业大学 | Cloud computing data platform construction method based on Kubernetes |
| CN111538719A (en) * | 2020-04-30 | 2020-08-14 | 深圳前海微众银行股份有限公司 | Data migration method, device, equipment and computer storage medium |
| CN111694518A (en) * | 2020-05-29 | 2020-09-22 | 苏州浪潮智能科技有限公司 | Method, device and equipment for automatically migrating data after cluster expansion or contraction |
Non-Patent Citations (5)
| Title |
|---|
| Data Repair for Distributed, Event-based IoT Applications;Wei-Tsung Lin 等;ACM;第139-150页 * |
| 分布式存储系统中数据修复的自适应流控机制;陈志鹏;李小勇;;信息技术(11);第139-144、149页 * |
| 基于HBase的健康大数据平台性能优化及应用;王勇;尹鹏飞;李娟;;软件导刊;20171015(10);第146-149、158页 * |
| 基于存储形态及特征的HBase数据库灾难恢复机制研究;罗文华;王志铭;;信息网络安全(09);第42-47页 * |
| 面向大数据分布式存储的动态负载均衡算法;张栗粽;崔园;罗光春;陈爱国;卢国明;王晓雪;;计算机科学;20170515(05);第178-183页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112527767A (en) | 2021-03-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9773015B2 (en) | Dynamically varying the number of database replicas | |
| CN109634932B (en) | Intelligent contract storage method and storage system | |
| US7529822B2 (en) | Business continuation policy for server consolidation environment | |
| US10356150B1 (en) | Automated repartitioning of streaming data | |
| CN108540315A (en) | Distributed memory system, method and apparatus | |
| CN105573660A (en) | Method and device for improving performance of declustered disk array | |
| CN104504147B (en) | A kind of resource coordination method of data-base cluster, apparatus and system | |
| US11775825B2 (en) | Secure intelligent networked architecture including an asymmetric parallel processing appliance | |
| CN107025066A (en) | The method and apparatus that data storage is write in the storage medium based on flash memory | |
| CN112365244B (en) | Data life cycle management method and device | |
| CN106909568A (en) | A kind of changing method and device of data-base cluster MDL | |
| CN114816728A (en) | Elastic expansion method and system for cloud environment MongoDB database cluster instance node | |
| CN108121497B (en) | Storage method and storage system | |
| CN107015876A (en) | A kind of service request processing method and device | |
| CN107943615B (en) | Data processing method and system based on distributed cluster | |
| CN111159140A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN112527767B (en) | Method and system for completely repairing multiple region tables after restarting distributed database | |
| TWI531903B (en) | System and method for data back-up | |
| US9037762B2 (en) | Balancing data distribution in a fault-tolerant storage system based on the movements of the replicated copies of data | |
| CN109788006A (en) | Data balancing method, device and computer equipment | |
| CN115454685A (en) | Resource migration method, device, computer equipment, storage medium and program product | |
| CN110502582B (en) | Online capacity expansion method of distributed database | |
| CN115225642A (en) | Elastic load balancing method and system of super-fusion system | |
| CN111240577B (en) | MPP database-based data multi-fragment storage method and device | |
| CN114153395A (en) | Object storage data life cycle management method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |